-- Logs begin at Sat 2021-12-18 20:01:14 UTC, end at Sat 2021-12-18 22:15:20 UTC. -- Dec 18 20:36:08.016484 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Dec 18 20:36:08.026143 ncdv-master-1 devstack@n-api.service[125313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 18 20:36:08.028668 ncdv-master-1 devstack@n-api.service[125313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 18 20:36:08 2021] *** Dec 18 20:36:08.028668 ncdv-master-1 devstack@n-api.service[125313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 18 20:36:08.028668 ncdv-master-1 devstack@n-api.service[125313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 18 20:36:08.028668 ncdv-master-1 devstack@n-api.service[125313]: nodename: ncdv-master-1 Dec 18 20:36:08.028668 ncdv-master-1 devstack@n-api.service[125313]: machine: x86_64 Dec 18 20:36:08.028668 ncdv-master-1 devstack@n-api.service[125313]: clock source: unix Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: pcre jit disabled Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: detected number of CPU cores: 4 Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: current working directory: / Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: detected binary path: /usr/bin/uwsgi-core Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: your processes number limit is 47680 Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: your memory page size is 4096 bytes Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: detected max file descriptor number: 2048 Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: lock engine: pthread robust mutexes Dec 18 20:36:08.029133 ncdv-master-1 devstack@n-api.service[125313]: thunder lock: enabled Dec 18 20:36:08.029618 ncdv-master-1 devstack@n-api.service[125313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 18 20:36:08.029618 ncdv-master-1 devstack@n-api.service[125313]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 18 20:36:08.078708 ncdv-master-1 devstack@n-api.service[125313]: Python main interpreter initialized at 0x56116a5b79c0 Dec 18 20:36:08.078708 ncdv-master-1 devstack@n-api.service[125313]: python threads support enabled Dec 18 20:36:08.078708 ncdv-master-1 devstack@n-api.service[125313]: your server socket listen backlog is limited to 100 connections Dec 18 20:36:08.078708 ncdv-master-1 devstack@n-api.service[125313]: your mercy for graceful operations on workers is 90 seconds Dec 18 20:36:08.079104 ncdv-master-1 devstack@n-api.service[125313]: mapped 403077 bytes (393 KB) for 2 cores Dec 18 20:36:08.079181 ncdv-master-1 devstack@n-api.service[125313]: *** Operational MODE: preforking *** Dec 18 20:36:08.079379 ncdv-master-1 devstack@n-api.service[125313]: *** uWSGI is running in multiple interpreter mode *** Dec 18 20:36:08.079379 ncdv-master-1 devstack@n-api.service[125313]: spawned uWSGI master process (pid: 125313) Dec 18 20:36:08.079572 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Dec 18 20:36:08.082280 ncdv-master-1 devstack@n-api.service[125313]: spawned uWSGI worker 1 (pid: 125314, cores: 1) Dec 18 20:36:08.082280 ncdv-master-1 devstack@n-api.service[125313]: spawned uWSGI worker 2 (pid: 125315, cores: 1) Dec 18 20:36:08.082280 ncdv-master-1 devstack@n-api.service[125313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 18 20:36:09.876638 ncdv-master-1 devstack@n-api.service[125314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:36:09.876638 ncdv-master-1 devstack@n-api.service[125314]: from cryptography.utils import int_from_bytes Dec 18 20:36:09.877309 ncdv-master-1 devstack@n-api.service[125314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:36:09.877309 ncdv-master-1 devstack@n-api.service[125314]: from cryptography.utils import int_from_bytes Dec 18 20:36:09.880655 ncdv-master-1 devstack@n-api.service[125315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:36:09.880655 ncdv-master-1 devstack@n-api.service[125315]: from cryptography.utils import int_from_bytes Dec 18 20:36:09.881160 ncdv-master-1 devstack@n-api.service[125315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:36:09.881160 ncdv-master-1 devstack@n-api.service[125315]: from cryptography.utils import int_from_bytes Dec 18 20:36:12.430949 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 20:36:12.431509 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 20:36:12.431853 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 20:36:12.431956 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 20:36:12.432048 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 20:36:12.432141 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 20:36:12.432250 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 20:36:12.432328 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 20:36:12.432403 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 20:36:12.432473 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 20:36:12.432640 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.432836 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.432945 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.433165 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.433261 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.433493 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.433587 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.433818 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.433948 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.434143 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.434227 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.434488 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.434631 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.434801 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.434903 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.435126 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.435223 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.435381 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.435746 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.435959 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.436052 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.436302 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.436390 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.436602 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.436697 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.436907 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.437002 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.437215 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.437307 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.437529 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.437613 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.437830 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.437917 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.438148 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.438239 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.438486 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.438576 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.438798 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.438988 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.439310 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.439485 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.439632 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.439744 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.439945 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.440030 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.440784 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.440957 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.441126 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.441210 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.441449 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.441541 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.441762 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.441848 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.442079 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.442166 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.442415 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.442499 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.442722 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.442821 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.443051 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.443144 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.443417 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.443550 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.443727 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.443817 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.444037 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.444122 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.444371 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.444454 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.444742 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.444836 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.445046 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.445146 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.445367 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.445463 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.445688 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.445782 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.445999 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.446092 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.446347 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.446451 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.446667 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.446757 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.446999 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.447091 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.447298 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.447394 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.447599 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.447683 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.447906 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.447989 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.448211 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.448307 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.448523 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.448613 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.448822 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.448905 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.449123 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.449208 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.449371 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.449453 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.449674 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.449764 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.449987 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.450070 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.450327 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.450412 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.450650 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.450748 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.450902 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.450993 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.451149 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.451239 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.451459 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.451555 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.451773 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.451856 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.452079 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.452164 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.452383 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.452467 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.452686 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.452784 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.452989 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.453120 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.453291 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.453382 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.453593 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.453682 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.453895 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.453978 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.454199 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.454314 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.454538 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.454629 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.454854 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.454951 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.455170 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.455261 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.455473 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.455556 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.455797 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.455892 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.456710 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.456796 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.456993 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.457116 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.457300 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.457396 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.457637 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.457721 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.457956 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.458040 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.458296 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.458449 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.458601 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.458692 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.458921 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.459004 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.459226 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.459318 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.459529 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.459613 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.459833 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.459915 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.460153 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.460244 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.460478 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.460561 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.460776 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.460865 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.461025 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.461113 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.461323 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.461413 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.461624 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.461707 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.461939 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.462034 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.462242 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.462346 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.462567 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.462662 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.462869 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.462954 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.463169 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.463252 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.463471 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.463564 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.463773 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.463863 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.464073 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.464155 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.464372 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.464467 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.464672 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.464756 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.464970 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.465054 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.465272 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.465365 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.465575 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.465658 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.465881 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.465973 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.466188 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.466320 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.466534 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.466624 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.466835 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.466919 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.467137 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.467229 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.467438 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.467525 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.467739 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.467831 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.468054 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.468211 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.468355 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.468484 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.468654 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.468737 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.468970 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.469061 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.469269 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.469361 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.469569 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.469653 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.469885 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.469976 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.470188 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.470292 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.470516 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.470600 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.470831 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.470929 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.471127 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.471210 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.471428 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.471526 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.471767 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.471855 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.472071 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.472157 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.472371 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.472455 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.472669 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.472754 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.472968 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.473052 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.473266 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.473350 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.473564 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.473649 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.473860 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.473943 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.474157 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.474240 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.474478 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.474568 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.474790 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.474874 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.475107 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.475199 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.475410 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.475493 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.475713 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.475797 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.476015 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.476107 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.476332 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.476419 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.476657 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:36:12.476747 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.476981 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.477071 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.477318 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.477437 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.477629 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.477727 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.477958 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.478054 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.478325 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.478412 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.478665 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.478759 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.478979 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.479069 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.479292 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.479376 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.479614 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.479696 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.479918 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.480001 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.480224 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.480306 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.480531 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.480615 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.480847 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.480937 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.481159 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.481248 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.481485 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.481574 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.481795 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.481889 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.482106 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.482197 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.482443 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.482527 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.482753 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.482844 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.483066 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.483158 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.483391 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.483487 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.483705 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.483787 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.484013 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.484095 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.484342 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.484434 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.484674 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.484764 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.484983 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.485067 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.485305 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.485404 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.485611 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.485702 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.485933 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.486024 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.486241 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.486363 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.486570 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.486654 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.486877 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.486961 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.487222 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.487306 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.487530 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.487626 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.487837 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.487926 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.488167 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.488256 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.488479 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.488568 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.488803 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.488905 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.489095 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.489189 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.489401 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.489485 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.489706 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.489795 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.490013 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.490098 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.490339 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.490424 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.490656 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.490752 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.490977 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.491059 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.491283 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.491366 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.491607 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.491700 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.491918 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.492014 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.492219 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.492304 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.492527 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.492620 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.492831 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.492914 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.493139 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.493221 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.493445 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.493539 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.493749 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.493832 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.494056 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.494144 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.494392 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.494491 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.494698 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.494782 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.495009 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.495091 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.495311 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.495401 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.495614 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.495698 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.495928 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.496018 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.496236 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.496321 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.496542 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.496632 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.496850 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.496933 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.497166 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.497257 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.497469 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.497553 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.497773 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.497865 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.498100 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.498183 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.498460 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.498554 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.498765 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.498857 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.499088 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.499171 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.499406 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.499488 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.499717 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.499809 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.500018 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.500108 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.500323 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.500406 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.500625 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.500717 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.500927 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.501010 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.501229 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.501312 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.501534 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.501628 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.501832 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.501914 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.502133 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.502217 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.502466 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.502558 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.503296 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.503396 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.503611 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.503722 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.503925 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.504010 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.504234 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.504323 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.504535 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.504619 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.504836 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.504921 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.505136 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.505219 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.505440 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.505529 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.505762 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.505847 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.506084 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.506167 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.506450 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.506547 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.506764 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.506849 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.507084 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.507166 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.507390 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.507488 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.507699 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.507809 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.508004 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.508088 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.508312 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.508409 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.508617 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.508702 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.508922 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.509005 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.509237 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.509328 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.509540 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.509623 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.509853 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.509939 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.510158 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.510243 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.510568 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.510678 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.510874 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.510983 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.511191 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.512127 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.512304 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.512477 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.512624 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.512795 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.512965 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.513119 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.513298 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.513469 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.513613 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.513817 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.513936 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.514142 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.514291 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.514497 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.514580 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.514817 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.514924 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.515139 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.515230 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.515450 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.515533 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.515756 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.515841 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.516071 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.516153 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.516375 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.516463 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.516691 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.516776 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.517001 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.517087 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.517320 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.517416 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.517627 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.517718 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.517941 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.518024 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.518243 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.518357 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.519168 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.519262 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.519482 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.519566 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.519803 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.519896 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.520121 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.520210 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.520432 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.520515 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.520751 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.520911 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.521061 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.521151 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.521369 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.521459 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.521678 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.521809 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.521983 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.522066 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.522309 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.522396 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.522637 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.522735 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.522930 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.523020 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.523234 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.523317 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.523542 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.523627 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.523846 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.523929 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.524159 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.524243 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.524466 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.524550 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.524765 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.524847 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.525067 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.525153 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.525376 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.525461 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.525682 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.525772 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.525992 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.526075 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.526335 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.526421 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.526657 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.526739 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.526961 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.527055 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.527267 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.527357 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.527589 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.527672 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.527897 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.527988 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.528196 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.528287 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.528498 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.528581 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.528800 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.528898 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.529117 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.529245 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.529426 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.529517 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.529728 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.529819 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.530044 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.530128 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.530387 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.530474 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.530700 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.530786 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.531013 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.531097 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.531324 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.531408 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.531636 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.531777 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.531950 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.532042 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.532261 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.532342 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.532569 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.532653 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.532879 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.532962 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.533187 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.533270 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.533497 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.533588 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.533806 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.533931 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.534145 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.534238 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.534489 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.534586 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.534797 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.534880 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.535106 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.535199 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.535412 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.535519 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.535723 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.535819 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.536028 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.536126 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.536345 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.536586 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.536671 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.536920 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.537220 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.537312 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.537536 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.537620 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.537852 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.537943 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.538169 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.538285 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.538519 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.538603 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.538842 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.538927 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.539153 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.539238 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.539456 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.539575 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.539765 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.539878 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.540072 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.540162 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.540376 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.540468 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.540683 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.540774 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.540986 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.541083 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.541291 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.541389 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.541594 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.541695 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.541920 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.542013 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.542202 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.542344 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.542543 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.542642 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.542853 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.542944 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.543165 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.543255 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.543472 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.543570 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.543775 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.543873 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.544085 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.544184 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.544385 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.544476 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.544703 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.544800 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.545006 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.545091 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.545311 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.545396 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.545610 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.545710 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.545909 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.546000 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.546229 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.546339 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.546558 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.546664 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.546899 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.546990 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.547207 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.547296 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.547552 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.547652 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.547853 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.547941 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.548155 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.548246 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.548477 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.548574 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.548777 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.548868 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.549079 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.549169 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.549379 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.549466 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.550222 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.550366 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.550557 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.550655 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.550860 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.550951 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.551167 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.551258 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.551473 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.551564 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.551778 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.551867 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.552083 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.552181 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.552384 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.552487 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.552688 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.552778 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.552989 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.553079 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.553298 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.553398 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.553603 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.553701 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.553906 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.553997 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.554208 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.554337 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.554546 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.554635 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.554850 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.554940 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.555151 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.555256 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.555458 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.555548 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.555758 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.555849 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.556071 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.556161 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.556371 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.556468 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.556672 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.556762 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.556973 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.557070 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.557282 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.557371 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.557583 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.557679 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.557887 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.557978 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.558196 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.558316 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.558530 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.558621 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.558829 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.558919 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.559129 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.559220 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.559433 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.559532 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.559732 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.559822 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.560030 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.560126 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.560333 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.560433 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.560904 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.560994 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.561215 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.561304 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.561515 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.561614 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.561819 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.561909 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.562118 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.562209 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.562438 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.562540 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.562743 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.562834 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.563046 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.563136 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.563344 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.563436 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.563642 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.563740 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.563941 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.564031 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.564240 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.564332 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.564540 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.564630 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.564846 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.564937 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.565149 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.565239 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.565529 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.565621 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.565832 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.565923 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.566131 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.566222 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.566466 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.566573 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.566778 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.566884 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.567127 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.567222 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.567432 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.567525 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.567742 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.567845 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.568056 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.568152 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.568363 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.568464 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.568670 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.568776 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.568982 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.569082 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.569284 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.569377 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.569595 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.569697 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.569898 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.569992 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.570205 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.570342 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.570529 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.570631 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.570827 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.570915 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.571141 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.571236 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.571445 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.571532 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.571751 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.571839 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.572072 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.572166 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.572387 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.572541 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.572702 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.572837 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.573003 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.573137 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.573310 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.573440 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.573614 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.573741 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.573917 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.574054 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.574313 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.574446 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.574586 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.574716 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.574846 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.574984 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.575162 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.575298 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.575478 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.575614 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.575786 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.575947 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.576104 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.576245 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.576380 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.576472 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.576685 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.576779 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.576996 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.577085 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.577296 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.577386 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.577611 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.577703 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.577914 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.577996 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.578214 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.578318 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.578544 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.578631 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.578847 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.578930 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.579153 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.579235 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.579455 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.579540 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.579770 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.579865 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.580078 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.580182 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.580496 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.580596 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.580802 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.581419 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.581636 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.581728 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.581944 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.582041 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.582271 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.582362 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.582587 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.582688 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.582891 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.582982 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.583207 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.583296 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.583519 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.583622 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.583893 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.583983 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.584200 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.584291 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.584497 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.584595 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.584802 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.584900 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.585109 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.585199 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.585431 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.585530 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.585733 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.585824 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.586031 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.586122 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.586355 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.586447 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.586675 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.586765 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.586971 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.587061 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.587291 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.587382 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.587598 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.587694 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.587925 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.588017 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.588288 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.588385 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.588651 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.588797 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.588963 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.589074 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.589286 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.589373 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.589607 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.589691 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.589931 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.590038 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.590276 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.590364 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.590576 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.590681 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.590890 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.590990 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.591196 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.591294 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.591517 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.591608 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.591838 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.592003 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.592154 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.592298 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.592441 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.592600 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.592743 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.592898 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.593041 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.593183 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.593331 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.593477 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.593628 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.593778 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.593928 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.594071 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.594313 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.594466 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.594634 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.594779 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.594955 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.595131 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.595288 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.595433 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.595582 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.595732 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.595884 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.596027 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.596170 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.596312 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.596467 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.597145 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.597303 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.597458 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.597602 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.597745 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.597900 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.598043 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.598198 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.598387 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.598581 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.598742 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.598887 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.599049 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.599193 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.599341 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.599493 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.599638 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.599780 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.599934 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.600077 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.600219 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.600368 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.600511 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.600654 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.600805 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.600959 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.601101 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.601250 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.601393 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.601535 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.601686 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.601830 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.601971 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.602135 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.602321 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.602484 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.602629 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.602772 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.602932 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.603082 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.603225 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.603474 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.603631 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.603815 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.603964 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.604107 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.604248 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.604399 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.604543 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.604730 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.604881 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.605040 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.605185 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.605336 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.605480 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.605667 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.605818 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.605991 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.606150 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.606324 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.606474 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.606617 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.606759 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.606939 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.607098 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.607242 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.607393 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.607537 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.607691 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.607834 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.607986 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.608136 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.608287 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.608431 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.608580 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.608723 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.608883 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.609029 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.609171 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.609320 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.609464 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.609615 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.609759 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.609901 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.610044 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.610187 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.610366 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.610525 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.610676 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.610831 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.610982 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.611127 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.611275 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.611428 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.611578 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.611720 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.611862 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.612005 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.612170 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.612327 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.612471 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.612624 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.612769 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.612911 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.613062 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.613220 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.613364 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.613507 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.613649 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.613801 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.613993 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.614145 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.614322 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.614471 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.614636 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.614781 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.614932 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.615075 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.615217 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.615360 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.615532 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.615680 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.615832 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.615976 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.616142 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.616297 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.616442 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.616607 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.616757 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.616908 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.617059 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.617202 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.617344 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.617495 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.617638 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.617781 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.617983 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.618131 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.618330 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.618499 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.618662 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.618806 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.619064 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.619212 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.619355 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.619507 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.619652 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.619801 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.619945 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.620087 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.620243 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.620410 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.620571 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.620737 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.620886 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.621060 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.621251 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.621404 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.621550 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.621693 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.621835 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.621978 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.622130 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.622321 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.622485 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.622659 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.622819 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.622973 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.623118 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.623289 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.623437 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.623602 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.623752 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.623943 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.624094 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.624242 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.624402 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.624547 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.624700 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.624844 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.624987 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.625129 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.625271 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.625416 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.625567 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.625717 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.625862 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.626005 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.626166 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.626382 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.626531 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.626673 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.626817 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.626960 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.627109 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.627262 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.627406 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.627549 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.627691 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.627869 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.628025 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.628178 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.628349 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.628500 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.628668 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.628818 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.628993 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.629144 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.629316 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.629467 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.629610 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.629752 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.629974 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.630134 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.630329 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.630481 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.630657 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.630806 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.630984 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.631135 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.631302 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.631454 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.631659 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.631830 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.632001 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.632160 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.632302 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.632445 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.632587 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.632768 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.632919 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.633100 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.633250 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.633418 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.633564 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.633715 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.633864 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.634007 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.634179 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.634378 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.634524 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.634675 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.634819 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.634961 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.635104 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.635254 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.635404 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.635555 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.635723 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.635879 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.636068 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.636228 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.636385 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.636528 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.636704 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.636854 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.637032 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.637181 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.637333 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.637621 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.637773 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.637952 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.638101 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.638284 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.638447 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.638599 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.638749 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.638892 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.639034 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.639176 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.639326 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.639472 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.639614 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.639756 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.639898 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.640052 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.640207 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.640356 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.640501 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.640643 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.640792 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.641150 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.641315 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.641479 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.641624 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.641767 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.641909 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642060 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642204 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642353 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642443 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642525 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642626 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642708 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.642880 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.643026 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.643193 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.643281 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.644057 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.644156 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.644372 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.644459 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.644678 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.644763 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.644987 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.645148 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.645301 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.645445 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.645587 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.645730 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.645892 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.646037 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.646190 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.646373 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.646529 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.646671 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.646827 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.646971 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.647114 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.647256 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.647399 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.647550 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.647693 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.647843 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.647987 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.648136 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.648279 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.648505 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.648663 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.648807 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.648958 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.649100 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.649243 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.649400 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.649544 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.649697 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.649841 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.649984 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.650126 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.650329 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.650507 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.650652 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.650795 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.650938 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.651089 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.651240 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.651384 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.651577 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.651735 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.651885 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.652038 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.652182 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.652465 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.652625 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.652770 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.652913 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.653089 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.653239 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.653389 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.653541 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.653685 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.653845 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.653990 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.654140 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.654312 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.654473 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.654627 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.654782 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.654925 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.655099 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.655249 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.655422 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.655571 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.655789 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.655935 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.656084 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.656227 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.656380 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.656534 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.656685 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.656838 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.656980 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.657134 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.657278 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.657436 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.657580 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.657722 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.657864 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.658006 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.658148 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.658346 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.658505 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.658648 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.658790 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.658932 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.659134 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.659799 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.659951 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.660093 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.660236 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.660379 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.660585 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.660734 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.660888 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.661031 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.661202 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.661352 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.661505 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.661659 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.661824 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.661974 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.662148 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.662332 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.662496 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.662640 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.662794 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.662943 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.663093 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.663244 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.663388 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.663531 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.663673 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.663815 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.664009 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.664167 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.664336 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.664486 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.664662 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.664820 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.664973 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.665129 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.665287 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.665430 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.665573 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.665716 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.665870 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.666013 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.666155 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.666346 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.666502 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.666668 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.666821 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.666965 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.667113 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.667257 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.667406 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.667549 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.667700 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.667843 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.667994 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.668137 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.668286 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.668439 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.668591 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.668768 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.668918 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.669106 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.669258 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.669409 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.669563 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.669740 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.669891 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.670043 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.670186 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.670396 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.670571 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.670715 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.670858 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.671000 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.671150 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.671306 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.671452 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.671594 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.671736 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.671879 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.672034 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.672182 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.672344 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.672532 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.672681 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.672831 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.672984 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.673128 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.673278 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.673422 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.673571 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.673714 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.673865 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.674019 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.674174 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.674360 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.674506 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.674672 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.674831 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.674976 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.675119 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.675261 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.675410 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.675567 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.675710 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.675858 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.676012 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.676167 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.676308 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.676468 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.676622 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.676766 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.676907 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.677049 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.677223 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.677385 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.677536 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.677685 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.677851 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.678009 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.678171 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.678375 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.678533 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.678676 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.678817 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.678959 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.679114 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.679267 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.679409 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 20:36:12.679551 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.679763 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.680094 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.680447 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.680772 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.681167 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.681460 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.681780 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.682101 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.682441 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:36:12.682691 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 20:36:12.702384 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_db.sqlalchemy.engines [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:12.704606 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_db.sqlalchemy.engines [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:12.771834 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.context [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=125315) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 20:36:12.772075 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.context [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=125314) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 20:36:12.776353 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_concurrency.lockutils [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:36:12.776461 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:36:12.777915 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:36:12.778005 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_concurrency.lockutils [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:36:12.778744 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:36:12.778839 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_concurrency.lockutils [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:36:12.780658 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:36:12.780746 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_concurrency.lockutils [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:36:12.791461 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_db.sqlalchemy.engines [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:12.794305 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_db.sqlalchemy.engines [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:12.797485 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_db.sqlalchemy.engines [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:12.801153 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_db.sqlalchemy.engines [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:12.962045 ncdv-master-1 devstack@n-api.service[125315]: DEBUG oslo_db.sqlalchemy.engines [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:12.964617 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_db.sqlalchemy.engines [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:36:13.305078 ncdv-master-1 devstack@n-api.service[125314]: WARNING keystonemiddleware.auth_token [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:36:13.306334 ncdv-master-1 devstack@n-api.service[125315]: WARNING keystonemiddleware.auth_token [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:36:13.311936 ncdv-master-1 devstack@n-api.service[125314]: WARNING keystonemiddleware.auth_token [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:36:13.313199 ncdv-master-1 devstack@n-api.service[125315]: WARNING keystonemiddleware.auth_token [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:36:13.656681 ncdv-master-1 devstack@n-api.service[125314]: WARNING keystonemiddleware.auth_token [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:36:13.657227 ncdv-master-1 devstack@n-api.service[125315]: WARNING keystonemiddleware.auth_token [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:36:13.662562 ncdv-master-1 devstack@n-api.service[125314]: WARNING keystonemiddleware.auth_token [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:36:13.662769 ncdv-master-1 devstack@n-api.service[125315]: WARNING keystonemiddleware.auth_token [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:36:13.667773 ncdv-master-1 devstack@n-api.service[125314]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56116a5b79c0 pid: 125314 (default app) Dec 18 20:36:13.667937 ncdv-master-1 devstack@n-api.service[125315]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56116a5b79c0 pid: 125315 (default app) Dec 18 20:36:13.669881 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:36:13.671097 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-8a9ab572-9d58-4e76-88b7-0e7f9cf046ff None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001800 Dec 18 20:36:13.671505 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sat Dec 18 20:36:13 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:37.481601 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:37.483629 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002725 Dec 18 20:37:37.484865 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:37 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:37.921226 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-6ff66d0b-cd87-464c-bfba-176989a3ea1b admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:37.950354 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-6ff66d0b-cd87-464c-bfba-176989a3ea1b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.459634 Dec 18 20:37:37.951059 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 20:37:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:37:40.446639 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:40.447651 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-9d81522b-6748-4eb4-972b-aa990a880378 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Dec 18 20:37:40.448206 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:37:40.513040 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-4c40aaf8-0eb3-4774-bbed-06094adf5307 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:40.531959 ncdv-master-1 devstack@n-api.service[125314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:37:40.531959 ncdv-master-1 devstack@n-api.service[125314]: warnings.warn(msg) Dec 18 20:37:40.561453 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-4c40aaf8-0eb3-4774-bbed-06094adf5307 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106075 Dec 18 20:37:40.562641 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:37:40 2021] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:37:40.780119 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-3df06485-f7e3-46d4-8689-7418e9267bbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:40.782494 ncdv-master-1 devstack@n-api.service[125315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:37:40.782494 ncdv-master-1 devstack@n-api.service[125315]: warnings.warn(msg) Dec 18 20:37:40.830733 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-3df06485-f7e3-46d4-8689-7418e9267bbe admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.259036 Dec 18 20:37:40.846657 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Dec 18 20:37:40 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:37:43.313440 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-4c40aaf8-0eb3-4774-bbed-06094adf5307 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:43.315489 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-4c40aaf8-0eb3-4774-bbed-06094adf5307 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001847 Dec 18 20:37:43.315898 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:43 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:43.441001 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-232ae736-b971-499a-bdf7-d467b8a8b611 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:43.461884 ncdv-master-1 devstack@n-api.service[125315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:37:43.461884 ncdv-master-1 devstack@n-api.service[125315]: warnings.warn(msg) Dec 18 20:37:43.485026 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-232ae736-b971-499a-bdf7-d467b8a8b611 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162494 Dec 18 20:37:43.485586 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:37:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:37:43.498276 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-a052e29b-4095-49c7-a91f-eb762747ba97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:43.500146 ncdv-master-1 devstack@n-api.service[125314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:37:43.500146 ncdv-master-1 devstack@n-api.service[125314]: warnings.warn(msg) Dec 18 20:37:43.538497 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-a052e29b-4095-49c7-a91f-eb762747ba97 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043879 Dec 18 20:37:43.539803 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Dec 18 20:37:43 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:37:46.194804 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-232ae736-b971-499a-bdf7-d467b8a8b611 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:46.196408 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-232ae736-b971-499a-bdf7-d467b8a8b611 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005615 Dec 18 20:37:46.197305 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:46 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:46.266117 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-15c5d07b-52e9-472a-bed2-01d9211edee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "disk": 10, "ram": 1024, "swap": 0}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:46.287269 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-15c5d07b-52e9-472a-bed2-01d9211edee7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080047 Dec 18 20:37:46.295872 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:37:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:37:46.300631 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-ad90fca0-154e-4247-b19d-55ea12933ef9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:46.324891 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-ad90fca0-154e-4247-b19d-55ea12933ef9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028357 Dec 18 20:37:46.326666 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Dec 18 20:37:46 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:37:49.106156 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-15c5d07b-52e9-472a-bed2-01d9211edee7 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:49.107302 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-15c5d07b-52e9-472a-bed2-01d9211edee7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Dec 18 20:37:49.107872 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:49.167511 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-8d8ca78d-dd15-4c1d-8e9a-cf3350134723 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "disk": 10, "id": "d3", "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:49.189833 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-8d8ca78d-dd15-4c1d-8e9a-cf3350134723 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074679 Dec 18 20:37:49.190739 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:37:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:37:49.204036 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-c6717948-7cd8-4b28-b753-8ae76336002e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:49.228732 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-c6717948-7cd8-4b28-b753-8ae76336002e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028476 Dec 18 20:37:49.229320 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Dec 18 20:37:49 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:37:51.763437 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-8d8ca78d-dd15-4c1d-8e9a-cf3350134723 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:51.764463 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-8d8ca78d-dd15-4c1d-8e9a-cf3350134723 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Dec 18 20:37:51.764875 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:51.824895 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-dbfec1be-2d92-40e9-99cf-107cabbbe4c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "name": "ds4G", "vcpus": 4}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:51.844301 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-dbfec1be-2d92-40e9-99cf-107cabbbe4c7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072484 Dec 18 20:37:51.844711 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:37:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:37:51.857344 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-e4150ae4-4a3f-47f4-b2ab-358334844897 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:51.882418 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-e4150ae4-4a3f-47f4-b2ab-358334844897 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028582 Dec 18 20:37:51.882997 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Dec 18 20:37:51 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:37:54.399792 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-dbfec1be-2d92-40e9-99cf-107cabbbe4c7 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:54.400794 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-dbfec1be-2d92-40e9-99cf-107cabbbe4c7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Dec 18 20:37:54.401192 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:54.459874 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-4d011e81-d1c7-440e-8cc4-572ec312eea6 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:54.488621 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-4d011e81-d1c7-440e-8cc4-572ec312eea6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081054 Dec 18 20:37:54.490294 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 20:37:54 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:37:56.996862 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-dbfec1be-2d92-40e9-99cf-107cabbbe4c7 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:56.997785 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-dbfec1be-2d92-40e9-99cf-107cabbbe4c7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Dec 18 20:37:56.998181 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:57.066985 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-a9f26bb0-53b3-40f4-82ce-95c9596b7845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "ram": 512}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:57.090510 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-a9f26bb0-53b3-40f4-82ce-95c9596b7845 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085192 Dec 18 20:37:57.106590 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-e42dd77f-e9a8-4d1e-82f3-5917e2acc63c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:57.113726 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:37:57 2021] POST /compute/v2.1/flavors => generated 402 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:37:57.141399 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-e42dd77f-e9a8-4d1e-82f3-5917e2acc63c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039988 Dec 18 20:37:57.155650 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Dec 18 20:37:57 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:37:59.812485 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-a9f26bb0-53b3-40f4-82ce-95c9596b7845 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:37:59.813578 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-a9f26bb0-53b3-40f4-82ce-95c9596b7845 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 Dec 18 20:37:59.814054 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:37:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:37:59.887327 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-5c38960d-ef59-4ae5-b54a-0d76c10730b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 2048}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:59.904775 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-5c38960d-ef59-4ae5-b54a-0d76c10730b3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082244 Dec 18 20:37:59.905339 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:37:59 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:37:59.918867 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-fba0759a-2971-4c13-bd0e-f0ee9666e5ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:37:59.943598 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-fba0759a-2971-4c13-bd0e-f0ee9666e5ae admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029709 Dec 18 20:37:59.944202 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Dec 18 20:37:59 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:38:02.857319 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-5c38960d-ef59-4ae5-b54a-0d76c10730b3 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:02.858448 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-5c38960d-ef59-4ae5-b54a-0d76c10730b3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Dec 18 20:38:02.859075 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:38:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:02.921886 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-501b8343-877f-43e7-878f-63ff72c7782d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "swap": 0}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:02.942128 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-501b8343-877f-43e7-878f-63ff72c7782d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075496 Dec 18 20:38:02.942721 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:38:02 2021] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:38:02.955032 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-0afbb457-0eb7-454b-becb-b9eff13a7789 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:02.976912 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-0afbb457-0eb7-454b-becb-b9eff13a7789 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025378 Dec 18 20:38:02.977403 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Dec 18 20:38:02 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:38:05.446166 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-501b8343-877f-43e7-878f-63ff72c7782d admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:05.447289 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-501b8343-877f-43e7-878f-63ff72c7782d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Dec 18 20:38:05.447769 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:38:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:05.503817 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-5fb1f322-9479-41b9-8cc7-6cf3de516981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "disk": 80}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:05.522611 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-5fb1f322-9479-41b9-8cc7-6cf3de516981 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068135 Dec 18 20:38:05.523181 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:38:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:38:05.534947 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-0216caa9-a1c3-42f2-92c5-0f8f30dcc1ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:05.557801 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-0216caa9-a1c3-42f2-92c5-0f8f30dcc1ca admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026280 Dec 18 20:38:05.562313 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Dec 18 20:38:05 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:38:08.160865 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-5fb1f322-9479-41b9-8cc7-6cf3de516981 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:08.162462 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-5fb1f322-9479-41b9-8cc7-6cf3de516981 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Dec 18 20:38:08.163070 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:38:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:08.225630 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-042c0b1f-fc2d-40bb-9006-6cb5c7107094 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:08.245171 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-042c0b1f-fc2d-40bb-9006-6cb5c7107094 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075048 Dec 18 20:38:08.245865 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Dec 18 20:38:08 2021] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:38:08.258893 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-08966bbf-be24-4a1a-88c6-437d5432ef4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:08.282919 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-08966bbf-be24-4a1a-88c6-437d5432ef4d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027511 Dec 18 20:38:08.283500 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Dec 18 20:38:08 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:38:33.011681 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-042c0b1f-fc2d-40bb-9006-6cb5c7107094 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:33.012692 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-042c0b1f-fc2d-40bb-9006-6cb5c7107094 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 18 20:38:33.013090 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:38:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:33.070766 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-5f2b92ba-f48d-4ba3-9e0a-829c5aa21ffe admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:33.087081 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-5f2b92ba-f48d-4ba3-9e0a-829c5aa21ffe admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067629 Dec 18 20:38:33.087607 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 20:38:33 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:38:34.775511 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-042c0b1f-fc2d-40bb-9006-6cb5c7107094 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:34.776529 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-042c0b1f-fc2d-40bb-9006-6cb5c7107094 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 18 20:38:34.776931 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:35.046955 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-53108ff9-75e5-4836-8e16-5a0b112cb57b admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:35.052614 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.wsgi [None req-53108ff9-75e5-4836-8e16-5a0b112cb57b admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 18 20:38:35.053180 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-53108ff9-75e5-4836-8e16-5a0b112cb57b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:38:35.053968 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-53108ff9-75e5-4836-8e16-5a0b112cb57b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059774 Dec 18 20:38:35.054519 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:38:34 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:35.064319 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-f023f8dd-81e3-4f73-8079-3c46a63708fb admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:35.085560 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-f023f8dd-81e3-4f73-8079-3c46a63708fb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024898 Dec 18 20:38:35.086143 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:38:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:38:35.113383 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-e0f7df0b-a114-4676-8bbd-5c52efb69650 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:35.142856 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-e0f7df0b-a114-4676-8bbd-5c52efb69650 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033199 Dec 18 20:38:35.143446 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:38:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:38:35.153476 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-eab66c01-56cd-4186-abf3-09de81c818bd admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:35.159590 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.wsgi [None req-eab66c01-56cd-4186-abf3-09de81c818bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 18 20:38:35.160153 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-eab66c01-56cd-4186-abf3-09de81c818bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:38:35.160936 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-eab66c01-56cd-4186-abf3-09de81c818bd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011069 Dec 18 20:38:35.161437 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:38:35 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:36.734708 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-e0f7df0b-a114-4676-8bbd-5c52efb69650 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:36.736208 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-e0f7df0b-a114-4676-8bbd-5c52efb69650 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Dec 18 20:38:36.736880 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:36.932717 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-5580d1f2-ba93-47b7-a800-abcfe33ed97a admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:36.940069 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.wsgi [None req-5580d1f2-ba93-47b7-a800-abcfe33ed97a admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 18 20:38:36.940633 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-5580d1f2-ba93-47b7-a800-abcfe33ed97a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:38:36.941415 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-5580d1f2-ba93-47b7-a800-abcfe33ed97a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059836 Dec 18 20:38:36.941973 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:38:36 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:36.951545 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-e19641d8-2e13-4668-b6af-c1d2a5c62fdf admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:36.964671 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-e19641d8-2e13-4668-b6af-c1d2a5c62fdf admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016659 Dec 18 20:38:36.965190 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:38:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:38:36.975697 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-b0416ff3-7230-4bf3-af9d-e2d9bc1e6658 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:36.989657 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-b0416ff3-7230-4bf3-af9d-e2d9bc1e6658 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017353 Dec 18 20:38:36.990224 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:38:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:38:37.000235 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-4d802a07-7774-4a94-b2c3-fd5b90798930 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:37.005898 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.wsgi [None req-4d802a07-7774-4a94-b2c3-fd5b90798930 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 18 20:38:37.006569 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-4d802a07-7774-4a94-b2c3-fd5b90798930 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:38:37.007507 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-4d802a07-7774-4a94-b2c3-fd5b90798930 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010683 Dec 18 20:38:37.008529 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:38:36 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:38.666048 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-b0416ff3-7230-4bf3-af9d-e2d9bc1e6658 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:38.667118 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-b0416ff3-7230-4bf3-af9d-e2d9bc1e6658 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Dec 18 20:38:38.667520 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:38.913911 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-ee818959-7f23-41ab-86ff-18196b517067 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:38.919264 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.wsgi [None req-ee818959-7f23-41ab-86ff-18196b517067 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 18 20:38:38.919820 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-ee818959-7f23-41ab-86ff-18196b517067 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:38:38.920605 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-ee818959-7f23-41ab-86ff-18196b517067 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069849 Dec 18 20:38:38.921121 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:38:38 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:38.931421 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-1e144f76-7922-474d-9c86-ba26a0204aa3 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:38.945705 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-1e144f76-7922-474d-9c86-ba26a0204aa3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017752 Dec 18 20:38:38.946246 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:38:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:38:38.957044 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:38.969872 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017077 Dec 18 20:38:38.970432 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:38:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:38:38.980251 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-43883286-7eca-40e0-bada-f422f1eeb01f admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:38.985860 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.wsgi [None req-43883286-7eca-40e0-bada-f422f1eeb01f admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 18 20:38:38.986452 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-43883286-7eca-40e0-bada-f422f1eeb01f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:38:38.987214 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-43883286-7eca-40e0-bada-f422f1eeb01f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010515 Dec 18 20:38:38.987702 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:38:38 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:40.577707 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:40.579287 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Dec 18 20:38:40.579679 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:40.780620 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-c1cda10e-142c-420d-b1d0-15b9944ff6b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:40.798397 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-c1cda10e-142c-420d-b1d0-15b9944ff6b4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069185 Dec 18 20:38:40.798852 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Dec 18 20:38:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:38:42.385637 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:42.386671 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Dec 18 20:38:42.387070 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:42.584933 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-b2714888-63e9-4151-912d-17dfb0fbe994 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:42.603217 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-b2714888-63e9-4151-912d-17dfb0fbe994 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069859 Dec 18 20:38:42.603769 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Dec 18 20:38:42 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:38:44.213610 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:44.214657 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Dec 18 20:38:44.215103 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:44.431086 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-a20de035-3799-47d5-806c-5abfa76efa57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:44.448464 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-a20de035-3799-47d5-806c-5abfa76efa57 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070374 Dec 18 20:38:44.449009 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Dec 18 20:38:44 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:38:45.989454 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:45.990476 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Dec 18 20:38:45.990868 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:46.185867 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-4138e11c-61f2-4b85-8257-a36a383afcaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:38:46.203270 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-4138e11c-61f2-4b85-8257-a36a383afcaf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067383 Dec 18 20:38:46.204287 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Dec 18 20:38:46 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:38:47.767089 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:47.768238 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Dec 18 20:38:47.768951 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:38:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:38:47.967135 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-28fb03d3-ebf3-4598-9421-38436a6c05e5 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:38:47.986427 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-28fb03d3-ebf3-4598-9421-38436a6c05e5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069404 Dec 18 20:38:47.986955 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sat Dec 18 20:38:47 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:39:37.454262 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:39:37.455784 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-701a3bc8-a900-4355-a2c6-dc9e921dc79e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001729 Dec 18 20:39:37.457167 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 930 bytes} [Sat Dec 18 20:39:37 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:39:37.514439 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-9cecdaa4-238f-4162-9bda-61229ec62e84 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:39:37.533692 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-9cecdaa4-238f-4162-9bda-61229ec62e84 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069682 Dec 18 20:39:37.534289 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 20:39:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:39:37.556769 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-abc5a126-d2a2-4304-ad49-5815003554aa admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:39:37.564622 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-abc5a126-d2a2-4304-ad49-5815003554aa admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011401 Dec 18 20:39:37.565149 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1282 bytes} [Sat Dec 18 20:39:37 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:39:37.576688 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-8571918f-77e1-4b09-9c43-67be8b80ee46 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:39:37.584074 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-8571918f-77e1-4b09-9c43-67be8b80ee46 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010742 Dec 18 20:39:37.584592 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1285 bytes} [Sat Dec 18 20:39:37 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:39:37.595640 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-ac2926ef-565b-47cb-8c32-f2cca94e7cea admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:39:37.603147 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-ac2926ef-565b-47cb-8c32-f2cca94e7cea admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010781 Dec 18 20:39:37.603671 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1285 bytes} [Sat Dec 18 20:39:37 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:39:37.615507 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-18a78b4f-1384-4c68-8a83-06e606d635f9 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:39:37.623352 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-18a78b4f-1384-4c68-8a83-06e606d635f9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011829 Dec 18 20:39:37.623890 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1282 bytes} [Sat Dec 18 20:39:37 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:41:01.124895 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-b4f87686-d6e8-4f87-8968-6c2b66116142 tempest-verify_tempest_config-2049244199 tempest-verify_tempest_config-2049244199-project] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:41:01.127361 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-b4f87686-d6e8-4f87-8968-6c2b66116142 tempest-verify_tempest_config-2049244199 tempest-verify_tempest_config-2049244199-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107888 Dec 18 20:41:01.127898 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 35/69] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 20:41:01 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:45:00.313544 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-18a78b4f-1384-4c68-8a83-06e606d635f9 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:45:00.314580 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-18a78b4f-1384-4c68-8a83-06e606d635f9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 18 20:45:00.314981 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:45:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:45:00.570929 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-ac46cca2-3d3e-49dc-8fb7-bccaef56103c admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:45:00.572082 ncdv-master-1 devstack@n-api.service[125314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:45:00.572082 ncdv-master-1 devstack@n-api.service[125314]: warnings.warn(msg) Dec 18 20:45:00.574220 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-ac46cca2-3d3e-49dc-8fb7-bccaef56103c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:00.574682 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-ac46cca2-3d3e-49dc-8fb7-bccaef56103c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:00.575501 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-ac46cca2-3d3e-49dc-8fb7-bccaef56103c admin admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:00.575925 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-ac46cca2-3d3e-49dc-8fb7-bccaef56103c admin admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:00.614112 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-ac46cca2-3d3e-49dc-8fb7-bccaef56103c admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.151557 Dec 18 20:45:00.614698 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 36/71] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:45:00 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:45:02.150108 ncdv-master-1 devstack@n-api.service[125315]: DEBUG nova.api.openstack.wsgi [None req-18a78b4f-1384-4c68-8a83-06e606d635f9 admin admin] Calling method '>' {{(pid=125315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:45:02.151133 ncdv-master-1 devstack@n-api.service[125315]: INFO nova.api.openstack.requestlog [None req-18a78b4f-1384-4c68-8a83-06e606d635f9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Dec 18 20:45:02.152018 ncdv-master-1 devstack@n-api.service[125315]: [pid: 125315|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Dec 18 20:45:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:45:02.347903 ncdv-master-1 devstack@n-api.service[125314]: DEBUG nova.api.openstack.wsgi [None req-54129702-44fd-4546-9982-581d03d9a823 admin admin] Calling method '>' {{(pid=125314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:45:02.349063 ncdv-master-1 devstack@n-api.service[125314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:45:02.349063 ncdv-master-1 devstack@n-api.service[125314]: warnings.warn(msg) Dec 18 20:45:02.350682 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-54129702-44fd-4546-9982-581d03d9a823 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:02.351112 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-54129702-44fd-4546-9982-581d03d9a823 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:02.351922 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-54129702-44fd-4546-9982-581d03d9a823 admin admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:02.352337 ncdv-master-1 devstack@n-api.service[125314]: DEBUG oslo_concurrency.lockutils [None req-54129702-44fd-4546-9982-581d03d9a823 admin admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:02.373793 ncdv-master-1 devstack@n-api.service[125314]: INFO nova.api.openstack.requestlog [None req-54129702-44fd-4546-9982-581d03d9a823 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.076856 Dec 18 20:45:02.374318 ncdv-master-1 devstack@n-api.service[125314]: [pid: 125314|app: 0|req: 37/73] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:45:02 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:45:51.026288 ncdv-master-1 devstack@n-api.service[125313]: Sat Dec 18 20:45:51 2021 - graceful shutdown triggered... Dec 18 20:45:51.026841 ncdv-master-1 devstack@n-api.service[125314]: Gracefully killing worker 1 (pid: 125314)... Dec 18 20:45:51.026422 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Dec 18 20:45:51.028148 ncdv-master-1 devstack@n-api.service[125315]: Gracefully killing worker 2 (pid: 125315)... Dec 18 20:45:52.027513 ncdv-master-1 devstack@n-api.service[125313]: worker 1 buried after 1 seconds Dec 18 20:45:52.027513 ncdv-master-1 devstack@n-api.service[125313]: worker 2 buried after 1 seconds Dec 18 20:45:52.027513 ncdv-master-1 devstack@n-api.service[125313]: goodbye to uWSGI. Dec 18 20:45:52.029064 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Dec 18 20:45:52.029727 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Dec 18 20:45:52.032481 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Dec 18 20:45:52.077491 ncdv-master-1 devstack@n-api.service[140719]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 18 20:45:52 2021] *** Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: nodename: ncdv-master-1 Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: machine: x86_64 Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: clock source: unix Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: pcre jit disabled Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: detected number of CPU cores: 4 Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: current working directory: / Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: detected binary path: /usr/bin/uwsgi-core Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: your processes number limit is 47680 Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: your memory page size is 4096 bytes Dec 18 20:45:52.094510 ncdv-master-1 devstack@n-api.service[140719]: detected max file descriptor number: 2048 Dec 18 20:45:52.095579 ncdv-master-1 devstack@n-api.service[140719]: lock engine: pthread robust mutexes Dec 18 20:45:52.095579 ncdv-master-1 devstack@n-api.service[140719]: thunder lock: enabled Dec 18 20:45:52.095579 ncdv-master-1 devstack@n-api.service[140719]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 18 20:45:52.095579 ncdv-master-1 devstack@n-api.service[140719]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 18 20:45:52.143470 ncdv-master-1 devstack@n-api.service[140719]: Python main interpreter initialized at 0x55cb7da919c0 Dec 18 20:45:52.143470 ncdv-master-1 devstack@n-api.service[140719]: python threads support enabled Dec 18 20:45:52.143470 ncdv-master-1 devstack@n-api.service[140719]: your server socket listen backlog is limited to 100 connections Dec 18 20:45:52.143470 ncdv-master-1 devstack@n-api.service[140719]: your mercy for graceful operations on workers is 90 seconds Dec 18 20:45:52.143905 ncdv-master-1 devstack@n-api.service[140719]: mapped 403077 bytes (393 KB) for 2 cores Dec 18 20:45:52.143905 ncdv-master-1 devstack@n-api.service[140719]: *** Operational MODE: preforking *** Dec 18 20:45:52.144164 ncdv-master-1 devstack@n-api.service[140719]: *** uWSGI is running in multiple interpreter mode *** Dec 18 20:45:52.144164 ncdv-master-1 devstack@n-api.service[140719]: spawned uWSGI master process (pid: 140719) Dec 18 20:45:52.144377 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Dec 18 20:45:52.146143 ncdv-master-1 devstack@n-api.service[140719]: spawned uWSGI worker 1 (pid: 140731, cores: 1) Dec 18 20:45:52.146143 ncdv-master-1 devstack@n-api.service[140719]: spawned uWSGI worker 2 (pid: 140732, cores: 1) Dec 18 20:45:52.146143 ncdv-master-1 devstack@n-api.service[140719]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 18 20:45:54.157894 ncdv-master-1 devstack@n-api.service[140731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:45:54.157894 ncdv-master-1 devstack@n-api.service[140731]: from cryptography.utils import int_from_bytes Dec 18 20:45:54.158681 ncdv-master-1 devstack@n-api.service[140732]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:45:54.158681 ncdv-master-1 devstack@n-api.service[140732]: from cryptography.utils import int_from_bytes Dec 18 20:45:54.159137 ncdv-master-1 devstack@n-api.service[140731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:45:54.159137 ncdv-master-1 devstack@n-api.service[140731]: from cryptography.utils import int_from_bytes Dec 18 20:45:54.159268 ncdv-master-1 devstack@n-api.service[140732]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:45:54.159268 ncdv-master-1 devstack@n-api.service[140732]: from cryptography.utils import int_from_bytes Dec 18 20:45:56.654930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 20:45:56.655487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 20:45:56.655691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 20:45:56.656055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 20:45:56.656311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 20:45:56.656905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.657239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.657564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.657886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.658219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.658556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.658879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.659203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.659534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.659804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.660120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.660445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.660773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.661084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.661402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.661721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.662027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.662421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.662733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.663227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.663679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.663992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.664406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.664650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.664967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.665276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.665596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.665906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.666232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.666581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.666987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.667336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.667650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.667965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.668379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.668691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.669002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.669385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.669658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.669972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.670318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.670644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.670983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.671288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.671593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.671904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.672215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.672541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.672847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.673153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.673403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.673713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.677475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.677475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.677475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.677475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.677475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.677475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.678798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.680964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.681747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.682008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.682359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.682685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.683520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.683826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.684139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.684474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.684800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.685114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.685364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.685672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.685981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.686325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.686639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.687202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.687512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.687819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.688126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.688436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.688742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.689054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.689361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.689669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.689978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.690311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.690625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.690949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.691284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.691584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.691892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.692200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.692508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.692833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.693142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.693449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.693771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.694080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.694411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.694733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.695048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.695357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.695676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.695979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.696287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.696604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.696910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.697217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.697522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.697829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.698134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.699047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.699348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.699655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.699959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.700282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.700602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.700914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.701226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.701534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.701860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.702200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.702572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.702919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.703240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.703577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.703909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.704229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.704542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.704857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.705189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.705503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.705812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.706124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.706467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.706788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.707118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.707436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.707755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.708073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.708386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.708706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.709037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.709359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.709673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.710018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.710384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.710701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.711030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.711347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.711686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.711993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.712303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.713139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.713139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.713394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.713558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.713895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.714243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.714584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.714897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.715204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.715513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.715822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.716129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.716451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.716784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.717089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.717424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.717731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.718041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.718384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.718903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.719389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.719705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.720016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.720344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.720658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.721361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.721361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.721560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.721865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.722183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.722524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.722838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.723152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.723480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.723794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.724107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.724444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.724776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.725089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.725417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.725743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.726060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.726460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.726710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.727019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.727328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.727635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.727947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.728301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.728563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.728893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.729179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.729483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.729836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.730146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.730480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.730791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.731096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.731441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.731749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.732167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.732434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.732756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.733082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.733395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.733714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.734025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.734461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.734785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.735107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.735972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.735972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.736297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.736450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.736643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.736957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.737350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.737582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.737898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.738238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.738599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.738922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.739337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.739547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.739859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.740169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.740481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.740791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.741101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.741420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.741733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.742056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.742400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.742726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.743050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.743360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.743667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.743983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.744314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.744647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.744963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.745783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 20:45:56.746210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.746329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 20:45:56.746425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.746425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.746592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 20:45:56.746735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.746933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 20:45:56.747032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.747194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 20:45:56.747341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.747585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.747676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.747919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.748009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.748244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.748341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.748556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.748655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.748866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.748958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.749172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.749267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.749488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.749580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.749797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.749905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.750103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.750194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.750413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.750518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.750734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.750834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.751058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.751161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.751369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.751476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.751685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.751792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.752000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.752101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.752306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.752504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.752661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.752814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.752968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.753117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.753264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.753358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.753510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.753803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.753997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.754088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.754171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.754383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.754477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.754701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.754803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.755034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.755139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.755351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.755449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.755666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.755769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.756046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.756169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.756292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.756458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.756612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.756754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.756892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.757031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.757202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.757362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.757509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.757654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.757809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.757952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.758105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.758245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.758443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.758676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.758815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.758984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.759094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.759301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.759407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.759631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.759732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.759945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.760045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.760253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.760344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.760558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.760648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.760887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.761504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.761730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.761833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.762161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.762350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.762674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.762767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.762857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.762975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.763128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.763293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.763515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.763608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.763923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.764058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.764194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.764320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.764440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.764557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.764765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.764890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.765098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.765296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.765419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.765529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.765736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.765861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.765995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.766125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.766243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.766413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.766664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.766780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.766970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.767087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.767278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.767401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.767587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.767710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.767892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.768010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.768199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.768316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.768535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.768670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.768843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.768945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.769156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.769257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.769462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.769563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.769773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.769865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.770076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.770182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.770431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.770621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.770778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.770977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.771126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.771288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.771438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.771592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.771808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.771970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.772128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.772283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.772430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.772579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.772749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.772893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.773042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.773190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.773357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.773491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.773631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.773775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.773935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.774115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.774285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.775265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.775444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.775596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.775741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.775741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.775909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.775994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.776077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.776169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.776265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.776356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.776447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.776575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.776714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.776813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.776911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.776994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.777077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.777158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.777311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.777440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.777625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.777748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.777938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.778039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.778270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.778389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.778664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.778754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.778965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.779058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.779269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.779373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.779579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.779671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.779889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.780107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.780268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.780364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.780485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.780588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.780786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.780878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.781096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.781188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.781398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.781488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.781702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.781802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.782006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.782174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.782345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.782524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.782679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.782843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.783020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.783166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.783316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.783469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.783618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.783764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.783922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.784062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.784209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.784359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.784499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.784637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.784777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.784922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.785077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.785223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.785393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.785533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.785704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.785865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.786034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.786183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.786367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.786467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.786684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.786784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.787009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.787108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.787323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.787414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.787627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.787716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.787933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.788024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.788234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.788331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.788538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.788639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.788862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.789165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.789258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.789341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.789432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.789609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.789747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.789857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.790048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.790150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.790377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.790490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.790685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.790784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.790989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.791080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.791330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.791423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.791636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.791733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:45:56.791986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.792076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.792320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.792413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.792639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.792778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.792966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.793131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.793285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.793425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.793566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.793705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.793863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.794016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.794161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.794347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.794505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.794604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.794817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.794945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.795133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.795265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.795446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.795585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.795753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.795905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.796078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.796229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.796391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.796704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.796804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.797024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.797152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.797348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.797465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.797674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.797806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.797980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.798346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.798625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.798859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.798995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.799209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.799425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.799548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.799761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.799947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.800068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.800192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.800309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.800418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.800634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.800750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.800867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.801014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.801133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.801321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.801439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.801630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.801768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.801940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.802097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.802304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.802478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.802641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.802799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.802953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.803197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.803359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.803503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.803653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.803811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.803954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.804094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.804243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.804473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.804653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.804798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.804946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.805095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.805245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.805388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.805538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.805686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.805836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.805978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.806119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.806332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.806516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.806670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.806812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.806960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.807101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.807241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.807392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.807535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.807675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.808305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.808456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.808612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.808763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.808925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.809069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.809210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.809358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.809510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.809659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.809802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.809942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.810117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.810292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.810452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.810597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.810746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.810898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.811078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.811234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.811404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.811704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.811704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.812259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.812402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.812558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.812558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.812827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.812968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.813117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.813357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.813519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.813672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.813813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.813962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.814103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.814284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.814472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.814692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.814840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.814981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.815122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.815280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.815432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.815581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.815730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.815879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.816020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.816173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.816315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.816464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.816606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.816745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.816886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.817039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.817190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.817331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.817471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.817611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.817751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.817908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.818058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.818200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.818463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.818612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.818754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.818971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.819116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.819277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.819420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.819571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.819723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.819865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.820007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.820147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.820295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.820445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.820600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.820742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.820889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.821051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.821200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.821350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.821507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.821810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.821960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.822103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.822244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.822421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.822573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.822724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.822873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.823014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.823168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.823339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.824164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.824322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.824465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.824465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.824826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.824989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.825175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.825322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.825483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.825627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.825767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.825767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.826064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.826206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.826370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.826523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.826666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.826816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.826959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.827099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.827246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.827396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.827551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.827700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.827859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.828009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.828151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.828298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.828450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.828592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.828732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.828872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.829020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.829163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.829317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.829468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.829617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.829778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.829920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.830069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.830220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.830388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.830542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.830691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.830841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.830998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.831140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.831280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.831420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.831583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.831885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.832046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.832198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.832347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.832490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.832631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.832778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.832935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.833096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.833825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.833981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.833981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.834448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.834614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.834769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.835002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.835161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.835304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.835460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.835611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.835761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.835905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.836053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.836204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.836360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.836514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.836694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.836841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.836983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.837123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.837274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.837417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.837558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.837698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.837877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.838031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.838183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.838366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.838520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.838673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.838833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.839025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.839183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.839326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.839475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.839617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.839765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.839918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.840068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.840224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.840378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.840527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.840696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.840849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.841000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.841149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.841299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.841441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.841582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.841732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.842029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.842188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.842367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.842522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.842672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.842824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.842973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.843123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.843265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.843405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.843558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.843701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.843841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.843981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.844130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.844130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.844451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.844679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.844829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.844991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.845221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.845371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.845527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.845678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.845828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.845971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.846120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.846291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.846441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.846593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.846745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.846896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.847038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.847188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.847330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.847472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.847612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.847760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.847902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.848052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.848194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.848347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.848489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.848630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.848778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.849010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.849162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.849313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.849455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.849595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.849749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.849892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.850033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.850185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.850349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.850496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.850650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.850793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.850933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.851083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.851225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.851374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.851524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.851673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.851822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.852127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.852279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.852431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.852574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.852715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.852863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.852863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.853140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.853291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.853442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.853584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.853725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.853865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.854024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.854175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.854378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.854524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.854716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.854944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.855110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.856297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.856460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.856620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.856778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.856931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.857097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.857243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.857392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.857392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.857662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.857812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.857968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.858110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.858269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.858429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.858572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.858722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.858866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.859028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.859170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.859310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.859451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.859722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.859871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.860021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.860171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.860313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.860462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.860617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.860769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.860925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.861087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.861242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.861384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.861533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.861682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.861831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.861988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.862305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.862467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.862610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.862758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.862899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.863056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.863210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.863351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.863493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.863642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.863784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.863939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.864089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.864273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.864419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.864734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.864913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.865134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.865300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.865444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.865586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.865734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.865890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.866033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.866184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.866447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.866606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.866773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.866930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.867086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.867237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.867390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.867545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.867696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.867838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.867986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.868135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.868277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.868427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.868578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.868719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.868868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.869024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.869172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.869346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.869497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.869644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.869791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.869947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.870104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.870878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.871081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.871242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.871392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.871546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.871706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.871855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.872022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.872178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.872496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.872653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.872816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.872965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.873122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.873270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.873425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.873574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.873732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.873888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.874048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.874204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.874387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.874538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.874695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.874851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.875001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.875173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.875398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.875563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.875721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.875877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.876027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.876191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.876341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.876582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.876747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.876895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.877042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.877189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.877348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.877506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.877656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.877812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.878046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.878235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.878418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.878581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.878733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.878881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.878881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.879177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.879335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.879492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.879640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.879798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.879955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.880244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.880443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.880619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.880781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.880939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.881095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.881251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.881409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.881557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.881704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.881853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.882007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.882156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.882516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.882687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.882844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.883008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.883165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.883323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.883471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.883627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.883777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.883933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.884081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.884237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.884394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.884542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.884700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.884861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.885010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.885168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.885326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.885567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.885723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.885977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.886738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.886902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.887054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.887203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.887359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.887530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.887693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.887843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.887991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.888148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.888305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.888455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.888618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.888768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.888926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.889075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.889231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.889381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.889550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.889700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.889848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.890004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.890161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.890349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.890505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.890653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.890809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.890959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.891107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.891270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.891436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.891595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.891752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.891900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.892054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.892212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.892363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.892661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.892826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.892976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.893132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.893290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.893458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.893608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.893756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.893904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.894060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.894219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.894445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.894596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.894745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.894901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.895064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.895214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.895379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.895560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.895560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.896117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.896117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.896420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.896577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.896750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.896977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.897147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.897297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.897452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.897613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.897771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.897931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.898093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.898243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.898417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.898565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.898714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.898861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.899030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.899181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.899329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.899476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.899632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.899632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.899948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.900105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.900262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.900419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.900575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.900745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.900895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.901051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.901207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.901362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.901547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.901790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.901963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.902121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.902290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.902444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.902744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.902918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.903069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.903218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.903373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.903575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.903728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.903888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.904048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.904198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.904355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.904511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.904683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.904842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.904992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.905149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.905315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.905476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.905635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.905810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.906041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.906207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.906420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.906582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.906582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.906888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.906888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.907275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.907425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.907587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.907587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.907871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.908020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.908168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.908334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.908498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.908658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.908809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.908967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.909118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.909275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.909433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.909583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.909739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.909896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.910733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.911859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.913200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.914397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.914397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.914397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.914397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.914397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.915094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.915094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.915393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.915556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.915838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.916169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.916482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.916814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.917183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.917472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.917787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.918099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.918492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.918810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.919139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.919478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.919817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.920135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.920910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.920910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.921236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.921421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.921752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.922065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.922787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.922787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.923281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.923432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.923590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.923916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.924216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.924528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.924834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.925379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.925777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.925777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.926556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.926556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.926731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.927025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.927380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.927694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.928039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.928369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.928700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.929037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.929356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.929689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.930046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_db.sqlalchemy.engines [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:56.930578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.930578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.933967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.934604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.934604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.934604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.934921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.935244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.935574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.935900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.936254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.936530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.937094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.937424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.937875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.938103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.938593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.938901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.939208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.939375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.939696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.940051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.940336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.940704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.941030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.941347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.941748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.941976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.942319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.942721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.942987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.943265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.943651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.944027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.944195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.944512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.944834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.945163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.945505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.945867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.946151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.946500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.946828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.947389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.947714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.948059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.948486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.949814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.949814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.950149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.950457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.950730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.950885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.951167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.951484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.951796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.952126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.952446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.952837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.953096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.953400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.953966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.954405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.954643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.954978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.955312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.955655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.956014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.956277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.956592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.956906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.957230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.957549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.957859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.958172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.958516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.958834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.959183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.959486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.959765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.960097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.960469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.960765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.961030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.961349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.961663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.961976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.962377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.962699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.963023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.963336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.963653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.963993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.964637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.964937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.965259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.965577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.965911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.966230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.966567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.966907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.967305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.967545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.967867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.968186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.968545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.968873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.969438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.969830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.970160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.970585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.970893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.971209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.971526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.971841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.972171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.972490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.972808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.973128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.973447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.973762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.974081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.974443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.974745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.975062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.975383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.975732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.976058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.976445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.976704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.977030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.977348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.977667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.977984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.978423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.978653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.978992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.979314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.980145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.980584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.980916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.981230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.981556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.981871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.982202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.982580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.982898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.983227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.983544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.983880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.984231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.984566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.984902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.985216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.985530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.985843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.986158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.986588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.986862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.987186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.987515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.987834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.988163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.988480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.988809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.989139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.989464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.989780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.990118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.990473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.990879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.991189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.991430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.991747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.992062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.992395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.992727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.993041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.993376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.993701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.994298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.994478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.994805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.995010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.995952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.996280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.996599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.996919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.997350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.997566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.997901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.998239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.998646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.998933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:56.999291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:57.000167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:57.000167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:57.000496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:57.000657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:57.000905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:57.001281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:45:57.001818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 20:45:57.003560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.context [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=140731) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 20:45:57.014853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:57.016470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:57.017446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:57.021768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:57.028239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_db.sqlalchemy.engines [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:57.034795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_db.sqlalchemy.engines [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:57.036428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_db.sqlalchemy.engines [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:57.105583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.context [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=140732) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 20:45:57.110544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:57.112192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:57.113032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:45:57.115019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:45:57.126615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_db.sqlalchemy.engines [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:57.127630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_db.sqlalchemy.engines [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:57.201888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_db.sqlalchemy.engines [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:57.293957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_db.sqlalchemy.engines [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:45:57.534186 ncdv-master-1 devstack@n-api.service[140731]: WARNING keystonemiddleware.auth_token [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:45:57.540806 ncdv-master-1 devstack@n-api.service[140731]: WARNING keystonemiddleware.auth_token [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:45:57.621879 ncdv-master-1 devstack@n-api.service[140732]: WARNING keystonemiddleware.auth_token [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:45:57.628856 ncdv-master-1 devstack@n-api.service[140732]: WARNING keystonemiddleware.auth_token [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:45:57.884845 ncdv-master-1 devstack@n-api.service[140731]: WARNING keystonemiddleware.auth_token [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:45:57.890594 ncdv-master-1 devstack@n-api.service[140731]: WARNING keystonemiddleware.auth_token [None req-0b2dfbc1-8e04-4c44-b3ac-88675d31f4c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:45:57.896779 ncdv-master-1 devstack@n-api.service[140731]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb7da919c0 pid: 140731 (default app) Dec 18 20:45:57.969108 ncdv-master-1 devstack@n-api.service[140732]: WARNING keystonemiddleware.auth_token [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 20:45:57.974413 ncdv-master-1 devstack@n-api.service[140732]: WARNING keystonemiddleware.auth_token [None req-b54388a7-5087-4387-bb92-a20e668507fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 20:45:57.980602 ncdv-master-1 devstack@n-api.service[140732]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb7da919c0 pid: 140732 (default app) Dec 18 20:46:36.629083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e78983db-1c1e-4a63-af12-1925fbc3a2e6 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:36.631429 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:36.631429 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:36.632947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e78983db-1c1e-4a63-af12-1925fbc3a2e6 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:36.633404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e78983db-1c1e-4a63-af12-1925fbc3a2e6 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:36.634286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e78983db-1c1e-4a63-af12-1925fbc3a2e6 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:36.635330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e78983db-1c1e-4a63-af12-1925fbc3a2e6 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:36.676085 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e78983db-1c1e-4a63-af12-1925fbc3a2e6 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.314456 Dec 18 20:46:36.677010 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:46:35 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:36.689810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-88ed5b66-c003-411a-bf5c-a576db1d4d7b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-41562354"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:36.707859 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:36.707859 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:36.709366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.aggregate [None req-88ed5b66-c003-411a-bf5c-a576db1d4d7b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid f10eb079-e7ff-449d-83c2-a828ba86c6d0 for aggregate {{(pid=140731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:36.799825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-88ed5b66-c003-411a-bf5c-a576db1d4d7b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.113961 Dec 18 20:46:36.810737 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:36 2021] POST /compute/v2.1/os-aggregates => generated 196 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:46:36.812480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-88ed5b66-c003-411a-bf5c-a576db1d4d7b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:36.813780 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-88ed5b66-c003-411a-bf5c-a576db1d4d7b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001945 Dec 18 20:46:36.814776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3/3] 10.222.0.13 () {56 vars in 885 bytes} [Sat Dec 18 20:46:36 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 18 20:46:36.825109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12e4e1de-5080-4a14-9da1-7ac59aceb20d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:36.828361 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:36.828361 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:36.856062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12e4e1de-5080-4a14-9da1-7ac59aceb20d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:36.856524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12e4e1de-5080-4a14-9da1-7ac59aceb20d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:37.630616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Calling method '.version_select at 0x7f715e56ae50>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:37.634431 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:37.634431 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:37.641894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=140732) load_cells /opt/stack/nova/nova/compute/api.py:302}} Dec 18 20:46:37.642789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:37.643229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:37.673025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:37.673476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:37.688260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:37.689044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:37.698154 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ab5e791-f23b-4312-9cdc-b3ec483c5939 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.098905 Dec 18 20:46:37.698789 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1/4] 10.222.0.13 () {60 vars in 1207 bytes} [Sat Dec 18 20:46:36 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:46:37.722726 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12e4e1de-5080-4a14-9da1-7ac59aceb20d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 240 microversion: 2.1 time: 0.903762 Dec 18 20:46:37.724381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4/5] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:46:36 2021] POST /compute/v2.1/os-aggregates/1/action => generated 240 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:37.955921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c428211c-7053-4d85-9dae-d90df01c4d37 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715e436550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:37.957050 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:37.957050 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:37.959320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c428211c-7053-4d85-9dae-d90df01c4d37 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:37.959771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c428211c-7053-4d85-9dae-d90df01c4d37 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:37.960578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c428211c-7053-4d85-9dae-d90df01c4d37 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:37.961012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c428211c-7053-4d85-9dae-d90df01c4d37 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:37.963062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '.version_select at 0x7f715cb79ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:37.964088 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:37.964088 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:37.971197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=140731) load_cells /opt/stack/nova/nova/compute/api.py:302}} Dec 18 20:46:37.972400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:37.972987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:37.990720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:37.991416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:38.002648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:38.003175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:38.005188 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c428211c-7053-4d85-9dae-d90df01c4d37 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.305079 Dec 18 20:46:38.006088 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2/6] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:46:37 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:38.010392 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d1c4a8bd-d845-4a41-ba5e-1542786bce8d tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.284697 Dec 18 20:46:38.018727 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 5/7] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Dec 18 20:46:37 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:38.178589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8737d712-e279-4f30-84ed-607bb7ca061c tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-727900807", "id": 1667595971, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:38.211393 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:38.211393 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:38.261657 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8737d712-e279-4f30-84ed-607bb7ca061c tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.253731 Dec 18 20:46:38.262717 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3/8] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:38 2021] POST /compute/v2.1/flavors => generated 429 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:38.275983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad3e7153-8bfc-41e2-ac32-db05071c3c96 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:38.278715 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:38.278715 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:38.327944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad3e7153-8bfc-41e2-ac32-db05071c3c96 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:38.328588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad3e7153-8bfc-41e2-ac32-db05071c3c96 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:38.346912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-270185560", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:38.374843 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-ad3e7153-8bfc-41e2-ac32-db05071c3c96 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] HTTP exception thrown: Aggregate 1 already has host nch2-master-1. Dec 18 20:46:38.375492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad3e7153-8bfc-41e2-ac32-db05071c3c96 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 409 to user: Aggregate 1 already has host nch2-master-1. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:38.376452 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ad3e7153-8bfc-41e2-ac32-db05071c3c96 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.112200 Dec 18 20:46:38.380740 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4/9] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:46:38 2021] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Dec 18 20:46:38.386058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7be4188c-0d6b-4053-8f8a-6bd7b63f8449 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715db134c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:38.387775 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:38.387775 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:38.389393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7be4188c-0d6b-4053-8f8a-6bd7b63f8449 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:38.389848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7be4188c-0d6b-4053-8f8a-6bd7b63f8449 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:38.390822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7be4188c-0d6b-4053-8f8a-6bd7b63f8449 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:38.391262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7be4188c-0d6b-4053-8f8a-6bd7b63f8449 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:38.415754 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7be4188c-0d6b-4053-8f8a-6bd7b63f8449 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.033828 Dec 18 20:46:38.422800 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 5/10] 10.222.0.13 () {58 vars in 1138 bytes} [Sat Dec 18 20:46:38 2021] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:38.428040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0842472d-81fc-47fa-8f3d-9f21f9229163 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:38.428691 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:38.428691 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:38.457356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0842472d-81fc-47fa-8f3d-9f21f9229163 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1667595971" status: 202 len: 0 microversion: 2.1 time: 0.033574 Dec 18 20:46:38.458229 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:46:38 2021] DELETE /compute/v2.1/flavors/1667595971 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:38.468995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-984d1244-1fd8-464f-a0f8-3d996c715ffa tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:38.472457 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:38.472457 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:38.498533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-984d1244-1fd8-464f-a0f8-3d996c715ffa tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:38.507867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-984d1244-1fd8-464f-a0f8-3d996c715ffa tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:38.983456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:46:39.093747 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-984d1244-1fd8-464f-a0f8-3d996c715ffa tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 225 microversion: 2.1 time: 0.634135 Dec 18 20:46:39.095028 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 7/12] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:46:38 2021] POST /compute/v2.1/os-aggregates/1/action => generated 225 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.100480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3cb64cc4-6357-4f45-b812-0e2af93c39da tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715db36040>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.101939 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.101939 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.104177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cb64cc4-6357-4f45-b812-0e2af93c39da tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.104646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cb64cc4-6357-4f45-b812-0e2af93c39da tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.105642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cb64cc4-6357-4f45-b812-0e2af93c39da tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.106139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cb64cc4-6357-4f45-b812-0e2af93c39da tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.131341 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3cb64cc4-6357-4f45-b812-0e2af93c39da tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.034779 Dec 18 20:46:39.132166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 8/13] 10.222.0.13 () {58 vars in 1144 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:46:39.137243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e9f5260e-7aae-4298-aef0-11eea6b7e108 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.169139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e9f5260e-7aae-4298-aef0-11eea6b7e108 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035661 Dec 18 20:46:39.169901 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 9/14] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:39.173989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6353afed-4fb3-4e8b-910f-59770311d6d7 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.174736 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.174736 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.204891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6353afed-4fb3-4e8b-910f-59770311d6d7 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.034099 Dec 18 20:46:39.210097 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 10/15] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:39 2021] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:46:39.357953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a0dbbdf1-ed18-47cd-a58d-9785ab3ffd00 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.359951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0dbbdf1-ed18-47cd-a58d-9785ab3ffd00 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.360615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0dbbdf1-ed18-47cd-a58d-9785ab3ffd00 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.361534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0dbbdf1-ed18-47cd-a58d-9785ab3ffd00 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.362090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0dbbdf1-ed18-47cd-a58d-9785ab3ffd00 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.391817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a0dbbdf1-ed18-47cd-a58d-9785ab3ffd00 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.180608 Dec 18 20:46:39.393040 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 11/16] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:46:39.397550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c7c6894-8ddd-4f08-aa16-a9751300285d tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1671027448", "id": 272356836, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:39.400138 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.400138 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.418765 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c7c6894-8ddd-4f08-aa16-a9751300285d tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.024429 Dec 18 20:46:39.419477 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 12/17] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:39 2021] POST /compute/v2.1/flavors => generated 414 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.428540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8966fa6a-d4bc-4ebe-ba55-8adc7f76e59f tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-220251270"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:39.430560 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.430560 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.432332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-8966fa6a-d4bc-4ebe-ba55-8adc7f76e59f tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid 95faa829-9df1-4656-a11b-40123dac78d7 for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:39.437487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:46:39.437911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:46:39.438411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:46:39.438838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:46:39.439646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:46:39.454912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.455358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.456336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.456917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.471309 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8966fa6a-d4bc-4ebe-ba55-8adc7f76e59f tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047265 Dec 18 20:46:39.472036 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 13/18] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:39 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.486139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c660b39d-d299-46df-998d-77e11d579bdf tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715db36550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.487663 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.487663 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.489678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660b39d-d299-46df-998d-77e11d579bdf tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.490123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660b39d-d299-46df-998d-77e11d579bdf tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.491155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660b39d-d299-46df-998d-77e11d579bdf tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.491780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660b39d-d299-46df-998d-77e11d579bdf tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.499422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Getting quotas for project fd46334a58394a98a92a0d9dbcfcfe59. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:39.506575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Getting quotas for user 38872124d18947de9ea12c83e207715e and project fd46334a58394a98a92a0d9dbcfcfe59. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:39.517758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c660b39d-d299-46df-998d-77e11d579bdf tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.038658 Dec 18 20:46:39.518468 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 14/19] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.520482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:46:39.523474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-347c05e2-10c8-4436-a38b-1d6e35fa8ae3 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.524357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:46:39.524554 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.524554 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.525964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-347c05e2-10c8-4436-a38b-1d6e35fa8ae3 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.526480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-347c05e2-10c8-4436-a38b-1d6e35fa8ae3 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.527316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-347c05e2-10c8-4436-a38b-1d6e35fa8ae3 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.527731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-347c05e2-10c8-4436-a38b-1d6e35fa8ae3 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.550030 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-347c05e2-10c8-4436-a38b-1d6e35fa8ae3 tempest-AZAdminV2TestJSON-194360838 tempest-AZAdminV2TestJSON-194360838-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.030375 Dec 18 20:46:39.550797 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 15/20] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.555714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7dc07ad4-9daf-4446-92de-05c5b7975817 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.580499 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7dc07ad4-9daf-4446-92de-05c5b7975817 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.028215 Dec 18 20:46:39.580923 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 16/21] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:39.594491 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60226d08-2413-4599-85af-6aa17ee9ff13 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574779 Dec 18 20:46:39.600704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 6/22] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:46:39.604284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-849d24a4-fd62-44f7-92b5-c4301c5fd5a6 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715cb3e790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.605969 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.605969 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:39.607991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-849d24a4-fd62-44f7-92b5-c4301c5fd5a6 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.608476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-849d24a4-fd62-44f7-92b5-c4301c5fd5a6 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.609423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-849d24a4-fd62-44f7-92b5-c4301c5fd5a6 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.609874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-849d24a4-fd62-44f7-92b5-c4301c5fd5a6 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.637563 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-849d24a4-fd62-44f7-92b5-c4301c5fd5a6 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.037756 Dec 18 20:46:39.638154 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 7/23] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.660319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25c35001-d488-46c1-ad59-7deb6165c278 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.661846 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.661846 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:39.702073 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25c35001-d488-46c1-ad59-7deb6165c278 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/272356836" status: 202 len: 0 microversion: 2.1 time: 0.062045 Dec 18 20:46:39.703583 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 8/24] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:46:39 2021] DELETE /compute/v2.1/flavors/272356836 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:39.709936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-313242be-dd66-4990-a420-4148e84c10a4 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.710938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-313242be-dd66-4990-a420-4148e84c10a4 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:39.795365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-313242be-dd66-4990-a420-4148e84c10a4 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:39.809476 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-313242be-dd66-4990-a420-4148e84c10a4 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1219 microversion: 2.1 time: 0.104351 Dec 18 20:46:39.810279 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 9/25] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:39.815100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-28b5c230-fa8e-42bf-9c06-8b76dc7eb43d tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715ca7fe50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.816427 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.816427 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:39.818185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b5c230-fa8e-42bf-9c06-8b76dc7eb43d tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.818813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b5c230-fa8e-42bf-9c06-8b76dc7eb43d tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.819823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b5c230-fa8e-42bf-9c06-8b76dc7eb43d tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.820415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b5c230-fa8e-42bf-9c06-8b76dc7eb43d tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.825940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3d50c75-0004-4bae-a772-8bdf0213e4c5 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:39.827805 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.827805 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.829130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3d50c75-0004-4bae-a772-8bdf0213e4c5 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9a188df8ed504951b850b40842ffbe73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38480e435834a8cb37eacd183315171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:39.829986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3d50c75-0004-4bae-a772-8bdf0213e4c5 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:39.831228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3d50c75-0004-4bae-a772-8bdf0213e4c5 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.249384 Dec 18 20:46:39.832129 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 17/26] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:46:39 2021] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 251 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:39.838104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af591479-c7a3-4e1e-bfd3-5a1b105f4283 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1443061686"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:39.840368 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.840368 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.842580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-af591479-c7a3-4e1e-bfd3-5a1b105f4283 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Generated uuid 565e25ed-3c13-4070-acd5-8bc7ddf2ec26 for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:39.855130 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-28b5c230-fa8e-42bf-9c06-8b76dc7eb43d tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.042919 Dec 18 20:46:39.856877 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 10/27] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.862439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a2f585d6-2b03-47d7-bacb-945e63b8bb59 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.876406 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af591479-c7a3-4e1e-bfd3-5a1b105f4283 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.042120 Dec 18 20:46:39.883740 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 18/28] 10.222.0.13 () {62 vars in 1204 bytes} [Sat Dec 18 20:46:39 2021] POST /compute/v2.1/os-aggregates => generated 246 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:46:39.890187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2cf339ec-7e6b-407c-90b4-037193193b53 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.891393 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.891393 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:39.892597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a2f585d6-2b03-47d7-bacb-945e63b8bb59 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034264 Dec 18 20:46:39.898382 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 11/29] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:39.905947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1621324f-7c9a-4942-b29f-6099b6d975f9 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715ca0faf0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:39.907292 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.907292 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:39.924966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1621324f-7c9a-4942-b29f-6099b6d975f9 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.925462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1621324f-7c9a-4942-b29f-6099b6d975f9 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.940649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1621324f-7c9a-4942-b29f-6099b6d975f9 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:39.941035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1621324f-7c9a-4942-b29f-6099b6d975f9 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:39.943230 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2cf339ec-7e6b-407c-90b4-037193193b53 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.057793 Dec 18 20:46:39.944295 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 19/30] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:39 2021] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:46:39.951453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d59a265a-f632-41f2-aee2-f86f8c7abeb4 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1716872789"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:39.979863 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1621324f-7c9a-4942-b29f-6099b6d975f9 tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 332 microversion: 2.1 time: 0.079808 Dec 18 20:46:39.980982 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 12/31] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 20:46:39 2021] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 332 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:39.990204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-464e5f84-764a-4651-805f-f0483df22242 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-728481624", "id": 427308824, "os-flavor-access:is_public": "True"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:39.992545 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:39.992545 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:40.024545 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-464e5f84-764a-4651-805f-f0483df22242 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.042204 Dec 18 20:46:40.025677 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 13/32] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:39 2021] POST /compute/v2.1/flavors => generated 425 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.036926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d521740-1f9c-49fb-b11e-2f9866755e0e tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-266697487"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.038285 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.038285 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:40.039692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.aggregate [None req-3d521740-1f9c-49fb-b11e-2f9866755e0e tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid a25b695f-993d-4c54-b8ef-cbca424dd50a for aggregate {{(pid=140731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:40.050818 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.050818 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.073432 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d521740-1f9c-49fb-b11e-2f9866755e0e tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040879 Dec 18 20:46:40.081019 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 14/33] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.086414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0cf28004-7507-46fd-9b44-d4be09ac18ec tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Calling method '.version_select at 0x7f715c9f0ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.087793 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.087793 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:40.096933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf28004-7507-46fd-9b44-d4be09ac18ec tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:40.097543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf28004-7507-46fd-9b44-d4be09ac18ec tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:40.106768 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d59a265a-f632-41f2-aee2-f86f8c7abeb4 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.160657 Dec 18 20:46:40.107359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 20/34] 10.222.0.13 () {62 vars in 1209 bytes} [Sat Dec 18 20:46:39 2021] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:46:40.118398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf28004-7507-46fd-9b44-d4be09ac18ec tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:40.119021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf28004-7507-46fd-9b44-d4be09ac18ec tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:40.119297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d57aa3bc-584e-49bf-924a-47eb8b0b3334 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.120060 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.120060 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.130516 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0cf28004-7507-46fd-9b44-d4be09ac18ec tempest-HostsAdminTestJSON-680928417 tempest-HostsAdminTestJSON-680928417-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 332 microversion: 2.1 time: 0.048203 Dec 18 20:46:40.136898 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 15/35] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 20:46:40 2021] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 332 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.148707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1372726378"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.149517 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.149517 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:40.153030 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d57aa3bc-584e-49bf-924a-47eb8b0b3334 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/427308824" status: 202 len: 0 microversion: 2.1 time: 0.037169 Dec 18 20:46:40.154419 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 21/36] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/flavors/427308824 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:40.158837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b0dc14cb-7370-4528-90aa-c71850c6aff3 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.159598 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.159598 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.167788 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b0dc14cb-7370-4528-90aa-c71850c6aff3 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.012329 Dec 18 20:46:40.168359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 22/37] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Dec 18 20:46:40 2021] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:46:40.172038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:40.172504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:40.185354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75205f4e-9ef8-4df8-b690-b8b9bcaf8860 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.189812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:40.190732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:40.207723 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1372726378 could not be found. Dec 18 20:46:40.209749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1372726378 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:40.209749 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25cd60e1-b51a-486d-81f9-28d036960ead tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.076176 Dec 18 20:46:40.210719 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 16/38] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:40.217905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-327e358b-4c5d-4d38-8eb5-257e76a1e56e tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.233839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75205f4e-9ef8-4df8-b690-b8b9bcaf8860 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051745 Dec 18 20:46:40.233924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-327e358b-4c5d-4d38-8eb5-257e76a1e56e tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:40.234361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-327e358b-4c5d-4d38-8eb5-257e76a1e56e tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:40.246920 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 23/39] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:40 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:40.246920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6f29454-5210-4ba9-afea-f993c968f401 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.246920 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.246920 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.287524 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c6f29454-5210-4ba9-afea-f993c968f401 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.049631 Dec 18 20:46:40.293515 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 24/40] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:46:40.301668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a4ca490-2bd4-4bac-8486-3b65dcf3eb55 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-79166281", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.303233 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.303233 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.339130 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a4ca490-2bd4-4bac-8486-3b65dcf3eb55 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.044516 Dec 18 20:46:40.340049 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 25/41] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/flavors => generated 505 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.348607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ebe156d-e1f1-4423-859a-8ab4aa38109b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.349779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ebe156d-e1f1-4423-859a-8ab4aa38109b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:40.350617 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ebe156d-e1f1-4423-859a-8ab4aa38109b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009637 Dec 18 20:46:40.355354 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 26/42] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:46:40.362515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85e5fa08-a70d-4e89-90b8-a5afd75fad6e tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.363361 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.363361 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.413172 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85e5fa08-a70d-4e89-90b8-a5afd75fad6e tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/a631291b-4c08-482c-8e19-00a750b74ed6" status: 202 len: 0 microversion: 2.1 time: 0.056562 Dec 18 20:46:40.413973 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 27/43] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/flavors/a631291b-4c08-482c-8e19-00a750b74ed6 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:40.421474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e28266a-2679-4f32-ab22-82db8eb49d5b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.422902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e28266a-2679-4f32-ab22-82db8eb49d5b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:40.427211 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e28266a-2679-4f32-ab22-82db8eb49d5b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008707 Dec 18 20:46:40.428037 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 28/44] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:46:40.439255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49122398-33ee-45a2-9230-86df74cb8d97 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.441961 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-327e358b-4c5d-4d38-8eb5-257e76a1e56e tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.230174 Dec 18 20:46:40.443000 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 17/45] 10.222.0.13 () {62 vars in 1231 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:46:40.451487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-299c895d-a0b9-4744-9f9a-b399e1587965 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1126583924"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.452941 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.452941 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:40.457954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-299c895d-a0b9-4744-9f9a-b399e1587965 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9a188df8ed504951b850b40842ffbe73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38480e435834a8cb37eacd183315171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:40.460275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-299c895d-a0b9-4744-9f9a-b399e1587965 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:40.461044 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-299c895d-a0b9-4744-9f9a-b399e1587965 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.017128 Dec 18 20:46:40.464877 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 18/46] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:40.483544 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49122398-33ee-45a2-9230-86df74cb8d97 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054252 Dec 18 20:46:40.487916 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 29/47] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:40 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:40.494784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f547a3c1-00d6-4b95-88e7-8e2797c31c0b tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.496428 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.496428 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:40.502355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49cca483-215a-4bb3-a55a-f54b90176baf tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-326494418"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.510579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f547a3c1-00d6-4b95-88e7-8e2797c31c0b tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:40.510984 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.510984 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.511734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f547a3c1-00d6-4b95-88e7-8e2797c31c0b tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:40.516097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-49cca483-215a-4bb3-a55a-f54b90176baf tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid a226c5c6-903e-489b-825f-9d5a662db5e1 for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:40.563032 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49cca483-215a-4bb3-a55a-f54b90176baf tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.073900 Dec 18 20:46:40.570396 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 30/48] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.582642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dde12b6c-53d4-46f8-8dca-063bd32c3abf tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1145265478", "id": "0791a4ef-4fc6-439b-b51e-f26a39dedc91", "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.586708 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.586708 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.626284 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dde12b6c-53d4-46f8-8dca-063bd32c3abf tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.053392 Dec 18 20:46:40.632891 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 31/49] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/flavors => generated 507 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.634957 ncdv-master-1 devstack@n-api.service[140731]: WARNING nova.scheduler.client.report [None req-f547a3c1-00d6-4b95-88e7-8e2797c31c0b tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] [req-19306ca3-76d7-416c-95a3-7cd6c4e06482] Failed to update aggregates to [] for resource provider with UUID 6d305bf8-321e-47f1-a7eb-ce11fbc23fa3. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-19306ca3-76d7-416c-95a3-7cd6c4e06482"}]} Dec 18 20:46:40.642403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-593faba2-8934-4846-bc34-bbd1f2b88e9d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-326494418"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.643732 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.643732 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.644949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-593faba2-8934-4846-bc34-bbd1f2b88e9d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid ce7c0f6d-f1f0-4f85-9f14-746480dc7236 for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:40.670946 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-593faba2-8934-4846-bc34-bbd1f2b88e9d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-326494418 already exists. Dec 18 20:46:40.671752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-593faba2-8934-4846-bc34-bbd1f2b88e9d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-326494418 already exists. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:40.673159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-593faba2-8934-4846-bc34-bbd1f2b88e9d tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.037450 Dec 18 20:46:40.681506 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 32/50] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates => generated 110 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:46:40.687924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66c55eeb-df32-4481-9947-c13f88ea2602 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.688888 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.688888 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.709251 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66c55eeb-df32-4481-9947-c13f88ea2602 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/0791a4ef-4fc6-439b-b51e-f26a39dedc91" status: 202 len: 0 microversion: 2.1 time: 0.025995 Dec 18 20:46:40.720218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 33/51] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/flavors/0791a4ef-4fc6-439b-b51e-f26a39dedc91 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:40.729952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a20a7149-b684-4411-b81c-9004f1887466 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.730858 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.730858 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.780805 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a20a7149-b684-4411-b81c-9004f1887466 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.059299 Dec 18 20:46:40.781399 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 34/52] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:46:40.793643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16251004-d8e7-45f4-b24a-e638b220b6d5 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.794120 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f547a3c1-00d6-4b95-88e7-8e2797c31c0b tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.327689 Dec 18 20:46:40.794738 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 19/53] 10.222.0.13 () {62 vars in 1231 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:46:40.804343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-94915f0f-4d30-4205-85b4-67a6b9230827 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1960183052"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.805610 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.805610 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:40.814509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.aggregate [None req-94915f0f-4d30-4205-85b4-67a6b9230827 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid c8d18102-52e4-4c3c-afc2-9a2fb521defd for aggregate {{(pid=140731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:40.833595 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-16251004-d8e7-45f4-b24a-e638b220b6d5 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049120 Dec 18 20:46:40.834196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 35/54] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:40 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:40.840280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-941bbe20-9731-4b88-b84c-c88527884da4 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.841049 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.841049 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.868153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-94915f0f-4d30-4205-85b4-67a6b9230827 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065759 Dec 18 20:46:40.879167 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 20/55] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.884695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6b423ed-776a-4f56-8671-61be2abc0e05 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.885110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6b423ed-776a-4f56-8671-61be2abc0e05 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:40.893412 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-941bbe20-9731-4b88-b84c-c88527884da4 tempest-AggregatesAdminTestV241-1196534653 tempest-AggregatesAdminTestV241-1196534653-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.057570 Dec 18 20:46:40.894008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 36/56] 10.222.0.13 () {60 vars in 1192 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.900210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e12c05a2-4210-4c32-b881-6c6a8373a0ac tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1107085554", "id": 321530029, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:40.901928 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.901928 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.940336 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e12c05a2-4210-4c32-b881-6c6a8373a0ac tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044952 Dec 18 20:46:40.946526 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 37/57] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:40 2021] POST /compute/v2.1/flavors => generated 411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.952268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9cb749f2-f708-455e-b078-b411e1df281c tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.953213 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:40.953213 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:40.955037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9cb749f2-f708-455e-b078-b411e1df281c tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9a188df8ed504951b850b40842ffbe73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38480e435834a8cb37eacd183315171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:40.955898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9cb749f2-f708-455e-b078-b411e1df281c tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:40.956914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9cb749f2-f708-455e-b078-b411e1df281c tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.008776 Dec 18 20:46:40.957596 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 38/58] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:40.966223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb0d35b4-c156-4703-9cf5-e0fcc9a98493 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:40.981109 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb0d35b4-c156-4703-9cf5-e0fcc9a98493 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/321530029" status: 200 len: 411 microversion: 2.1 time: 0.018638 Dec 18 20:46:40.982121 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 39/59] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:46:40 2021] GET /compute/v2.1/flavors/321530029 => generated 411 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:40.989557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c6b423ed-776a-4f56-8671-61be2abc0e05 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:40.992054 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6b423ed-776a-4f56-8671-61be2abc0e05 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1219 microversion: 2.1 time: 0.111663 Dec 18 20:46:41.002851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7823e1cd-184f-46ad-a2ac-8bd842f9b575 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.005009 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 21/60] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:40 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:41.010299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6eccedb-8296-4e35-9a8a-8ad25446a89c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1854400554", "name": "tempest-test_aggregate-1610921224"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:41.040653 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.040653 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.046149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.aggregate [None req-e6eccedb-8296-4e35-9a8a-8ad25446a89c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid f2604598-c418-48d5-890a-76ef6635b7a5 for aggregate {{(pid=140731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:41.047323 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7823e1cd-184f-46ad-a2ac-8bd842f9b575 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.053525 Dec 18 20:46:41.047902 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 40/61] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:40 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:46:41.098815 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6eccedb-8296-4e35-9a8a-8ad25446a89c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.092479 Dec 18 20:46:41.102114 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 22/62] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Dec 18 20:46:41 2021] POST /compute/v2.1/os-aggregates => generated 222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:41.108112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ec29102-93e2-425d-8efa-49af2d099083 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.108891 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.108891 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.120658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-3ec29102-93e2-425d-8efa-49af2d099083 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Dec 18 20:46:41.121274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ec29102-93e2-425d-8efa-49af2d099083 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:41.122069 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3ec29102-93e2-425d-8efa-49af2d099083 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.019111 Dec 18 20:46:41.126976 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 23/63] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:46:41 2021] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:46:41.132281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c583c89-36f1-4e76-af20-729721c53441 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.133144 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.133144 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.145296 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c583c89-36f1-4e76-af20-729721c53441 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.018469 Dec 18 20:46:41.151814 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 24/64] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/os-aggregates => generated 303 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:41.151814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e45bd99-2a57-4e2c-9329-f67e33a0bb9c tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-116696137"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:41.152798 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.152798 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.154030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.aggregate [None req-9e45bd99-2a57-4e2c-9329-f67e33a0bb9c tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid e7990b93-595e-46c1-abc6-76abf947888d for aggregate {{(pid=140731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:46:41.182616 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e45bd99-2a57-4e2c-9329-f67e33a0bb9c tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.034652 Dec 18 20:46:41.183381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 25/65] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:46:41 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:41.191020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ada4185-e149-4016-8eb8-fbf4f95bf1b8 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:41.192642 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.192642 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.204143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ada4185-e149-4016-8eb8-fbf4f95bf1b8 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:41.204811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ada4185-e149-4016-8eb8-fbf4f95bf1b8 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:41.393911 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ada4185-e149-4016-8eb8-fbf4f95bf1b8 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 315 microversion: 2.1 time: 0.208715 Dec 18 20:46:41.394699 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 26/66] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:46:41 2021] POST /compute/v2.1/os-aggregates/7/action => generated 315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:41.399239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b8e5dac8-574a-4644-8e9f-40f25d841f21 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.400687 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.400687 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.401748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b8e5dac8-574a-4644-8e9f-40f25d841f21 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9a188df8ed504951b850b40842ffbe73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38480e435834a8cb37eacd183315171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:41.402437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b8e5dac8-574a-4644-8e9f-40f25d841f21 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:41.403301 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b8e5dac8-574a-4644-8e9f-40f25d841f21 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.007425 Dec 18 20:46:41.403725 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 27/67] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:41.413354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c370236-a273-4fbd-bce4-b8b0cbe121ce tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.414563 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.414563 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.474566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c370236-a273-4fbd-bce4-b8b0cbe121ce tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.064426 Dec 18 20:46:41.479136 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 28/68] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:41 2021] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:46:41.484093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-511619a9-a992-449a-9231-32a79775b8db tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.484860 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.484860 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.493467 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-511619a9-a992-449a-9231-32a79775b8db tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Dec 18 20:46:41.494051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-511619a9-a992-449a-9231-32a79775b8db tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:41.494907 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-511619a9-a992-449a-9231-32a79775b8db tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.014618 Dec 18 20:46:41.498299 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 29/69] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 18 20:46:41.514810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b184ea88-a19a-4c13-a91a-a3bcccdb53b2 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.515576 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.515576 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.517121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b184ea88-a19a-4c13-a91a-a3bcccdb53b2 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9a188df8ed504951b850b40842ffbe73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38480e435834a8cb37eacd183315171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:41.517834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b184ea88-a19a-4c13-a91a-a3bcccdb53b2 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:41.519291 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b184ea88-a19a-4c13-a91a-a3bcccdb53b2 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009204 Dec 18 20:46:41.519834 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 30/70] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/os-aggregates => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:41.585440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c3eec6b-6233-4de0-854e-4338f649db4f tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.627002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c3eec6b-6233-4de0-854e-4338f649db4f tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.578051 Dec 18 20:46:41.628294 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 41/71] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:41.644828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e6e313a-a9c7-4ffc-b34a-a083b03a5822 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.645724 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.645724 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:41.672656 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e6e313a-a9c7-4ffc-b34a-a083b03a5822 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/321530029" status: 202 len: 0 microversion: 2.1 time: 0.032357 Dec 18 20:46:41.673248 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 31/72] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:46:41 2021] DELETE /compute/v2.1/flavors/321530029 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:41.682680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-347f937c-ee7b-486b-a116-e8a2b2c9afb7 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.710293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-347f937c-ee7b-486b-a116-e8a2b2c9afb7 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032060 Dec 18 20:46:41.711195 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 42/73] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:41.744377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-436e8321-b75d-4fdb-a313-cb61bcbcce21 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1580050991", "id": 1369175329, "os-flavor-access:is_public": "False"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:41.746411 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.746411 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:41.774383 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-436e8321-b75d-4fdb-a313-cb61bcbcce21 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.043520 Dec 18 20:46:41.775524 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 43/74] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:41 2021] POST /compute/v2.1/flavors => generated 430 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:41.786569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6d5f9e8-2b04-48f6-8b42-a0aa49102dfa tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "1369175329"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:41.809148 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f6d5f9e8-2b04-48f6-8b42-a0aa49102dfa tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] HTTP exception thrown: Flavor 1369175329 could not be found. Dec 18 20:46:41.810414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6d5f9e8-2b04-48f6-8b42-a0aa49102dfa tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] Returning 400 to user: Flavor 1369175329 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:41.811914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f6d5f9e8-2b04-48f6-8b42-a0aa49102dfa tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.029887 Dec 18 20:46:41.813290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 44/75] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:41 2021] POST /compute/v2.1/servers => generated 81 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:41.824729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c9373ba-8ca1-462e-81fe-4e2b5578e408 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.825997 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:41.825997 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:41.853166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c9373ba-8ca1-462e-81fe-4e2b5578e408 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1369175329" status: 202 len: 0 microversion: 2.1 time: 0.035569 Dec 18 20:46:41.854654 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 45/76] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:46:41 2021] DELETE /compute/v2.1/flavors/1369175329 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:41.863277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf5bb847-20f4-4aaf-bad8-489c583beb48 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:41.900934 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf5bb847-20f4-4aaf-bad8-489c583beb48 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041719 Dec 18 20:46:41.901961 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 46/77] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:41.921038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-55219db0-53f1-4d15-b2b6-ea757526a474 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-967423956", "id": 60481676, "os-flavor-access:is_public": "False"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:41.945098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-55219db0-53f1-4d15-b2b6-ea757526a474 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.029949 Dec 18 20:46:41.946000 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 47/78] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:41 2021] POST /compute/v2.1/flavors => generated 408 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:42.106938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76f18af4-2b45-49e6-aa86-db48f62de44a tempest-InstanceUsageAuditLogNegativeTestJSON-265895576 tempest-InstanceUsageAuditLogNegativeTestJSON-265895576-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.107711 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:42.107711 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:42.110469 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-76f18af4-2b45-49e6-aa86-db48f62de44a tempest-InstanceUsageAuditLogNegativeTestJSON-265895576 tempest-InstanceUsageAuditLogNegativeTestJSON-265895576-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Dec 18 20:46:42.111042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76f18af4-2b45-49e6-aa86-db48f62de44a tempest-InstanceUsageAuditLogNegativeTestJSON-265895576 tempest-InstanceUsageAuditLogNegativeTestJSON-265895576-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:42.111842 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76f18af4-2b45-49e6-aa86-db48f62de44a tempest-InstanceUsageAuditLogNegativeTestJSON-265895576 tempest-InstanceUsageAuditLogNegativeTestJSON-265895576-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.380984 Dec 18 20:46:42.114421 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 32/79] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:41 2021] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 382 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:42.116490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3091cf6-6376-4461-8270-e60fa383458f tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-382746053", "id": 1862946506, "os-flavor-access:is_public": "True"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:42.117932 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:42.117932 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:42.134950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3091cf6-6376-4461-8270-e60fa383458f tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.020876 Dec 18 20:46:42.135932 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 33/80] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:42 2021] POST /compute/v2.1/flavors => generated 413 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:42.146306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.147020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:42.155115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:42.159488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:42.160731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:42.161255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:42.292888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-498825273", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "availability_zone": "tempest-test_az-1854400554"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:42.304754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:42.305328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:42.307068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:42.307696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:42.375195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:42.403216 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f69486de-0f7d-4766-a132-9d8846e1ce57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1293 microversion: 2.1 time: 0.261181 Dec 18 20:46:42.403828 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 34/81] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1293 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:42.760592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c6b1aef-7e8f-41b3-860e-6f7185b1660a tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.761800 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:42.761800 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:42.764492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0c6b1aef-7e8f-41b3-860e-6f7185b1660a tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3f837d6a45324047b431286734ff9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76f59e79d2644fdb8fdecb14f0a06cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:42.765430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c6b1aef-7e8f-41b3-860e-6f7185b1660a tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:42.766669 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c6b1aef-7e8f-41b3-860e-6f7185b1660a tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.361874 Dec 18 20:46:42.767807 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 35/82] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 363 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:42.774201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9289b8ca-bef6-49c0-84ce-0a684e8e1030 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.798615 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9289b8ca-bef6-49c0-84ce-0a684e8e1030 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 411 microversion: 2.1 time: 0.028456 Dec 18 20:46:42.799539 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 36/83] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/flavors/detail?is_public=f => generated 411 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:42.809820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2778459f-c487-47c9-9d4a-6b46cf8e5a27 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.811288 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:42.811288 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:42.813369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2778459f-c487-47c9-9d4a-6b46cf8e5a27 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3f837d6a45324047b431286734ff9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76f59e79d2644fdb8fdecb14f0a06cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:42.820449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2778459f-c487-47c9-9d4a-6b46cf8e5a27 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:42.823240 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2778459f-c487-47c9-9d4a-6b46cf8e5a27 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076 tempest-InstanceUsageAuditLogNegativeTestJSON-2051173076-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2021-12-18 20:46:42" status: 403 len: 128 microversion: 2.1 time: 0.022237 Dec 18 20:46:42.824124 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 37/84] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-12-18%2020%3A46%3A42 => generated 128 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:42.829635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd0c7741-baef-45c0-ba4a-012bd52dc39f tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.841538 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd0c7741-baef-45c0-ba4a-012bd52dc39f tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 411 microversion: 2.1 time: 0.016090 Dec 18 20:46:42.842621 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 38/85] 10.222.0.13 () {58 vars in 1176 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/flavors/detail?is_public=false => generated 411 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:42.849554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:46:42.855114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25f8b886-8c1a-4d59-80a8-32ad861e552c tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.877627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25f8b886-8c1a-4d59-80a8-32ad861e552c tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 411 microversion: 2.1 time: 0.027881 Dec 18 20:46:42.878678 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 39/86] 10.222.0.13 () {58 vars in 1170 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/flavors/detail?is_public=no => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:46:42.890551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce953b09-ed45-47da-80c6-e1371feef921 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.900474 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce953b09-ed45-47da-80c6-e1371feef921 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 411 microversion: 2.1 time: 0.013462 Dec 18 20:46:42.901357 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 40/87] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/flavors/detail?is_public=0 => generated 411 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:42.913817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7120e3c2-8ff0-4ac1-87ba-0340912c1f98 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.941955 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7120e3c2-8ff0-4ac1-87ba-0340912c1f98 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.033881 Dec 18 20:46:42.943122 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 41/88] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:42.960899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9de0616a-9cca-4125-a17d-0daf3245cb66 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:42.982795 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9de0616a-9cca-4125-a17d-0daf3245cb66 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.025615 Dec 18 20:46:42.983779 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 42/89] 10.222.0.13 () {58 vars in 1174 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:42.999527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6ce6552-1440-49c7-b44a-50e6621505ff tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.061526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6ce6552-1440-49c7-b44a-50e6621505ff tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.064381 Dec 18 20:46:43.063502 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 43/90] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Dec 18 20:46:42 2021] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:43.079112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cbd0bda9-52e1-420f-b557-1ab9ed995648 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.100088 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cbd0bda9-52e1-420f-b557-1ab9ed995648 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.024431 Dec 18 20:46:43.106535 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 44/91] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:43.121843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e27d5c95-57d1-436f-b552-71ffe9460a28 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.126897 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:43.126897 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:43.145610 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e27d5c95-57d1-436f-b552-71ffe9460a28 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1862946506" status: 202 len: 0 microversion: 2.1 time: 0.032786 Dec 18 20:46:43.146808 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:46:43 2021] DELETE /compute/v2.1/flavors/1862946506 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:43.151948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:46:43.152376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:46:43.152850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:46:43.153259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:46:43.153666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:46:43.154796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fb22d57-e6ca-4444-8f5c-08bffd3a756a tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.169151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:43.169806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:43.171269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:43.172323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:43.177931 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fb22d57-e6ca-4444-8f5c-08bffd3a756a tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026632 Dec 18 20:46:43.178558 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 46/93] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:43.193232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-89761a4f-3806-4d05-844b-fec7cae45928 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.206321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Getting quotas for project 6cbee547725d4a06ad0a4be9314d8d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:43.211461 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-89761a4f-3806-4d05-844b-fec7cae45928 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/60481676" status: 202 len: 0 microversion: 2.1 time: 0.021544 Dec 18 20:46:43.214587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Getting quotas for user da04cb8260ca46fb8738fdfd071158f9 and project 6cbee547725d4a06ad0a4be9314d8d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:43.215858 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 47/94] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:46:43 2021] DELETE /compute/v2.1/flavors/60481676 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:46:43.222452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-839eea7d-8029-4183-b604-399db5da201b tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.230124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:46:43.234502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:46:43.252993 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-839eea7d-8029-4183-b604-399db5da201b tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035916 Dec 18 20:46:43.267485 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 48/95] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:43.273556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db2ebe9b-3672-48fb-8352-ce1b056d192e tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-322461063", "id": 1987152472, "os-flavor-access:is_public": "False"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:43.275744 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:43.275744 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:43.298285 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db2ebe9b-3672-48fb-8352-ce1b056d192e tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029504 Dec 18 20:46:43.299657 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 49/96] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:43 2021] POST /compute/v2.1/flavors => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:43.318906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b523b5ca-fd52-4742-bf6b-869f26c48a61 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.337269 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b523b5ca-fd52-4742-bf6b-869f26c48a61 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021756 Dec 18 20:46:43.338209 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 50/97] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:43.348933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6a0fb4e2-5302-40b3-a759-953f6c3d0862 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396628 Dec 18 20:46:43.354394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d9a9b903-3fb1-46fa-9fcc-39320e6b2baa tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.354890 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 48/98] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:46:43.360248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34fc0fe7-bbb4-43ee-bf26-db27476bbc0d tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.361047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-34fc0fe7-bbb4-43ee-bf26-db27476bbc0d tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:43.411095 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d9a9b903-3fb1-46fa-9fcc-39320e6b2baa tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061388 Dec 18 20:46:43.411690 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:43.422313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.422313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:43.441054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-34fc0fe7-bbb4-43ee-bf26-db27476bbc0d tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:43.443686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:43.444194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:43.445009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:43.445697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:43.472892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-34fc0fe7-bbb4-43ee-bf26-db27476bbc0d tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1242 microversion: 2.1 time: 0.116339 Dec 18 20:46:43.476795 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:43.485449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e9a2e6e-540a-4249-a353-001d498ddb32 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.489304 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:43.489304 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:43.523774 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e9a2e6e-540a-4249-a353-001d498ddb32 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1987152472" status: 202 len: 0 microversion: 2.1 time: 0.044736 Dec 18 20:46:43.529494 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 50/101] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:46:43 2021] DELETE /compute/v2.1/flavors/1987152472 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:43.535354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0a4cc57f-ceaa-4377-aee4-9217399ac4c8 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.577950 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0a4cc57f-ceaa-4377-aee4-9217399ac4c8 tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045180 Dec 18 20:46:43.589298 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 51/102] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:43.594793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2b1df09-6529-41ac-a2c3-d4204a68842b tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1919973916", "id": 1592883984, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:43.596552 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:43.596552 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:43.611217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:43.625945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2b1df09-6529-41ac-a2c3-d4204a68842b tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032483 Dec 18 20:46:43.628512 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6948b855-d325-457d-82c3-3562a6ed84f3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1299 microversion: 2.1 time: 0.212438 Dec 18 20:46:43.634299 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 52/103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:43.634431 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 52/104] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:43 2021] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:43.648394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48fbdcc6-b804-41e7-bc6e-44e461976add tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.671528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48fbdcc6-b804-41e7-bc6e-44e461976add tempest-FlavorsAdminTestJSON-1909974532 tempest-FlavorsAdminTestJSON-1909974532-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.037565 Dec 18 20:46:43.672390 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 53/105] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:43.696727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-61607729-2c2f-44b9-b80f-91382a32065c tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.726557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-61607729-2c2f-44b9-b80f-91382a32065c tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1592883984" status: 202 len: 0 microversion: 2.1 time: 0.042726 Dec 18 20:46:43.728508 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 53/106] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:46:43 2021] DELETE /compute/v2.1/flavors/1592883984 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:46:43.736581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51156599-30b2-4899-8ee4-8e9d49fb8e2f tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:43.772304 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51156599-30b2-4899-8ee4-8e9d49fb8e2f tempest-FlavorsAdminTestJSON-1277624291 tempest-FlavorsAdminTestJSON-1277624291-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039215 Dec 18 20:46:43.783049 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 54/107] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:43 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:44.496415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-980188c9-27d0-4740-8d55-d989e7e2c83e tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:44.497138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-980188c9-27d0-4740-8d55-d989e7e2c83e tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:44.647493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:44.648194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:44.673158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-980188c9-27d0-4740-8d55-d989e7e2c83e tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:44.677106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:44.680821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:44.685212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:44.687192 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-980188c9-27d0-4740-8d55-d989e7e2c83e tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1242 microversion: 2.1 time: 0.196692 Dec 18 20:46:44.701890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:44.702428 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 54/108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:44 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1242 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:45.120120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:45.131439 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-166ef7fb-d4ee-414e-a144-fae51e8c4a70 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.489357 Dec 18 20:46:45.132751 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 55/109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:44 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:45.706894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:45.707707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:45.719528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:45.722281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:45.724302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:45.725422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:46.029481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:46.051494 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98fcb91c-9347-457d-b185-2f6d1a105664 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1242 microversion: 2.1 time: 0.346970 Dec 18 20:46:46.053339 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 55/110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:45 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1242 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:46.151404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:46.152012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:46.171670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:46.178891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:46.179989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:46.195009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:46.618927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:46.648171 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b3d64dc5-5198-4764-afec-0c25ae16ef74 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.498754 Dec 18 20:46:46.658687 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 56/111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:46 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:47.081594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:47.091442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:47.105767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:47.107631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:47.108706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:47.109369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:47.442285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:47.452529 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35737992-d76a-4b30-979d-054c95960e4b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1234 microversion: 2.1 time: 0.384954 Dec 18 20:46:47.462814 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 56/112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:47 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1234 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:47.666175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:47.667582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:47.674653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:47.675424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:47.676525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:47.677208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:47.872839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:47.880274 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b06155b5-f0ae-485d-bbf4-df1508a330fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.217839 Dec 18 20:46:47.891652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 57/113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:47 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:48.210038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-984abd07-64e3-429b-8e9e-632487315502 req-2623f94e-75a5-40d4-a8b3-1c6e3ee4d5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e", "tag": "e1c0dc06-ebfc-431e-968a-d5f4c08e76ac"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:48.215120 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:48.215120 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:48.237759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-984abd07-64e3-429b-8e9e-632487315502 req-2623f94e-75a5-40d4-a8b3-1c6e3ee4d5dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:48.238212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-984abd07-64e3-429b-8e9e-632487315502 req-2623f94e-75a5-40d4-a8b3-1c6e3ee4d5dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:48.291866 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-984abd07-64e3-429b-8e9e-632487315502 req-2623f94e-75a5-40d4-a8b3-1c6e3ee4d5dd service nova] Creating event network-changed:e1c0dc06-ebfc-431e-968a-d5f4c08e76ac for instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e on nch2-master-1 Dec 18 20:46:48.292614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-984abd07-64e3-429b-8e9e-632487315502 req-2623f94e-75a5-40d4-a8b3-1c6e3ee4d5dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:46:48.302758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ef5b4-a843-4020-8737-5b45d0d283c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:48.303473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ef5b4-a843-4020-8737-5b45d0d283c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:48.304521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ef5b4-a843-4020-8737-5b45d0d283c8 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:48.305102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ef5b4-a843-4020-8737-5b45d0d283c8 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:48.318493 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.compute.rpcapi [None req-4a8ef5b4-a843-4020-8737-5b45d0d283c8 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 18 20:46:48.325201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ef5b4-a843-4020-8737-5b45d0d283c8 None None] Releasing lock "compute-rpcapi-router" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:46:48.355280 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a8ef5b4-a843-4020-8737-5b45d0d283c8 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.635768 Dec 18 20:46:48.359731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 57/114] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:46:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:46:48.471947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:48.472950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:48.481113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:48.482239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:48.483260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:48.483913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:48.578092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:48.587606 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7f18c8b-24c9-4a1f-a73a-13805c457fa2 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1234 microversion: 2.1 time: 0.119856 Dec 18 20:46:48.599250 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 58/115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:48 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1234 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:48.898386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:48.899015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:48.908264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:48.908544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:48.909368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:48.909907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:49.107145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:49.117171 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2f4aafc6-1120-4822-bc82-1e3639940b33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.222770 Dec 18 20:46:49.118903 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 59/116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:48 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:49.158505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6adc92f-e9b4-4b08-a53d-7b593018d002 tempest-AZAdminNegativeTestJSON-1478164743 tempest-AZAdminNegativeTestJSON-1478164743-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:49.159874 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:49.159874 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:49.161335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c6adc92f-e9b4-4b08-a53d-7b593018d002 tempest-AZAdminNegativeTestJSON-1478164743 tempest-AZAdminNegativeTestJSON-1478164743-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'bda7ac78bfc44746b26992edcf507be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bec72855984e15b784ddb87c4516cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:49.167814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6adc92f-e9b4-4b08-a53d-7b593018d002 tempest-AZAdminNegativeTestJSON-1478164743 tempest-AZAdminNegativeTestJSON-1478164743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:49.168986 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c6adc92f-e9b4-4b08-a53d-7b593018d002 tempest-AZAdminNegativeTestJSON-1478164743 tempest-AZAdminNegativeTestJSON-1478164743-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.494741 Dec 18 20:46:49.169780 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 58/117] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Dec 18 20:46:48 2021] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 496 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:49.610141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:49.611772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:49.619793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:49.620417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:49.621212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:49.621653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:49.705427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:49.714518 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56ff6027-0e60-4204-9f92-ad47ba3b0409 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1234 microversion: 2.1 time: 0.108186 Dec 18 20:46:49.726729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 59/118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:49 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1234 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:50.018166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1675065548", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:50.101009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:46:50.139807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:50.140544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:50.163109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:50.163562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:50.164367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:50.164843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:50.445952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:46:50.446769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:46:50.447365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:46:50.447873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:46:50.448382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:46:50.462508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:50.462956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:50.468135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:50.473521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:50.521985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Getting quotas for project 1c1f758740e442a0829910680148236b. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:50.538933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Getting quotas for user b9e4893e5d944bce9da0588758509af4 and project 1c1f758740e442a0829910680148236b. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:50.559434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:50.570483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:46:50.574809 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-480ef62b-0a33-4503-b7c0-f2ba1e93866a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.437483 Dec 18 20:46:50.574955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:46:50.575713 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 60/119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:50 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:50.680303 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4295a32d-d246-40e4-8194-db351b3aa5a3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146668 Dec 18 20:46:50.681624 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 60/120] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:46:50.694866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-657362e9-df72-4ca4-81ff-56d46a74813e tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:50.695853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-657362e9-df72-4ca4-81ff-56d46a74813e tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:50.803186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-657362e9-df72-4ca4-81ff-56d46a74813e tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:50.816458 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-657362e9-df72-4ca4-81ff-56d46a74813e tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1219 microversion: 2.1 time: 0.128474 Dec 18 20:46:50.819570 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 61/121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:50 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:50.835213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:50.836129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:50.845769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:50.846525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:50.847456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:50.848087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:50.943028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-68f0e42f-a9c4-4a8c-a90a-645b592f17e5 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Action: 'create', calling method: .version_select at 0x7f715c08f310>, body: {"keypair": {"name": "tempest-keypair-843856219", "type": "ssh", "user_id": "c1cef2e4be554adabdff1c3f00c1bd6d"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:50.989666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:50.994621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-68f0e42f-a9c4-4a8c-a90a-645b592f17e5 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:51.005919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-68f0e42f-a9c4-4a8c-a90a-645b592f17e5 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for user 9623a93108e2442bb6e99505d20929d1 and project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:51.010911 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d5bfab7f-4de7-49e5-b5a8-f63bdc632c32 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1234 microversion: 2.1 time: 0.179253 Dec 18 20:46:51.014911 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 62/122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:50 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1234 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:51.465953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-68f0e42f-a9c4-4a8c-a90a-645b592f17e5 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:51.470855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-68f0e42f-a9c4-4a8c-a90a-645b592f17e5 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for user 9623a93108e2442bb6e99505d20929d1 and project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:51.496333 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-68f0e42f-a9c4-4a8c-a90a-645b592f17e5 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.10 time: 0.909166 Dec 18 20:46:51.497531 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 61/123] 10.222.0.13 () {62 vars in 1199 bytes} [Sat Dec 18 20:46:50 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 912 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:46:51.507609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4fe9bb27-847e-40b1-9efe-826960f022f4 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Action: 'create', calling method: .version_select at 0x7f715c9f05e0>, body: {"keypair": {"name": "tempest-keypair-1010106124", "type": "ssh", "user_id": "c1cef2e4be554adabdff1c3f00c1bd6d"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:51.565009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4fe9bb27-847e-40b1-9efe-826960f022f4 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:51.575376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4fe9bb27-847e-40b1-9efe-826960f022f4 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for user 9623a93108e2442bb6e99505d20929d1 and project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:51.592837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:51.593883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:51.605275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:51.606903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:51.608364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:51.609498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:51.940830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:51.955552 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3c631db-e89d-4f8a-bb55-fa9922dd9804 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.366854 Dec 18 20:46:51.957911 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 62/124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:51 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:51.963895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:51.964720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:51.971883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:51.972536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:51.973726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:51.974367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:52.063721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:52.076266 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f8991b9-659d-4557-8118-4dc7043ce6f3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1271 microversion: 2.1 time: 0.116478 Dec 18 20:46:52.085702 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 63/125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:51 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:52.103215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:52.103825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:52.111052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4fe9bb27-847e-40b1-9efe-826960f022f4 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:52.116968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4fe9bb27-847e-40b1-9efe-826960f022f4 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for user 9623a93108e2442bb6e99505d20929d1 and project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:52.119524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:52.120029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:52.120767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:52.121211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:52.135193 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4fe9bb27-847e-40b1-9efe-826960f022f4 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.631401 Dec 18 20:46:52.136333 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 63/126] 10.222.0.13 () {62 vars in 1199 bytes} [Sat Dec 18 20:46:51 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 633 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:46:52.225493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:52.235871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abe8cf68-c87f-4747-af5a-2ee2c1cd607b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1234 microversion: 2.1 time: 0.137399 Dec 18 20:46:52.236834 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 64/127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:52 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:52.531549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-042a4f8d-8d46-45a1-acef-f71704adea12 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:52.532808 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:52.532808 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:52.534567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-042a4f8d-8d46-45a1-acef-f71704adea12 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:52.535021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-042a4f8d-8d46-45a1-acef-f71704adea12 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:52.540455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-042a4f8d-8d46-45a1-acef-f71704adea12 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:52.540907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-042a4f8d-8d46-45a1-acef-f71704adea12 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:52.613778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a0adefc0-0c72-4861-950b-528e677aa0d7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1713855728", "id": 15553320, "os-flavor-access:is_public": "False"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:52.616421 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:52.616421 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:52.647498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a0adefc0-0c72-4861-950b-528e677aa0d7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.409335 Dec 18 20:46:52.652174 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 65/128] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:52 2021] POST /compute/v2.1/flavors => generated 425 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:52.678658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32b37523-a7b8-4d25-8af4-024d3be3edb6 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Calling method '.version_select at 0x7f715c08fc10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:52.702216 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32b37523-a7b8-4d25-8af4-024d3be3edb6 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-843856219?user_id=c1cef2e4be554adabdff1c3f00c1bd6d" status: 200 len: 705 microversion: 2.10 time: 0.048230 Dec 18 20:46:52.703363 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 66/129] 10.222.0.13 () {60 vars in 1336 bytes} [Sat Dec 18 20:46:52 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-843856219?user_id=c1cef2e4be554adabdff1c3f00c1bd6d => generated 705 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:46:52.708045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-870dfca1-e12b-4d71-840c-68020baa8827 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a4b87a38aaf24b5b8bb90fb9e4e479c8"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:52.709534 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:52.709534 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:52.762647 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-042a4f8d-8d46-45a1-acef-f71704adea12 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.620423 Dec 18 20:46:52.769919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 64/130] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:46:52 2021] GET /compute/v2.1/os-services => generated 969 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:52.782332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce6d2f27-0cb1-49cd-8291-73caca8bb0af tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Action: 'create', calling method: .version_select at 0x7f715c962160>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-554525583", "type": "ssh"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:52.799483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ce6d2f27-0cb1-49cd-8291-73caca8bb0af tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:52.806164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ce6d2f27-0cb1-49cd-8291-73caca8bb0af tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for user 9623a93108e2442bb6e99505d20929d1 and project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:52.823621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-870dfca1-e12b-4d71-840c-68020baa8827 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/15553320/action" status: 200 len: 95 microversion: 2.1 time: 0.119024 Dec 18 20:46:52.827875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 67/131] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:46:52 2021] POST /compute/v2.1/flavors/15553320/action => generated 95 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:46:52.842603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35afd446-def3-4a43-b5e0-1cfb70c43175 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:52.845223 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:52.845223 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:52.848188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35afd446-def3-4a43-b5e0-1cfb70c43175 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:52.849347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35afd446-def3-4a43-b5e0-1cfb70c43175 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:52.851062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35afd446-def3-4a43-b5e0-1cfb70c43175 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:52.852025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35afd446-def3-4a43-b5e0-1cfb70c43175 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:52.918331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35afd446-def3-4a43-b5e0-1cfb70c43175 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.089054 Dec 18 20:46:52.925463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 68/132] 10.222.0.13 () {58 vars in 1173 bytes} [Sat Dec 18 20:46:52 2021] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:53.114454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ce6d2f27-0cb1-49cd-8291-73caca8bb0af tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:46:53.120658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ce6d2f27-0cb1-49cd-8291-73caca8bb0af tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Getting quotas for user 9623a93108e2442bb6e99505d20929d1 and project 79c1a11aa4e0420fb64e2fecc5783455. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:46:53.157917 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce6d2f27-0cb1-49cd-8291-73caca8bb0af tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.10 time: 0.383402 Dec 18 20:46:53.165316 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 65/133] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Dec 18 20:46:52 2021] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 395 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:46:53.172550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2a4a4d1-8b09-44b5-809f-6432a522b6d9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.175026 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:53.175026 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:53.176900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a4a4d1-8b09-44b5-809f-6432a522b6d9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.177506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a4a4d1-8b09-44b5-809f-6432a522b6d9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.178569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a4a4d1-8b09-44b5-809f-6432a522b6d9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.179170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a4a4d1-8b09-44b5-809f-6432a522b6d9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.206376 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2a4a4d1-8b09-44b5-809f-6432a522b6d9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.038368 Dec 18 20:46:53.207491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 66/134] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:46:53 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:53.211989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.212798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:53.219794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.220460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.221400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.221976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.369929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-699d7d36-61f6-4a03-a09c-fde344c886a9 tempest-FlavorsAccessTestJSON-694388888 tempest-FlavorsAccessTestJSON-694388888-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.395155 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-699d7d36-61f6-4a03-a09c-fde344c886a9 tempest-FlavorsAccessTestJSON-694388888 tempest-FlavorsAccessTestJSON-694388888-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.468453 Dec 18 20:46:53.396944 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 69/135] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:52 2021] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:53.402429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.403235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:53.410352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.410977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.411927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.412558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.527251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:53.538585 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5940e4f7-bdd6-4a9d-bc93-c5299b78fb24 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1277 microversion: 2.1 time: 0.140239 Dec 18 20:46:53.550579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 70/136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:53 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:53.555797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9fcd3c1-4792-4dcc-bd0e-4b02bf98eb07 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Calling method '.version_select at 0x7f715c9091f0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.559093 ncdv-master-1 devstack@n-api.service[140732]: WARNING oslo_db.sqlalchemy.utils [None req-b9fcd3c1-4792-4dcc-bd0e-4b02bf98eb07 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Dec 18 20:46:53.566616 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9fcd3c1-4792-4dcc-bd0e-4b02bf98eb07 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs?user_id=c1cef2e4be554adabdff1c3f00c1bd6d" status: 200 len: 1113 microversion: 2.10 time: 0.014498 Dec 18 20:46:53.574008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 71/137] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Dec 18 20:46:53 2021] GET /compute/v2.1/os-keypairs?user_id=c1cef2e4be554adabdff1c3f00c1bd6d => generated 1113 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:46:53.578858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f8387c0-3d40-4688-98c8-7dc227750cf9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.581466 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:53.581466 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:53.583473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8387c0-3d40-4688-98c8-7dc227750cf9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.584304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8387c0-3d40-4688-98c8-7dc227750cf9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.585480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8387c0-3d40-4688-98c8-7dc227750cf9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.586147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8387c0-3d40-4688-98c8-7dc227750cf9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.615606 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f8387c0-3d40-4688-98c8-7dc227750cf9 tempest-ServicesAdminTestJSON-1304547915 tempest-ServicesAdminTestJSON-1304547915-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.040372 Dec 18 20:46:53.625902 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 72/138] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:46:53 2021] GET /compute/v2.1/os-services => generated 969 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:53.631793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.632714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:53.640410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.641150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.642154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:53.642820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:53.810512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:53.828470 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1664bf7a-aa4a-466b-9dd1-f9ef7ad7c419 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1234 microversion: 2.1 time: 0.197556 Dec 18 20:46:53.830197 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 73/139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:53 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1234 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:53.855642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28809fc8-6ceb-4db7-bef5-6e023065f9f1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a4b87a38aaf24b5b8bb90fb9e4e479c8"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:53.863190 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:53.863190 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:53.895745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:53.904921 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9efdde07-d5f9-4351-a9aa-229199be1a33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.696162 Dec 18 20:46:53.912312 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 67/140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:53 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:53.921324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0ba9b03-def0-48e6-8fd2-d179e4cd5e0b tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Calling method '.version_select at 0x7f715c851c10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:53.973597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0ba9b03-def0-48e6-8fd2-d179e4cd5e0b tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-554525583" status: 204 len: 0 microversion: 2.10 time: 0.055667 Dec 18 20:46:53.976050 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 68/141] 10.222.0.13 () {60 vars in 1321 bytes} [Sat Dec 18 20:46:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-554525583 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:46:53.988126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87ed5850-a16c-4280-9298-27486945801a tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Calling method '.version_select at 0x7f715c897d30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:54.026847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87ed5850-a16c-4280-9298-27486945801a tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010106124?user_id=c1cef2e4be554adabdff1c3f00c1bd6d" status: 204 len: 0 microversion: 2.10 time: 0.042963 Dec 18 20:46:54.033006 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 69/142] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Dec 18 20:46:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010106124?user_id=c1cef2e4be554adabdff1c3f00c1bd6d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:46:54.048318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-94d0b43e-05bf-4850-a93a-eeb57d760b71 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] Calling method '.version_select at 0x7f715c8ebd30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:54.081558 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-94d0b43e-05bf-4850-a93a-eeb57d760b71 tempest-KeyPairsV210TestJSON-1475555306 tempest-KeyPairsV210TestJSON-1475555306-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843856219?user_id=c1cef2e4be554adabdff1c3f00c1bd6d" status: 204 len: 0 microversion: 2.10 time: 0.047066 Dec 18 20:46:54.091921 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 70/143] 10.222.0.13 () {60 vars in 1339 bytes} [Sat Dec 18 20:46:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843856219?user_id=c1cef2e4be554adabdff1c3f00c1bd6d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:46:54.558053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:54.563030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:54.573608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:54.574474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:54.575493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:54.576085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:54.713250 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28809fc8-6ceb-4db7-bef5-6e023065f9f1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/15553320/action" status: 200 len: 21 microversion: 2.1 time: 0.877131 Dec 18 20:46:54.716356 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 74/144] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:46:53 2021] POST /compute/v2.1/flavors/15553320/action => generated 21 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:46:54.731453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-418162ef-5c89-458f-95ed-80f74d2c8882 tempest-FlavorsAccessTestJSON-694388888 tempest-FlavorsAccessTestJSON-694388888-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:54.761004 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-418162ef-5c89-458f-95ed-80f74d2c8882 tempest-FlavorsAccessTestJSON-694388888 tempest-FlavorsAccessTestJSON-694388888-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039016 Dec 18 20:46:54.762319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 75/145] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:54 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:54.781410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0cbe8d46-de6d-417e-9477-f7f8b0080f59 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:54.782289 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:54.782289 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:54.803388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:54.813944 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf219c36-3ed3-4159-92ed-900d6099fd0a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1277 microversion: 2.1 time: 0.260580 Dec 18 20:46:54.817318 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 71/146] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:54 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:54.840034 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0cbe8d46-de6d-417e-9477-f7f8b0080f59 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/15553320" status: 202 len: 0 microversion: 2.1 time: 0.066173 Dec 18 20:46:54.842073 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 76/147] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:46:54 2021] DELETE /compute/v2.1/flavors/15553320 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:54.847134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:54.848002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:54.854604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4c076b9-db09-4f81-972b-500c807892d5 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:54.859156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:54.865264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:54.867331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:54.869392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:54.895199 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4c076b9-db09-4f81-972b-500c807892d5 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047533 Dec 18 20:46:54.898013 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 77/148] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:54 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:54.936473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6443ba8e-6daa-4649-a0e2-a646b3f0c39a tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-809973958", "id": 2108496351, "os-flavor-access:is_public": "False"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:54.951813 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:54.951813 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:54.997512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6443ba8e-6daa-4649-a0e2-a646b3f0c39a tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.083939 Dec 18 20:46:54.997947 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 78/149] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:54 2021] POST /compute/v2.1/flavors => generated 430 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:46:55.014836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:55.015456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:55.036769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:55.037236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:55.038040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:55.038508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:55.197037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:55.209510 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a61ee3ed-ee81-4b24-a94d-187d0b16deb1 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1290 microversion: 2.1 time: 0.366685 Dec 18 20:46:55.211414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 72/150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:54 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1290 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:55.233969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-209ffebe-4100-4e0e-b8c6-4b64cd387348 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:55.233969 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:55.233969 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:55.308770 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-209ffebe-4100-4e0e-b8c6-4b64cd387348 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/2108496351/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.095055 Dec 18 20:46:55.328359 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 73/151] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 20:46:55 2021] GET /compute/v2.1/flavors/2108496351/os-flavor-access => generated 21 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:46:55.354230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a5388c6-f1b1-416a-93db-418a46fcd6b5 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:55.367174 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:55.367174 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:55.428953 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a5388c6-f1b1-416a-93db-418a46fcd6b5 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2108496351" status: 202 len: 0 microversion: 2.1 time: 0.093048 Dec 18 20:46:55.432867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 74/152] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:46:55 2021] DELETE /compute/v2.1/flavors/2108496351 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:55.444509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67a985e1-ef67-4ed4-8cf3-bd79b33e7b8a tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:55.484033 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67a985e1-ef67-4ed4-8cf3-bd79b33e7b8a tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041587 Dec 18 20:46:55.484711 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 75/153] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:55 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:55.972559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:55.984351 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ce8b524-b88e-4433-9de3-4beecaa08228 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.972726 Dec 18 20:46:56.003592 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 79/154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:55 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:56.010281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:56.011131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:56.019783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:56.020329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:56.021350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:56.021963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:56.444529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41c5e55a-af58-48ef-aec9-892c91f359b9 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-551439321", "ram": 512, "vcpus": 1, "disk": 10, "id": 1546412026, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:56.460850 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:56.460850 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:46:56.534606 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41c5e55a-af58-48ef-aec9-892c91f359b9 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.740077 Dec 18 20:46:56.535579 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 76/155] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:46:55 2021] POST /compute/v2.1/flavors => generated 415 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:46:56.561332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:56.564047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:56.588511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:56.589414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:56.591016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:56.591689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:56.761312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:56.769798 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21144035-4ce0-4026-ade2-ca2e517f4bf4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.764927 Dec 18 20:46:56.781407 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 80/156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:56 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:56.829522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:56.851054 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3ac8fa5-24ab-4531-84c1-8f5333648794 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1296 microversion: 2.1 time: 0.313929 Dec 18 20:46:56.866194 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 77/157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:56 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1296 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:56.989609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3024dfb-2cf5-42fa-801e-8437df43ff35 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:57.008311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:57.011500 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f3024dfb-2cf5-42fa-801e-8437df43ff35 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] HTTP exception thrown: Flavor 1546412026 has no extra specs with key hw:cpu_thread_policy. Dec 18 20:46:57.011670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:57.012103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3024dfb-2cf5-42fa-801e-8437df43ff35 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Returning 404 to user: Flavor 1546412026 has no extra specs with key hw:cpu_thread_policy. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:57.012945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3024dfb-2cf5-42fa-801e-8437df43ff35 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] 10.222.0.13 "GET /compute/v2.1/flavors/1546412026/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.236069 Dec 18 20:46:57.013859 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 81/158] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:46:56 2021] GET /compute/v2.1/flavors/1546412026/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:57.023049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9892c7b7-3dd3-4be2-9554-5a0ce7630e7b tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:57.026853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:57.029757 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:57.029757 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:57.031809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9892c7b7-3dd3-4be2-9554-5a0ce7630e7b tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '147de5c7427e4f88b1db71476ebcc5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e15548f5de148ff92b951b5b631bef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:57.032439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:57.032677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9892c7b7-3dd3-4be2-9554-5a0ce7630e7b tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:57.033625 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9892c7b7-3dd3-4be2-9554-5a0ce7630e7b tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] 10.222.0.13 "POST /compute/v2.1/flavors/1546412026/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014832 Dec 18 20:46:57.033941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:57.034640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:57.036048 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 82/159] 10.222.0.13 () {60 vars in 1223 bytes} [Sat Dec 18 20:46:57 2021] POST /compute/v2.1/flavors/1546412026/os-extra_specs => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:46:57.045083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96f62489-b55f-473d-853f-5c920374e38f tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:57.139730 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96f62489-b55f-473d-853f-5c920374e38f tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1546412026/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.098528 Dec 18 20:46:57.140369 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 83/160] 10.222.0.13 () {60 vars in 1223 bytes} [Sat Dec 18 20:46:57 2021] POST /compute/v2.1/flavors/1546412026/os-extra_specs => generated 66 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:46:57.149349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da5c582d-a9b1-456a-b962-f798fffbdac7 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:57.150117 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:57.150117 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:57.154303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da5c582d-a9b1-456a-b962-f798fffbdac7 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '147de5c7427e4f88b1db71476ebcc5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e15548f5de148ff92b951b5b631bef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:57.155034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da5c582d-a9b1-456a-b962-f798fffbdac7 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:57.155910 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da5c582d-a9b1-456a-b962-f798fffbdac7 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] 10.222.0.13 "DELETE /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010163 Dec 18 20:46:57.160379 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 84/161] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 20:46:57 2021] DELETE /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:46:57.168573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c36f10ff-bade-4ace-976b-31ea863abc0b tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:57.227549 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c36f10ff-bade-4ace-976b-31ea863abc0b tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1546412026/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065031 Dec 18 20:46:57.228437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 85/162] 10.222.0.13 () {60 vars in 1223 bytes} [Sat Dec 18 20:46:57 2021] POST /compute/v2.1/flavors/1546412026/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:46:57.237749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4dd39381-42d8-4429-a550-841bb7cd40d2 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:57.239198 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:57.239198 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:57.240150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4dd39381-42d8-4429-a550-841bb7cd40d2 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '147de5c7427e4f88b1db71476ebcc5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e15548f5de148ff92b951b5b631bef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:57.240799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4dd39381-42d8-4429-a550-841bb7cd40d2 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:57.241616 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4dd39381-42d8-4429-a550-841bb7cd40d2 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845 tempest-FlavorsExtraSpecsNegativeTestJSON-830430845-project] 10.222.0.13 "PUT /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008076 Dec 18 20:46:57.245702 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 86/163] 10.222.0.13 () {60 vars in 1264 bytes} [Sat Dec 18 20:46:57 2021] PUT /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:57.255979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd66b044-e6da-4fab-b337-9583e597ba41 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:57.280674 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-bd66b044-e6da-4fab-b337-9583e597ba41 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] HTTP exception thrown: Flavor 1546412026 has no extra specs with key hw:cpu_thread_policy. Dec 18 20:46:57.281550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd66b044-e6da-4fab-b337-9583e597ba41 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Returning 404 to user: Flavor 1546412026 has no extra specs with key hw:cpu_thread_policy. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:57.282577 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bd66b044-e6da-4fab-b337-9583e597ba41 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1546412026/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.031941 Dec 18 20:46:57.283304 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 87/164] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 20:46:57 2021] DELETE /compute/v2.1/flavors/1546412026/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:46:57.293000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7cf93d9a-7b07-4f79-a146-bf3dd42f9f1a tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:57.295709 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-7cf93d9a-7b07-4f79-a146-bf3dd42f9f1a tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] HTTP exception thrown: Request body and URI mismatch Dec 18 20:46:57.296209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7cf93d9a-7b07-4f79-a146-bf3dd42f9f1a tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:57.297021 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7cf93d9a-7b07-4f79-a146-bf3dd42f9f1a tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.008295 Dec 18 20:46:57.316352 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 88/165] 10.222.0.13 () {60 vars in 1264 bytes} [Sat Dec 18 20:46:57 2021] PUT /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:57.321104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a997b27-8bdc-4a4d-b118-b8b28e607522 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:46:57.322677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a997b27-8bdc-4a4d-b118-b8b28e607522 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:46:57.323513 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6a997b27-8bdc-4a4d-b118-b8b28e607522 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.006199 Dec 18 20:46:57.324073 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 89/166] 10.222.0.13 () {60 vars in 1264 bytes} [Sat Dec 18 20:46:57 2021] PUT /compute/v2.1/flavors/1546412026/os-extra_specs/hw:numa_nodes => generated 117 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 18 20:46:57.336211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-226d9b5c-8788-4d36-a250-4c2b379bffc4 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:57.337514 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:57.337514 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:46:57.398645 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-226d9b5c-8788-4d36-a250-4c2b379bffc4 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1546412026" status: 202 len: 0 microversion: 2.1 time: 0.069272 Dec 18 20:46:57.400361 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 90/167] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:46:57 2021] DELETE /compute/v2.1/flavors/1546412026 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:46:57.408614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aea3d8ad-6406-45ef-b458-e03d4cd05d4e tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:57.451367 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aea3d8ad-6406-45ef-b458-e03d4cd05d4e tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666 tempest-FlavorsExtraSpecsNegativeTestJSON-1995736666-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046675 Dec 18 20:46:57.455276 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 91/168] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:46:57 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:57.788906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:57.789837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:57.799121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:57.804959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:57.806048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:57.806659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:57.978713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:57.987091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-782becca-e0f0-473e-871c-49c511d4e7bc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.986828 Dec 18 20:46:57.991357 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 78/169] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:56 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:57.995933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:58.002087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:58.016019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:58.016782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:58.023251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:58.024551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:58.244666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:58.257211 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48ee01b6-81c0-443a-9a43-ead7ee99e487 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1296 microversion: 2.1 time: 0.263900 Dec 18 20:46:58.259693 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 79/170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:57 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1296 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:58.364257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:58.372791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f403208c-a224-4df9-9acc-4bd0f5823dd4 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.587644 Dec 18 20:46:58.384618 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 92/171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:57 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:46:59.012354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:59.015004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:59.042117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:59.043545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:59.046764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:59.049639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:59.282348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:59.283255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:59.294940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:59.296782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:59.297622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:59.300897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:59.909493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:46:59.926632 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3cafffcc-ca69-4a8e-8096-dbdadadf3e8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.924042 Dec 18 20:46:59.940842 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 80/172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:58 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:46:59.945698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:46:59.946832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:46:59.968324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:59.968780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:46:59.969588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:46:59.970027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:00.019741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:00.028672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52ab79f4-ef3b-48e0-9d68-3cef17c2a2f0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.753215 Dec 18 20:47:00.030899 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 93/173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:59 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:00.518624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:00.526168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-895b5233-0035-4bd4-88e3-0947a8cbeb08 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.584073 Dec 18 20:47:00.526940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 81/174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:46:59 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:00.947882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:00.948769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:00.964815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:00.965848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:00.973452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-20f87fa6-d60c-452c-b59a-f97cf54c7fdc req-948901bb-d1e2-4e67-bdec-544cc01dc14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cf5470-3fd1-480e-be6c-0d42081ad67a", "tag": "9c56ffb6-7657-464e-a842-95bf30427272"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:00.984379 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:00.984379 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:00.991071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:00.997056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:01.015355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-20f87fa6-d60c-452c-b59a-f97cf54c7fdc req-948901bb-d1e2-4e67-bdec-544cc01dc14b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:01.015827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-20f87fa6-d60c-452c-b59a-f97cf54c7fdc req-948901bb-d1e2-4e67-bdec-544cc01dc14b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:01.075603 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-20f87fa6-d60c-452c-b59a-f97cf54c7fdc req-948901bb-d1e2-4e67-bdec-544cc01dc14b service nova] Creating event network-changed:9c56ffb6-7657-464e-a842-95bf30427272 for instance 95cf5470-3fd1-480e-be6c-0d42081ad67a on nch1-master-1 Dec 18 20:47:01.095231 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-20f87fa6-d60c-452c-b59a-f97cf54c7fdc req-948901bb-d1e2-4e67-bdec-544cc01dc14b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.635225 Dec 18 20:47:01.101119 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 94/175] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:47:01.122746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:01.123571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:01.144256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:01.146175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:01.148559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:01.149550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:01.563549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:01.569589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:01.585426 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96e4ce34-a265-4f95-bea7-85ed5d9de767 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.482923 Dec 18 20:47:01.591816 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c485178a-82f0-42f8-9a0c-dba5efac5a5a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.645218 Dec 18 20:47:01.592439 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 95/176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:01 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:01.593997 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 82/177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:00 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:01.599150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:01.604390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:01.621926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:01.622700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:01.631278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:01.633825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:01.976002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:01.984767 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2702823a-25ff-47da-bb5b-c7110462a1f8 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.391262 Dec 18 20:47:01.985906 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 96/178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:01 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:02.169251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97a0cc32-ea68-4e8b-a3bf-db5b47918a7d tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.183644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97a0cc32-ea68-4e8b-a3bf-db5b47918a7d tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.558525 Dec 18 20:47:02.184855 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 83/179] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:01 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:47:02.198845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a8e69683-03ea-4c9b-b5b1-e2ed0c0352ef tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.220816 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a8e69683-03ea-4c9b-b5b1-e2ed0c0352ef tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.027426 Dec 18 20:47:02.222069 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 97/180] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors => generated 2594 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:02.241318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7c7bc5eb-c1f5-46c1-bb6f-2af728dc70e5 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.267863 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7c7bc5eb-c1f5-46c1-bb6f-2af728dc70e5 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032484 Dec 18 20:47:02.270445 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 84/181] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:02.282210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25380f26-6a97-4fa6-af4a-eeeba719e20c tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.297879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25380f26-6a97-4fa6-af4a-eeeba719e20c tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018534 Dec 18 20:47:02.301191 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 98/182] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:02.312033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-759830c8-fb51-4057-ae57-23292f0aaf55 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.350187 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-759830c8-fb51-4057-ae57-23292f0aaf55 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.042713 Dec 18 20:47:02.351356 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 85/183] 10.222.0.13 () {58 vars in 1164 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:02.368793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e96466c9-bc07-46ee-aa76-64d60ca876b0 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.392166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e96466c9-bc07-46ee-aa76-64d60ca876b0 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030598 Dec 18 20:47:02.396831 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 99/184] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:02.406136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-89bb53e0-b248-4ab6-b6b5-4db923faf9e1 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.444718 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-89bb53e0-b248-4ab6-b6b5-4db923faf9e1 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.042481 Dec 18 20:47:02.445797 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 86/185] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:02.459078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4366424f-3a73-4364-becf-dac0f9c29b9b tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.473890 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4366424f-3a73-4364-becf-dac0f9c29b9b tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018780 Dec 18 20:47:02.474609 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 100/186] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:02.489345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40f307f0-4052-4463-8af2-bdd95e6ca4f6 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.501717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40f307f0-4052-4463-8af2-bdd95e6ca4f6 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016599 Dec 18 20:47:02.502635 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 87/187] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:02.513453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e7644c0-78c1-45fb-953a-6a02e93a6191 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.559915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e7644c0-78c1-45fb-953a-6a02e93a6191 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.050094 Dec 18 20:47:02.574002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d06fc71-bbb4-49d7-8921-bde1a37bd349 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.578610 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 101/188] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:02.583006 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d06fc71-bbb4-49d7-8921-bde1a37bd349 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012227 Dec 18 20:47:02.590201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 88/189] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:02.597716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e92096e8-d52a-4f4f-b47f-1b4bb652e1ab tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.609912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.610945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:02.619485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:02.625601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:02.626591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:02.628678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:02.663338 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e92096e8-d52a-4f4f-b47f-1b4bb652e1ab tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.070634 Dec 18 20:47:02.663932 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 102/190] 10.222.0.13 () {58 vars in 1143 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:02.680031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:02.680641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:02.700484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:02.701110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:02.702146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:02.702825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:03.024690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:03.035043 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6daa088f-452f-41bd-8719-f9d0ae895e7b tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.427953 Dec 18 20:47:03.035659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 89/191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:03.051620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3054c514-8f9c-484b-bc9a-c696b3c795e7 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.071585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3054c514-8f9c-484b-bc9a-c696b3c795e7 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031681 Dec 18 20:47:03.072674 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 90/192] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:03.084233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.087143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:03.096526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:03.106897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f9eab5f1-dac6-4254-9527-ad421f7d9bb7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.430408 Dec 18 20:47:03.107481 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 103/193] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:02 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:03.109021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:03.112310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:03.113326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:03.113709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:03.116161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c4a51b9-7409-4a2a-a663-ad910b630273 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.186092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c4a51b9-7409-4a2a-a663-ad910b630273 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.076044 Dec 18 20:47:03.187685 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 104/194] 10.222.0.13 () {58 vars in 1147 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:03.209877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6fdaaa9f-3903-45ae-938e-967fdd37367e req-f0a1a8fd-06e4-4cfd-92f1-fd7e5a3e318e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caccd2f9-d868-4b2a-b4bd-860b5805bc39", "tag": "9cc622e7-d64a-4dcb-9aee-7d8f79a9bb22"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:03.213352 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:03.213352 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:03.230848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6fdaaa9f-3903-45ae-938e-967fdd37367e req-f0a1a8fd-06e4-4cfd-92f1-fd7e5a3e318e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:03.232573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6fdaaa9f-3903-45ae-938e-967fdd37367e req-f0a1a8fd-06e4-4cfd-92f1-fd7e5a3e318e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:03.261408 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6fdaaa9f-3903-45ae-938e-967fdd37367e req-f0a1a8fd-06e4-4cfd-92f1-fd7e5a3e318e service nova] Creating event network-changed:9cc622e7-d64a-4dcb-9aee-7d8f79a9bb22 for instance caccd2f9-d868-4b2a-b4bd-860b5805bc39 on nch2-master-1 Dec 18 20:47:03.274860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6fdaaa9f-3903-45ae-938e-967fdd37367e req-f0a1a8fd-06e4-4cfd-92f1-fd7e5a3e318e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084423 Dec 18 20:47:03.275980 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 105/195] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:03.284800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f128cb49-d7cc-4eb3-91ce-d49541aa4525 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.300802 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f128cb49-d7cc-4eb3-91ce-d49541aa4525 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022456 Dec 18 20:47:03.301737 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 106/196] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:03.534118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:03.551919 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e61ac978-caff-45a5-a993-ac1dd169d7bf tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.467752 Dec 18 20:47:03.552684 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 91/197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:03.565616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2a7e364-e2b4-4aa5-b84d-f41519ca69da tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.584055 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2a7e364-e2b4-4aa5-b84d-f41519ca69da tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030385 Dec 18 20:47:03.585202 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 92/198] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:03.596382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6e0144d-e433-49e0-bf24-0723ba332683 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.605016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2ab59ea-a2c1-4939-906f-906d94f1cd08 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Calling method '.version_select at 0x7f715daf2790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.606654 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:03.606654 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:03.608844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ab59ea-a2c1-4939-906f-906d94f1cd08 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:03.609470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ab59ea-a2c1-4939-906f-906d94f1cd08 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:03.610495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ab59ea-a2c1-4939-906f-906d94f1cd08 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:03.623550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ab59ea-a2c1-4939-906f-906d94f1cd08 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:03.707838 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2ab59ea-a2c1-4939-906f-906d94f1cd08 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.404979 Dec 18 20:47:03.708686 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 107/199] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/os-hosts => generated 401 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:03.730932 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6e0144d-e433-49e0-bf24-0723ba332683 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.138154 Dec 18 20:47:03.731535 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 93/200] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:03.749104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f087ec29-198d-4674-b9fe-a44dbaa10e07 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.791496 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f087ec29-198d-4674-b9fe-a44dbaa10e07 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049828 Dec 18 20:47:03.793230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 94/201] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:03.808422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-708f5b9e-0889-4ec9-b2f5-7a0567c65c74 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.831030 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-708f5b9e-0889-4ec9-b2f5-7a0567c65c74 tempest-FlavorsV2TestJSON-1765724371 tempest-FlavorsV2TestJSON-1765724371-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027001 Dec 18 20:47:03.831848 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 95/202] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:47:03.931565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-26e6edc0-9357-4c31-8dee-433411732c5d tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Calling method '.version_select at 0x7f715c909550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.932890 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:03.932890 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:03.934689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-26e6edc0-9357-4c31-8dee-433411732c5d tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'da2977a4846847cfbe2bc895e8163d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f864f89c274d6484fa3bf4415a6bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:03.935418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-26e6edc0-9357-4c31-8dee-433411732c5d tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:03.937356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-26e6edc0-9357-4c31-8dee-433411732c5d tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.221975 Dec 18 20:47:03.939673 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 108/203] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/os-hosts => generated 109 bytes in 225 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:47:03.951467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5dd3d4b-1b59-492b-8565-1a5969f562ec tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Calling method '.version_select at 0x7f715c8eb550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.956791 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:03.956791 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:03.958141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d5dd3d4b-1b59-492b-8565-1a5969f562ec tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'da2977a4846847cfbe2bc895e8163d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f864f89c274d6484fa3bf4415a6bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:03.958882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5dd3d4b-1b59-492b-8565-1a5969f562ec tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:03.959710 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d5dd3d4b-1b59-492b-8565-1a5969f562ec tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.011778 Dec 18 20:47:03.960228 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 96/204] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:03.970872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e216b31f-294f-48b2-b658-72c63e8a246b tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Calling method '.version_select at 0x7f715c0abc10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:03.972197 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:03.972197 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:03.988854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e216b31f-294f-48b2-b658-72c63e8a246b tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 18 20:47:03.990891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e216b31f-294f-48b2-b658-72c63e8a246b tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:03.993874 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e216b31f-294f-48b2-b658-72c63e8a246b tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.026917 Dec 18 20:47:04.006408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-27f55423-91cf-44ea-a00a-f0b0f1a4b1f4 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Calling method '.version_select at 0x7f715c8515e0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.007485 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:04.007485 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:04.009740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-27f55423-91cf-44ea-a00a-f0b0f1a4b1f4 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'da2977a4846847cfbe2bc895e8163d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f864f89c274d6484fa3bf4415a6bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:04.010565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-27f55423-91cf-44ea-a00a-f0b0f1a4b1f4 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:04.011509 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-27f55423-91cf-44ea-a00a-f0b0f1a4b1f4 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.009044 Dec 18 20:47:04.012220 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 97/206] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:04.012373 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 109/206] 10.222.0.13 () {58 vars in 1211 bytes} [Sat Dec 18 20:47:03 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:04.021700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a22dc92-77d4-41f3-a573-48923c8c6eac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Calling method '.version_select at 0x7f715ed951f0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.045173 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-6a22dc92-77d4-41f3-a573-48923c8c6eac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 18 20:47:04.056703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.057906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:04.065391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a22dc92-77d4-41f3-a573-48923c8c6eac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:04.069802 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a22dc92-77d4-41f3-a573-48923c8c6eac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049147 Dec 18 20:47:04.071945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.072637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.073794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.074361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 98/207] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 18 20:47:04.074835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.087726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d6befa4-387b-4e9e-b126-85978c957e2b tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Calling method '.version_select at 0x7f715c8ebdc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.091861 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:04.091861 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:04.099220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4d6befa4-387b-4e9e-b126-85978c957e2b tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'da2977a4846847cfbe2bc895e8163d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f864f89c274d6484fa3bf4415a6bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:04.100201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d6befa4-387b-4e9e-b126-85978c957e2b tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:04.102767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d6befa4-387b-4e9e-b126-85978c957e2b tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.023994 Dec 18 20:47:04.103304 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 99/208] 10.222.0.13 () {58 vars in 1196 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:04.119734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ef856f4-7d42-4e00-a0ea-4b8e8695ed07 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Calling method '.version_select at 0x7f715c8513a0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.141812 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8ef856f4-7d42-4e00-a0ea-4b8e8695ed07 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 18 20:47:04.142350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ef856f4-7d42-4e00-a0ea-4b8e8695ed07 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:04.152075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8ef856f4-7d42-4e00-a0ea-4b8e8695ed07 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.042838 Dec 18 20:47:04.153031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 100/209] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:04.159181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.161197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:04.180742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.181444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.182471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.183061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.617188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:04.628860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5e42896f-ab52-4aba-bab3-0856a75fc400 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.581051 Dec 18 20:47:04.643550 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 110/210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:04.643897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:04.643897 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7eff7da-ffec-418f-866c-cbf89bee137a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.483773 Dec 18 20:47:04.643897 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 101/211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:04.659820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1b8b97d-1683-404e-a850-35f905fb9fea tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Calling method '.version_select at 0x7f715c08f040>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.660878 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:04.660878 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:04.662194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1b8b97d-1683-404e-a850-35f905fb9fea tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'da2977a4846847cfbe2bc895e8163d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f864f89c274d6484fa3bf4415a6bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:04.662900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1b8b97d-1683-404e-a850-35f905fb9fea tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:04.663713 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1b8b97d-1683-404e-a850-35f905fb9fea tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.032812 Dec 18 20:47:04.668840 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 111/212] 10.222.0.13 () {58 vars in 1193 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:04.674617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:04.675446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:04.682373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.683020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.683961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.684544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.838441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:04.847045 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32eb6e28-5fa1-4032-9f67-4d51dc81e844 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.177130 Dec 18 20:47:04.848426 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 112/213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:04 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:04.917537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3070e412-a4ae-488f-8ff2-99d79f0e888e req-92c0eb6f-5cce-444b-885d-bf8ee2fdb477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e", "name": "network-vif-plugged", "status": "completed", "tag": "e1c0dc06-ebfc-431e-968a-d5f4c08e76ac"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:04.920398 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:04.920398 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:04.934820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3070e412-a4ae-488f-8ff2-99d79f0e888e req-92c0eb6f-5cce-444b-885d-bf8ee2fdb477 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.935877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3070e412-a4ae-488f-8ff2-99d79f0e888e req-92c0eb6f-5cce-444b-885d-bf8ee2fdb477 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.961556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3070e412-a4ae-488f-8ff2-99d79f0e888e req-92c0eb6f-5cce-444b-885d-bf8ee2fdb477 service nova] Creating event network-vif-plugged:e1c0dc06-ebfc-431e-968a-d5f4c08e76ac for instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e on nch2-master-1 Dec 18 20:47:04.962807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3070e412-a4ae-488f-8ff2-99d79f0e888e req-92c0eb6f-5cce-444b-885d-bf8ee2fdb477 service nova] Acquired lock "compute-rpcapi-router" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:47:04.964379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b17a538e-f56d-465e-bd4c-297eb8199e96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.965022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b17a538e-f56d-465e-bd4c-297eb8199e96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.966127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b17a538e-f56d-465e-bd4c-297eb8199e96 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:04.966986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b17a538e-f56d-465e-bd4c-297eb8199e96 None None] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:04.978567 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.rpcapi [None req-b17a538e-f56d-465e-bd4c-297eb8199e96 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 18 20:47:04.979673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b17a538e-f56d-465e-bd4c-297eb8199e96 None None] Releasing lock "compute-rpcapi-router" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:47:05.014492 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b17a538e-f56d-465e-bd4c-297eb8199e96 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374300 Dec 18 20:47:05.015134 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 102/214] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:05.020502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e3174cdf-ddad-4387-840b-702e3e66f6ac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Calling method '.version_select at 0x7f715ed95700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:05.021357 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:05.021357 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:05.032613 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e3174cdf-ddad-4387-840b-702e3e66f6ac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 18 20:47:05.033214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e3174cdf-ddad-4387-840b-702e3e66f6ac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:05.034008 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e3174cdf-ddad-4387-840b-702e3e66f6ac tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017509 Dec 18 20:47:05.038318 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 103/215] 10.222.0.13 () {58 vars in 1214 bytes} [Sat Dec 18 20:47:05 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:05.052301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-148dba4c-e8ef-4c60-baf8-b4b8715a88e3 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Action: 'update', calling method: .version_select at 0x7f715c9f0af0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:05.053817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-148dba4c-e8ef-4c60-baf8-b4b8715a88e3 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:05.057131 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-148dba4c-e8ef-4c60-baf8-b4b8715a88e3 tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.015738 Dec 18 20:47:05.058843 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 104/216] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Dec 18 20:47:05 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:47:05.071216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8eddd5dd-03e5-4fb0-bd60-6542b1e69dbd tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Action: 'update', calling method: .version_select at 0x7f715ed958b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:05.072330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8eddd5dd-03e5-4fb0-bd60-6542b1e69dbd tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:05.073140 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8eddd5dd-03e5-4fb0-bd60-6542b1e69dbd tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.006196 Dec 18 20:47:05.073657 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 105/217] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Dec 18 20:47:05 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 18 20:47:05.087659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71873e7c-e8cf-4267-8df3-386ab6f224b3 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Action: 'update', calling method: .version_select at 0x7f715c861670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:05.089361 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:05.089361 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:05.091209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-71873e7c-e8cf-4267-8df3-386ab6f224b3 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'da2977a4846847cfbe2bc895e8163d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f864f89c274d6484fa3bf4415a6bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:05.091647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71873e7c-e8cf-4267-8df3-386ab6f224b3 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:05.092562 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71873e7c-e8cf-4267-8df3-386ab6f224b3 tempest-HostsAdminNegativeTestJSON-717544948 tempest-HostsAdminNegativeTestJSON-717544948-project] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.008995 Dec 18 20:47:05.094726 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 106/218] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Dec 18 20:47:05 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:05.113565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d0fbb81-a2e6-4297-b02a-5e57b3a6504f tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Action: 'update', calling method: .version_select at 0x7f715ed95160>, body: {"status": null, "maintenance_mode": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:05.115086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d0fbb81-a2e6-4297-b02a-5e57b3a6504f tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:05.115989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d0fbb81-a2e6-4297-b02a-5e57b3a6504f tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.016010 Dec 18 20:47:05.116801 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 107/219] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Dec 18 20:47:05 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 18 20:47:05.129332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db09e7b1-0310-4216-865b-d99b39cb597d tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Action: 'update', calling method: .version_select at 0x7f715c9f0b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:05.132918 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.hosts [None req-db09e7b1-0310-4216-865b-d99b39cb597d tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Enabling host nonexistent_hostname. Dec 18 20:47:05.145365 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-db09e7b1-0310-4216-865b-d99b39cb597d tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 18 20:47:05.146649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db09e7b1-0310-4216-865b-d99b39cb597d tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:05.147542 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db09e7b1-0310-4216-865b-d99b39cb597d tempest-HostsAdminNegativeTestJSON-1157882387 tempest-HostsAdminNegativeTestJSON-1157882387-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023188 Dec 18 20:47:05.154035 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 108/220] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:47:05 2021] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:05.239756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98248db2-d780-4db9-9883-eaae5e5fb3f0 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1226893746", "id": 446598062, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:05.241584 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:05.241584 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:05.276329 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98248db2-d780-4db9-9883-eaae5e5fb3f0 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.426487 Dec 18 20:47:05.276925 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 113/221] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 20:47:04 2021] POST /compute/v2.1/flavors => generated 465 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:47:05.644932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:05.645563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:05.653182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:05.653633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:05.654461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:05.654906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:05.686013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fc3c93ce-7138-4580-a22b-59cb6056cf3b tempest-FlavorsV261TestJSON-1721104543 tempest-FlavorsV261TestJSON-1721104543-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:05.704321 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fc3c93ce-7138-4580-a22b-59cb6056cf3b tempest-FlavorsV261TestJSON-1721104543 tempest-FlavorsV261TestJSON-1721104543-project] 10.222.0.13 "GET /compute/v2.1/flavors/446598062" status: 200 len: 465 microversion: 2.61 time: 0.419506 Dec 18 20:47:05.720816 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 109/222] 10.222.0.13 () {60 vars in 1195 bytes} [Sat Dec 18 20:47:05 2021] GET /compute/v2.1/flavors/446598062 => generated 465 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:47:05.727373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:05.737183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:05.759585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:05.761925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:05.762968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:05.763414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:06.065163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:06.073256 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62f5e35e-3db2-49c5-a72c-cd2122a49e67 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.432075 Dec 18 20:47:06.074302 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 114/223] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:05 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:06.088478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-065fe57f-4c78-4914-916a-56511bb461d7 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] Action: 'update', calling method: .version_select at 0x7f715e987700>, body: {"flavor": {"description": "new"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:06.104046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:06.109724 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:06.109724 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:06.113384 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67bec77b-4037-417e-8d4b-a22af20bc766 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.391093 Dec 18 20:47:06.122806 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 110/224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:05 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:06.122806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:06.122806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:06.129109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:06.129562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:06.130806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:06.131259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:06.159554 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-065fe57f-4c78-4914-916a-56511bb461d7 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/446598062" status: 200 len: 466 microversion: 2.61 time: 0.075549 Dec 18 20:47:06.162289 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 115/225] 10.222.0.13 () {62 vars in 1215 bytes} [Sat Dec 18 20:47:06 2021] PUT /compute/v2.1/flavors/446598062 => generated 466 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:47:06.171159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eee11e08-dbb9-4808-92ad-6b737bb4cdc4 tempest-FlavorsV261TestJSON-1721104543 tempest-FlavorsV261TestJSON-1721104543-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:06.209951 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eee11e08-dbb9-4808-92ad-6b737bb4cdc4 tempest-FlavorsV261TestJSON-1721104543 tempest-FlavorsV261TestJSON-1721104543-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.042249 Dec 18 20:47:06.224419 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 116/226] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Dec 18 20:47:06 2021] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:47:06.229810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-95d08d85-7589-4ae6-bdb0-ac901c27bad6 tempest-FlavorsV261TestJSON-1721104543 tempest-FlavorsV261TestJSON-1721104543-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:06.252166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-95d08d85-7589-4ae6-bdb0-ac901c27bad6 tempest-FlavorsV261TestJSON-1721104543 tempest-FlavorsV261TestJSON-1721104543-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.026510 Dec 18 20:47:06.253043 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 117/227] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:47:06 2021] GET /compute/v2.1/flavors => generated 3154 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:06.268811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17a3fed5-0d0c-49e6-910e-9856ff32a031 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:06.270031 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:06.270031 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:06.299546 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-17a3fed5-0d0c-49e6-910e-9856ff32a031 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/446598062" status: 202 len: 0 microversion: 2.61 time: 0.035179 Dec 18 20:47:06.300693 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 118/228] 10.222.0.13 () {60 vars in 1198 bytes} [Sat Dec 18 20:47:06 2021] DELETE /compute/v2.1/flavors/446598062 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:06.310081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c949e097-d064-4a6d-9ce0-59f0cd3ebc93 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:06.345647 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c949e097-d064-4a6d-9ce0-59f0cd3ebc93 tempest-FlavorsV261TestJSON-609283813 tempest-FlavorsV261TestJSON-609283813-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.039670 Dec 18 20:47:06.347092 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 119/229] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Dec 18 20:47:06 2021] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:06.389036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:06.400515 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01719b34-f4c1-45e1-87f3-89469c54576b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.284290 Dec 18 20:47:06.402485 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 111/230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:06 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:07.090943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:07.092757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:07.100034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:07.100645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:07.102283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:07.102874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:07.199623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-874099493", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5cbb2c71-d950-4efd-806f-e5446059ac55"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:07.254545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:07.265989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cbbe7040-5559-402a-bff4-7397133b4007 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.178401 Dec 18 20:47:07.267168 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 112/231] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:07 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:07.272246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:07.272843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:07.280050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:07.280502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:07.281674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:07.282445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:07.283238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] validate_networks() for [('5cbb2c71-d950-4efd-806f-e5446059ac55', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:07.745514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:07.756022 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b04c6207-3ff2-4d36-bf29-b8dbbb836192 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1341 microversion: 2.1 time: 0.487554 Dec 18 20:47:07.756602 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 113/232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:07 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1341 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:07.761828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:07.762450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:07.776461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:07.777743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:07.779207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:07.779828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:08.069480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:08.078210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-180aec0d-b466-4401-bce4-983c4fada082 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.320238 Dec 18 20:47:08.078968 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 114/233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:07 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:08.084213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ee4e8149-b71b-4a95-af12-7e262d12644a req-df3716c2-48f6-4abe-a6b9-8a6e12fd92d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caccd2f9-d868-4b2a-b4bd-860b5805bc39", "name": "network-vif-plugged", "status": "completed", "tag": "9cc622e7-d64a-4dcb-9aee-7d8f79a9bb22"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:08.086721 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:08.086721 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:08.096627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ee4e8149-b71b-4a95-af12-7e262d12644a req-df3716c2-48f6-4abe-a6b9-8a6e12fd92d1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:08.097742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ee4e8149-b71b-4a95-af12-7e262d12644a req-df3716c2-48f6-4abe-a6b9-8a6e12fd92d1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:08.111230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ee4e8149-b71b-4a95-af12-7e262d12644a req-df3716c2-48f6-4abe-a6b9-8a6e12fd92d1 service nova] Creating event network-vif-plugged:9cc622e7-d64a-4dcb-9aee-7d8f79a9bb22 for instance caccd2f9-d868-4b2a-b4bd-860b5805bc39 on nch2-master-1 Dec 18 20:47:08.117411 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ee4e8149-b71b-4a95-af12-7e262d12644a req-df3716c2-48f6-4abe-a6b9-8a6e12fd92d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037054 Dec 18 20:47:08.119097 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 115/234] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:08.283847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:08.285289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:08.292655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:08.293407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:08.294476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:08.295146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:08.798100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:08.810771 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e307c60-1328-472a-869d-6d9d33c73e02 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.530964 Dec 18 20:47:08.821714 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 116/235] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:08 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:08.829452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:08.830366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:08.837755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:08.838209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:08.839082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:08.840039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:08.982438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:08.984007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:08.984701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:08.985312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:08.985950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:09.004025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:09.007443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:09.010804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:09.011420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:09.049207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:09.055656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for user 5aaf1ced6baf4e1d9c940cfe96b2c254 and project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:09.070080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:09.073341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:09.147917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa15dedc-6185-47a3-a6ab-1ac841ee6529 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.316096 Dec 18 20:47:09.150622 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 120/236] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:09.157784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:09.158754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:09.166727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:09.167363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:09.168737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:09.169417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:09.279543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:09.292426 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9629d09-055a-430c-ac73-b69f4c8dfc57 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1490 microversion: 2.1 time: 0.468201 Dec 18 20:47:09.292934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 117/237] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:08 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1490 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:09.309523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3f9bbf7-99ce-47e0-b152-38d219430061 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:09.310315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3f9bbf7-99ce-47e0-b152-38d219430061 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:09.512717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a3f9bbf7-99ce-47e0-b152-38d219430061 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:09.523849 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3f9bbf7-99ce-47e0-b152-38d219430061 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1210 microversion: 2.1 time: 0.229649 Dec 18 20:47:09.524453 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 118/238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:09 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1210 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:09.620828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:09.629140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82935a62-f6bd-40fa-8295-dab05fa9962d tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.477272 Dec 18 20:47:09.629720 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 121/239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:09 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:09.827596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:09.828351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:09.839035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:09.839549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:09.848677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:09.849316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.000984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:10.001705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:10.022076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.024713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.026241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.028558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.195541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:47:10.328430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:10.341238 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-17037d4c-d48b-487b-91b4-dda648841501 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1338 microversion: 2.1 time: 0.517972 Dec 18 20:47:10.346737 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 122/240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:09 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1338 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:10.475147 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-947650e6-14bc-47d2-be86-52c5dd95863c tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 204 len: 0 microversion: 2.1 time: 0.935806 Dec 18 20:47:10.481281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 119/241] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:09 2021] DELETE /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 0 bytes in 952 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:10.485488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:10.486097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:10.499760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.502731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.505031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.506204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.553002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:10.553955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:10.568561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.569438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.574131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.575206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.789015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:10.799695 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-19f09493-8032-417f-98c9-28f24af149b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1262 microversion: 2.1 time: 0.257680 Dec 18 20:47:10.801342 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 120/242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:10 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1262 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:10.821090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:10.821829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:10.838687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.841505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:10.845647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:10.846708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:11.185258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:11.201065 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5edc9cc-24ec-4d11-a115-babe9c59fb14 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1496 microversion: 2.1 time: 0.719449 Dec 18 20:47:11.201654 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 123/243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:10 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1496 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:11.365730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:11.366353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:11.377190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:11.378086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:11.378826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:11.379268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:11.393740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:11.403015 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c0bbc9f7-b104-43c8-8335-8d56e2a66a98 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.598413 Dec 18 20:47:11.403607 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 121/244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:10 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:11.827316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Calling method '.version_select at 0x7f715c7bf670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:11.829237 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:11.829237 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:11.832076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:11.832532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:11.863164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:11.863998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:11.875980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:11.876765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:11.884934 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22139805-9f97-4146-a17b-bb7721b89beb tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.480289 Dec 18 20:47:11.886300 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 122/245] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Dec 18 20:47:11 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:47:11.892680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:11.893708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:11.900414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:11.900870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:11.901671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:11.903297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.031423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:12.039681 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad33fb8b-211f-4ce5-8a85-7d85354fff60 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1268 microversion: 2.1 time: 0.151702 Dec 18 20:47:12.040351 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 123/246] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:11 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:12.044996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1cd919da-4aad-4bca-bc30-300def960011 tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Calling method '.version_select at 0x7f715c8eb670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:12.046127 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:12.046127 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:12.048445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd919da-4aad-4bca-bc30-300def960011 tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.049133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd919da-4aad-4bca-bc30-300def960011 tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.064114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd919da-4aad-4bca-bc30-300def960011 tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.064556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd919da-4aad-4bca-bc30-300def960011 tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.070985 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1cd919da-4aad-4bca-bc30-300def960011 tempest-HypervisorAdminV228Test-484581378 tempest-HypervisorAdminV228Test-484581378-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.028952 Dec 18 20:47:12.071850 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 124/247] 10.222.0.13 () {60 vars in 1192 bytes} [Sat Dec 18 20:47:12 2021] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:47:12.225490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:12.226202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:12.235986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:12.237294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.238203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.239928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.241787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.254567 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f924368c-1cb4-421d-bc72-cf3172d65b9f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1488 microversion: 2.1 time: 0.893039 Dec 18 20:47:12.266484 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 124/248] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:11 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1488 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:12.272093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e3f5d1b-8502-4ce8-b462-1da87752827b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:12.272760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e3f5d1b-8502-4ce8-b462-1da87752827b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:12.279276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e3f5d1b-8502-4ce8-b462-1da87752827b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.279733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e3f5d1b-8502-4ce8-b462-1da87752827b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.280528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e3f5d1b-8502-4ce8-b462-1da87752827b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.280966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e3f5d1b-8502-4ce8-b462-1da87752827b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.816660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:12.824461 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a2c9bb93-73e3-43ae-81a6-6de761de675a tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1496 microversion: 2.1 time: 0.605562 Dec 18 20:47:12.825037 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 125/249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:12 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1496 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:12.832911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:12.833503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:12.846471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.847805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:12.849305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:12.850079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:13.549023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:13.558785 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e88dd352-6604-410d-876d-bd29bde5944c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.732663 Dec 18 20:47:13.559360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 126/250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:12 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:13.669994 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e3f5d1b-8502-4ce8-b462-1da87752827b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1639 microversion: 2.1 time: 1.401693 Dec 18 20:47:13.683052 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 125/251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:12 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1639 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:13.688300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:13.689356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:13.696393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:13.697156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:13.698223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:13.699331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:13.855085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1262434103", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "fab4d786-81c4-48dc-b51f-790f7e93cb03"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:13.994011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] validate_networks() for [('fab4d786-81c4-48dc-b51f-790f7e93cb03', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:14.165693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:14.173812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3208554f-c1f8-45e7-8668-a81fb758e7f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1310 microversion: 2.1 time: 0.489319 Dec 18 20:47:14.176987 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 126/252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:13 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1310 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:14.204551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d9a3b64-b3e0-410e-8764-e3e736820785 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:14.207683 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:14.207683 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:14.229740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d9a3b64-b3e0-410e-8764-e3e736820785 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:14.230233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d9a3b64-b3e0-410e-8764-e3e736820785 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:14.443603 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d9a3b64-b3e0-410e-8764-e3e736820785 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 300 microversion: 2.1 time: 0.265102 Dec 18 20:47:14.447202 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 127/253] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:47:14 2021] POST /compute/v2.1/os-aggregates/7/action => generated 300 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:14.458951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:14.461950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:14.480445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:14.482578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:14.484678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:14.486330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:14.580925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:14.581745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:14.588934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lazy-loading 'fault' on Instance uuid 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:14.719021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:14.744669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a43053ce-5cb0-49ed-a08d-99038c54dac7 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 200 len: 1309 microversion: 2.1 time: 0.290357 Dec 18 20:47:14.755552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 128/254] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:14 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:14.760964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-33ea5215-5d93-4854-90f0-11f89155a90a req-09b08ee7-5ca0-4ee3-b96b-aff63447a959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e", "name": "network-vif-deleted", "tag": "e1c0dc06-ebfc-431e-968a-d5f4c08e76ac"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:14.763815 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:14.763815 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:14.772027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-33ea5215-5d93-4854-90f0-11f89155a90a req-09b08ee7-5ca0-4ee3-b96b-aff63447a959 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:14.772738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-33ea5215-5d93-4854-90f0-11f89155a90a req-09b08ee7-5ca0-4ee3-b96b-aff63447a959 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:14.789789 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-33ea5215-5d93-4854-90f0-11f89155a90a req-09b08ee7-5ca0-4ee3-b96b-aff63447a959 service nova] Creating event network-vif-deleted:e1c0dc06-ebfc-431e-968a-d5f4c08e76ac for instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e on nch2-master-1 Dec 18 20:47:14.796609 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-33ea5215-5d93-4854-90f0-11f89155a90a req-09b08ee7-5ca0-4ee3-b96b-aff63447a959 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039296 Dec 18 20:47:14.797339 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 129/255] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:14.806714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-392eb57d-4dc4-4a90-be57-e4c771bda81c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:14.807867 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:14.807867 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:14.837887 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-392eb57d-4dc4-4a90-be57-e4c771bda81c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.038003 Dec 18 20:47:14.841708 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 130/256] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:47:14 2021] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:14.856960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:14.858439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:14.876356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:14.877144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:14.878356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:14.878990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:15.275047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:15.287148 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a4bd04a-1f6d-4626-8556-e73e229b6104 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.442836 Dec 18 20:47:15.291527 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 131/257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:14 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:15.317404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cbec4859-1375-4bfe-bc83-cd28ef18b4b4 req-8ae52908-6353-49df-bda4-e39ec8305250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cf5470-3fd1-480e-be6c-0d42081ad67a", "name": "network-vif-plugged", "status": "completed", "tag": "9c56ffb6-7657-464e-a842-95bf30427272"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:15.320582 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:15.320582 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:15.348241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cbec4859-1375-4bfe-bc83-cd28ef18b4b4 req-8ae52908-6353-49df-bda4-e39ec8305250 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:15.349960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cbec4859-1375-4bfe-bc83-cd28ef18b4b4 req-8ae52908-6353-49df-bda4-e39ec8305250 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:15.356853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:15.357307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:15.357804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:15.358464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:15.359076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:15.374004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:15.374771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:15.375770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:15.376524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:15.378335 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cbec4859-1375-4bfe-bc83-cd28ef18b4b4 req-8ae52908-6353-49df-bda4-e39ec8305250 service nova] Creating event network-vif-plugged:9c56ffb6-7657-464e-a842-95bf30427272 for instance 95cf5470-3fd1-480e-be6c-0d42081ad67a on nch1-master-1 Dec 18 20:47:15.389844 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cbec4859-1375-4bfe-bc83-cd28ef18b4b4 req-8ae52908-6353-49df-bda4-e39ec8305250 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095725 Dec 18 20:47:15.393166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 132/258] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:15.406461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:15.411188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for user 8042de28328d4b26b910f1be4b499879 and project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:15.412779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a0b4ce65-4fdb-4fad-8b78-4a6b648d9d4a tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-704762042"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:15.420076 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:15.420076 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:15.435514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-a0b4ce65-4fdb-4fad-8b78-4a6b648d9d4a tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid 75483357-0955-45b2-a197-f3eda3b5974a for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:15.442758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:15.445470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:15.471285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a0b4ce65-4fdb-4fad-8b78-4a6b648d9d4a tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075488 Dec 18 20:47:15.480352 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 133/259] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:15 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:15.485250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:15.494755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:15.506878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:15.507681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:15.509265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:15.509890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:15.558714 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1dca97b-d1ab-4a84-ba75-e43ce4b66ae0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.997313 Dec 18 20:47:15.562331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 127/260] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 20:47:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 20:47:15.572714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dae635eb-a999-4a6d-9c8a-0851b8935d63 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:15.577056 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:15.577056 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:15.594350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dae635eb-a999-4a6d-9c8a-0851b8935d63 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:15.598728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dae635eb-a999-4a6d-9c8a-0851b8935d63 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:15.845347 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dae635eb-a999-4a6d-9c8a-0851b8935d63 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.281571 Dec 18 20:47:15.846490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 128/261] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:47:15 2021] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:15.860709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06a88965-0875-4568-a296-d9838b4a6df8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:15.861661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06a88965-0875-4568-a296-d9838b4a6df8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:15.961209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06a88965-0875-4568-a296-d9838b4a6df8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:15.974747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06a88965-0875-4568-a296-d9838b4a6df8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:15.977463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06a88965-0875-4568-a296-d9838b4a6df8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:15.978615 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06a88965-0875-4568-a296-d9838b4a6df8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1262 microversion: 2.25 time: 0.125143 Dec 18 20:47:15.999825 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 129/262] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:15 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1262 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:16.008055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:16.011971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:16.033100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:16.034169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:16.040704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:16.041192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:16.082319 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] HTTP exception thrown: Instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e could not be found. Dec 18 20:47:16.083925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Returning 404 to user: Instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:16.088209 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-05c16d3b-bdbe-450f-a460-b7733e2b3cf3 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 404 len: 111 microversion: 2.1 time: 0.084876 Dec 18 20:47:16.094407 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 130/263] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:16 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:16.111693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:16.114453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf1253c8-4cb9-407d-984d-019fc64ee092 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:16.116018 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:16.116018 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:16.125929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf1253c8-4cb9-407d-984d-019fc64ee092 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.028248 Dec 18 20:47:16.127540 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 131/264] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 20:47:16 2021] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:16.139706 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6255323e-7764-4c1e-99dd-53e8eab23d94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1310 microversion: 2.1 time: 0.654895 Dec 18 20:47:16.145875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5bdd069-5566-41ed-bd70-f78173d2325c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:16.158780 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 134/265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:15 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1310 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:16.164720 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:16.164720 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:16.197614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd069-5566-41ed-bd70-f78173d2325c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:16.199437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd069-5566-41ed-bd70-f78173d2325c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:16.402413 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5bdd069-5566-41ed-bd70-f78173d2325c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.259980 Dec 18 20:47:16.403231 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 132/266] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Dec 18 20:47:16 2021] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:16.410394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:16.411242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:16.424874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:16.425789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:16.426918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:16.427690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:16.440004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1094778953", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:16.517096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:16.838438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:16.859491 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01a4e051-db17-44ca-9e50-76b817928f7a tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1319 microversion: 2.1 time: 0.452800 Dec 18 20:47:16.861287 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 133/267] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:16 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:16.870391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1284688271", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:16.937357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:16.989743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:16.990213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:16.990775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:16.991408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:16.992443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:17.007171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.008005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.008997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.009602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.045064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Getting quotas for project 5a64115a8fdc4fd78580446ebb4622de. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:17.051365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Getting quotas for user 09e05995c6824c90ab707fca61caaf85 and project 5a64115a8fdc4fd78580446ebb4622de. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:17.068577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:17.071362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:17.173386 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2e3671a-7b8f-498b-a4e4-6f89c359c4cd tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960936 Dec 18 20:47:17.174400 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 135/268] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:17.182222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd5aef2e-ec51-491a-90ee-63cf7e96b8c9 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:17.185015 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:17.185015 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:17.231663 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd5aef2e-ec51-491a-90ee-63cf7e96b8c9 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.055817 Dec 18 20:47:17.232985 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 136/269] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:47:17 2021] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:17.238889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d5f91aa2-f3d7-4e7e-a3ff-6a30902b0256 req-66c6c5cf-03da-4886-a848-20513acf9849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f", "tag": "4ca78321-f8c5-417a-8eae-41822d244cd0"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:17.241350 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:17.241350 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:17.267930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d5f91aa2-f3d7-4e7e-a3ff-6a30902b0256 req-66c6c5cf-03da-4886-a848-20513acf9849 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.270297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d5f91aa2-f3d7-4e7e-a3ff-6a30902b0256 req-66c6c5cf-03da-4886-a848-20513acf9849 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.316861 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d5f91aa2-f3d7-4e7e-a3ff-6a30902b0256 req-66c6c5cf-03da-4886-a848-20513acf9849 service nova] Creating event network-changed:4ca78321-f8c5-417a-8eae-41822d244cd0 for instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f on nch1-master-1 Dec 18 20:47:17.324033 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d5f91aa2-f3d7-4e7e-a3ff-6a30902b0256 req-66c6c5cf-03da-4886-a848-20513acf9849 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089288 Dec 18 20:47:17.325418 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 137/270] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:17.336434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:17.337202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:17.350042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.350659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.352218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.352620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.438442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:17.438946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:17.439504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:17.440033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:17.440542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:17.453741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.456032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.457547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.458181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.492565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Getting quotas for project fd46334a58394a98a92a0d9dbcfcfe59. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:17.500192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Getting quotas for user 38872124d18947de9ea12c83e207715e and project fd46334a58394a98a92a0d9dbcfcfe59. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:17.524089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:17.528624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:17.623583 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1f6888a8-cb21-44ca-84dc-32af0c85304e tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759203 Dec 18 20:47:17.625440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 134/271] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:17.639321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:17.644457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:17.656368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.657152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.658326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:17.659041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:17.790677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:17.800621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:17.803725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:17.805919 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45cabb4e-167f-4721-a929-97b50c935597 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1322 microversion: 2.25 time: 0.478928 Dec 18 20:47:17.806950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 138/272] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:17 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:17.814043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c033391e-1722-4279-bde1-2318ba078b20 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:17.814836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c033391e-1722-4279-bde1-2318ba078b20 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:17.914462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c033391e-1722-4279-bde1-2318ba078b20 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:17.923561 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c033391e-1722-4279-bde1-2318ba078b20 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1222 microversion: 2.1 time: 0.115466 Dec 18 20:47:17.926783 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 139/273] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:17 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:17.933409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-975e2590-eead-4b3f-ac54-7d971295c22e tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-571309168"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:17.936093 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:17.936093 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:17.938067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-975e2590-eead-4b3f-ac54-7d971295c22e tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid 2c7b511e-df0e-4816-a249-469caa50fa18 for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:17.988803 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-975e2590-eead-4b3f-ac54-7d971295c22e tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060549 Dec 18 20:47:17.998120 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 140/274] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:17 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:18.076968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-712042846", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:18.156018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] validate_networks() for [('d5d78104-ccc5-490d-ac8e-b3ffc0787b91', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:18.239600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:18.250840 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7423a1c-a62e-490e-945c-6369e539ad57 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1310 microversion: 2.1 time: 0.618193 Dec 18 20:47:18.251849 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 135/275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:17 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1310 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:18.256797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:18.262433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:18.270050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:18.270513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:18.271427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:18.272162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:18.392616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:18.400615 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-018e38e6-4b6a-430d-9bda-fd508131225f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1224 microversion: 2.1 time: 0.147742 Dec 18 20:47:18.401364 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 136/276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:18 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:18.414602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:18.415224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:18.422235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:18.422800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:18.423651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:18.424034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:19.016770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:19.034852 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57700e9d-83cf-4201-b45f-25458e7da01b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1468 microversion: 2.1 time: 0.631941 Dec 18 20:47:19.035450 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 137/277] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:18 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1468 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:19.053088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c076a82-80d9-4cb6-9d59-f705e8cc30ed tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:19.060308 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:19.060308 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:19.079421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c076a82-80d9-4cb6-9d59-f705e8cc30ed tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:19.079877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c076a82-80d9-4cb6-9d59-f705e8cc30ed tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:19.288085 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c076a82-80d9-4cb6-9d59-f705e8cc30ed tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.239335 Dec 18 20:47:19.289117 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 138/278] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:19 2021] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:19.295287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:19.296244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:19.305687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:19.307321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:19.308273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:19.308815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:19.522784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:19.545265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:19.549628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:19.556072 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b2a39cd-5486-4a51-b445-e3eb9c8da079 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1320 microversion: 2.25 time: 0.264285 Dec 18 20:47:19.572673 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 139/279] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:19 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:19.582984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:19.584417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:19.594714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:19.595853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:19.597901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:19.598598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.065243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:20.065784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:20.066018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:20.066450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:20.066864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:20.086324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.086781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.087785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.088407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.128682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Getting quotas for project e622a6218cdd40c8861466b0d36c1ffe. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:20.140893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Getting quotas for user 6992d255e81c499a8373dd4c727e1f41 and project e622a6218cdd40c8861466b0d36c1ffe. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:20.159794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:20.162322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:20.298734 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-db214d4f-5a74-46f9-b982-a6e8f196cfcf tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.298253 Dec 18 20:47:20.300005 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 141/280] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:20.541524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2132331434", "block_migration": true, "disk_over_commit": false}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:20.545322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:20.572034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.574648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.587118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.587805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.815665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lazy-loading 'flavor' on Instance uuid 95cf5470-3fd1-480e-be6c-0d42081ad67a {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:20.841082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:20.852317 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6082b666-bcf5-418f-a7b2-f3e5ad407baf tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1322 microversion: 2.1 time: 1.275558 Dec 18 20:47:20.862816 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 140/281] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:19 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1322 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:20.876105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:20.877499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:20.890144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.894027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.895751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.897497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.927164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Going to try to live migrate instance to tempest-host-2132331434 {{(pid=140732) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:47:20.936077 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] HTTP exception thrown: Compute host tempest-host-2132331434 could not be found. Dec 18 20:47:20.937731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Returning 400 to user: Compute host tempest-host-2132331434 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:20.938877 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5fbaeffa-457a-4764-9ce6-442d368a187f tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a/action" status: 400 len: 100 microversion: 2.1 time: 0.637820 Dec 18 20:47:20.940182 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 142/282] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Dec 18 20:47:20 2021] POST /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a/action => generated 100 bytes in 639 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:47:20.945818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d0434233-0a03-4243-be26-363301443787 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:20.947241 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:20.947241 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:20.961894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d0434233-0a03-4243-be26-363301443787 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.020080 Dec 18 20:47:20.969512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 143/283] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:47:20 2021] GET /compute/v2.1/os-aggregates => generated 245 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:20.974804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:20.975920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:20.984400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.985188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:20.986214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:20.986896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:21.135659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:21.152136 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24195093-6e05-4629-ba39-a909ae842ed8 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1278 microversion: 2.1 time: 0.180387 Dec 18 20:47:21.153343 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 144/284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:20 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:21.160456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:21.162817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:21.177792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:21.178405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:21.187813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:21.188597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:21.488356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:21.495998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e9b7fc2-4a43-48db-bb8f-f11109bd18ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1227 microversion: 2.1 time: 0.341099 Dec 18 20:47:21.497225 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 145/285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:21 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1227 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:21.501855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:21.502941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:21.509524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:21.510436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:21.511478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:21.512256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:21.678331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:21.697370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d1cd1cd7-3a2b-4349-8fa7-5a04ecad9b64 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1310 microversion: 2.1 time: 0.832151 Dec 18 20:47:21.711182 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 141/286] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:20 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1310 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:21.716903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-5e672a88-f3f2-4667-afe1-fff4762d327e req-da0a316e-4aba-415f-98d1-2f95da05b71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8c0a8e-fad4-49ff-9339-2f05327c58f3", "tag": "14e2305d-ac69-431f-8068-23084ff0cb71"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:21.719527 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:21.719527 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:21.751804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5e672a88-f3f2-4667-afe1-fff4762d327e req-da0a316e-4aba-415f-98d1-2f95da05b71c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:21.752647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5e672a88-f3f2-4667-afe1-fff4762d327e req-da0a316e-4aba-415f-98d1-2f95da05b71c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:21.765932 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-5e672a88-f3f2-4667-afe1-fff4762d327e req-da0a316e-4aba-415f-98d1-2f95da05b71c service nova] Creating event network-changed:14e2305d-ac69-431f-8068-23084ff0cb71 for instance 7f8c0a8e-fad4-49ff-9339-2f05327c58f3 on nch2-master-1 Dec 18 20:47:21.771486 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-5e672a88-f3f2-4667-afe1-fff4762d327e req-da0a316e-4aba-415f-98d1-2f95da05b71c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058625 Dec 18 20:47:21.772086 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 142/287] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:21.777524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:21.778292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:21.786600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:21.787251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:21.788181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:21.788853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:22.295614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:22.306168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:22.311589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:22.316881 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec8013a4-65e7-4dcb-9f7e-29152b3673e0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1362 microversion: 2.25 time: 0.818324 Dec 18 20:47:22.317470 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 146/288] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:21 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1362 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:22.323221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d03bb3b2-0268-4ca0-9886-d6562bcab192 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:22.324916 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:22.324916 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:22.336097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d03bb3b2-0268-4ca0-9886-d6562bcab192 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:22.336756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d03bb3b2-0268-4ca0-9886-d6562bcab192 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:22.456061 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d03bb3b2-0268-4ca0-9886-d6562bcab192 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.136953 Dec 18 20:47:22.457257 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 147/289] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:22 2021] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:22.465457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:22.466372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:22.472889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:22.473526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:22.474592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:22.475179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:22.483600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:22.492162 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4b75120-51e7-4906-a367-70e604c4b14b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1468 microversion: 2.1 time: 0.718319 Dec 18 20:47:22.513431 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 143/290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:21 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1468 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:22.525932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:22.526582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:22.540504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:22.542510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:22.543315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:22.554981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:22.685702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:22.697029 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1782ec5-b130-42d5-9b8c-93f7e2108ae5 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1278 microversion: 2.1 time: 0.173214 Dec 18 20:47:22.697897 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 144/291] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:22 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:22.705944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5971dfd-a8d1-408d-8a56-b1f515aa4e05 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:22.707263 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:22.707263 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:22.741378 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5971dfd-a8d1-408d-8a56-b1f515aa4e05 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.039482 Dec 18 20:47:22.745399 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 145/292] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:22 2021] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:22.755761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:22.757429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:22.770920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:22.771517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:22.777893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:22.778512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:23.164658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:23.173933 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8416d7e5-9351-4210-bda6-16f69293bffc tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1281 microversion: 2.1 time: 0.427396 Dec 18 20:47:23.174783 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 146/293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:22 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1281 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:23.188565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:23.189192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:23.196136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:23.196583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:23.197375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:23.197978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:23.352357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:23.367370 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-764ff09b-63ab-4ab2-be94-1dc3bcea8250 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1322 microversion: 2.1 time: 0.908796 Dec 18 20:47:23.377993 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 148/294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:22 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1322 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:23.385919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1cd81422-54a4-420c-8c54-8fb2792aeb62 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1377533313"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:23.393486 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:23.393486 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:23.395405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-1cd81422-54a4-420c-8c54-8fb2792aeb62 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid 25dcc91b-e490-4878-940c-f1022d9e0077 for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:23.438576 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1cd81422-54a4-420c-8c54-8fb2792aeb62 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058174 Dec 18 20:47:23.439846 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 149/295] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:23 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:23.453252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-964052111", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:23.564778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:23.770266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:23.777682 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01df0e67-3e54-435c-b50d-92718a8f4eff tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1310 microversion: 2.1 time: 0.593202 Dec 18 20:47:23.778474 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 147/296] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:23 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1310 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:23.791609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:23.792376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:23.801347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:23.802385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:23.804995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:23.805530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.457976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:24.469036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:24.472051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:24.473545 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-866adbf1-37ad-499f-b71f-65e45c1b5923 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1362 microversion: 2.25 time: 0.685491 Dec 18 20:47:24.474457 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 148/297] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:23 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1362 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:24.490065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf579b49-8ad0-438b-851a-0d86bc19c11b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:24.491491 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:24.491491 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:24.503268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf579b49-8ad0-438b-851a-0d86bc19c11b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.504345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf579b49-8ad0-438b-851a-0d86bc19c11b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.513514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:24.514707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:24.515372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:24.515966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:24.518208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:24.540334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.540863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.543204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.543662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.590373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Getting quotas for project 1c1f758740e442a0829910680148236b. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:24.596505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Getting quotas for user b9e4893e5d944bce9da0588758509af4 and project 1c1f758740e442a0829910680148236b. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:24.613418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:24.615999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:24.669021 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80b95119-2ec7-43f8-b707-51946f7d3859 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.227432 Dec 18 20:47:24.672555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf579b49-8ad0-438b-851a-0d86bc19c11b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.196759 Dec 18 20:47:24.674022 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 149/298] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:24 2021] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:24.675681 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 150/299] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:24.679161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d8df4a29-2394-4f13-90d2-eb15d49ef589 req-db7ce380-34e2-48ad-97b8-5091201a4d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8c445f-06db-4133-a919-8c79de5333f0", "tag": "35ef2a63-339b-4a47-a0b0-2edcd0dd0be1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:24.680863 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:24.680863 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:24.684057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:24.684987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:24.692641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.693088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.693882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.694603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.707766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d8df4a29-2394-4f13-90d2-eb15d49ef589 req-db7ce380-34e2-48ad-97b8-5091201a4d42 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.708430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d8df4a29-2394-4f13-90d2-eb15d49ef589 req-db7ce380-34e2-48ad-97b8-5091201a4d42 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.733093 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d8df4a29-2394-4f13-90d2-eb15d49ef589 req-db7ce380-34e2-48ad-97b8-5091201a4d42 service nova] Creating event network-changed:35ef2a63-339b-4a47-a0b0-2edcd0dd0be1 for instance 9b8c445f-06db-4133-a919-8c79de5333f0 on nch2-master-1 Dec 18 20:47:24.739997 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d8df4a29-2394-4f13-90d2-eb15d49ef589 req-db7ce380-34e2-48ad-97b8-5091201a4d42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064517 Dec 18 20:47:24.741127 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 150/300] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:24.748863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6a057701-2ecd-4fef-81b9-f04d2483849e req-2582d02d-c4f8-46d3-b9f3-db0efedbb399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5", "tag": "d5d720a6-0889-449d-a427-b3d33c3e0143"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:24.750538 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:24.750538 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:24.766949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a057701-2ecd-4fef-81b9-f04d2483849e req-2582d02d-c4f8-46d3-b9f3-db0efedbb399 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.767508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a057701-2ecd-4fef-81b9-f04d2483849e req-2582d02d-c4f8-46d3-b9f3-db0efedbb399 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.781391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6a057701-2ecd-4fef-81b9-f04d2483849e req-2582d02d-c4f8-46d3-b9f3-db0efedbb399 service nova] Creating event network-changed:d5d720a6-0889-449d-a427-b3d33c3e0143 for instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 on nch1-master-1 Dec 18 20:47:24.788297 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6a057701-2ecd-4fef-81b9-f04d2483849e req-2582d02d-c4f8-46d3-b9f3-db0efedbb399 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045389 Dec 18 20:47:24.788979 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 151/301] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:24.796682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:24.797507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:24.804477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.804671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:24.805446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:24.805882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.415131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:25.423002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-be124b39-f033-4622-9530-b459dc1ee62d tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.745993 Dec 18 20:47:25.423683 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 151/302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:24 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:25.428318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cecd48e9-631a-417a-a154-a3c74f0969c1 req-0db42041-3a03-45be-9433-fcef2bf4ced8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f", "name": "network-vif-plugged", "status": "completed", "tag": "4ca78321-f8c5-417a-8eae-41822d244cd0"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:25.430610 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:25.430610 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:25.438184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cecd48e9-631a-417a-a154-a3c74f0969c1 req-0db42041-3a03-45be-9433-fcef2bf4ced8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.438941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cecd48e9-631a-417a-a154-a3c74f0969c1 req-0db42041-3a03-45be-9433-fcef2bf4ced8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.452231 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cecd48e9-631a-417a-a154-a3c74f0969c1 req-0db42041-3a03-45be-9433-fcef2bf4ced8 service nova] Creating event network-vif-plugged:4ca78321-f8c5-417a-8eae-41822d244cd0 for instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f on nch1-master-1 Dec 18 20:47:25.457552 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cecd48e9-631a-417a-a154-a3c74f0969c1 req-0db42041-3a03-45be-9433-fcef2bf4ced8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 Dec 18 20:47:25.458345 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 152/303] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:25.463437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:25.464128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:25.482080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.482734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.483711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.488883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.511585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:25.525613 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-31146c50-94ba-4315-9ecb-ff03d65d06ae tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1323 microversion: 2.1 time: 0.734058 Dec 18 20:47:25.549721 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 152/304] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:24 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1323 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:25.557906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:25.558796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:25.570865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.572250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.573332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.573998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.727391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:25.734925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4fea71f3-afea-4248-973b-5c5921efd02c tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1270 microversion: 2.1 time: 0.183356 Dec 18 20:47:25.735695 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 153/305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:25 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:25.747186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6aa0ef65-4e0e-4b57-ba73-f877827a10cc tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:25.748730 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:25.748730 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:25.757516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aa0ef65-4e0e-4b57-ba73-f877827a10cc tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.758102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aa0ef65-4e0e-4b57-ba73-f877827a10cc tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.913080 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6aa0ef65-4e0e-4b57-ba73-f877827a10cc tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.176109 Dec 18 20:47:25.921409 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 154/306] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:25 2021] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:25.927555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:25.928436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:25.935736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.936645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:25.937676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:25.938278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:26.081740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:26.091530 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e571bfd2-1eec-4669-9865-c665ab85fd0b tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1322 microversion: 2.1 time: 0.631862 Dec 18 20:47:26.092105 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 153/307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:25 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:26.097218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:26.097999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:26.105696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:26.106232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:26.107104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:26.107675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:26.414368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:26.422209 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-407cb8a3-3a2a-4021-9d37-df663a58ae29 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1310 microversion: 2.1 time: 0.499157 Dec 18 20:47:26.424812 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 155/308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:25 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1310 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:26.429024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23d13678-077a-45ab-8e6d-7d2b0b37332b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:26.429985 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:26.429985 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:26.454766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23d13678-077a-45ab-8e6d-7d2b0b37332b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.030213 Dec 18 20:47:26.456545 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 156/309] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:26 2021] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:26.462890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:26.463506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:26.469819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:26.470277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:26.471269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:26.471523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:26.661944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:26.670465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:26.672173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:26.673450 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ab60826-a035-46e6-b1c1-6fff0d6ebff0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1362 microversion: 2.25 time: 0.580431 Dec 18 20:47:26.674177 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 154/310] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:26 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:26.679701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43b88d5d-5109-4bc2-af02-962277c3a270 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749039892"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:26.681620 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:26.681620 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:26.683219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-43b88d5d-5109-4bc2-af02-962277c3a270 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid d03a8b03-45e3-4a5b-a0cd-6c719879d4d4 for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:26.716413 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-43b88d5d-5109-4bc2-af02-962277c3a270 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040836 Dec 18 20:47:26.717276 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 155/311] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:26 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:26.724030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-821e993f-2a56-4240-a04e-9ca47133de2b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1790259459"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:26.725759 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:26.725759 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:26.728053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-821e993f-2a56-4240-a04e-9ca47133de2b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid b8b8827c-6750-4afb-bf10-8f2fccded1fa for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:26.768954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-821e993f-2a56-4240-a04e-9ca47133de2b tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050223 Dec 18 20:47:26.778415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 156/312] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:26 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:26.785126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:26.785967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:26.794203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:26.794764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:26.795622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:26.796076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.164111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:27.173138 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-78b49d71-b234-476d-bcd7-948cb8e68ad2 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.715482 Dec 18 20:47:27.174490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 157/313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:26 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:27.188829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-030a3766-c6c1-4d9a-968c-3a833e4795cf tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:27.189602 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:27.189602 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:27.239570 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-030a3766-c6c1-4d9a-968c-3a833e4795cf tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.063905 Dec 18 20:47:27.241008 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 158/314] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:27 2021] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:27.253749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:27.254401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:27.275562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.276217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.277325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.277771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.408125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:27.433598 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-089b3907-bf24-41b7-9e6a-e2d968273e49 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1323 microversion: 2.1 time: 0.650502 Dec 18 20:47:27.435640 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 157/315] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:26 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1323 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:27.441459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e567288e-055f-4d22-9e8f-9482cd78c88e req-826d836b-e1c6-4274-ae06-0194bdc3324f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5797131-be90-426e-9985-dd40c4b114b9", "tag": "4d05019a-71c6-40bd-a082-feb8872a8f1f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:27.443377 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:27.443377 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:27.456787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e567288e-055f-4d22-9e8f-9482cd78c88e req-826d836b-e1c6-4274-ae06-0194bdc3324f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.457225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e567288e-055f-4d22-9e8f-9482cd78c88e req-826d836b-e1c6-4274-ae06-0194bdc3324f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.469135 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e567288e-055f-4d22-9e8f-9482cd78c88e req-826d836b-e1c6-4274-ae06-0194bdc3324f service nova] Creating event network-changed:4d05019a-71c6-40bd-a082-feb8872a8f1f for instance a5797131-be90-426e-9985-dd40c4b114b9 on nch2-master-1 Dec 18 20:47:27.474885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e567288e-055f-4d22-9e8f-9482cd78c88e req-826d836b-e1c6-4274-ae06-0194bdc3324f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037459 Dec 18 20:47:27.476923 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 158/316] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:27.489348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d0108e46-bb75-41ba-b64d-0cb3f6f825fc tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:27.491018 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:27.491018 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:27.503968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0108e46-bb75-41ba-b64d-0cb3f6f825fc tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.504418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0108e46-bb75-41ba-b64d-0cb3f6f825fc tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.505466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:27.514205 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-435dbf0f-0c9e-4058-95a2-99f0608ce00b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1318 microversion: 2.1 time: 0.270443 Dec 18 20:47:27.518983 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 159/317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:27 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:27.527091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:27.527754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:27.539730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.543643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.546828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.547447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.696041 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d0108e46-bb75-41ba-b64d-0cb3f6f825fc tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.218143 Dec 18 20:47:27.696707 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 159/318] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:27 2021] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:27.701159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21779a3b-7750-4d07-8a3e-320d2ac7c5fb tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:27.702381 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:27.702381 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:27.709067 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-21779a3b-7750-4d07-8a3e-320d2ac7c5fb tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Dec 18 20:47:27.709770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21779a3b-7750-4d07-8a3e-320d2ac7c5fb tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:27.711380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21779a3b-7750-4d07-8a3e-320d2ac7c5fb tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.013684 Dec 18 20:47:27.715512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 160/319] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:47:27 2021] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:27.720904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:27.721663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:27.728461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.729119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.729918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.730395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.890940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:27.920389 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6941ee4f-ce0e-409c-bbae-95d44a3fb7d2 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1322 microversion: 2.1 time: 0.400104 Dec 18 20:47:27.920990 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 160/320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:27 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:27.941990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-46465ef2-1d78-4240-b96b-b76f47472b3b req-a90c5eaa-4740-4312-8e0b-752fcd99f56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8c0a8e-fad4-49ff-9339-2f05327c58f3", "name": "network-vif-plugged", "status": "completed", "tag": "14e2305d-ac69-431f-8068-23084ff0cb71"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:27.946879 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:27.946879 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:27.955078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-46465ef2-1d78-4240-b96b-b76f47472b3b req-a90c5eaa-4740-4312-8e0b-752fcd99f56f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:27.955742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-46465ef2-1d78-4240-b96b-b76f47472b3b req-a90c5eaa-4740-4312-8e0b-752fcd99f56f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:27.975142 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-46465ef2-1d78-4240-b96b-b76f47472b3b req-a90c5eaa-4740-4312-8e0b-752fcd99f56f service nova] Creating event network-vif-plugged:14e2305d-ac69-431f-8068-23084ff0cb71 for instance 7f8c0a8e-fad4-49ff-9339-2f05327c58f3 on nch2-master-1 Dec 18 20:47:27.981654 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-46465ef2-1d78-4240-b96b-b76f47472b3b req-a90c5eaa-4740-4312-8e0b-752fcd99f56f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053077 Dec 18 20:47:27.982890 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 161/321] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:27.992618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:27.993509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:28.004175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.005432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.007932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.008855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.065316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:28.075603 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b5060a66-35c7-4c08-9502-60233cbf2399 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1493 microversion: 2.1 time: 0.358563 Dec 18 20:47:28.089380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 161/322] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:27 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1493 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:28.094466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea8e8ca3-2d22-427f-9073-0daf99224951 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:28.096007 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:28.096007 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:28.097183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ea8e8ca3-2d22-427f-9073-0daf99224951 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9a188df8ed504951b850b40842ffbe73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38480e435834a8cb37eacd183315171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:28.098008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea8e8ca3-2d22-427f-9073-0daf99224951 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:28.099293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ea8e8ca3-2d22-427f-9073-0daf99224951 tempest-AggregatesAdminNegativeTestJSON-999867906 tempest-AggregatesAdminNegativeTestJSON-999867906-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.008559 Dec 18 20:47:28.104008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 162/323] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:28 2021] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:28.109238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a14207e-efc1-4d0a-8764-ec7a308cc208 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:28.110005 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:28.110005 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:28.122569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-8a14207e-efc1-4d0a-8764-ec7a308cc208 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Dec 18 20:47:28.123156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a14207e-efc1-4d0a-8764-ec7a308cc208 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:28.123967 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a14207e-efc1-4d0a-8764-ec7a308cc208 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.018763 Dec 18 20:47:28.130218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 163/324] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:28 2021] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:28.135777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3c635f69-86a8-4d88-9d28-5d4b015ca893 req-585e0522-cc2c-43cd-a796-58ef1439a73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414c46a7-2ac0-44c1-a29f-eed2a0f1a029", "tag": "58e60486-e1d6-436d-9e39-32ef38bda602"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:28.137458 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:28.137458 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:28.144931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3c635f69-86a8-4d88-9d28-5d4b015ca893 req-585e0522-cc2c-43cd-a796-58ef1439a73e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.145377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3c635f69-86a8-4d88-9d28-5d4b015ca893 req-585e0522-cc2c-43cd-a796-58ef1439a73e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.159931 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3c635f69-86a8-4d88-9d28-5d4b015ca893 req-585e0522-cc2c-43cd-a796-58ef1439a73e service nova] Creating event network-changed:58e60486-e1d6-436d-9e39-32ef38bda602 for instance 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 on nch1-master-1 Dec 18 20:47:28.165866 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3c635f69-86a8-4d88-9d28-5d4b015ca893 req-585e0522-cc2c-43cd-a796-58ef1439a73e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034318 Dec 18 20:47:28.166790 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 164/325] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:28.349103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-37558ea0-83f8-48cc-88f9-b937b38553ce tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:28.349797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-37558ea0-83f8-48cc-88f9-b937b38553ce tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:28.360827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37558ea0-83f8-48cc-88f9-b937b38553ce tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.361274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37558ea0-83f8-48cc-88f9-b937b38553ce tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.362291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37558ea0-83f8-48cc-88f9-b937b38553ce tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.363015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37558ea0-83f8-48cc-88f9-b937b38553ce tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.371522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:28.385591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:28.389899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:28.393872 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c3c89df7-8b6c-40e8-b79e-ef7ebd06ee1a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1362 microversion: 2.25 time: 0.409595 Dec 18 20:47:28.396326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 162/326] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:27 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:28.408142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7bfb8dd2-5618-4bd3-a023-71730708e7be tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:28.411523 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:28.411523 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:28.423760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bfb8dd2-5618-4bd3-a023-71730708e7be tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.424591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bfb8dd2-5618-4bd3-a023-71730708e7be tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.553394 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-37558ea0-83f8-48cc-88f9-b937b38553ce tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1644 microversion: 2.1 time: 0.384432 Dec 18 20:47:28.562565 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7bfb8dd2-5618-4bd3-a023-71730708e7be tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.162313 Dec 18 20:47:28.563373 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 163/327] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:28 2021] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:28.569023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44624a76-a245-4b21-b733-fb85fed1ff91 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1059971235", "name": "tempest-test_aggregate-1573934798"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:28.570795 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:28.570795 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:28.572545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.aggregate [None req-44624a76-a245-4b21-b733-fb85fed1ff91 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid e963a4fc-6e60-4724-b33a-2143a3dad35a for aggregate {{(pid=140731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:28.584865 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 165/328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:28 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1644 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:28.589829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:28.590693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:28.597309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.597965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.599013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.600253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.611590 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44624a76-a245-4b21-b733-fb85fed1ff91 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.046888 Dec 18 20:47:28.620369 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 164/329] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Dec 18 20:47:28 2021] POST /compute/v2.1/os-aggregates => generated 223 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:28.620692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:28.621369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:28.630161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.630802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.632840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.633266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.874458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:28.875906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:28.885196 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-753d6b92-5b7e-4f2a-b6f5-0e78ab77024b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.298997 Dec 18 20:47:28.886008 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-50576a44-88f9-4088-a381-4ac6d1befcb1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1323 microversion: 2.1 time: 0.271695 Dec 18 20:47:28.894754 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 166/330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:28 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:28.896896 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 165/331] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:28 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:28.899859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:28.900627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:28.901370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7bf45b5-911e-4a7c-995f-fbcbe5920136 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:28.902130 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:28.902130 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:28.908423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.909108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.910051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.910717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.932992 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7bf45b5-911e-4a7c-995f-fbcbe5920136 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.034990 Dec 18 20:47:28.933580 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 166/332] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:28 2021] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:28.939096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b1028be-b598-45e0-9d86-aa9b4a3bf274 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:28.949831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b1028be-b598-45e0-9d86-aa9b4a3bf274 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:28.957793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1028be-b598-45e0-9d86-aa9b4a3bf274 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.958352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1028be-b598-45e0-9d86-aa9b4a3bf274 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:28.959144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1028be-b598-45e0-9d86-aa9b4a3bf274 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:28.959639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1028be-b598-45e0-9d86-aa9b4a3bf274 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.082712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:29.090517 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d64ca9bd-8979-4dce-9122-032810bc83f6 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1318 microversion: 2.1 time: 0.194514 Dec 18 20:47:29.091097 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 167/333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:28 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:29.095668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c16f07ed-8db2-45ae-a4e6-b0a206a6268e tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.096519 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.096519 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.118675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c16f07ed-8db2-45ae-a4e6-b0a206a6268e tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.026446 Dec 18 20:47:29.119157 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 168/334] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:29 2021] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:29.123927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.124747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:29.130747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.131152 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b1028be-b598-45e0-9d86-aa9b4a3bf274 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1644 microversion: 2.1 time: 0.196551 Dec 18 20:47:29.131539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.142817 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 167/335] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:28 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1644 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:29.143000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.143000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.143177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c55cc63-4a50-4403-b5b6-e10b1a5843b5 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1895818310"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:29.143177 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.143177 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:29.143177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.aggregate [None req-5c55cc63-4a50-4403-b5b6-e10b1a5843b5 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Generated uuid 52794177-337a-4be6-9bfd-b87d1bad40b3 for aggregate {{(pid=140731) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:29.160862 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c55cc63-4a50-4403-b5b6-e10b1a5843b5 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.027236 Dec 18 20:47:29.166981 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 168/336] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:29 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:29.171539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8d5b257-156d-42fb-add4-9adac41c8ac6 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.172420 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.172420 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:29.179626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f8d5b257-156d-42fb-add4-9adac41c8ac6 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Dec 18 20:47:29.180291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8d5b257-156d-42fb-add4-9adac41c8ac6 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:29.181182 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8d5b257-156d-42fb-add4-9adac41c8ac6 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.013141 Dec 18 20:47:29.184833 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 169/337] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:29.186947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ed0104e-7e01-4019-b47c-6a455db1aa1f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.188354 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.188354 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:29.190154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ed0104e-7e01-4019-b47c-6a455db1aa1f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.190699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ed0104e-7e01-4019-b47c-6a455db1aa1f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.191529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ed0104e-7e01-4019-b47c-6a455db1aa1f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.191966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ed0104e-7e01-4019-b47c-6a455db1aa1f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.216157 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8ed0104e-7e01-4019-b47c-6a455db1aa1f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.032973 Dec 18 20:47:29.216752 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 170/338] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:29.221032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:29.222284 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.222284 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:29.230847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.231300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.236626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.237072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.255003 ncdv-master-1 devstack@n-api.service[140731]: ERROR nova.api.openstack.compute.aggregates [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Dec 18 20:47:29.255612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Dec 18 20:47:29.256197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:29.257014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-578e856f-32cb-4a66-a119-6c678ad6aff4 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.039371 Dec 18 20:47:29.257578 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 171/339] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:29 2021] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:29.262227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07b6526b-fcd9-47dd-b2f2-2a14e21deec5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.262997 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.262997 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:29.271686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:29.274178 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-07b6526b-fcd9-47dd-b2f2-2a14e21deec5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Dec 18 20:47:29.274876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07b6526b-fcd9-47dd-b2f2-2a14e21deec5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:29.275753 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07b6526b-fcd9-47dd-b2f2-2a14e21deec5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.017215 Dec 18 20:47:29.276341 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 172/340] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:29 2021] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:29.280474 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f90dfe3-30d2-4935-b091-5608e4102604 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1322 microversion: 2.1 time: 0.159511 Dec 18 20:47:29.280799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:29.280918 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 169/341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:29.281903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:29.285754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-376725fc-0169-4778-83dc-5b27f04fb6a7 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.286544 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.286544 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.288592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.289524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.289945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.290425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.307077 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-376725fc-0169-4778-83dc-5b27f04fb6a7 tempest-AggregatesAdminNegativeTestJSON-1724686702 tempest-AggregatesAdminNegativeTestJSON-1724686702-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.024416 Dec 18 20:47:29.312032 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 170/342] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:29 2021] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:29.314092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35263f75-ffe5-4456-b131-50235720b412 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-640445421"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:29.315522 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.315522 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.316708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-35263f75-ffe5-4456-b131-50235720b412 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid c6e86abd-81b5-49c0-a939-463320e18c2f for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:29.348724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35263f75-ffe5-4456-b131-50235720b412 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039146 Dec 18 20:47:29.354833 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 171/343] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:29 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:29.360470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1959d97f-bf82-4259-aa83-4b5717422b17 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.361948 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.361948 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.373420 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1959d97f-bf82-4259-aa83-4b5717422b17 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.016624 Dec 18 20:47:29.378306 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 172/344] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:47:29.385581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3cd8aa0b-7434-4402-9882-c70ed782285b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:29.387114 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.387114 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.392206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lazy-loading 'flavor' on Instance uuid 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:29.419356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3cd8aa0b-7434-4402-9882-c70ed782285b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.037651 Dec 18 20:47:29.420233 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 173/345] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 20:47:29 2021] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:29.430639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.432577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:29.440659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.441922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.443194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.443881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.478731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Going to try to live migrate instance to nch2-master-1 {{(pid=140731) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:47:29.613017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:29.621804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:29.624295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:29.625894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e356042-5fe4-408a-bb54-aa27dbb7790f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1362 microversion: 2.25 time: 0.202080 Dec 18 20:47:29.636371 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 174/346] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:29.647973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0632e8bc-aeec-42c2-82c3-2108e12a27ec tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.648921 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.648921 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.659190 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0632e8bc-aeec-42c2-82c3-2108e12a27ec tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.020251 Dec 18 20:47:29.660902 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 175/347] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:29.672805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b40a1b8-2c71-4060-b346-2346015f62a2 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.674701 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.674701 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.705501 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b40a1b8-2c71-4060-b346-2346015f62a2 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.037725 Dec 18 20:47:29.706678 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 176/348] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:29 2021] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:29.716268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5e3b739e-24c7-4b4a-aa28-0619c89f75d7 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1708859732", "availability_zone": "tempest-test_az-1025894588"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:29.745049 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.745049 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.745978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-5e3b739e-24c7-4b4a-aa28-0619c89f75d7 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid 9784ae2e-23eb-47be-9e71-d91965e2e05c for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:29.772158 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5e3b739e-24c7-4b4a-aa28-0619c89f75d7 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.059510 Dec 18 20:47:29.773897 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 177/349] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Dec 18 20:47:29 2021] POST /compute/v2.1/os-aggregates => generated 223 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:29.784082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82313474-97bb-4623-93ab-b42ef80b38c5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1708859732_new", "availability_zone": "tempest-test_az-1025894588_new"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:29.785470 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.785470 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.826669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82313474-97bb-4623-93ab-b42ef80b38c5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.827210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82313474-97bb-4623-93ab-b42ef80b38c5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.868538 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82313474-97bb-4623-93ab-b42ef80b38c5 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.087527 Dec 18 20:47:29.869380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 178/350] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Dec 18 20:47:29 2021] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:29.880679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b4422ec-99a6-43b7-afef-ca02e0b5040b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.881783 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:29.881783 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:29.892124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b4422ec-99a6-43b7-afef-ca02e0b5040b tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.015569 Dec 18 20:47:29.893698 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 179/351] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/os-aggregates => generated 340 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:47:29.905125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:29.906231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:29.916426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.917141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:29.918935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:29.919541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.114694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:30.123118 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60d8158f-5f60-493f-812f-f63267921962 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.224097 Dec 18 20:47:30.123542 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 180/352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:29 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:30.130474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:30.131525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:30.140264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.141300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.142613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.143738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.351440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:30.359801 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6a8001aa-632f-4a05-b806-f20b11624c38 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1323 microversion: 2.1 time: 0.235009 Dec 18 20:47:30.370399 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 181/353] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:30 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:30.376386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59abfac3-3cfb-4f07-a9d9-511f46ebb318 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:30.378656 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:30.378656 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:30.407940 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59abfac3-3cfb-4f07-a9d9-511f46ebb318 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.035985 Dec 18 20:47:30.415078 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 182/354] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:30 2021] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:30.419700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:30.420418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:30.426315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.426883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.427763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.428292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.582415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:30.595967 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4139fe88-0636-4214-8749-47b54066b31f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1318 microversion: 2.1 time: 0.179700 Dec 18 20:47:30.596537 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 183/355] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:30 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:30.601268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:30.601911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:30.607997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.608439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.609248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.609909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.781384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:30.789095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eaab7f74-5f84-4c96-b11a-ec4cef1dbfc5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1472 microversion: 2.1 time: 0.191470 Dec 18 20:47:30.789673 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 184/356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:30 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:30.807315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a0d5d01c-b7d2-4004-8bb7-02fc44de0122 req-b3b97876-b4f2-4c0d-b67a-c58c351986a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5", "name": "network-vif-plugged", "status": "completed", "tag": "d5d720a6-0889-449d-a427-b3d33c3e0143"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:30.809118 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:30.809118 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:30.816093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a0d5d01c-b7d2-4004-8bb7-02fc44de0122 req-b3b97876-b4f2-4c0d-b67a-c58c351986a8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.816730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a0d5d01c-b7d2-4004-8bb7-02fc44de0122 req-b3b97876-b4f2-4c0d-b67a-c58c351986a8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.827415 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a0d5d01c-b7d2-4004-8bb7-02fc44de0122 req-b3b97876-b4f2-4c0d-b67a-c58c351986a8 service nova] Creating event network-vif-plugged:d5d720a6-0889-449d-a427-b3d33c3e0143 for instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 on nch1-master-1 Dec 18 20:47:30.832435 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a0d5d01c-b7d2-4004-8bb7-02fc44de0122 req-b3b97876-b4f2-4c0d-b67a-c58c351986a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029792 Dec 18 20:47:30.833223 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 185/357] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:30.838432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-199a47ca-bd5a-4577-abf7-c956a2c82f00 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-132100971"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:30.839759 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:30.839759 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:30.840930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-199a47ca-bd5a-4577-abf7-c956a2c82f00 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Generated uuid 72c849eb-63ce-48ea-9e08-7806a4dabc3f for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 20:47:30.863727 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-199a47ca-bd5a-4577-abf7-c956a2c82f00 tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.028986 Dec 18 20:47:30.864918 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 186/358] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 20:47:30 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:30.871258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:30.872288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:30.878952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.879405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:30.880201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:30.880641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:31.081777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:31.090862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:31.092387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:31.093689 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78ea8bb9-f27c-4825-8cba-57907a647f9c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1362 microversion: 2.25 time: 0.227567 Dec 18 20:47:31.094413 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 187/359] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:30 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:31.300163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6439240-569c-4b64-bb3f-ebcbcbadd0a9 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:31.300739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6439240-569c-4b64-bb3f-ebcbcbadd0a9 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] [instance: 89f463c4-1f93-4d96-b68d-8f3635cf8770] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:31.307159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d6439240-569c-4b64-bb3f-ebcbcbadd0a9 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] HTTP exception thrown: Instance 89f463c4-1f93-4d96-b68d-8f3635cf8770 could not be found. Dec 18 20:47:31.307822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6439240-569c-4b64-bb3f-ebcbcbadd0a9 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Returning 404 to user: Instance 89f463c4-1f93-4d96-b68d-8f3635cf8770 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:31.309281 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6439240-569c-4b64-bb3f-ebcbcbadd0a9 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/89f463c4-1f93-4d96-b68d-8f3635cf8770/action" status: 404 len: 111 microversion: 2.1 time: 0.213956 Dec 18 20:47:31.310511 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 188/360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:31 2021] POST /compute/v2.1/servers/89f463c4-1f93-4d96-b68d-8f3635cf8770/action => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:31.316716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30724b83-37ac-4f1d-ba29-48349fe9652c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:31.317534 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:31.317534 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:31.327580 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30724b83-37ac-4f1d-ba29-48349fe9652c tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.015504 Dec 18 20:47:31.344906 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 189/361] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:47:31 2021] GET /compute/v2.1/os-aggregates => generated 230 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:31.349791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:31.353571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:31.371890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:31.371890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:31.371890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:31.371890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:31.646919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:31.660269 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5202b308-991c-4323-bb4a-0b7e73d078fc tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.309838 Dec 18 20:47:31.665854 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 190/362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:31 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:31.686926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bf999f2-2e61-40db-93de-02fa1243474f tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:31.688296 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:31.688296 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:31.722625 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1bf999f2-2e61-40db-93de-02fa1243474f tempest-AggregatesAdminTestJSON-768904803 tempest-AggregatesAdminTestJSON-768904803-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.043567 Dec 18 20:47:31.725014 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 191/363] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 20:47:31 2021] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:47:31.743646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:31.744313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:31.757112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:31.757740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:31.758514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:31.759053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:31.765180 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c81ee55a-6951-4ae5-97cd-59e85b81812e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f/action" status: 202 len: 0 microversion: 2.1 time: 2.487709 Dec 18 20:47:31.767308 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 173/364] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:29 2021] POST /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f/action => generated 0 bytes in 2490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:31.773278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-901877677", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:31.861354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:32.019416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:32.031285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1166940f-9dcd-454c-902d-8b08cadd3098 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1323 microversion: 2.1 time: 0.299237 Dec 18 20:47:32.032861 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 192/365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:31 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:32.041853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:32.043730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:32.059717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.060862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.062890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.063638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.343872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:32.344522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:32.345664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:32.346290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:32.347007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:32.359376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.360141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.361315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.362028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.387764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Getting quotas for project 5a64115a8fdc4fd78580446ebb4622de. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:32.394431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Getting quotas for user 09e05995c6824c90ab707fca61caaf85 and project 5a64115a8fdc4fd78580446ebb4622de. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:32.401285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:32.410557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:32.413160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:32.414282 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a80cd93-d678-4b32-9bc3-8a9995d7c2ec tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1318 microversion: 2.1 time: 0.379521 Dec 18 20:47:32.414881 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 193/366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:32 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:32.424666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:32.426520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:32.440999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.442613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.446625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.448578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.464906 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7733a741-47b5-4349-9bc8-708c3b2d4143 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696135 Dec 18 20:47:32.465918 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 174/367] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:32.471090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:32.472112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:32.479428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.480185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.481181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.481945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.510833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:47:32.683017 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f79d7f61-963f-427e-9124-bdf468f368e0 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "DELETE /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 204 len: 0 microversion: 2.1 time: 0.265670 Dec 18 20:47:32.683804 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 194/368] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:32 2021] DELETE /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:32.693532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:32.695153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:32.703328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.703789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:32.704739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:32.706182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.080861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.089403 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-abe7f09d-a23c-423f-a31d-8383e6f5894e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1503 microversion: 2.1 time: 0.621961 Dec 18 20:47:33.089979 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 175/369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:32 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:33.099803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:33.101464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:33.107576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.108025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.108805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.109402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.220462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.233910 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a880afe8-bf15-48a3-b603-7be6c94a956a tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1225 microversion: 2.1 time: 0.139571 Dec 18 20:47:33.234768 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 176/370] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:33 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:33.237083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.239355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:33.239947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:33.245813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.246350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.247182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.247671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.251392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.253224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.254577 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4edffb50-509a-4f57-a8da-f6384b71c79a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1362 microversion: 2.25 time: 0.569565 Dec 18 20:47:33.255642 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 195/371] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:32 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1362 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:33.262388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:33.263517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:33.273352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.274498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.275578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.276418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.592826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.602052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32275ff9-44b4-445f-ade8-94dde2400f3f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.365907 Dec 18 20:47:33.602487 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 177/372] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:33 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:33.606436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.607481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f658639c-20b2-40ec-8d2e-93b2250d38a0 req-597c1419-1416-47a1-8b44-bbb4850eb1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8c445f-06db-4133-a919-8c79de5333f0", "name": "network-vif-plugged", "status": "completed", "tag": "35ef2a63-339b-4a47-a0b0-2edcd0dd0be1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:33.609405 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:33.609405 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:33.614827 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b704d2a9-9b25-468d-b548-af485382442f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1472 microversion: 2.1 time: 0.357924 Dec 18 20:47:33.615399 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 196/373] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:33 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:33.620530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f658639c-20b2-40ec-8d2e-93b2250d38a0 req-597c1419-1416-47a1-8b44-bbb4850eb1cf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.621243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f658639c-20b2-40ec-8d2e-93b2250d38a0 req-597c1419-1416-47a1-8b44-bbb4850eb1cf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.621431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:33.622029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:33.628733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.629178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.629952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.630406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.636613 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f658639c-20b2-40ec-8d2e-93b2250d38a0 req-597c1419-1416-47a1-8b44-bbb4850eb1cf service nova] Creating event network-vif-plugged:35ef2a63-339b-4a47-a0b0-2edcd0dd0be1 for instance 9b8c445f-06db-4133-a919-8c79de5333f0 on nch2-master-1 Dec 18 20:47:33.642512 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f658639c-20b2-40ec-8d2e-93b2250d38a0 req-597c1419-1416-47a1-8b44-bbb4850eb1cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038631 Dec 18 20:47:33.644321 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 178/374] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:33.870273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e46f7ee6-4ca5-48ca-8266-20ab25004bbb tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1145641217", "id": 1674634002, "os-flavor-access:is_public": "False"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:33.872018 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:33.872018 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:33.894821 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e46f7ee6-4ca5-48ca-8266-20ab25004bbb tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.248555 Dec 18 20:47:33.896035 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 179/375] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:33 2021] POST /compute/v2.1/flavors => generated 439 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:33.901072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:33.901937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:33.911013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.911871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.914629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:33.915118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:33.946229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:33.956996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57ac7f26-86d3-4be4-b8c8-d7ce73b0b954 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1519 microversion: 2.1 time: 0.340550 Dec 18 20:47:33.958654 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 197/376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:33 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1519 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:33.977783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ad65d13-f869-4336-ac95-80c8124b6263 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d2b26001001846edad29d1588d2ddeb0"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:33.980981 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:33.980981 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:34.070200 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ad65d13-f869-4336-ac95-80c8124b6263 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1674634002/action" status: 200 len: 97 microversion: 2.1 time: 0.110518 Dec 18 20:47:34.070839 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 198/377] 10.222.0.13 () {60 vars in 1199 bytes} [Sat Dec 18 20:47:33 2021] POST /compute/v2.1/flavors/1674634002/action => generated 97 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:47:34.077404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1f5cd25-134e-40bf-8701-b1e5b0c45904 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'create', calling method: .version_select at 0x7f714fe17820>, body: {"pool": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:34.338555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:34.355715 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71de82c4-9f2f-42f7-83b3-8d6ef7d83e52 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1318 microversion: 2.1 time: 0.458474 Dec 18 20:47:34.358088 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 180/378] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:33 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:34.364902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e0cb3862-ca7a-4616-90a1-d0b26dc21b6a req-adf1d789-db56-457c-9084-0f33a5967ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f", "name": "network-vif-unplugged", "status": "completed", "tag": "4ca78321-f8c5-417a-8eae-41822d244cd0"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:34.374836 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:34.374836 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:34.385252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e0cb3862-ca7a-4616-90a1-d0b26dc21b6a req-adf1d789-db56-457c-9084-0f33a5967ed5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:34.386048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e0cb3862-ca7a-4616-90a1-d0b26dc21b6a req-adf1d789-db56-457c-9084-0f33a5967ed5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:34.399888 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e0cb3862-ca7a-4616-90a1-d0b26dc21b6a req-adf1d789-db56-457c-9084-0f33a5967ed5 service nova] Creating event network-vif-unplugged:4ca78321-f8c5-417a-8eae-41822d244cd0 for instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f on nch1-master-1 Dec 18 20:47:34.404756 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e0cb3862-ca7a-4616-90a1-d0b26dc21b6a req-adf1d789-db56-457c-9084-0f33a5967ed5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044350 Dec 18 20:47:34.405975 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 181/379] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:34.411017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e98cb35f-7fff-4147-adad-319706851def tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d2b26001001846edad29d1588d2ddeb0"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:34.412472 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:34.412472 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:34.500915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e98cb35f-7fff-4147-adad-319706851def tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project d2b26001001846edad29d1588d2ddeb0 combination. Dec 18 20:47:34.502609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e98cb35f-7fff-4147-adad-319706851def tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project d2b26001001846edad29d1588d2ddeb0 combination. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:34.502609 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e98cb35f-7fff-4147-adad-319706851def tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1674634002/action" status: 409 len: 152 microversion: 2.1 time: 0.095349 Dec 18 20:47:34.507728 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 182/380] 10.222.0.13 () {60 vars in 1199 bytes} [Sat Dec 18 20:47:34 2021] POST /compute/v2.1/flavors/1674634002/action => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:34.513915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:34.514788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:34.524129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:34.524679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:34.525554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:34.529842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:35.231033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:35.239308 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-720eb63a-de95-43f9-8d40-ec9e5ea10ec8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1503 microversion: 2.1 time: 0.734284 Dec 18 20:47:35.242439 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 183/381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:34 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1503 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:35.259012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:35.259865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:35.279702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:35.280148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:35.280940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:35.281381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:35.642653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:35.650623 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-472e268c-b825-42af-baf1-30de3e5294c6 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1321 microversion: 2.1 time: 0.396908 Dec 18 20:47:35.660600 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 184/382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:35 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:35.665515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:35.666456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:35.672316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:35.673033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:35.673819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:35.674481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.067972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:36.078142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:36.079688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:36.080844 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f18f0edf-0bea-4a70-b620-dadd729218a4 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1558 microversion: 2.25 time: 0.418981 Dec 18 20:47:36.083623 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 185/383] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:35 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1558 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:36.088089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-354b248d-017d-4d44-af0a-eb36a24b8cd4 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d2b26001001846edad29d1588d2ddeb0"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:36.089366 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:36.089366 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:36.165716 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-354b248d-017d-4d44-af0a-eb36a24b8cd4 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1674634002/action" status: 200 len: 21 microversion: 2.1 time: 0.080832 Dec 18 20:47:36.166363 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 186/384] 10.222.0.13 () {60 vars in 1199 bytes} [Sat Dec 18 20:47:36 2021] POST /compute/v2.1/flavors/1674634002/action => generated 21 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:47:36.171379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:36.172145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:36.180717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.181216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.182113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.182686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.392661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:36.400419 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-37d09f5d-8537-472b-aab3-3f681a579c18 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.232888 Dec 18 20:47:36.400980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 187/385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:36 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:36.405226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:36.405968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:36.411547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.411991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.412757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.413827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.445962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.446465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.447037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lazy-loading 'fault' on Instance uuid caccd2f9-d868-4b2a-b4bd-860b5805bc39 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:36.548590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da04cb8260ca46fb8738fdfd071158f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbee547725d4a06ad0a4be9314d8d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:36.556655 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb002838-be29-451b-b532-8749f51989e6 tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 200 len: 1306 microversion: 2.1 time: 0.154302 Dec 18 20:47:36.566284 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 188/386] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:36 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 1306 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:36.566284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9ed9ad84-e0b6-4b55-acf3-2fec97a1b483 req-c4add099-254b-461f-b10f-c9ef66969de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7452c4b1-3737-41a6-a4cb-f98c06ee7f8b", "tag": "718fbc80-b499-485d-b8e8-9cf091c713e9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:36.566284 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:36.566284 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:36.571316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9ed9ad84-e0b6-4b55-acf3-2fec97a1b483 req-c4add099-254b-461f-b10f-c9ef66969de1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.571756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9ed9ad84-e0b6-4b55-acf3-2fec97a1b483 req-c4add099-254b-461f-b10f-c9ef66969de1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.583456 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9ed9ad84-e0b6-4b55-acf3-2fec97a1b483 req-c4add099-254b-461f-b10f-c9ef66969de1 service nova] Creating event network-changed:718fbc80-b499-485d-b8e8-9cf091c713e9 for instance 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b on nch2-master-1 Dec 18 20:47:36.588810 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9ed9ad84-e0b6-4b55-acf3-2fec97a1b483 req-c4add099-254b-461f-b10f-c9ef66969de1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030490 Dec 18 20:47:36.589584 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 189/387] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:36.594160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:36.594867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:36.601708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.602379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.603306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.603881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.813671 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1f5cd25-134e-40bf-8701-b1e5b0c45904 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.741775 Dec 18 20:47:36.814270 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 199/388] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:47:34 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:36.818800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-31fdb256-04a9-43e7-8fa9-9d7296a4c27d req-0e35733d-7125-4890-b007-c08de66a9135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5797131-be90-426e-9985-dd40c4b114b9", "name": "network-vif-plugged", "status": "completed", "tag": "4d05019a-71c6-40bd-a082-feb8872a8f1f"}, {"server_uuid": "414c46a7-2ac0-44c1-a29f-eed2a0f1a029", "name": "network-vif-plugged", "status": "completed", "tag": "58e60486-e1d6-436d-9e39-32ef38bda602"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:36.821316 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:36.821316 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:36.830828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-31fdb256-04a9-43e7-8fa9-9d7296a4c27d req-0e35733d-7125-4890-b007-c08de66a9135 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.831336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-31fdb256-04a9-43e7-8fa9-9d7296a4c27d req-0e35733d-7125-4890-b007-c08de66a9135 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.843910 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-31fdb256-04a9-43e7-8fa9-9d7296a4c27d req-0e35733d-7125-4890-b007-c08de66a9135 service nova] Creating event network-vif-plugged:4d05019a-71c6-40bd-a082-feb8872a8f1f for instance a5797131-be90-426e-9985-dd40c4b114b9 on nch2-master-1 Dec 18 20:47:36.844416 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-31fdb256-04a9-43e7-8fa9-9d7296a4c27d req-0e35733d-7125-4890-b007-c08de66a9135 service nova] Creating event network-vif-plugged:58e60486-e1d6-436d-9e39-32ef38bda602 for instance 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 on nch1-master-1 Dec 18 20:47:36.853135 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-31fdb256-04a9-43e7-8fa9-9d7296a4c27d req-0e35733d-7125-4890-b007-c08de66a9135 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037501 Dec 18 20:47:36.854164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 200/389] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:36 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:36.874918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:36.885503 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ede12a75-8e49-4c99-8048-3a49b9a16fc3 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1318 microversion: 2.1 time: 0.294865 Dec 18 20:47:36.886747 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 190/390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:36 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:36.891679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0872ceba-3942-4cd5-9812-1e72fc931889 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:36.892766 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:36.892766 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:36.918882 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0872ceba-3942-4cd5-9812-1e72fc931889 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1674634002" status: 202 len: 0 microversion: 2.1 time: 0.030194 Dec 18 20:47:36.920168 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 191/391] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:47:36 2021] DELETE /compute/v2.1/flavors/1674634002 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:36.931069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:36.931918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:36.941316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.941775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:36.942596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:36.943030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.016875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.017568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:37.024688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.025139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.025924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.027027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.166471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:37.174027 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-874b0a8b-b89b-4d66-adae-3f383642499a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1503 microversion: 2.1 time: 0.247032 Dec 18 20:47:37.174618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 192/392] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:36 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:37.179619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-beb93c13-fd0a-465a-aba6-26d9350244ea req-7040f466-7dbd-4548-8fd5-3f40f67fe0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f", "tag": "4ca78321-f8c5-417a-8eae-41822d244cd0"}, {"server_uuid": "caccd2f9-d868-4b2a-b4bd-860b5805bc39", "name": "network-vif-deleted", "tag": "9cc622e7-d64a-4dcb-9aee-7d8f79a9bb22"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:37.181252 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:37.181252 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:37.189087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-beb93c13-fd0a-465a-aba6-26d9350244ea req-7040f466-7dbd-4548-8fd5-3f40f67fe0b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.189529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-beb93c13-fd0a-465a-aba6-26d9350244ea req-7040f466-7dbd-4548-8fd5-3f40f67fe0b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.202048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-beb93c13-fd0a-465a-aba6-26d9350244ea req-7040f466-7dbd-4548-8fd5-3f40f67fe0b7 service nova] Creating event network-changed:4ca78321-f8c5-417a-8eae-41822d244cd0 for instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f on nch1-master-1 Dec 18 20:47:37.202576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-beb93c13-fd0a-465a-aba6-26d9350244ea req-7040f466-7dbd-4548-8fd5-3f40f67fe0b7 service nova] Creating event network-vif-deleted:9cc622e7-d64a-4dcb-9aee-7d8f79a9bb22 for instance caccd2f9-d868-4b2a-b4bd-860b5805bc39 on nch2-master-1 Dec 18 20:47:37.210895 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-beb93c13-fd0a-465a-aba6-26d9350244ea req-7040f466-7dbd-4548-8fd5-3f40f67fe0b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034979 Dec 18 20:47:37.211477 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 193/393] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:37 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:37.215270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 9b8c445f-06db-4133-a919-8c79de5333f0 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:37.219207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.219888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:37.225904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.226392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.227178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.227616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.271879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f9755ce-d81b-4a50-b77e-9d71d88d4daa tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 2051 microversion: 2.25 time: 0.416470 Dec 18 20:47:37.272504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 201/394] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:36 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 2051 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:37.277019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a11a6da-c409-48d2-9d17-1a52b1248cf7 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.294865 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a11a6da-c409-48d2-9d17-1a52b1248cf7 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021342 Dec 18 20:47:37.295604 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 202/395] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:37.299881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1150537700", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:37.353908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] validate_networks() for [('d5d78104-ccc5-490d-ac8e-b3ffc0787b91', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:37.363611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:37.372253 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aa809987-830b-4ae2-a5b8-d9cc57464515 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1321 microversion: 2.1 time: 0.159395 Dec 18 20:47:37.372930 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 194/396] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:37.381627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.381627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:37.385290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.385741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.386552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.386992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.602876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 9b8c445f-06db-4133-a919-8c79de5333f0 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:37.683392 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70abaa0a-a4a6-4877-acbb-709991ede312 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 2051 microversion: 2.25 time: 0.308721 Dec 18 20:47:37.684154 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 195/397] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 2051 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:37.688801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26c9cf09-87b4-4148-8ae2-f0557dbb5f2f tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1846338706", "id": 1358289543, "os-flavor-access:is_public": "True"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:37.690473 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:37.690473 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:37.706616 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26c9cf09-87b4-4148-8ae2-f0557dbb5f2f tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021325 Dec 18 20:47:37.707690 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 196/398] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:37 2021] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:37.718557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.718967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:37.724987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.725980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.726799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.727234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.852773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:37.853246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:37.853655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:37.854062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:37.854571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:37.863692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.864141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.865165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.865600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.886594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Getting quotas for project e622a6218cdd40c8861466b0d36c1ffe. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:37.891024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Getting quotas for user 6992d255e81c499a8373dd4c727e1f41 and project e622a6218cdd40c8861466b0d36c1ffe. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:37.898503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:37.903954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:37.906337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:37.921792 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1027bb2f-f021-4163-8575-9c2a2bcf6330 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.200171 Dec 18 20:47:37.923874 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 197/399] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:37.939877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.940590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] [instance: caccd2f9-d868-4b2a-b4bd-860b5805bc39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:37.947484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.948021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.949155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.949712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.962096 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b85f34e6-c7ba-4bc4-abe3-4ea29e32890a tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665588 Dec 18 20:47:37.962838 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 203/400] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:37.967326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dab4a4df-4cf4-40a6-b8b6-8e700b18a106 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.968922 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:37.968922 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:37.969466 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] HTTP exception thrown: Instance caccd2f9-d868-4b2a-b4bd-860b5805bc39 could not be found. Dec 18 20:47:37.970155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] Returning 404 to user: Instance caccd2f9-d868-4b2a-b4bd-860b5805bc39 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:37.971003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dab4a4df-4cf4-40a6-b8b6-8e700b18a106 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.971193 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b719d3cb-98d1-4655-a22a-8d866346ba3f tempest-AggregatesAdminTestJSON-741315684 tempest-AggregatesAdminTestJSON-741315684-project] 10.222.0.13 "GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39" status: 404 len: 111 microversion: 2.1 time: 0.043074 Dec 18 20:47:37.971472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dab4a4df-4cf4-40a6-b8b6-8e700b18a106 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.972035 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 198/401] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/servers/caccd2f9-d868-4b2a-b4bd-860b5805bc39 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:37.972300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dab4a4df-4cf4-40a6-b8b6-8e700b18a106 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:37.972737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dab4a4df-4cf4-40a6-b8b6-8e700b18a106 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:37.977869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54ac843c-d9d4-4d37-886c-cc302ddcc882 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:37.978793 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:37.978793 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:37.992293 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-54ac843c-d9d4-4d37-886c-cc302ddcc882 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] HTTP exception thrown: Access list not available for public flavors. Dec 18 20:47:37.992996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54ac843c-d9d4-4d37-886c-cc302ddcc882 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:37.993864 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54ac843c-d9d4-4d37-886c-cc302ddcc882 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1358289543/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020979 Dec 18 20:47:37.997524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 199/402] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/flavors/1358289543/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:38.001228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dab4a4df-4cf4-40a6-b8b6-8e700b18a106 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037156 Dec 18 20:47:38.002101 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 204/403] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:47:38.005866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:38.006585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:38.012452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-058982c0-4c06-49a6-adc5-1719a25ed852 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:38.013070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-058982c0-4c06-49a6-adc5-1719a25ed852 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:38.020035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.020494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.021300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.021739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.102507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-058982c0-4c06-49a6-adc5-1719a25ed852 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:38.110031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-058982c0-4c06-49a6-adc5-1719a25ed852 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1224 microversion: 2.1 time: 0.106646 Dec 18 20:47:38.110886 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 205/404] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:38 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:38.116357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ec80f4a-eafd-4043-9c61-7d619dd71e43 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:38.117335 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:38.117335 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:38.146894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ec80f4a-eafd-4043-9c61-7d619dd71e43 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1358289543" status: 202 len: 0 microversion: 2.1 time: 0.034428 Dec 18 20:47:38.148570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 206/405] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:47:38 2021] DELETE /compute/v2.1/flavors/1358289543 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:38.156631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:38.157802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:38.165984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.166500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.167500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.168279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.195074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'flavor' on Instance uuid 9b8c445f-06db-4133-a919-8c79de5333f0 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:38.208569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Going to try to live migrate instance to nch1-master-1 {{(pid=140732) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:47:38.474458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:38.485274 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf273157-bf56-45d3-aef9-41db66019ae0 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1318 microversion: 2.1 time: 0.486633 Dec 18 20:47:38.488217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 200/406] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:37 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:38.495875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a3b1c22-631a-4634-8cd5-356adf8d62b0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:38.536453 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a3b1c22-631a-4634-8cd5-356adf8d62b0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046729 Dec 18 20:47:38.537248 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 201/407] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:47:38 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:38.542730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:38.543330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:38.553173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.554444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.555484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.556495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.721405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:38.729980 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-269412bc-3f6a-4a70-acaf-6f8a2e7ec672 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1503 microversion: 2.1 time: 0.190679 Dec 18 20:47:38.730590 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 202/408] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:38 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:38.745229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:38.745842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:38.753850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.754334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.755211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.755724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.917788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:38.931683 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3948a3fc-c573-4f47-a919-eaed3b0593ca tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1321 microversion: 2.1 time: 0.190120 Dec 18 20:47:38.932261 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 203/409] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:38 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:38.937266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7aecf843-207c-4b44-845b-6440a3430eac tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1222743606", "id": 1763909821, "os-flavor-access:is_public": "False"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:38.938828 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:38.938828 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:38.955388 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7aecf843-207c-4b44-845b-6440a3430eac tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.021821 Dec 18 20:47:38.962505 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 204/410] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:38 2021] POST /compute/v2.1/flavors => generated 439 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:38.962505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:38.963020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:38.974119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.974620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:38.975998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:38.976458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:39.122496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:39.132278 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e5917e1c-4097-4fb0-916c-4d650047ef31 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.174305 Dec 18 20:47:39.132860 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 205/411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:38 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:39.443487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b6738da-1fa6-45b2-9719-074845ddb0f8 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d2b26001001846edad29d1588d2ddeb0"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:39.445552 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:39.445552 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:39.446942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9b6738da-1fa6-45b2-9719-074845ddb0f8 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '603f790d6a4f497fa99f48765d323d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b26001001846edad29d1588d2ddeb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:39.447809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b6738da-1fa6-45b2-9719-074845ddb0f8 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:39.449539 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b6738da-1fa6-45b2-9719-074845ddb0f8 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] 10.222.0.13 "POST /compute/v2.1/flavors/1763909821/action" status: 403 len: 130 microversion: 2.1 time: 0.315655 Dec 18 20:47:39.450741 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 206/412] 10.222.0.13 () {60 vars in 1199 bytes} [Sat Dec 18 20:47:39 2021] POST /compute/v2.1/flavors/1763909821/action => generated 130 bytes in 317 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:39.457828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:39.458850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:39.467672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:39.468591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:39.469611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:39.470473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:39.540878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:39.549861 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04a45e3e-e70c-4c1c-8d2d-5774312b48e5 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1282 microversion: 2.1 time: 0.097985 Dec 18 20:47:39.551040 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 207/413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:39 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:39.556130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e27179a-9e25-4ff9-b852-29836aa2a331 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:39.556889 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:39.556889 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:39.578648 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e27179a-9e25-4ff9-b852-29836aa2a331 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1763909821" status: 202 len: 0 microversion: 2.1 time: 0.026520 Dec 18 20:47:39.581714 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 208/414] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:47:39 2021] DELETE /compute/v2.1/flavors/1763909821 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:39.590058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:39.591000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:39.597664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:39.598864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:39.602140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:39.602628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:39.760665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:39.776664 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59374bed-cc9d-48b7-ab92-f29701e4bfca tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1468 microversion: 2.1 time: 0.193749 Dec 18 20:47:39.782316 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 209/415] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:39 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1468 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:39.789757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d7f39bc-f4b0-458a-aaa9-02e816e1a2e1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:39.815117 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d7f39bc-f4b0-458a-aaa9-02e816e1a2e1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036807 Dec 18 20:47:39.816358 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 210/416] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:47:39 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:39.820893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:39.821661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:39.828056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:39.828702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:39.829638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:39.830239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:40.125018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:40.157503 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4099d73-5d4f-4385-aca8-95a4352aa888 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1503 microversion: 2.1 time: 0.336101 Dec 18 20:47:40.158174 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 211/417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:39 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:40.181605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:40.184438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:40.203263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:40.203920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:40.205065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:40.206623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:40.264766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lazy-loading 'flavor' on Instance uuid 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:40.451049 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86b28ed2-2560-4c47-8285-863668742e70 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029/action" status: 202 len: 0 microversion: 2.1 time: 0.291506 Dec 18 20:47:40.452094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 212/418] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:40 2021] POST /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:40.461866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2629204-d584-4a53-829a-c72caa5ea0b7 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-626200324", "id": 452194612, "os-flavor-access:is_public": "False"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:40.467794 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:40.467794 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:40.496228 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2629204-d584-4a53-829a-c72caa5ea0b7 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.042777 Dec 18 20:47:40.496838 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 213/419] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:40 2021] POST /compute/v2.1/flavors => generated 435 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:40.501660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:40.502501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:40.509865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:40.510379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:40.511517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:40.512213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:40.788369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:40.802962 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a04aa09-ec0d-4d35-8568-afbefca302b1 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1321 microversion: 2.1 time: 0.305016 Dec 18 20:47:40.803722 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 214/420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:40 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:40.810101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:40.811012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:40.820776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:40.821494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:40.823155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:40.823744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:41.239505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:41.266041 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60f56f0f-0aa9-48bc-a402-28616f4de0ce tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1320 microversion: 2.1 time: 0.459298 Dec 18 20:47:41.268724 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 215/421] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:40 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:41.279302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:41.279964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:41.293998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:41.295283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:41.297123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:41.299361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:41.725960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:41.745419 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-098fe57c-9028-43ab-bb78-27f8f2f813d5 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1459 microversion: 2.1 time: 0.473516 Dec 18 20:47:41.759923 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19433f9c-d580-4648-9f5d-482832959809 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0/action" status: 202 len: 0 microversion: 2.25 time: 3.606308 Dec 18 20:47:41.764096 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 207/423] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:47:38 2021] POST /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0/action => generated 0 bytes in 3615 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:41.770124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8bbfbb39-ba35-4ac9-a0ef-0d113d6f92aa tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d2b26001001846edad29d1588d2ddeb0"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:41.771379 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:41.771379 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:41.771749 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 216/423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:41 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1459 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:41.777322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:41.778131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:41.785475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:41.786670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:41.788191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:41.788909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:42.037900 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8bbfbb39-ba35-4ac9-a0ef-0d113d6f92aa tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/452194612/action" status: 200 len: 96 microversion: 2.1 time: 0.272430 Dec 18 20:47:42.038872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 208/424] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Dec 18 20:47:41 2021] POST /compute/v2.1/flavors/452194612/action => generated 96 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:47:42.045788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f8f4b497-de14-4b43-81e8-48ec0fbd9b83 req-7f504db8-6153-4d6b-9a54-c7270d37685a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8acb2d-06ca-4772-91e2-d13f92d112c3", "tag": "84a44e31-f256-408a-9208-81d575d9e905"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:42.047895 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:42.047895 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:42.055865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f8f4b497-de14-4b43-81e8-48ec0fbd9b83 req-7f504db8-6153-4d6b-9a54-c7270d37685a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:42.056609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f8f4b497-de14-4b43-81e8-48ec0fbd9b83 req-7f504db8-6153-4d6b-9a54-c7270d37685a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:42.068720 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f8f4b497-de14-4b43-81e8-48ec0fbd9b83 req-7f504db8-6153-4d6b-9a54-c7270d37685a service nova] Creating event network-changed:84a44e31-f256-408a-9208-81d575d9e905 for instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 on nch1-master-1 Dec 18 20:47:42.074176 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f8f4b497-de14-4b43-81e8-48ec0fbd9b83 req-7f504db8-6153-4d6b-9a54-c7270d37685a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033781 Dec 18 20:47:42.075285 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 209/425] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:42.081497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:42.082189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:42.089574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:42.091209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:42.092735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:42.093182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:42.309103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:42.317243 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46a3ce86-bf8d-4e7b-9625-d88da3b385a7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1324 microversion: 2.1 time: 0.543639 Dec 18 20:47:42.317940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 217/426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:41 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:42.324129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4fdc6cd4-0361-4143-b676-de24578174e7 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:42.325016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4fdc6cd4-0361-4143-b676-de24578174e7 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:42.336449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fdc6cd4-0361-4143-b676-de24578174e7 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:42.336890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fdc6cd4-0361-4143-b676-de24578174e7 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:42.337851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fdc6cd4-0361-4143-b676-de24578174e7 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:42.338336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fdc6cd4-0361-4143-b676-de24578174e7 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:42.540086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:42.550347 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-809b5889-1948-4089-9559-2147b3662c1b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1503 microversion: 2.1 time: 0.473364 Dec 18 20:47:42.551122 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 210/427] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:42 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:42.556422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:42.557020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:42.565342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:42.566012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:42.567068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:42.567527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:43.053273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:43.068249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:43.071153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:43.072686 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5dc1c3cc-7083-4ee7-b927-11b5c66fbb50 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 0.520639 Dec 18 20:47:43.087132 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 211/428] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:42 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:43.093375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:43.094410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:43.102891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:43.103682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:43.105002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:43.106881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:43.251225 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4fdc6cd4-0361-4143-b676-de24578174e7 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1610 microversion: 2.1 time: 0.931978 Dec 18 20:47:43.251984 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 218/429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:42 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1610 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:43.257322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-fab47fb1-e649-4bdb-9a95-27f5c259defc req-966028a2-7669-406d-862b-210a0beb8d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7452c4b1-3737-41a6-a4cb-f98c06ee7f8b", "name": "network-vif-plugged", "status": "completed", "tag": "718fbc80-b499-485d-b8e8-9cf091c713e9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:43.259052 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:43.259052 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:43.266274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fab47fb1-e649-4bdb-9a95-27f5c259defc req-966028a2-7669-406d-862b-210a0beb8d10 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:43.266929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fab47fb1-e649-4bdb-9a95-27f5c259defc req-966028a2-7669-406d-862b-210a0beb8d10 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:43.280123 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-fab47fb1-e649-4bdb-9a95-27f5c259defc req-966028a2-7669-406d-862b-210a0beb8d10 service nova] Creating event network-vif-plugged:718fbc80-b499-485d-b8e8-9cf091c713e9 for instance 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b on nch2-master-1 Dec 18 20:47:43.285596 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-fab47fb1-e649-4bdb-9a95-27f5c259defc req-966028a2-7669-406d-862b-210a0beb8d10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Dec 18 20:47:43.287003 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 219/430] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:43.293223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-313a7b2c-0a0c-46fc-98b1-9fcc7f67ed56 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d2b26001001846edad29d1588d2ddeb0"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:43.294992 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:43.294992 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:43.296280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-313a7b2c-0a0c-46fc-98b1-9fcc7f67ed56 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '603f790d6a4f497fa99f48765d323d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b26001001846edad29d1588d2ddeb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:43.297187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-313a7b2c-0a0c-46fc-98b1-9fcc7f67ed56 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:43.298212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-313a7b2c-0a0c-46fc-98b1-9fcc7f67ed56 tempest-FlavorsAccessNegativeTestJSON-1408515411 tempest-FlavorsAccessNegativeTestJSON-1408515411-project] 10.222.0.13 "POST /compute/v2.1/flavors/452194612/action" status: 403 len: 133 microversion: 2.1 time: 0.009855 Dec 18 20:47:43.299373 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 220/431] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Dec 18 20:47:43 2021] POST /compute/v2.1/flavors/452194612/action => generated 133 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:43.304656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:43.305569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:43.312640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:43.313817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:43.314834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:43.315453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:43.910059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:43.921391 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83669150-6051-4034-bb44-2c3f9545def9 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1321 microversion: 2.1 time: 0.832644 Dec 18 20:47:43.922755 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 212/432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:43 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1321 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:43.932387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:43.942166 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ad3956b-bffe-4688-9ef6-748e0f578e33 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1470 microversion: 2.1 time: 0.641533 Dec 18 20:47:43.953434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-907988c6-8fd3-4049-a271-b87086950400 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:43.953886 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 221/433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:43 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1470 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:43.957435 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:43.957435 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:43.963307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ebc0b0e6-1062-4cd8-8dbe-5de87c4c828b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d2b26001001846edad29d1588d2ddeb0"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:43.966767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-907988c6-8fd3-4049-a271-b87086950400 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:43.967429 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:43.967429 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:43.973874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-907988c6-8fd3-4049-a271-b87086950400 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:43.975054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-907988c6-8fd3-4049-a271-b87086950400 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:43.979886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-907988c6-8fd3-4049-a271-b87086950400 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.009309 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-907988c6-8fd3-4049-a271-b87086950400 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085010 Dec 18 20:47:44.016370 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 213/434] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:47:43 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:44.023734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:44.025291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:44.031749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.035934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.036847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.037479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.063357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ebc0b0e6-1062-4cd8-8dbe-5de87c4c828b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/452194612/action" status: 200 len: 21 microversion: 2.1 time: 0.108290 Dec 18 20:47:44.063944 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 222/435] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Dec 18 20:47:43 2021] POST /compute/v2.1/flavors/452194612/action => generated 21 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:47:44.072427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:44.073248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:44.084050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.086488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.087483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.088061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.460032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:44.468316 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60e05eaf-83ee-4dad-b5c6-35e5fac02b91 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1324 microversion: 2.1 time: 0.450441 Dec 18 20:47:44.473379 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 214/436] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:44 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:44.486965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70f6bed3-2d40-4c20-8c18-58a4f46aa359 tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:44.488168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70f6bed3-2d40-4c20-8c18-58a4f46aa359 tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:44.494212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f6bed3-2d40-4c20-8c18-58a4f46aa359 tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.494907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f6bed3-2d40-4c20-8c18-58a4f46aa359 tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.495772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f6bed3-2d40-4c20-8c18-58a4f46aa359 tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.496218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f6bed3-2d40-4c20-8c18-58a4f46aa359 tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.516319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:44.525345 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5073c9c6-b6d5-4651-b4ef-1a65ebf05a74 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1503 microversion: 2.1 time: 0.456364 Dec 18 20:47:44.534750 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 223/437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:44 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1503 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:44.541622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:44.542855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:44.561961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.562450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.563251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.563682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.597608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Lazy-loading 'flavor' on Instance uuid 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:44.617598 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 while it is in vm_state suspended Dec 18 20:47:44.618777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 while it is in vm_state suspended {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:44.619854 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-caea0b9d-3c71-4820-a5a0-9bf33b780373 tempest-LiveMigrationNegativeTest-1456491822 tempest-LiveMigrationNegativeTest-1456491822-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029/action" status: 409 len: 155 microversion: 2.1 time: 0.086951 Dec 18 20:47:44.621786 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 224/438] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:44 2021] POST /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029/action => generated 155 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:44.629404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4845bb7-adc0-4a1b-b96c-53706426ce37 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:44.631872 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:44.631872 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:44.659190 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4845bb7-adc0-4a1b-b96c-53706426ce37 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/452194612" status: 202 len: 0 microversion: 2.1 time: 0.034925 Dec 18 20:47:44.659726 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70f6bed3-2d40-4c20-8c18-58a4f46aa359 tempest-DeleteServersAdminTestJSON-2015391149 tempest-DeleteServersAdminTestJSON-2015391149-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9/action" status: 202 len: 0 microversion: 2.1 time: 0.185060 Dec 18 20:47:44.660781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 215/440] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:44 2021] POST /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:44.660891 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 225/440] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:47:44 2021] DELETE /compute/v2.1/flavors/452194612 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:44.666352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:44.667293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:44.673959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.674625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.675558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.676070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.686124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:44.690276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:44.700531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.705648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.706740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.707338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.772308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:47:44.954940 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e3b7a0d3-bf21-4982-a476-d149987ad9bb tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "DELETE /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 204 len: 0 microversion: 2.1 time: 0.292204 Dec 18 20:47:44.955861 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 226/441] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:44 2021] DELETE /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:44.967235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:44.967975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:44.974306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.974640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:44.976505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:44.976974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.019067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.019585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.020180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lazy-loading 'fault' on Instance uuid a5797131-be90-426e-9985-dd40c4b114b9 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:45.029428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:45.038310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:45.039855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:45.041013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32a79397-54ab-4573-b710-338c621b23f2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 0.379020 Dec 18 20:47:45.041602 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 216/442] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:44 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:45.049977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01b5ecaf-d042-40e7-b50d-8573bc51348c tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:45.074762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01b5ecaf-d042-40e7-b50d-8573bc51348c tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028008 Dec 18 20:47:45.075353 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 217/443] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:47:45 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:45.100445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:45.104367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:45.117938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.118165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.121713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.134540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.481681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:45.490000 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c335ee7a-0060-4c6e-9a87-062bf0fa7627 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1453 microversion: 2.1 time: 0.532798 Dec 18 20:47:45.504047 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 227/444] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:44 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1453 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:45.504047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:45.504047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:45.532441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.533173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.541087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.541219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.728878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:45.738043 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c50ebb30-69d3-43b2-8528-cb614a352ebb tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1471 microversion: 2.1 time: 0.644348 Dec 18 20:47:45.742068 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 218/445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:45 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:45.746824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d469ea8-2c41-4496-a610-4269fa4581d4 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1805107242", "id": 414793993, "os-flavor-access:is_public": "False"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:45.759831 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:45.759831 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:45.785837 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d469ea8-2c41-4496-a610-4269fa4581d4 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.042288 Dec 18 20:47:45.787284 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 219/446] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:45 2021] POST /compute/v2.1/flavors => generated 436 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:45.799562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-9cb93fed-4d96-45d9-a929-1f3330175d4d req-045f786d-b902-4961-a7cd-dfcef9dbc52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8c445f-06db-4133-a919-8c79de5333f0", "name": "network-vif-unplugged", "status": "completed", "tag": "35ef2a63-339b-4a47-a0b0-2edcd0dd0be1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:45.804005 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:45.804005 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:45.820179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9cb93fed-4d96-45d9-a929-1f3330175d4d req-045f786d-b902-4961-a7cd-dfcef9dbc52e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.820847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9cb93fed-4d96-45d9-a929-1f3330175d4d req-045f786d-b902-4961-a7cd-dfcef9dbc52e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.837808 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9cb93fed-4d96-45d9-a929-1f3330175d4d req-045f786d-b902-4961-a7cd-dfcef9dbc52e service nova] Creating event network-vif-unplugged:35ef2a63-339b-4a47-a0b0-2edcd0dd0be1 for instance 9b8c445f-06db-4133-a919-8c79de5333f0 on nch2-master-1 Dec 18 20:47:45.845707 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-9cb93fed-4d96-45d9-a929-1f3330175d4d req-045f786d-b902-4961-a7cd-dfcef9dbc52e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054160 Dec 18 20:47:45.847131 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 220/447] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:45.855145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3de872b4-5d9f-4b6e-9f0d-e56ddd248599 req-62b83f01-0c13-40d4-88fd-09fdd1cd5775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f", "name": "network-vif-plugged", "status": "completed", "tag": "4ca78321-f8c5-417a-8eae-41822d244cd0"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:45.857865 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:45.857865 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:45.866153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3de872b4-5d9f-4b6e-9f0d-e56ddd248599 req-62b83f01-0c13-40d4-88fd-09fdd1cd5775 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.866704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3de872b4-5d9f-4b6e-9f0d-e56ddd248599 req-62b83f01-0c13-40d4-88fd-09fdd1cd5775 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.879421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3de872b4-5d9f-4b6e-9f0d-e56ddd248599 req-62b83f01-0c13-40d4-88fd-09fdd1cd5775 service nova] Creating event network-vif-plugged:4ca78321-f8c5-417a-8eae-41822d244cd0 for instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f on nch2-master-1 Dec 18 20:47:45.885267 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3de872b4-5d9f-4b6e-9f0d-e56ddd248599 req-62b83f01-0c13-40d4-88fd-09fdd1cd5775 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035932 Dec 18 20:47:45.889530 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 221/448] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:45.895899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:45.897174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:45.904571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.905796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.906941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:45.907497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:45.998845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:46.008795 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d830b3b5-3a05-456b-9494-039309bc3c09 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1465 microversion: 2.1 time: 0.514147 Dec 18 20:47:46.012474 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 228/449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:45 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1465 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:46.018727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:46.019443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:46.027588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.028805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.029760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.030609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.077065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:47:46.184810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:46.199983 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-94073259-ba23-4d1d-8fe6-3019cf6af9c1 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1324 microversion: 2.1 time: 0.304413 Dec 18 20:47:46.201012 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 222/450] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:45 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:46.209709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:46.213091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:46.220922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.221406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.222294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.222771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.237529 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b19fe7d9-0824-42e5-b6ce-ced6f70a5b8b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 204 len: 0 microversion: 2.1 time: 0.222023 Dec 18 20:47:46.238390 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 229/451] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:46 2021] DELETE /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:46.245504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:46.246418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:46.253157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.253939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.254943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.255519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.287089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lazy-loading 'flavor' on Instance uuid 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:46.374009 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ab9924c-8d02-491c-8cae-2d409a1b71c7 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b/action" status: 202 len: 0 microversion: 2.1 time: 0.133462 Dec 18 20:47:46.377602 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 230/452] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:46 2021] POST /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:46.381134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6313f97d-4e90-42b4-a5df-ae5d53a08260 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c140ea4d18ca492086b1d65b30864d5c"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:46.383295 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:46.383295 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:46.476887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:46.495856 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03e09a64-2656-40f6-b993-0d38ed9ab3e3 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1493 microversion: 2.1 time: 0.289648 Dec 18 20:47:46.496532 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 223/453] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:46 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1493 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:46.504019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:46.505139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:46.510976 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-6313f97d-4e90-42b4-a5df-ae5d53a08260 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] HTTP exception thrown: Flavor access not found for 34 / c140ea4d18ca492086b1d65b30864d5c combination. Dec 18 20:47:46.511564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6313f97d-4e90-42b4-a5df-ae5d53a08260 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Returning 404 to user: Flavor access not found for 34 / c140ea4d18ca492086b1d65b30864d5c combination. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:46.512422 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6313f97d-4e90-42b4-a5df-ae5d53a08260 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/414793993/action" status: 404 len: 124 microversion: 2.1 time: 0.136312 Dec 18 20:47:46.513015 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 231/454] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Dec 18 20:47:46 2021] POST /compute/v2.1/flavors/414793993/action => generated 124 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:46.524023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.524243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:46.524720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.524857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:46.527177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.529522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.536668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.538720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.540213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.542588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.588211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.589652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:46.590277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lazy-loading 'fault' on Instance uuid a5797131-be90-426e-9985-dd40c4b114b9 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:46.951007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:46.976617 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c29935e6-27e2-4711-bf8b-43880c2236dd tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1459 microversion: 2.1 time: 0.462538 Dec 18 20:47:46.977514 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 232/455] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:46 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1459 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:46.983154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fca6348d-7265-41bc-8714-4c498403f18c tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:46.990161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fca6348d-7265-41bc-8714-4c498403f18c tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:46.994701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:46.996919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca6348d-7265-41bc-8714-4c498403f18c tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:46.999776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca6348d-7265-41bc-8714-4c498403f18c tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.000671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca6348d-7265-41bc-8714-4c498403f18c tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.002170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca6348d-7265-41bc-8714-4c498403f18c tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.005412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:47.007637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:47.009174 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-61cee2c0-542d-41cc-8d75-86aa54c990e9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 0.509037 Dec 18 20:47:47.021010 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 224/456] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:46 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:47.029101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2dbd6409-4bf4-431b-8740-cd9471514bf0 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '.version_select at 0x7f714fce4670>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:47.031349 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:47.031349 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:47.033282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2dbd6409-4bf4-431b-8740-cd9471514bf0 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.034288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2dbd6409-4bf4-431b-8740-cd9471514bf0 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.071164 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2dbd6409-4bf4-431b-8740-cd9471514bf0 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.046331 Dec 18 20:47:47.078610 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 225/457] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:47:47 2021] GET /compute/v2.1/os-migrations => generated 782 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:47.083519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c8fe844e-e65d-45ae-bb07-2ed9ae81970f tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:47.085088 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:47.085088 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:47.108016 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c8fe844e-e65d-45ae-bb07-2ed9ae81970f tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/414793993" status: 202 len: 0 microversion: 2.1 time: 0.028153 Dec 18 20:47:47.109782 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 226/458] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:47:47 2021] DELETE /compute/v2.1/flavors/414793993 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:47:47.120178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:47.122413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:47.131249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.132058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.132993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.133634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.459873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:47.468856 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de64e8a2-8390-48a2-86c9-a1ae141f084b tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 200 len: 1465 microversion: 2.1 time: 0.357707 Dec 18 20:47:47.480065 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 227/459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:47 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 1465 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:47.484383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e89bb2f-2655-4401-b45a-feda69e0826d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:47.485194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e89bb2f-2655-4401-b45a-feda69e0826d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:47.492968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e89bb2f-2655-4401-b45a-feda69e0826d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.495829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e89bb2f-2655-4401-b45a-feda69e0826d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.496699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e89bb2f-2655-4401-b45a-feda69e0826d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.497133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e89bb2f-2655-4401-b45a-feda69e0826d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.669311 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fca6348d-7265-41bc-8714-4c498403f18c tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1630 microversion: 2.1 time: 0.689954 Dec 18 20:47:47.672649 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 233/460] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:46 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1630 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:47.693760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0763e52-573b-4293-9614-76fa4c984781 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:47.729147 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0763e52-573b-4293-9614-76fa4c984781 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043010 Dec 18 20:47:47.730381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 234/461] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:47:47 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:47.735621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:47.736694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:47.754153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.755825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.757222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.757870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.857830 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e89bb2f-2655-4401-b45a-feda69e0826d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1644 microversion: 2.1 time: 0.376720 Dec 18 20:47:47.859720 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 228/462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:47 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1644 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:47.874151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-443bc352-8359-44fe-ae3b-be5b33ffcc24 req-7d4c19ad-135e-47fe-bc2a-6afdc7473f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8c445f-06db-4133-a919-8c79de5333f0", "tag": "35ef2a63-339b-4a47-a0b0-2edcd0dd0be1"}, {"server_uuid": "414c46a7-2ac0-44c1-a29f-eed2a0f1a029", "name": "network-vif-deleted", "tag": "58e60486-e1d6-436d-9e39-32ef38bda602"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:47.876112 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:47.876112 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:47.910504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-443bc352-8359-44fe-ae3b-be5b33ffcc24 req-7d4c19ad-135e-47fe-bc2a-6afdc7473f3a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:47.911067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-443bc352-8359-44fe-ae3b-be5b33ffcc24 req-7d4c19ad-135e-47fe-bc2a-6afdc7473f3a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:47.947122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-443bc352-8359-44fe-ae3b-be5b33ffcc24 req-7d4c19ad-135e-47fe-bc2a-6afdc7473f3a service nova] Creating event network-changed:35ef2a63-339b-4a47-a0b0-2edcd0dd0be1 for instance 9b8c445f-06db-4133-a919-8c79de5333f0 on nch2-master-1 Dec 18 20:47:47.949808 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-443bc352-8359-44fe-ae3b-be5b33ffcc24 req-7d4c19ad-135e-47fe-bc2a-6afdc7473f3a service nova] Creating event network-vif-deleted:58e60486-e1d6-436d-9e39-32ef38bda602 for instance 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 on nch1-master-1 Dec 18 20:47:47.975764 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-443bc352-8359-44fe-ae3b-be5b33ffcc24 req-7d4c19ad-135e-47fe-bc2a-6afdc7473f3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.113509 Dec 18 20:47:47.989118 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 229/463] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:47 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:47.998148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:48.000550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:48.010317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:48.011266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:48.012238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:48.012828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:48.105346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:48.115884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:48.117534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lazy-loading 'fault' on Instance uuid a5797131-be90-426e-9985-dd40c4b114b9 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:47:48.195731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:48.204982 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b557c8a5-c3e5-4ac3-83ff-27b5deafb355 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1324 microversion: 2.1 time: 0.473322 Dec 18 20:47:48.216388 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 235/464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:47 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:48.229719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:48.230330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:48.254264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:48.254725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:48.255780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:48.265140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:49.044940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38872124d18947de9ea12c83e207715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46334a58394a98a92a0d9dbcfcfe59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:49.052298 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-718001b3-e80a-4209-9d1f-e8ea2a986016 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 200 len: 1459 microversion: 2.1 time: 1.061715 Dec 18 20:47:49.052992 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 230/465] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:47 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 1459 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:49.065751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-617479991", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5cbb2c71-d950-4efd-806f-e5446059ac55"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:49.138232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] validate_networks() for [('5cbb2c71-d950-4efd-806f-e5446059ac55', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:47:49.251795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:49.265549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:49.268401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:49.270903 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd558a39-bb76-4603-9b58-4e450ea8c64e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 1.052668 Dec 18 20:47:49.273317 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 236/466] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:48 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:49.288418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:49.289109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 414c46a7-2ac0-44c1-a29f-eed2a0f1a029] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:49.296181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:49.296786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:49.297710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:49.298395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:49.326632 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] HTTP exception thrown: Instance 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 could not be found. Dec 18 20:47:49.327578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Returning 404 to user: Instance 414c46a7-2ac0-44c1-a29f-eed2a0f1a029 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:49.329042 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-011f82c8-8c18-4712-a2b6-5af708654525 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029" status: 404 len: 111 microversion: 2.1 time: 0.054166 Dec 18 20:47:49.330116 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 237/467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:49 2021] GET /compute/v2.1/servers/414c46a7-2ac0-44c1-a29f-eed2a0f1a029 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:49.337361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2fb38db4-4b63-4a0f-9291-ce74505f483e req-7193d175-7812-4f2b-ade7-1336d5316e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8acb2d-06ca-4772-91e2-d13f92d112c3", "name": "network-vif-plugged", "status": "completed", "tag": "84a44e31-f256-408a-9208-81d575d9e905"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:49.339520 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:49.339520 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:49.349469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2fb38db4-4b63-4a0f-9291-ce74505f483e req-7193d175-7812-4f2b-ade7-1336d5316e29 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:49.350736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2fb38db4-4b63-4a0f-9291-ce74505f483e req-7193d175-7812-4f2b-ade7-1336d5316e29 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:49.368217 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2fb38db4-4b63-4a0f-9291-ce74505f483e req-7193d175-7812-4f2b-ade7-1336d5316e29 service nova] Creating event network-vif-plugged:84a44e31-f256-408a-9208-81d575d9e905 for instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 on nch1-master-1 Dec 18 20:47:49.373757 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2fb38db4-4b63-4a0f-9291-ce74505f483e req-7193d175-7812-4f2b-ade7-1336d5316e29 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042108 Dec 18 20:47:49.375425 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 238/468] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:49.389819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5fc28757-9914-4217-b9a7-177f3aee79f1 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:49.390983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5fc28757-9914-4217-b9a7-177f3aee79f1 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:49.411661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc28757-9914-4217-b9a7-177f3aee79f1 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:49.412339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc28757-9914-4217-b9a7-177f3aee79f1 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:49.414329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc28757-9914-4217-b9a7-177f3aee79f1 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:49.414918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc28757-9914-4217-b9a7-177f3aee79f1 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:49.933977 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5fc28757-9914-4217-b9a7-177f3aee79f1 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1613 microversion: 2.1 time: 0.556665 Dec 18 20:47:49.936791 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 239/469] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:49 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1613 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:49.948791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:49.959432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:49.973585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:49.974108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:49.977361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:49.977808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.025369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:47:50.025927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:47:50.026525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:47:50.027029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:47:50.027533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:47:50.057486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.058630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.059598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.060199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.084199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:47:50.089531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for user 5aaf1ced6baf4e1d9c940cfe96b2c254 and project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:47:50.106612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:47:50.109775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:47:50.197262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41262992-0bd4-40a6-a56f-271f32dbf5c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134979 Dec 18 20:47:50.200943 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 231/470] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:47:50.212605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:50.216877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.217399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.230196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.230856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.232391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.232991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.236350 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87200017-a10a-4c4c-98b6-7279c5be9715 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1324 microversion: 2.1 time: 0.296113 Dec 18 20:47:50.239054 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 240/471] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:49 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:50.250122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-221e58ce-fbfd-4dba-a048-077003c33681 req-edc6d27e-78ec-4796-bbc4-70298e6c053f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5797131-be90-426e-9985-dd40c4b114b9", "name": "network-vif-deleted", "tag": "4d05019a-71c6-40bd-a082-feb8872a8f1f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:50.253210 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:50.253210 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:50.270501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-221e58ce-fbfd-4dba-a048-077003c33681 req-edc6d27e-78ec-4796-bbc4-70298e6c053f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.272648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-221e58ce-fbfd-4dba-a048-077003c33681 req-edc6d27e-78ec-4796-bbc4-70298e6c053f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.273693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:47:50.302114 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-221e58ce-fbfd-4dba-a048-077003c33681 req-edc6d27e-78ec-4796-bbc4-70298e6c053f service nova] Creating event network-vif-deleted:4d05019a-71c6-40bd-a082-feb8872a8f1f for instance a5797131-be90-426e-9985-dd40c4b114b9 on nch2-master-1 Dec 18 20:47:50.317574 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-221e58ce-fbfd-4dba-a048-077003c33681 req-edc6d27e-78ec-4796-bbc4-70298e6c053f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073073 Dec 18 20:47:50.319883 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 241/472] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:50.328018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:50.333941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.346084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.346583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.348786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.349253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.379780 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-532da413-e146-4766-97ad-cfe2b4ee43ff tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 204 len: 0 microversion: 2.1 time: 0.177451 Dec 18 20:47:50.384451 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 232/473] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:50 2021] DELETE /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:50.390488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.391988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.399916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.400594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.401766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.402580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.425303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] HTTP exception thrown: Instance a5797131-be90-426e-9985-dd40c4b114b9 could not be found. Dec 18 20:47:50.426196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Returning 404 to user: Instance a5797131-be90-426e-9985-dd40c4b114b9 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.427591 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c273261-60e6-42ab-a440-196bef119177 tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 404 len: 111 microversion: 2.1 time: 0.041349 Dec 18 20:47:50.429137 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 233/474] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:50 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:50.438185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b06754eb-84bd-4059-9b51-fcfff645aa73 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.439681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b06754eb-84bd-4059-9b51-fcfff645aa73 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.480248 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] HTTP exception thrown: Cannot 'migrate' instance 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b while it is in vm_state suspended Dec 18 20:47:50.481396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Returning 409 to user: Cannot 'migrate' instance 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b while it is in vm_state suspended {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.482628 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ef1c4e6b-61e1-4170-af2d-f15cd8b7bd55 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b/action" status: 409 len: 148 microversion: 2.1 time: 0.158489 Dec 18 20:47:50.483336 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 242/475] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:50 2021] POST /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b/action => generated 148 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:50.488469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.490328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.498026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.498781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.499886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.500661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.520675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b06754eb-84bd-4059-9b51-fcfff645aa73 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:50.535294 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b06754eb-84bd-4059-9b51-fcfff645aa73 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1210 microversion: 2.1 time: 0.103729 Dec 18 20:47:50.544998 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 234/476] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:50 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:50.544998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.544998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.564323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.566575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.569602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.570204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.714494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:50.725954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:50.734290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:50.736519 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-73cda00f-afab-41b3-b18e-ab2bdc7f8c03 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 0.251055 Dec 18 20:47:50.736519 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 243/477] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:50 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:50.745747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.746349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.762962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.763483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.764346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.764859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.805659 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] HTTP exception thrown: Instance a5797131-be90-426e-9985-dd40c4b114b9 could not be found. Dec 18 20:47:50.806277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Returning 404 to user: Instance a5797131-be90-426e-9985-dd40c4b114b9 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.808422 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e10e74f8-0ea5-4753-ac52-e4cade44103f tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 404 len: 111 microversion: 2.1 time: 0.070937 Dec 18 20:47:50.810375 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 244/478] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:50 2021] DELETE /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:50.820864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-719fc68f-6980-49de-a125-20f23ab3c98a tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:50.825061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-719fc68f-6980-49de-a125-20f23ab3c98a tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.826696 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-719fc68f-6980-49de-a125-20f23ab3c98a tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3/action" status: 400 len: 144 microversion: 2.1 time: 0.013846 Dec 18 20:47:50.826841 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 245/479] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:50 2021] POST /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3/action => generated 144 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:47:50.837158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.837769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: a5797131-be90-426e-9985-dd40c4b114b9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.850707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.851158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.855205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.855653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.890502 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] HTTP exception thrown: Instance a5797131-be90-426e-9985-dd40c4b114b9 could not be found. Dec 18 20:47:50.891108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Returning 404 to user: Instance a5797131-be90-426e-9985-dd40c4b114b9 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.893153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d168cf90-3fd9-4313-99d1-d025b885ebbe tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9" status: 404 len: 111 microversion: 2.1 time: 0.062608 Dec 18 20:47:50.897085 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 246/480] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:50 2021] GET /compute/v2.1/servers/a5797131-be90-426e-9985-dd40c4b114b9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:50.907766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44df04fa-c9bf-48e0-9786-42b94b62da90 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:50.909097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44df04fa-c9bf-48e0-9786-42b94b62da90 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.909982 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44df04fa-c9bf-48e0-9786-42b94b62da90 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3/action" status: 400 len: 120 microversion: 2.1 time: 0.015165 Dec 18 20:47:50.915374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 247/481] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:50 2021] POST /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:47:50.916924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.916924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.938297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.938751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.944485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:50.945685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:50.979491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:50.980439 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] HTTP exception thrown: Instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e could not be found. Dec 18 20:47:50.981190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Returning 404 to user: Instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.982295 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53a4b39f-3fc8-4724-ac04-682a51d71b7b tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "DELETE /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 404 len: 111 microversion: 2.1 time: 0.070021 Dec 18 20:47:50.983201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 248/482] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:50 2021] DELETE /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:50.987847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5d86c17-8d17-416a-bca1-d5de176f7279 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:50.989052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5d86c17-8d17-416a-bca1-d5de176f7279 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Failed to fetch instance by id 999 {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 18 20:47:50.989778 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f5d86c17-8d17-416a-bca1-d5de176f7279 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] HTTP exception thrown: Instance 999 could not be found. Dec 18 20:47:50.991282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5d86c17-8d17-416a-bca1-d5de176f7279 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:50.992239 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5d86c17-8d17-416a-bca1-d5de176f7279 tempest-ServersAdminNegativeTestJSON-1070281687 tempest-ServersAdminNegativeTestJSON-1070281687-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.008059 Dec 18 20:47:50.993254 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 249/483] 10.222.0.13 () {60 vars in 1178 bytes} [Sat Dec 18 20:47:50 2021] POST /compute/v2.1/servers/999/action => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:47:50.997942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:50.998763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] [instance: 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:50.999807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b38bb086-3a30-49cb-bb6e-e149b4b6a63f tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1474 microversion: 2.1 time: 0.461549 Dec 18 20:47:51.000395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 235/484] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:50 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1474 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:51.011108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:51.016191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.016926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.017478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:51.018172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.018883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.031359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.034017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.036559 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] HTTP exception thrown: Instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e could not be found. Dec 18 20:47:51.037872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] Returning 404 to user: Instance 13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:51.037988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.038553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.039283 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23d9f76f-c3d3-44a9-919b-d9b974ab24ee tempest-DeleteServersAdminTestJSON-356374037 tempest-DeleteServersAdminTestJSON-356374037-project] 10.222.0.13 "GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e" status: 404 len: 111 microversion: 2.1 time: 0.044947 Dec 18 20:47:51.040367 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 250/485] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:50 2021] GET /compute/v2.1/servers/13ced8ca-f0a7-4515-a1d9-c3f093aa9c5e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:51.100769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:47:51.256834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:51.257820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:51.266445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.273096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.274621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.275216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.413280 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-836b6a71-cdc5-449d-893c-f8d03585b7b5 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 204 len: 0 microversion: 2.1 time: 0.405118 Dec 18 20:47:51.413873 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 236/486] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:51 2021] DELETE /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:51.423023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:51.424033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:51.435465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.444740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.445896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.454680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.848617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:51.856061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f70d82d9-2987-4461-807b-c6ba3b07f0ac tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1324 microversion: 2.1 time: 0.603966 Dec 18 20:47:51.858606 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 251/487] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:51 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:51.863061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:51.863657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:51.906707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.907341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:51.908292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:51.909762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:52.023541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:52.031613 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81caa9fe-7765-45e8-acac-b07e4391a8d0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1262 microversion: 2.1 time: 0.171952 Dec 18 20:47:52.039905 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 252/488] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:51 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1262 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:52.045011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:52.045675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:52.063530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:52.064170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:52.065142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:52.065725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:52.096073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:52.103842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65dcb9c5-fd56-47e6-a4e9-469a6ec06eff tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1468 microversion: 2.1 time: 0.685339 Dec 18 20:47:52.128708 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 237/489] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:51 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1468 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:52.135255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:52.136182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:52.167343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:52.171580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:52.173403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:52.176737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:52.588609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:52.596693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:52.598329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:52.599704 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66332949-d525-4a84-8f4c-2725be4a8da3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 0.558599 Dec 18 20:47:52.600521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 253/490] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:52 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:52.873366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:52.874149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:52.886963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:52.887419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:52.888253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:52.893738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:52.966842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e4893e5d944bce9da0588758509af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1f758740e442a0829910680148236b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:52.979130 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d72d55b6-18f4-47db-a047-973834173126 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 200 len: 1474 microversion: 2.1 time: 0.848948 Dec 18 20:47:52.983215 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 238/491] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:52 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 1474 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:53.063310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:53.064378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:53.098029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:53.099326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:53.100249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:53.105778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:53.597057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:53.615489 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e13d3a01-cede-42f2-abcf-3deb7cd5d47c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1268 microversion: 2.1 time: 0.561171 Dec 18 20:47:53.617102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 239/492] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:53 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1268 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:53.628854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:53.629985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:53.647684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:53.649078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:53.651475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:53.653652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:54.439996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:54.457403 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8679b2e9-0f14-4b4d-8872-eb4b967136e3 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 200 len: 1521 microversion: 2.1 time: 1.587176 Dec 18 20:47:54.475167 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 254/493] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:52 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 1521 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:47:54.479559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:54.480177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:54.487672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:54.489158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:54.490806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:54.492187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:54.776810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:54.785535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ad450e2-52ab-443c-8d3c-798a2a05f692 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1468 microversion: 2.1 time: 1.166896 Dec 18 20:47:54.792585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 240/494] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:53 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1468 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:54.798904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:54.803270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] [instance: 95cf5470-3fd1-480e-be6c-0d42081ad67a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:54.819939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:54.820648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:54.827481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:54.828179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:54.865697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] HTTP exception thrown: Instance 95cf5470-3fd1-480e-be6c-0d42081ad67a could not be found. Dec 18 20:47:54.869424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] Returning 404 to user: Instance 95cf5470-3fd1-480e-be6c-0d42081ad67a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:54.870378 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-37be478c-b56e-41d5-aa24-db3a3a550e56 tempest-LiveMigrationNegativeTest-1015229752 tempest-LiveMigrationNegativeTest-1015229752-project] 10.222.0.13 "GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a" status: 404 len: 111 microversion: 2.1 time: 0.076503 Dec 18 20:47:54.870954 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 241/495] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:54 2021] GET /compute/v2.1/servers/95cf5470-3fd1-480e-be6c-0d42081ad67a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:54.885399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-21685242-c3a4-4550-b768-547e4e2c2406 req-0f1366bc-0826-41f1-ae35-6307970f0be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cf5470-3fd1-480e-be6c-0d42081ad67a", "name": "network-vif-deleted", "tag": "9c56ffb6-7657-464e-a842-95bf30427272"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:54.887241 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:54.887241 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:47:54.902369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-21685242-c3a4-4550-b768-547e4e2c2406 req-0f1366bc-0826-41f1-ae35-6307970f0be0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:54.907245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-21685242-c3a4-4550-b768-547e4e2c2406 req-0f1366bc-0826-41f1-ae35-6307970f0be0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:54.940120 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-21685242-c3a4-4550-b768-547e4e2c2406 req-0f1366bc-0826-41f1-ae35-6307970f0be0 service nova] Creating event network-vif-deleted:9c56ffb6-7657-464e-a842-95bf30427272 for instance 95cf5470-3fd1-480e-be6c-0d42081ad67a on nch1-master-1 Dec 18 20:47:54.947552 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-21685242-c3a4-4550-b768-547e4e2c2406 req-0f1366bc-0826-41f1-ae35-6307970f0be0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074702 Dec 18 20:47:54.952034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 242/496] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:54.965253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'action', calling method: .version_select at 0x7f715e6c5ca0>, body: {"addFloatingIp": {"address": "172.35.3.55"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:54.966511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:54.982308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:54.983112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:54.984136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:54.984764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:55.138479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Acquired lock "refresh_cache-ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:47:55.562725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:55.571914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:55.573431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:55.574623 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41aa2d58-f7f0-45f3-9c0b-89994c16f055 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 1.098844 Dec 18 20:47:55.582822 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 255/497] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:54 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:55.600782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:55.601388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:55.618841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:55.619282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:55.628776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:55.629251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:56.005065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:56.017759 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b46c7c5-c89e-43ba-bbc1-29bec78fb49b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1268 microversion: 2.1 time: 0.433554 Dec 18 20:47:56.018562 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 256/498] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:55 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1268 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:56.026843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:56.031086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:56.055488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:56.056842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:56.059516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:56.063403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:56.677960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:56.689578 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b79c5f95-e106-45eb-ba64-43e2640c1c25 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 200 len: 1297 microversion: 2.1 time: 0.664019 Dec 18 20:47:56.702932 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 257/499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:56 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 1297 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:56.723935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:56.725908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:56.746176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:56.746944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:56.748851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:56.749515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:58.446180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:58.474195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:58.480527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:58.489316 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01317047-a336-485c-adc3-307ef906159a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1568 microversion: 2.25 time: 1.781542 Dec 18 20:47:58.490639 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 258/500] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:56 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1568 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:47:58.499565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:58.507010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:58.541242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:58.542095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:58.543079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:58.543794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:59.243318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:47:59.251589 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eda04178-0b81-4712-9f42-50e787cfb890 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1310 microversion: 2.1 time: 0.758409 Dec 18 20:47:59.253406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 259/501] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:58 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1310 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:47:59.259449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9cbc6f1e-be83-41e7-898a-bfcffa2bf215 req-1b0fad33-5ecd-4a42-b1fd-5ef6b5d53270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7452c4b1-3737-41a6-a4cb-f98c06ee7f8b", "name": "network-vif-deleted", "tag": "718fbc80-b499-485d-b8e8-9cf091c713e9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:59.261261 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:59.261261 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:59.270016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9cbc6f1e-be83-41e7-898a-bfcffa2bf215 req-1b0fad33-5ecd-4a42-b1fd-5ef6b5d53270 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:59.270566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9cbc6f1e-be83-41e7-898a-bfcffa2bf215 req-1b0fad33-5ecd-4a42-b1fd-5ef6b5d53270 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:59.288942 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9cbc6f1e-be83-41e7-898a-bfcffa2bf215 req-1b0fad33-5ecd-4a42-b1fd-5ef6b5d53270 service nova] Creating event network-vif-deleted:718fbc80-b499-485d-b8e8-9cf091c713e9 for instance 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b on nch2-master-1 Dec 18 20:47:59.295275 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9cbc6f1e-be83-41e7-898a-bfcffa2bf215 req-1b0fad33-5ecd-4a42-b1fd-5ef6b5d53270 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040556 Dec 18 20:47:59.296850 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 260/502] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:47:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:59.303436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:59.304494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:59.312081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:59.312769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:59.313766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:59.314473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:59.332519 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] HTTP exception thrown: Instance 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b could not be found. Dec 18 20:47:59.333103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Returning 404 to user: Instance 7452c4b1-3737-41a6-a4cb-f98c06ee7f8b could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:47:59.334687 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0fca984a-5eea-49c3-9d1c-e4e111f046dc tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b" status: 404 len: 111 microversion: 2.1 time: 0.035691 Dec 18 20:47:59.335237 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 261/503] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:47:59 2021] GET /compute/v2.1/servers/7452c4b1-3737-41a6-a4cb-f98c06ee7f8b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:47:59.538153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9a80b6ff-31c2-453f-b90f-b4d67328611d tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-73715874", "id": 2113885660, "os-flavor-access:is_public": "True"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:59.539939 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:47:59.539939 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:47:59.558029 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9a80b6ff-31c2-453f-b90f-b4d67328611d tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.221545 Dec 18 20:47:59.558654 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 262/504] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 20:47:59 2021] POST /compute/v2.1/flavors => generated 447 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:47:59.741103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2743045f-e6b4-49d4-a89b-db34bce1b0c4 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1941827040", "ram": 512, "vcpus": 1, "disk": 10, "id": 1900674496, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:47:59.760803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2743045f-e6b4-49d4-a89b-db34bce1b0c4 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.200840 Dec 18 20:47:59.761533 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 263/505] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:47:59 2021] POST /compute/v2.1/flavors => generated 416 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:47:59.766499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:59.767342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:59.773915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:59.774759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:59.775635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:59.776134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:59.801215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:47:59.881900 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cca673bf-e5fc-4e27-be27-ea22e9543702 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 204 len: 0 microversion: 2.1 time: 0.118382 Dec 18 20:47:59.882579 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 264/506] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:47:59 2021] DELETE /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:47:59.887775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:47:59.888422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:47:59.897787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:59.898243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:47:59.899071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:47:59.899510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:00.292484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:00.300873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:00.302677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:00.304005 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c61b6a3-dd7c-48c4-b347-124fdf8f01cf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1558 microversion: 2.25 time: 0.420246 Dec 18 20:48:00.304560 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 265/507] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:47:59 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1558 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:00.580654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Building network info cache for instance {{(pid=140732) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:48:00.601285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06c97721-c0e7-4599-9add-d5d46e5b31ee tempest-FlavorsV255TestJSON-314482730 tempest-FlavorsV255TestJSON-314482730-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:00.618823 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06c97721-c0e7-4599-9add-d5d46e5b31ee tempest-FlavorsV255TestJSON-314482730 tempest-FlavorsV255TestJSON-314482730-project] 10.222.0.13 "GET /compute/v2.1/flavors/2113885660" status: 200 len: 447 microversion: 2.55 time: 0.312987 Dec 18 20:48:00.619402 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 266/508] 10.222.0.13 () {60 vars in 1198 bytes} [Sat Dec 18 20:48:00 2021] GET /compute/v2.1/flavors/2113885660 => generated 447 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:00.652876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48f802f0-e5ba-4ecb-8acd-f17d223f05a1 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:00.655351 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:00.655351 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:00.718807 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48f802f0-e5ba-4ecb-8acd-f17d223f05a1 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1900674496/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090549 Dec 18 20:48:00.719755 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 267/509] 10.222.0.13 () {60 vars in 1223 bytes} [Sat Dec 18 20:48:00 2021] POST /compute/v2.1/flavors/1900674496/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:00.725800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:00.727859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:00.734927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:00.735696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:00.736951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:00.737787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:01.170389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e05995c6824c90ab707fca61caaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a64115a8fdc4fd78580446ebb4622de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:01.177904 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e5fe52bb-d396-4bc0-8bcf-c178e150ffa0 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 200 len: 1478 microversion: 2.1 time: 0.457130 Dec 18 20:48:01.190687 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 268/510] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:00 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 1478 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:01.195343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:01.195954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:01.201962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:01.203674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:01.205338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:01.206721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:01.724006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:01.738607 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae8326da-e452-494e-9475-074b6a044e01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1310 microversion: 2.1 time: 0.546758 Dec 18 20:48:01.739470 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 269/511] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:01 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1310 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:01.745991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a91d4d46-3c84-4768-b185-4498362ec4ce tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '.version_select at 0x7f715c495ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:01.747972 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:01.747972 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:01.751902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a91d4d46-3c84-4768-b185-4498362ec4ce tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:01.752357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a91d4d46-3c84-4768-b185-4498362ec4ce tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:01.770418 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a91d4d46-3c84-4768-b185-4498362ec4ce tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 856 microversion: 2.25 time: 0.028657 Dec 18 20:48:01.771250 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 270/512] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Dec 18 20:48:01 2021] GET /compute/v2.1/os-migrations => generated 856 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:01.775867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-77f0522b-4c2f-46ca-88da-ddea190afc53 req-e79ef529-4a6c-4cb4-b789-44a6fbaecf96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5", "tag": "d5d720a6-0889-449d-a427-b3d33c3e0143"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:01.777509 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:01.777509 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:01.785230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-77f0522b-4c2f-46ca-88da-ddea190afc53 req-e79ef529-4a6c-4cb4-b789-44a6fbaecf96 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:01.785948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-77f0522b-4c2f-46ca-88da-ddea190afc53 req-e79ef529-4a6c-4cb4-b789-44a6fbaecf96 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:01.819224 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-77f0522b-4c2f-46ca-88da-ddea190afc53 req-e79ef529-4a6c-4cb4-b789-44a6fbaecf96 service nova] Creating event network-changed:d5d720a6-0889-449d-a427-b3d33c3e0143 for instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 on nch1-master-1 Dec 18 20:48:01.825528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-77f0522b-4c2f-46ca-88da-ddea190afc53 req-e79ef529-4a6c-4cb4-b789-44a6fbaecf96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052772 Dec 18 20:48:01.829504 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 271/513] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:01.836177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7cdf1c8a-7d73-44ad-a310-1f04c7d8da79 tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] Action: 'update', calling method: .version_select at 0x7f715e986700>, body: {"flavor": {"description": "new"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:01.847910 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:01.847910 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:01.914725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7cdf1c8a-7d73-44ad-a310-1f04c7d8da79 tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/2113885660" status: 200 len: 448 microversion: 2.55 time: 0.082129 Dec 18 20:48:01.925482 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 272/514] 10.222.0.13 () {62 vars in 1218 bytes} [Sat Dec 18 20:48:01 2021] PUT /compute/v2.1/flavors/2113885660 => generated 448 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:02.295437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f9353b4a-ee56-4bee-ba53-c2ae1afe7ebc tempest-FlavorsExtraSpecsTestJSON-290818693 tempest-FlavorsExtraSpecsTestJSON-290818693-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:02.308796 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f9353b4a-ee56-4bee-ba53-c2ae1afe7ebc tempest-FlavorsExtraSpecsTestJSON-290818693 tempest-FlavorsExtraSpecsTestJSON-290818693-project] 10.222.0.13 "GET /compute/v2.1/flavors/1900674496/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.380157 Dec 18 20:48:02.309380 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 273/515] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 20:48:01 2021] GET /compute/v2.1/flavors/1900674496/os-extra_specs => generated 66 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:02.321122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:02.326017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:02.345300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:02.346014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:02.347045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:02.347630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:02.707679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Updating instance_info_cache with network_info: [{"id": "d5d720a6-0889-449d-a427-b3d33c3e0143", "address": "fa:16:3e:8e:75:e5", "network": {"id": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2088372549-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e622a6218cdd40c8861466b0d36c1ffe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5d720a6-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140732) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:48:02.728077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Releasing lock "refresh_cache-ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:48:02.728946 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de5a0370-4766-4213-bf53-8e6d3fb3fd3d tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action" status: 202 len: 0 microversion: 2.1 time: 7.775405 Dec 18 20:48:02.730643 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 243/516] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:47:54 2021] POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action => generated 0 bytes in 7777 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 20:48:02.737008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ff55825-cfa3-4c8f-ad0b-056e5fed7907 tempest-FlavorsV255TestJSON-314482730 tempest-FlavorsV255TestJSON-314482730-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:02.784751 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ff55825-cfa3-4c8f-ad0b-056e5fed7907 tempest-FlavorsV255TestJSON-314482730 tempest-FlavorsV255TestJSON-314482730-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.052969 Dec 18 20:48:02.785340 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 244/517] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Dec 18 20:48:02 2021] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:02.877658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 9b8c445f-06db-4133-a919-8c79de5333f0 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:02.879396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-193ba12b-d3be-45f5-ac13-43d3d0105730 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Calling method '.version_select at 0x7f714fc734c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:02.896430 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e8142654-67d9-4702-9e5e-c1e668c900d1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 2051 microversion: 2.25 time: 0.580832 Dec 18 20:48:02.897742 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 274/518] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:02 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 2051 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:02.902962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:02.903790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] [instance: 7f8c0a8e-fad4-49ff-9339-2f05327c58f3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:02.935798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:02.936889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:02.937878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:02.938511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:02.954009 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] HTTP exception thrown: Instance 7f8c0a8e-fad4-49ff-9339-2f05327c58f3 could not be found. Dec 18 20:48:02.955015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] Returning 404 to user: Instance 7f8c0a8e-fad4-49ff-9339-2f05327c58f3 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:02.956212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fc12d1d7-47f8-41f3-9f81-1c162bfe6321 tempest-ServersAdminNegativeTestJSON-1449622594 tempest-ServersAdminNegativeTestJSON-1449622594-project] 10.222.0.13 "GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3" status: 404 len: 111 microversion: 2.1 time: 0.057150 Dec 18 20:48:02.957140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 275/519] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:02 2021] GET /compute/v2.1/servers/7f8c0a8e-fad4-49ff-9339-2f05327c58f3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:02.961970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-02e6de65-3be2-44fa-8c90-8c73b028ecb4 req-205a024f-3dc9-4bec-a380-1926b1ba28f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8c0a8e-fad4-49ff-9339-2f05327c58f3", "name": "network-vif-deleted", "tag": "14e2305d-ac69-431f-8068-23084ff0cb71"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:02.964683 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:02.964683 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:02.973559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-02e6de65-3be2-44fa-8c90-8c73b028ecb4 req-205a024f-3dc9-4bec-a380-1926b1ba28f7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:02.975126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-02e6de65-3be2-44fa-8c90-8c73b028ecb4 req-205a024f-3dc9-4bec-a380-1926b1ba28f7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:02.988024 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-02e6de65-3be2-44fa-8c90-8c73b028ecb4 req-205a024f-3dc9-4bec-a380-1926b1ba28f7 service nova] Creating event network-vif-deleted:14e2305d-ac69-431f-8068-23084ff0cb71 for instance 7f8c0a8e-fad4-49ff-9339-2f05327c58f3 on nch2-master-1 Dec 18 20:48:02.993984 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-02e6de65-3be2-44fa-8c90-8c73b028ecb4 req-205a024f-3dc9-4bec-a380-1926b1ba28f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035270 Dec 18 20:48:02.995382 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 276/520] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:03.000773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e037d818-66a0-4bd5-8648-e9a6a110aa2d tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:03.002503 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:03.002503 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:03.030157 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e037d818-66a0-4bd5-8648-e9a6a110aa2d tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1900674496/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032115 Dec 18 20:48:03.034413 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 277/521] 10.222.0.13 () {60 vars in 1223 bytes} [Sat Dec 18 20:48:02 2021] POST /compute/v2.1/flavors/1900674496/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:03.041678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'action', calling method: .version_select at 0x7f715e6c6ca0>, body: {"addFloatingIp": {"address": "172.35.3.55"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:03.043408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:03.050287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:03.051055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:03.051878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:03.053207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:03.141917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Acquired lock "refresh_cache-0b8acb2d-06ca-4772-91e2-d13f92d112c3" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:48:03.149684 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-193ba12b-d3be-45f5-ac13-43d3d0105730 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d" status: 200 len: 371 microversion: 2.1 time: 0.359658 Dec 18 20:48:03.150619 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 245/522] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 20:48:02 2021] GET /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d => generated 371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:03.161067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:03.162215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:03.168827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:03.169303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:03.170074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:03.170538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:03.413811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:03.422080 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c9e6eac-65f0-4501-9382-796300adf6a8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1310 microversion: 2.1 time: 0.270227 Dec 18 20:48:03.432070 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 246/523] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:03 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1310 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:03.437705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e98b6f8e-19ce-4d00-8a32-d99d3c285aaf tempest-FlavorsV255TestJSON-314482730 tempest-FlavorsV255TestJSON-314482730-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:03.459648 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e98b6f8e-19ce-4d00-8a32-d99d3c285aaf tempest-FlavorsV255TestJSON-314482730 tempest-FlavorsV255TestJSON-314482730-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3408 microversion: 2.55 time: 0.025929 Dec 18 20:48:03.468798 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 247/524] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:48:03 2021] GET /compute/v2.1/flavors => generated 3408 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:03.468798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7598a088-ca59-46cc-92a8-e042ef3e0bee tempest-FlavorsExtraSpecsTestJSON-290818693 tempest-FlavorsExtraSpecsTestJSON-290818693-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:03.482128 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7598a088-ca59-46cc-92a8-e042ef3e0bee tempest-FlavorsExtraSpecsTestJSON-290818693 tempest-FlavorsExtraSpecsTestJSON-290818693-project] 10.222.0.13 "GET /compute/v2.1/flavors/1900674496/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017786 Dec 18 20:48:03.487199 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 248/525] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 20:48:03 2021] GET /compute/v2.1/flavors/1900674496/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:03.491298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1179602048", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "fab4d786-81c4-48dc-b51f-790f7e93cb03"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:03.549202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] validate_networks() for [('fab4d786-81c4-48dc-b51f-790f7e93cb03', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:04.329391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:04.330519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:04.331140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:04.331745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:04.332421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:04.345935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:04.347574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:04.348755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:04.351683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:04.390811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:04.399515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for user 8042de28328d4b26b910f1be4b499879 and project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:04.417999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:48:04.420634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:48:04.483067 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ddc55fa8-0136-4239-8437-762023c8dc6a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.998740 Dec 18 20:48:04.489626 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 249/526] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 20:48:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 20:48:05.014440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a6d37a8-e146-4f4d-8c3f-f073d85dd945 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:05.030140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a6d37a8-e146-4f4d-8c3f-f073d85dd945 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.539118 Dec 18 20:48:05.032699 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 250/527] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:48:04 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:05.041324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83ade8c8-859a-46d0-a36a-50d043cac902 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Action: 'update', calling method: .version_select at 0x7f714fcbcd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:05.049344 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:05.049344 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:05.491297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ade8c8-859a-46d0-a36a-50d043cac902 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:05.493597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ade8c8-859a-46d0-a36a-50d043cac902 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:05.494715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ade8c8-859a-46d0-a36a-50d043cac902 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:05.495765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ade8c8-859a-46d0-a36a-50d043cac902 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:05.624483 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83ade8c8-859a-46d0-a36a-50d043cac902 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d" status: 200 len: 328 microversion: 2.1 time: 0.590485 Dec 18 20:48:05.628631 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 251/528] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:05 2021] PUT /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d => generated 328 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:05.636230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cba76426-b9ba-4c4b-b36a-ab2d6362a9f6 tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:05.637399 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:05.637399 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:05.666307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cba76426-b9ba-4c4b-b36a-ab2d6362a9f6 tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2113885660" status: 202 len: 0 microversion: 2.55 time: 0.034485 Dec 18 20:48:05.667630 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 252/529] 10.222.0.13 () {60 vars in 1201 bytes} [Sat Dec 18 20:48:05 2021] DELETE /compute/v2.1/flavors/2113885660 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:48:05.673411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-102eb6c4-2f57-422c-ade0-66ba83f69182 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:05.675119 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:05.675119 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:05.705602 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-102eb6c4-2f57-422c-ade0-66ba83f69182 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1900674496/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036683 Dec 18 20:48:05.711320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 253/530] 10.222.0.13 () {60 vars in 1223 bytes} [Sat Dec 18 20:48:05 2021] POST /compute/v2.1/flavors/1900674496/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:05.715887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-08d06bd0-c2f5-4f0d-a088-70c71c5831be req-8cefaf68-989c-4b07-be31-eed4052eaeac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5985b52a-141c-483c-ab38-8b1e38a0278f", "tag": "9426e501-39e7-4a02-84c3-cc79d30a84ff"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:05.715887 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:05.715887 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:05.733162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-08d06bd0-c2f5-4f0d-a088-70c71c5831be req-8cefaf68-989c-4b07-be31-eed4052eaeac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:05.733917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-08d06bd0-c2f5-4f0d-a088-70c71c5831be req-8cefaf68-989c-4b07-be31-eed4052eaeac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:05.749951 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-08d06bd0-c2f5-4f0d-a088-70c71c5831be req-8cefaf68-989c-4b07-be31-eed4052eaeac service nova] Creating event network-changed:9426e501-39e7-4a02-84c3-cc79d30a84ff for instance 5985b52a-141c-483c-ab38-8b1e38a0278f on nch1-master-1 Dec 18 20:48:05.755212 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-08d06bd0-c2f5-4f0d-a088-70c71c5831be req-8cefaf68-989c-4b07-be31-eed4052eaeac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045321 Dec 18 20:48:05.756741 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 254/531] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:05.763926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:05.773438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:05.787807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:05.788409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:05.790147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:05.790755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:06.300793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:06.316428 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae85a60b-5478-419c-9149-49ee0eff165e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1310 microversion: 2.1 time: 0.558307 Dec 18 20:48:06.326765 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 255/532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:05 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1310 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:06.335648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:06.341499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:06.357877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:06.359215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:06.360598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:06.361191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:06.424137 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.network.neutron [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] re-assign floating IP 172.35.3.55 from instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 Dec 18 20:48:06.475234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:06.485899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:06.487499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:06.491401 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31e85677-e96f-4f9a-bc2f-14dcd43b4806 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1320 microversion: 2.25 time: 0.159648 Dec 18 20:48:06.501370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Building network info cache for instance {{(pid=140731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:48:06.502596 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 256/533] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:06 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:06.796447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b3ad1c01-dd19-4bbc-b1a5-3ee67d758003 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-833551734", "id": 467279096, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:06.798121 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:06.798121 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:06.835970 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b3ad1c01-dd19-4bbc-b1a5-3ee67d758003 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.329873 Dec 18 20:48:06.836864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 257/534] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:06 2021] POST /compute/v2.1/flavors => generated 421 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:06.851616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3e37aa0-9b48-4c7d-8cc5-62e1f1a1f8b0 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:06.855303 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:06.855303 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:06.881631 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3e37aa0-9b48-4c7d-8cc5-62e1f1a1f8b0 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d" status: 202 len: 0 microversion: 2.1 time: 0.042557 Dec 18 20:48:06.883092 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 258/535] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 20:48:06 2021] DELETE /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:48:06.889642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7a74005-fdc5-4ded-8fb3-1cdaadfbacfc tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:06.917623 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7a74005-fdc5-4ded-8fb3-1cdaadfbacfc tempest-FlavorsV255TestJSON-1848160655 tempest-FlavorsV255TestJSON-1848160655-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6144 microversion: 2.55 time: 0.032899 Dec 18 20:48:06.943279 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 259/536] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Dec 18 20:48:06 2021] GET /compute/v2.1/flavors/detail => generated 6144 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:06.943279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9b2a127-7685-4176-9b8d-7b7793ac6809 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:06.951018 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9b2a127-7685-4176-9b8d-7b7793ac6809 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1900674496/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017435 Dec 18 20:48:06.955597 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 260/537] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 20:48:06 2021] GET /compute/v2.1/flavors/1900674496/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:06.961776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecaf2bdc-011f-4bb2-a4e6-72cee6881ab9 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:06.977263 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecaf2bdc-011f-4bb2-a4e6-72cee6881ab9 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024086 Dec 18 20:48:06.979797 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 261/538] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Dec 18 20:48:06 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:06.985565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0de4a3b-28ff-46e9-9d42-14faa0fad63e tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Calling method '.version_select at 0x7f714fbf6a60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:07.183343 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0de4a3b-28ff-46e9-9d42-14faa0fad63e tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d" status: 200 len: 371 microversion: 2.1 time: 0.202353 Dec 18 20:48:07.185133 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 262/539] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 20:48:06 2021] GET /compute/v2.1/os-quota-sets/18056e3f54074bac82a22bb83ad4dd6d => generated 371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:07.206372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b16d596-1af6-4737-a46b-e02e1c9f4ec3 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:07.211532 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:07.211532 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:07.276554 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b16d596-1af6-4737-a46b-e02e1c9f4ec3 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1900674496/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.087129 Dec 18 20:48:07.283285 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 263/540] 10.222.0.13 () {60 vars in 1264 bytes} [Sat Dec 18 20:48:07 2021] PUT /compute/v2.1/flavors/1900674496/os-extra_specs/hw:numa_nodes => generated 22 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:07.303795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1be9208-5a8e-43c6-8e1a-43caf9ed68dc tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-277189119", "id": 1297665195, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:07.344726 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1be9208-5a8e-43c6-8e1a-43caf9ed68dc tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.059253 Dec 18 20:48:07.345764 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 264/541] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:07 2021] POST /compute/v2.1/flavors => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:07.350622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb2597f6-b2b7-46c0-a2af-9551e49a5cb4 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:07.361728 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb2597f6-b2b7-46c0-a2af-9551e49a5cb4 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1900674496/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014811 Dec 18 20:48:07.363505 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 265/542] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 20:48:07 2021] GET /compute/v2.1/flavors/1900674496/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:07.370665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:07.371963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:07.394314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:07.394926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:07.398024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:07.398654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:07.904434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:07.913034 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b60d672-1e61-4691-9bd9-81f7d613c5cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1310 microversion: 2.1 time: 0.548506 Dec 18 20:48:07.923313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Updating instance_info_cache with network_info: [{"id": "d5d720a6-0889-449d-a427-b3d33c3e0143", "address": "fa:16:3e:8e:75:e5", "network": {"id": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2088372549-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e622a6218cdd40c8861466b0d36c1ffe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5d720a6-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:48:07.933785 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 266/543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:07 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1310 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:07.942067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24c02348-560e-4594-825f-157713538002 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:07.946726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Building network info cache for instance {{(pid=140731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:48:07.953433 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24c02348-560e-4594-825f-157713538002 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017608 Dec 18 20:48:07.959789 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 267/544] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Dec 18 20:48:07 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:07.964281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b689b81-2c34-406d-9c08-9d0cfdb2e987 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:07.965038 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:07.965038 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:08.000306 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b689b81-2c34-406d-9c08-9d0cfdb2e987 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1900674496/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.035342 Dec 18 20:48:08.000306 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 268/545] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 20:48:07 2021] DELETE /compute/v2.1/flavors/1900674496/os-extra_specs/hw:numa_nodes => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:48:08.005614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:08.006277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:08.015140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:08.027362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:08.028611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:08.028977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:08.455053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:08.466143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:08.468179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:08.469294 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-457e656c-8fcd-4d8f-8d34-62f63b41455a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1362 microversion: 2.25 time: 0.470294 Dec 18 20:48:08.469848 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 269/546] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:07 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:08.495242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad372d00-2e43-4463-b4c6-67a284143d8a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Calling method '.version_select at 0x7f714fe170d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:09.005865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Updating instance_info_cache with network_info: [{"id": "84a44e31-f256-408a-9208-81d575d9e905", "address": "fa:16:3e:36:66:a7", "network": {"id": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2088372549-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e622a6218cdd40c8861466b0d36c1ffe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap84a44e31-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:48:09.019583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Releasing lock "refresh_cache-0b8acb2d-06ca-4772-91e2-d13f92d112c3" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:48:09.019871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ad372d00-2e43-4463-b4c6-67a284143d8a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.535573 Dec 18 20:48:09.020448 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 270/547] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 20:48:08 2021] GET /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf/defaults => generated 371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:09.020577 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fc09dbdb-b0d2-4a01-acca-ac9af4247f54 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3/action" status: 202 len: 0 microversion: 2.1 time: 5.984923 Dec 18 20:48:09.028184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d6805327-9e8b-4eea-8266-34a28ed52039 req-e89f9e14-fc08-4f6c-9f03-0ffc83054e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5", "tag": "d5d720a6-0889-449d-a427-b3d33c3e0143"}, {"name": "network-changed", "server_uuid": "0b8acb2d-06ca-4772-91e2-d13f92d112c3", "tag": "84a44e31-f256-408a-9208-81d575d9e905"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:09.028762 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 278/548] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:03 2021] POST /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3/action => generated 0 bytes in 5994 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 20:48:09.034180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44f7a8fb-ee98-4c09-a882-5160efca157c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'create', calling method: .version_select at 0x7f715c3355e0>, body: {"keypair": {"name": "tempest-keypair-1493312864"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:09.034762 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:09.034762 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:09.051212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-44f7a8fb-ee98-4c09-a882-5160efca157c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for project b48e95c75c9444f2a0d2cb6704727346. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:09.056332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-44f7a8fb-ee98-4c09-a882-5160efca157c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for user c3e0c0d3dc8441968dafc98b902ab349 and project b48e95c75c9444f2a0d2cb6704727346. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:09.056948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d6805327-9e8b-4eea-8266-34a28ed52039 req-e89f9e14-fc08-4f6c-9f03-0ffc83054e8b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.057405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d6805327-9e8b-4eea-8266-34a28ed52039 req-e89f9e14-fc08-4f6c-9f03-0ffc83054e8b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.090995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d6805327-9e8b-4eea-8266-34a28ed52039 req-e89f9e14-fc08-4f6c-9f03-0ffc83054e8b service nova] Creating event network-changed:d5d720a6-0889-449d-a427-b3d33c3e0143 for instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 on nch1-master-1 Dec 18 20:48:09.091535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d6805327-9e8b-4eea-8266-34a28ed52039 req-e89f9e14-fc08-4f6c-9f03-0ffc83054e8b service nova] Creating event network-changed:84a44e31-f256-408a-9208-81d575d9e905 for instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 on nch1-master-1 Dec 18 20:48:09.102940 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d6805327-9e8b-4eea-8266-34a28ed52039 req-e89f9e14-fc08-4f6c-9f03-0ffc83054e8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.080756 Dec 18 20:48:09.103539 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 271/549] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:09.117493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78698d47-ca60-4712-a18b-5c7f473fa7b6 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:09.120599 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:09.120599 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:09.185991 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78698d47-ca60-4712-a18b-5c7f473fa7b6 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1900674496/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.074625 Dec 18 20:48:09.193098 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 272/550] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 20:48:09 2021] DELETE /compute/v2.1/flavors/1900674496/os-extra_specs/hw:cpu_policy => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 20:48:09.194552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-44f7a8fb-ee98-4c09-a882-5160efca157c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for project b48e95c75c9444f2a0d2cb6704727346. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:09.202372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-44f7a8fb-ee98-4c09-a882-5160efca157c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for user c3e0c0d3dc8441968dafc98b902ab349 and project b48e95c75c9444f2a0d2cb6704727346. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:09.204855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1c4571b7-74dc-4254-a407-8cd8e127e2fc req-4f376c7f-4692-4261-9774-d1c87a3d927c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1389e6-a05e-4f01-aa45-405bf57c622d", "tag": "f4d2142c-df3c-4259-89f6-888e1edbf513"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:09.206444 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:09.206444 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:09.220809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1c4571b7-74dc-4254-a407-8cd8e127e2fc req-4f376c7f-4692-4261-9774-d1c87a3d927c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.221600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1c4571b7-74dc-4254-a407-8cd8e127e2fc req-4f376c7f-4692-4261-9774-d1c87a3d927c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.230725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44f7a8fb-ee98-4c09-a882-5160efca157c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.200036 Dec 18 20:48:09.236781 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 279/551] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:48:09 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:09.241573 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1c4571b7-74dc-4254-a407-8cd8e127e2fc req-4f376c7f-4692-4261-9774-d1c87a3d927c service nova] Creating event network-changed:f4d2142c-df3c-4259-89f6-888e1edbf513 for instance 6b1389e6-a05e-4f01-aa45-405bf57c622d on nch2-master-1 Dec 18 20:48:09.248334 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1c4571b7-74dc-4254-a407-8cd8e127e2fc req-4f376c7f-4692-4261-9774-d1c87a3d927c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053768 Dec 18 20:48:09.249545 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 273/552] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:09.252868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:09.253493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:09.255883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e6504952-1148-4231-9fa0-0f99503d5cdb req-7dab2ffc-d6e0-46cc-a2bc-9b7de49a4d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5985b52a-141c-483c-ab38-8b1e38a0278f", "name": "network-vif-plugged", "status": "completed", "tag": "9426e501-39e7-4a02-84c3-cc79d30a84ff"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:09.257942 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:09.257942 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:09.265763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e6504952-1148-4231-9fa0-0f99503d5cdb req-7dab2ffc-d6e0-46cc-a2bc-9b7de49a4d84 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.266455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e6504952-1148-4231-9fa0-0f99503d5cdb req-7dab2ffc-d6e0-46cc-a2bc-9b7de49a4d84 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.271786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.274702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.276299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.277999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.283505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e6504952-1148-4231-9fa0-0f99503d5cdb req-7dab2ffc-d6e0-46cc-a2bc-9b7de49a4d84 service nova] Creating event network-vif-plugged:9426e501-39e7-4a02-84c3-cc79d30a84ff for instance 5985b52a-141c-483c-ab38-8b1e38a0278f on nch1-master-1 Dec 18 20:48:09.291945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e6504952-1148-4231-9fa0-0f99503d5cdb req-7dab2ffc-d6e0-46cc-a2bc-9b7de49a4d84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040760 Dec 18 20:48:09.292764 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 274/553] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:09.304922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'action', calling method: .version_select at 0x7f715e6c5c10>, body: {"removeFloatingIp": {"address": "172.35.3.55"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:09.722936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:09.731440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.732130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.733159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.734271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.897693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:09.908138 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7bd5a75f-e595-4348-845d-a080070f060e tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1310 microversion: 2.1 time: 0.674674 Dec 18 20:48:09.913391 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 280/554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:09 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1310 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:09.925382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a8756583-e461-4a11-a1e9-ba2bdae1793c tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:09.939071 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a8756583-e461-4a11-a1e9-ba2bdae1793c tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1900674496/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024351 Dec 18 20:48:09.939655 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 281/555] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 20:48:09 2021] GET /compute/v2.1/flavors/1900674496/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:09.953279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:09.954029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:09.963783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.964816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:09.966956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:09.967569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:10.080049 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] HTTP exception thrown: Floating IP 172.35.3.55 is not associated with instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5. Dec 18 20:48:10.081345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Returning 409 to user: Floating IP 172.35.3.55 is not associated with instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:10.082585 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19bf739e-7d1c-438a-85db-36d8b6e20eff tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action" status: 409 len: 145 microversion: 2.1 time: 0.788119 Dec 18 20:48:10.088884 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 275/556] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:09 2021] POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action => generated 145 bytes in 794 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:48:10.097671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abf0f2ab-92c8-4281-a633-2f53240bb482 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Action: 'update', calling method: .version_select at 0x7f714fb8d040>, body: {"quota_set": {"ram": "5120"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:10.100985 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:10.100985 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:10.180369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:10.191914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:10.196943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:10.199122 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ada62748-e3aa-492e-89d9-7043a4b14669 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1362 microversion: 2.25 time: 0.258282 Dec 18 20:48:10.199882 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 282/557] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:09 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:10.211502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4371bc65-3c61-477d-b972-a0f549721659 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:10.212345 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:10.212345 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:10.233577 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4371bc65-3c61-477d-b972-a0f549721659 tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1900674496" status: 202 len: 0 microversion: 2.1 time: 0.032391 Dec 18 20:48:10.237102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 283/558] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:48:10 2021] DELETE /compute/v2.1/flavors/1900674496 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:48:10.242188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'action', calling method: .version_select at 0x7f715e6c6c10>, body: {"removeFloatingIp": {"address": "172.35.3.55"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:10.379763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abf0f2ab-92c8-4281-a633-2f53240bb482 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:10.381523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abf0f2ab-92c8-4281-a633-2f53240bb482 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:10.382838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abf0f2ab-92c8-4281-a633-2f53240bb482 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:10.383639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abf0f2ab-92c8-4281-a633-2f53240bb482 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:10.421974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:10.430932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:10.431998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:10.440962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:10.446273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:10.448978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abf0f2ab-92c8-4281-a633-2f53240bb482 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181" status: 200 len: 328 microversion: 2.1 time: 0.357346 Dec 18 20:48:10.449666 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 276/559] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:10 2021] PUT /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181 => generated 328 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:10.459730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5d309375-404f-4359-8772-b9814b921bfc tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:10.483393 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5d309375-404f-4359-8772-b9814b921bfc tempest-FlavorsExtraSpecsTestJSON-1868627066 tempest-FlavorsExtraSpecsTestJSON-1868627066-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.032116 Dec 18 20:48:10.484462 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 277/560] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:48:10 2021] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:10.499962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-efda910f-0d6e-4fcb-8480-d24c491398c3 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Calling method '.version_select at 0x7f714fb8d9d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:10.877457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Acquired lock "refresh_cache-0b8acb2d-06ca-4772-91e2-d13f92d112c3" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:48:11.071710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efda910f-0d6e-4fcb-8480-d24c491398c3 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:11.072156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efda910f-0d6e-4fcb-8480-d24c491398c3 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:11.072971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efda910f-0d6e-4fcb-8480-d24c491398c3 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:11.074791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efda910f-0d6e-4fcb-8480-d24c491398c3 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:11.117601 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-efda910f-0d6e-4fcb-8480-d24c491398c3 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181/detail" status: 200 len: 916 microversion: 2.1 time: 0.625334 Dec 18 20:48:11.133869 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 278/561] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:48:10 2021] GET /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181/detail => generated 916 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:11.138930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:11.139841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:11.147750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:11.149018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:11.151957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:11.152647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:11.460200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:11.475491 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e75ef259-a6e6-42a9-a9b5-3377f62e89f1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1310 microversion: 2.1 time: 0.336039 Dec 18 20:48:11.476612 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 279/562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:11 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1310 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:11.500951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:11.502776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:11.518802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:11.522136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:11.523391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:11.526239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:12.190985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:12.214566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:12.225620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:12.228044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c840f729-75b8-403c-a376-d728b81116f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1362 microversion: 2.25 time: 0.749865 Dec 18 20:48:12.230441 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 280/563] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:11 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1362 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:12.236821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Action: 'update', calling method: .version_select at 0x7f714fc86ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:12.254514 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:12.254514 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:12.703406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Building network info cache for instance {{(pid=140731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:48:12.774317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:12.774774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:12.775597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:12.776035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:12.906648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:12.910187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:12.911146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:12.916533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:13.072585 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2fda5df-db4f-49f0-b3fe-53a00a22060c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181?user_id=45dca67b2e16488d85798a7a79a74f90" status: 200 len: 328 microversion: 2.1 time: 0.840781 Dec 18 20:48:13.079100 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 281/564] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Dec 18 20:48:12 2021] PUT /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181?user_id=45dca67b2e16488d85798a7a79a74f90 => generated 328 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:13.090573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:13.092461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:13.104098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:13.106815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:13.108475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:13.110291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:13.382842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:13.395497 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eac7592d-2e40-4b52-8a04-57b8d7c1928b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1494 microversion: 2.1 time: 0.314815 Dec 18 20:48:13.397934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 282/565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:13 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1494 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:13.403174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ef496b66-56e2-43cf-9d5d-0da700d3c5cf req-ee0e3a0c-66ef-4bf1-860b-27a5dc7222b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8acb2d-06ca-4772-91e2-d13f92d112c3", "tag": "84a44e31-f256-408a-9208-81d575d9e905"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:13.405114 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:13.405114 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:13.415734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ef496b66-56e2-43cf-9d5d-0da700d3c5cf req-ee0e3a0c-66ef-4bf1-860b-27a5dc7222b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:13.416462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ef496b66-56e2-43cf-9d5d-0da700d3c5cf req-ee0e3a0c-66ef-4bf1-860b-27a5dc7222b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:13.431972 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ef496b66-56e2-43cf-9d5d-0da700d3c5cf req-ee0e3a0c-66ef-4bf1-860b-27a5dc7222b9 service nova] Creating event network-changed:84a44e31-f256-408a-9208-81d575d9e905 for instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 on nch1-master-1 Dec 18 20:48:13.438366 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ef496b66-56e2-43cf-9d5d-0da700d3c5cf req-ee0e3a0c-66ef-4bf1-860b-27a5dc7222b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038086 Dec 18 20:48:13.439602 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 283/566] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:13.516815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Updating instance_info_cache with network_info: [{"id": "84a44e31-f256-408a-9208-81d575d9e905", "address": "fa:16:3e:36:66:a7", "network": {"id": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2088372549-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e622a6218cdd40c8861466b0d36c1ffe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap84a44e31-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:48:13.528421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Releasing lock "refresh_cache-0b8acb2d-06ca-4772-91e2-d13f92d112c3" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:48:13.529276 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0d0e2a6-4500-447d-8a71-c3e57e4a6004 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3/action" status: 202 len: 0 microversion: 2.1 time: 3.291625 Dec 18 20:48:13.529895 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 284/567] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:10 2021] POST /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3/action => generated 0 bytes in 3295 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 20:48:13.537835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-717b6f9d-1580-409e-842e-3ad365df2380 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Calling method '.version_select at 0x7f715c219820>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:13.856809 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-717b6f9d-1580-409e-842e-3ad365df2380 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181?user_id=45dca67b2e16488d85798a7a79a74f90" status: 200 len: 370 microversion: 2.1 time: 0.321178 Dec 18 20:48:13.860038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-83838345", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "8baa41ee-0761-45dc-9249-6ee935d2158f"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:13.865471 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 285/568] 10.222.0.13 () {58 vars in 1322 bytes} [Sat Dec 18 20:48:13 2021] GET /compute/v2.1/os-quota-sets/5f9d3ce5386447a58506a38417851181?user_id=45dca67b2e16488d85798a7a79a74f90 => generated 370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:13.871909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1373019849", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "1297665195", "adminPass": "***", "networks": [{"uuid": "b16f44c1-8015-4e89-85aa-20e9d5fd9f2e"}], "security_groups": [{"name": "tempest-securitygroup--1483741819"}], "key_name": "tempest-keypair-1493312864", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:13.957183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] validate_networks() for [('8baa41ee-0761-45dc-9249-6ee935d2158f', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:14.159635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] validate_networks() for [('b16f44c1-8015-4e89-85aa-20e9d5fd9f2e', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:14.659095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:14.659884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:14.661315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:14.662892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:14.663558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:14.676427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:14.677038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:14.677962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:14.678652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:14.702647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Getting quotas for project 47584e2b5b674fc295b6a63ffe8df191. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:14.707174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Getting quotas for user c971aa1884174ed0acec9d140f2eda87 and project 47584e2b5b674fc295b6a63ffe8df191. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:14.720636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:48:14.723204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:48:14.778302 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a9985783-4286-432b-80a4-c1ec060c87d2 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.336983 Dec 18 20:48:14.779242 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 284/569] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:48:14.784066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:14.784864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:14.791920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:14.792594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:14.793550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:14.794179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:14.802091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:14.802551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:14.803023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:14.803431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:14.803879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:14.814519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:14.815139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:14.816138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:14.816734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:14.858614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for project b48e95c75c9444f2a0d2cb6704727346. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:14.863425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for user c3e0c0d3dc8441968dafc98b902ab349 and project b48e95c75c9444f2a0d2cb6704727346. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:14.882982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:48:14.885323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:48:14.960363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:14.963338 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f461587b-743a-4eae-a453-5231565d5e93 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.096397 Dec 18 20:48:14.964753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 286/570] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:48:14.976309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0f67d8d0-692a-4877-b6a7-ebde37efa543 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:14.977854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0f67d8d0-692a-4877-b6a7-ebde37efa543 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:14.979718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:14.985975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:14.988159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fbc3abc2-03a0-4054-a467-714c6829c0d9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1362 microversion: 2.25 time: 0.207548 Dec 18 20:48:14.989553 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 285/571] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:14 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:14.999689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:15.001023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:15.008062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67d8d0-692a-4877-b6a7-ebde37efa543 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.013591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67d8d0-692a-4877-b6a7-ebde37efa543 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.015137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67d8d0-692a-4877-b6a7-ebde37efa543 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.016157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67d8d0-692a-4877-b6a7-ebde37efa543 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.018236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.019035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.020503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.027789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.070781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:48:15.172755 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e13be653-8fb9-4e0f-8e4d-1259e79586f7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 204 len: 0 microversion: 2.1 time: 0.179140 Dec 18 20:48:15.174310 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 286/572] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:48:14 2021] DELETE /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:48:15.181915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ec3e1fbf-a6d4-4226-924b-df7a938cc9ea req-e1d199b4-9fb8-4f8e-a492-88f69301bb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1389e6-a05e-4f01-aa45-405bf57c622d", "name": "network-vif-plugged", "status": "completed", "tag": "f4d2142c-df3c-4259-89f6-888e1edbf513"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:15.185175 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:15.185175 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:15.202240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ec3e1fbf-a6d4-4226-924b-df7a938cc9ea req-e1d199b4-9fb8-4f8e-a492-88f69301bb59 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.202859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ec3e1fbf-a6d4-4226-924b-df7a938cc9ea req-e1d199b4-9fb8-4f8e-a492-88f69301bb59 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.217108 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ec3e1fbf-a6d4-4226-924b-df7a938cc9ea req-e1d199b4-9fb8-4f8e-a492-88f69301bb59 service nova] Creating event network-vif-plugged:f4d2142c-df3c-4259-89f6-888e1edbf513 for instance 6b1389e6-a05e-4f01-aa45-405bf57c622d on nch2-master-1 Dec 18 20:48:15.222535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ec3e1fbf-a6d4-4226-924b-df7a938cc9ea req-e1d199b4-9fb8-4f8e-a492-88f69301bb59 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046278 Dec 18 20:48:15.227577 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 287/573] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:15.248009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2826dcc9-8fef-4199-b418-b1613ad4418c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Calling method '.version_select at 0x7f714fb8ddc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:15.249728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0f67d8d0-692a-4877-b6a7-ebde37efa543 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1645 microversion: 2.1 time: 0.283700 Dec 18 20:48:15.254158 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 287/574] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:14 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1645 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:15.260023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d227f16a-8345-4100-a5e8-cc4a875b1bb1 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:15.260626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d227f16a-8345-4100-a5e8-cc4a875b1bb1 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:15.404828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d227f16a-8345-4100-a5e8-cc4a875b1bb1 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:15.414234 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d227f16a-8345-4100-a5e8-cc4a875b1bb1 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1216 microversion: 2.1 time: 0.159963 Dec 18 20:48:15.415944 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 288/575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:15 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:15.430582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d39b3a2-451a-4a55-8b09-88464def1210 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:15.432279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2d39b3a2-451a-4a55-8b09-88464def1210 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:15.538412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2d39b3a2-451a-4a55-8b09-88464def1210 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:15.552913 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d39b3a2-451a-4a55-8b09-88464def1210 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1265 microversion: 2.1 time: 0.133948 Dec 18 20:48:15.562473 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 289/576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:15 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:15.562473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.55"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:15.563165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:15.570799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.571254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.572178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.572655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.603503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Acquired lock "refresh_cache-ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:48:15.664109 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2826dcc9-8fef-4199-b418-b1613ad4418c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.434947 Dec 18 20:48:15.664714 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 288/577] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 20:48:15 2021] GET /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf/defaults => generated 371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:15.669406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f240fafe-9c2c-4469-8ec5-d6c69420d98c tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:15.670104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f240fafe-9c2c-4469-8ec5-d6c69420d98c tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:15.677770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f240fafe-9c2c-4469-8ec5-d6c69420d98c tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.678215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f240fafe-9c2c-4469-8ec5-d6c69420d98c tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.679135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f240fafe-9c2c-4469-8ec5-d6c69420d98c tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:15.679562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f240fafe-9c2c-4469-8ec5-d6c69420d98c tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:15.955765 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f240fafe-9c2c-4469-8ec5-d6c69420d98c tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1645 microversion: 2.1 time: 0.289986 Dec 18 20:48:15.956332 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 289/578] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:15 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1645 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:15.961761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ff75345-39de-47f7-800d-205e3dba0ced tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Action: 'update', calling method: .version_select at 0x7f714fbad3a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:15.964011 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:15.964011 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:16.127682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ff75345-39de-47f7-800d-205e3dba0ced tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.128704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ff75345-39de-47f7-800d-205e3dba0ced tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.129503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ff75345-39de-47f7-800d-205e3dba0ced tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.130651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ff75345-39de-47f7-800d-205e3dba0ced tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.395807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ff75345-39de-47f7-800d-205e3dba0ced tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf" status: 200 len: 329 microversion: 2.1 time: 0.438365 Dec 18 20:48:16.401815 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 290/579] 10.222.0.13 () {60 vars in 1262 bytes} [Sat Dec 18 20:48:15 2021] PUT /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf => generated 329 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:16.452842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f714fb501f0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:16.453648 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:16.453648 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:16.455238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.455695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.477696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.478387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.489415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.490098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.496039 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fb00aa53-685c-4d35-8a73-bb86b3f4d33d tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.098545 Dec 18 20:48:16.502792 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 291/580] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:48:16 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:16.502792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f7d4d428-8b27-4d7e-9b53-383ea84e25df tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:16.502792 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:16.502792 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:16.503836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d4d428-8b27-4d7e-9b53-383ea84e25df tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.504290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d4d428-8b27-4d7e-9b53-383ea84e25df tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.505668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d4d428-8b27-4d7e-9b53-383ea84e25df tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.506302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d4d428-8b27-4d7e-9b53-383ea84e25df tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.539259 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f7d4d428-8b27-4d7e-9b53-383ea84e25df tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041603 Dec 18 20:48:16.540050 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 292/581] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:48:16 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:16.551236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:16.551884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:16.559665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.560068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.561785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:16.562598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:16.883714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:16.895964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:16.900315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:16.904392 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-76fcc813-8a93-49bb-a2bb-6ff2c6df9189 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1362 microversion: 2.25 time: 0.355067 Dec 18 20:48:16.914897 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 293/582] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:16 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:16.923878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-558c8da7-b1dc-4c0d-811c-146a2f3e5415 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Action: 'update', calling method: .version_select at 0x7f714fb8dee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:16.934705 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:16.934705 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:17.028722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558c8da7-b1dc-4c0d-811c-146a2f3e5415 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:17.029715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558c8da7-b1dc-4c0d-811c-146a2f3e5415 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:17.031706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558c8da7-b1dc-4c0d-811c-146a2f3e5415 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:17.032400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558c8da7-b1dc-4c0d-811c-146a2f3e5415 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:17.228588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Building network info cache for instance {{(pid=140731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:48:17.430880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-558c8da7-b1dc-4c0d-811c-146a2f3e5415 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf" status: 200 len: 329 microversion: 2.1 time: 0.521338 Dec 18 20:48:17.438421 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 294/583] 10.222.0.13 () {60 vars in 1262 bytes} [Sat Dec 18 20:48:16 2021] PUT /compute/v2.1/os-quota-sets/4dcf3c5f1734482aa4846eb77a17abdf => generated 329 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:17.446727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:17.448942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:17.467301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:17.467651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:17.471700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:17.473873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.469591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:18.478578 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c0761ac1-be17-4277-9036-93958589af55 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1316 microversion: 2.1 time: 1.045071 Dec 18 20:48:18.479609 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 295/584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:17 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1316 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:18.484138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f714fe17a60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:18.485089 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:18.485089 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:18.486818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:18.487348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.507828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:18.508387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.520354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:18.520354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.527815 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f176283-1f49-460b-9c73-366a4dfbe914 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.047295 Dec 18 20:48:18.528819 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 296/585] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Dec 18 20:48:18 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:18.541190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bee4a8c6-8ecf-4ce3-be4d-8977b3f8df1d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:18.541718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bee4a8c6-8ecf-4ce3-be4d-8977b3f8df1d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:18.554242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee4a8c6-8ecf-4ce3-be4d-8977b3f8df1d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:18.555096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee4a8c6-8ecf-4ce3-be4d-8977b3f8df1d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.556581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee4a8c6-8ecf-4ce3-be4d-8977b3f8df1d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:18.557348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee4a8c6-8ecf-4ce3-be4d-8977b3f8df1d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.687271 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bee4a8c6-8ecf-4ce3-be4d-8977b3f8df1d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f/action" status: 202 len: 0 microversion: 2.1 time: 0.157098 Dec 18 20:48:18.688178 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 297/586] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:18 2021] POST /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:48:18.695010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:18.695987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:18.702944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:18.703710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.704858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:18.705518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:18.920387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Updating instance_info_cache with network_info: [{"id": "d5d720a6-0889-449d-a427-b3d33c3e0143", "address": "fa:16:3e:8e:75:e5", "network": {"id": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2088372549-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e622a6218cdd40c8861466b0d36c1ffe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5d720a6-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:48:18.974562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Releasing lock "refresh_cache-ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:48:18.976458 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41752f19-9d05-4bec-8c92-e9b32a394c4e tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action" status: 202 len: 0 microversion: 2.1 time: 3.418117 Dec 18 20:48:18.977790 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 290/587] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:15 2021] POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action => generated 0 bytes in 3423 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 20:48:18.996078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-39e6e132-6845-4be0-a9ac-376b9d0ec7fe req-f08032e9-ede5-43fd-9792-c7674b4066f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5", "tag": "d5d720a6-0889-449d-a427-b3d33c3e0143"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:19.001830 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:19.001830 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:19.022044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-39e6e132-6845-4be0-a9ac-376b9d0ec7fe req-f08032e9-ede5-43fd-9792-c7674b4066f0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.022780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-39e6e132-6845-4be0-a9ac-376b9d0ec7fe req-f08032e9-ede5-43fd-9792-c7674b4066f0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.039949 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-39e6e132-6845-4be0-a9ac-376b9d0ec7fe req-f08032e9-ede5-43fd-9792-c7674b4066f0 service nova] Creating event network-changed:d5d720a6-0889-449d-a427-b3d33c3e0143 for instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 on nch1-master-1 Dec 18 20:48:19.052848 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-39e6e132-6845-4be0-a9ac-376b9d0ec7fe req-f08032e9-ede5-43fd-9792-c7674b4066f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071061 Dec 18 20:48:19.054429 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 291/588] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:19.247270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:19.263117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-728bc1f6-392f-49ec-b87c-2059403ef0c4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1391 microversion: 2.1 time: 0.573270 Dec 18 20:48:19.263716 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 298/589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:18 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1391 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:19.279708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:19.280429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:19.287793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.288245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.289070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.289474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.440283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b3ff0975-2a7e-4c8d-bd49-c3fc6fb247aa tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] Calling method '.version_select at 0x7f715c440940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:19.441472 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:19.441472 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:19.457346 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b3ff0975-2a7e-4c8d-bd49-c3fc6fb247aa tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.398896 Dec 18 20:48:19.459275 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 292/590] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Dec 18 20:48:19 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:19.470703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-5ed0fe39-5835-40cd-8733-4dad98e5bc9e req-bcc0d764-8b4f-4f13-953e-f110eb6e2750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8acb2d-06ca-4772-91e2-d13f92d112c3", "name": "network-vif-deleted", "tag": "84a44e31-f256-408a-9208-81d575d9e905"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:19.478674 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:19.478674 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:19.492815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5ed0fe39-5835-40cd-8733-4dad98e5bc9e req-bcc0d764-8b4f-4f13-953e-f110eb6e2750 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.493610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5ed0fe39-5835-40cd-8733-4dad98e5bc9e req-bcc0d764-8b4f-4f13-953e-f110eb6e2750 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.513656 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-5ed0fe39-5835-40cd-8733-4dad98e5bc9e req-bcc0d764-8b4f-4f13-953e-f110eb6e2750 service nova] Creating event network-vif-deleted:84a44e31-f256-408a-9208-81d575d9e905 for instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 on nch1-master-1 Dec 18 20:48:19.521036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-5ed0fe39-5835-40cd-8733-4dad98e5bc9e req-bcc0d764-8b4f-4f13-953e-f110eb6e2750 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060149 Dec 18 20:48:19.522830 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 293/591] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:19.531645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f715c208f70>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:19.532540 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:19.532540 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:19.534090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.534526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.549668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.550308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.562672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.563665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.569811 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-78e35334-af4c-4445-b77b-a71d98c32e6f tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044449 Dec 18 20:48:19.574901 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 294/592] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:48:19 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:19.579554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d487141-8a42-4001-b6fc-886165c54a18 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:19.580282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d487141-8a42-4001-b6fc-886165c54a18 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:19.587177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d487141-8a42-4001-b6fc-886165c54a18 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.587895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d487141-8a42-4001-b6fc-886165c54a18 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.589012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d487141-8a42-4001-b6fc-886165c54a18 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:19.589717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d487141-8a42-4001-b6fc-886165c54a18 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:19.852826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:19.866451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:19.868620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:19.869747 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32ecf8f6-1a50-4a6d-8256-d54d77c560bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1558 microversion: 2.25 time: 0.594675 Dec 18 20:48:19.870808 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 299/593] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:19 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1558 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:19.875474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a67e4848-0aa7-4aef-a88d-ac52ea7ecaf7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '.version_select at 0x7f714fe17f70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:20.138244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d487141-8a42-4001-b6fc-886165c54a18 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1630 microversion: 2.1 time: 0.562068 Dec 18 20:48:20.139214 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 295/594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:19 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1630 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:20.143347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ee7369e-3c93-4430-b0b9-5f54c559c7c6 tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] Action: 'update', calling method: .version_select at 0x7f715c2084c0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:20.145091 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:20.145091 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:20.471755 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ee7369e-3c93-4430-b0b9-5f54c559c7c6 tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.331601 Dec 18 20:48:20.477883 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 296/595] 10.222.0.13 () {60 vars in 1205 bytes} [Sat Dec 18 20:48:20 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:20.483888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:20.484509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:20.492373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.492758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.493570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.494012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.500697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a67e4848-0aa7-4aef-a88d-ac52ea7ecaf7 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/6d392644-2ab7-4e37-a803-fa390564bfc9" status: 200 len: 183 microversion: 2.1 time: 0.628433 Dec 18 20:48:20.501453 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 300/596] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:48:19 2021] GET /compute/v2.1/os-floating-ips/6d392644-2ab7-4e37-a803-fa390564bfc9 => generated 183 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:20.506936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf18eee7-eee4-40fa-92c7-626a48705f9b tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f714fb0eca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:20.508037 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:20.508037 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:20.510510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf18eee7-eee4-40fa-92c7-626a48705f9b tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.511667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf18eee7-eee4-40fa-92c7-626a48705f9b tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.530181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf18eee7-eee4-40fa-92c7-626a48705f9b tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.530889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf18eee7-eee4-40fa-92c7-626a48705f9b tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.538877 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bf18eee7-eee4-40fa-92c7-626a48705f9b tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.035806 Dec 18 20:48:20.539642 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 301/597] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:48:20 2021] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:20.547291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:20.548122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:20.555644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.556190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.557073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.557517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.820214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:20.829911 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-636ec9c7-720b-40a9-9864-d48d3d9ca9db tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1316 microversion: 2.1 time: 0.350832 Dec 18 20:48:20.830839 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 297/598] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:20 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:20.835379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:20.836802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:20.843748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.844397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.845882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.845882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.865449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 6b1389e6-a05e-4f01-aa45-405bf57c622d {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:20.884941 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d5c85c6-6543-455c-a75e-2745550eb07c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 2051 microversion: 2.25 time: 0.343211 Dec 18 20:48:20.886604 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 302/599] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:20 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 2051 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:20.892302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:20.893124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:20.898155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lazy-loading 'flavor' on Instance uuid 5985b52a-141c-483c-ab38-8b1e38a0278f {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:20.906495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.907116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.908868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:20.909484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:20.929733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Going to try to live migrate instance to nch2-master-1 {{(pid=140731) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:48:21.191627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:21.199446 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ad9d43f4-482f-41c7-9d4a-50baa6e31990 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1391 microversion: 2.1 time: 0.311576 Dec 18 20:48:21.200099 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 303/600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:20 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:21.204233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3f9cc35-c2f6-4ee6-9ba9-cf0e4f34113c tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] Calling method '.version_select at 0x7f714fb0e8b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:21.205368 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:21.205368 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:21.224798 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3f9cc35-c2f6-4ee6-9ba9-cf0e4f34113c tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023548 Dec 18 20:48:21.225983 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 304/601] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Dec 18 20:48:21 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:21.231507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.55"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:21.687524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:21.701040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:21.702426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:21.703491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:21.704154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:22.064436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Acquired lock "refresh_cache-ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:48:22.479316 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6c801f9-0ed0-4fae-9755-7d91c951cd3e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f/action" status: 202 len: 0 microversion: 2.1 time: 1.647574 Dec 18 20:48:22.480797 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 298/602] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:20 2021] POST /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f/action => generated 0 bytes in 1650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:48:22.493442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-366439e6-ad94-4197-800a-7af9f4ae9322 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f715c1c9940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:22.495292 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:22.495292 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:22.497804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-366439e6-ad94-4197-800a-7af9f4ae9322 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:22.498276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-366439e6-ad94-4197-800a-7af9f4ae9322 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:22.522283 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-366439e6-ad94-4197-800a-7af9f4ae9322 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.035735 Dec 18 20:48:22.523083 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 299/603] 10.222.0.13 () {58 vars in 1178 bytes} [Sat Dec 18 20:48:22 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:22.529049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:22.529677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:22.537545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:22.538007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:22.539205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:22.539774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:22.926162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 6b1389e6-a05e-4f01-aa45-405bf57c622d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:22.957023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04450c44-6345-44e8-b279-3367967fa9b1 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 2051 microversion: 2.25 time: 0.432879 Dec 18 20:48:22.957750 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 300/604] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:22 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 2051 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:22.962577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a8ff3330-bd36-4377-b613-07adacd57cb1 req-e2eb2f36-2175-4967-9bc0-508d31ab2ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9d9725-ba21-477e-9e70-c7e9c733e54e", "tag": "ac8166be-db9c-48d7-aed1-022cd6d22a09"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:22.964086 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:22.964086 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:22.971111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a8ff3330-bd36-4377-b613-07adacd57cb1 req-e2eb2f36-2175-4967-9bc0-508d31ab2ecd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:22.971641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a8ff3330-bd36-4377-b613-07adacd57cb1 req-e2eb2f36-2175-4967-9bc0-508d31ab2ecd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:22.983277 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a8ff3330-bd36-4377-b613-07adacd57cb1 req-e2eb2f36-2175-4967-9bc0-508d31ab2ecd service nova] Creating event network-changed:ac8166be-db9c-48d7-aed1-022cd6d22a09 for instance bf9d9725-ba21-477e-9e70-c7e9c733e54e on nch2-master-1 Dec 18 20:48:22.988850 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a8ff3330-bd36-4377-b613-07adacd57cb1 req-e2eb2f36-2175-4967-9bc0-508d31ab2ecd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029512 Dec 18 20:48:22.990220 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 301/605] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:22.995602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7ba3bca-ede5-4db8-a606-fd12da7cbe75 tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] Action: 'update', calling method: .version_select at 0x7f715c208c10>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:22.997448 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:22.997448 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:23.109235 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7ba3bca-ede5-4db8-a606-fd12da7cbe75 tempest-QuotaClassesAdminTestJSON-223404934 tempest-QuotaClassesAdminTestJSON-223404934-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.117421 Dec 18 20:48:23.110227 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 302/606] 10.222.0.13 () {60 vars in 1205 bytes} [Sat Dec 18 20:48:22 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:23.134281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3263861f-b5d9-4554-850a-6cd15d3cfefb req-c3d04c96-17e8-4145-a70e-a2453e52c675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b52f544-8eb3-4f5e-a37c-c694695123bd", "tag": "a51358c4-71d5-40ec-bd5c-4e5e2bfda8e1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:23.137827 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:23.137827 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:23.156317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3263861f-b5d9-4554-850a-6cd15d3cfefb req-c3d04c96-17e8-4145-a70e-a2453e52c675 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:23.158136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3263861f-b5d9-4554-850a-6cd15d3cfefb req-c3d04c96-17e8-4145-a70e-a2453e52c675 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:23.175714 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3263861f-b5d9-4554-850a-6cd15d3cfefb req-c3d04c96-17e8-4145-a70e-a2453e52c675 service nova] Creating event network-changed:a51358c4-71d5-40ec-bd5c-4e5e2bfda8e1 for instance 5b52f544-8eb3-4f5e-a37c-c694695123bd on nch2-master-1 Dec 18 20:48:23.184498 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3263861f-b5d9-4554-850a-6cd15d3cfefb req-c3d04c96-17e8-4145-a70e-a2453e52c675 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065314 Dec 18 20:48:23.185326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 303/607] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:23.201507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:23.202594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:23.216573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:23.217093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:23.222142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:23.222341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:23.431319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Building network info cache for instance {{(pid=140732) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:48:23.919066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:23.943704 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51e7f45d-5a10-4c99-83c3-19ad6054c7af tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1316 microversion: 2.1 time: 0.746654 Dec 18 20:48:23.946758 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 304/608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:23 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:23.956048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:23.956666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:23.979023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:23.983858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:23.984866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:23.985404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:24.803693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:24.815482 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7e4704bb-c5f0-45e8-8e25-723af03af9cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1391 microversion: 2.1 time: 0.867546 Dec 18 20:48:24.825074 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 305/609] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:23 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1391 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:24.825074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:24.825074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:24.838055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:24.838583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:24.839898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:24.840807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.435331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:25.448998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6dafc429-329f-47c8-86d1-f6a77b313665 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1504 microversion: 2.1 time: 0.631863 Dec 18 20:48:25.449695 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 306/610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:24 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:25.454166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f715c208700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.455970 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:25.455970 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:25.457871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.458643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.475903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.476351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.490910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.491424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.498214 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff6cb268-4bf9-4332-b563-5c70d87ad9a9 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047286 Dec 18 20:48:25.498829 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 307/611] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:25.502814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Updating instance_info_cache with network_info: [{"id": "d5d720a6-0889-449d-a427-b3d33c3e0143", "address": "fa:16:3e:8e:75:e5", "network": {"id": "d5d78104-ccc5-490d-ac8e-b3ffc0787b91", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2088372549-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e622a6218cdd40c8861466b0d36c1ffe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5d720a6-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140732) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:48:25.504419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3511d437-1cad-4c73-be94-c4e82d40bb52 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.506410 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:25.506410 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:25.508451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3511d437-1cad-4c73-be94-c4e82d40bb52 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.509039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3511d437-1cad-4c73-be94-c4e82d40bb52 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.510541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3511d437-1cad-4c73-be94-c4e82d40bb52 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.511136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3511d437-1cad-4c73-be94-c4e82d40bb52 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.532660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Releasing lock "refresh_cache-ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:48:25.533512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50f524cb-8cc7-45f2-9ffc-3ff80160d0f8 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action" status: 202 len: 0 microversion: 2.1 time: 4.306391 Dec 18 20:48:25.534054 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 305/612] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:21 2021] POST /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5/action => generated 0 bytes in 4308 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 20:48:25.540122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.540916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:25.548322 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3511d437-1cad-4c73-be94-c4e82d40bb52 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048328 Dec 18 20:48:25.555482 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 308/613] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:25.555782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.556244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.557054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.557496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.563026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-77412125-b88b-4a38-8b9f-1dfb27eea4a9 req-6cc0de6d-3928-4cf9-861a-63ec190d1db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5", "tag": "d5d720a6-0889-449d-a427-b3d33c3e0143"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:25.565095 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:25.565095 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:25.575178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-77412125-b88b-4a38-8b9f-1dfb27eea4a9 req-6cc0de6d-3928-4cf9-861a-63ec190d1db7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.575944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-77412125-b88b-4a38-8b9f-1dfb27eea4a9 req-6cc0de6d-3928-4cf9-861a-63ec190d1db7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.587624 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-77412125-b88b-4a38-8b9f-1dfb27eea4a9 req-6cc0de6d-3928-4cf9-861a-63ec190d1db7 service nova] Creating event network-changed:d5d720a6-0889-449d-a427-b3d33c3e0143 for instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 on nch1-master-1 Dec 18 20:48:25.593979 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-77412125-b88b-4a38-8b9f-1dfb27eea4a9 req-6cc0de6d-3928-4cf9-861a-63ec190d1db7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 Dec 18 20:48:25.594993 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 309/614] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:25.602405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cccff5c9-b074-4e7e-b45b-102820f954a4 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f715c1e5ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.603493 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:25.603493 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:25.605274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cccff5c9-b074-4e7e-b45b-102820f954a4 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.605976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cccff5c9-b074-4e7e-b45b-102820f954a4 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.626421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cccff5c9-b074-4e7e-b45b-102820f954a4 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.626930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cccff5c9-b074-4e7e-b45b-102820f954a4 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.638577 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cccff5c9-b074-4e7e-b45b-102820f954a4 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.042078 Dec 18 20:48:25.639268 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 310/615] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:25.646228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.646228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:25.652415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.653040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.654006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.654534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.677896 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] HTTP exception thrown: Instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 could not be found. Dec 18 20:48:25.678604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Returning 404 to user: Instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:25.679871 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-659d3e9d-0e4c-4e22-b150-d18adea87340 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 404 len: 111 microversion: 2.1 time: 0.039174 Dec 18 20:48:25.681405 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 311/616] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:48:25 2021] DELETE /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:25.692932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e13beee-9630-49a3-876c-5e76e2440700 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:25.695053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e13beee-9630-49a3-876c-5e76e2440700 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:25.708058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e13beee-9630-49a3-876c-5e76e2440700 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.708058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e13beee-9630-49a3-876c-5e76e2440700 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.709102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e13beee-9630-49a3-876c-5e76e2440700 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.711681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e13beee-9630-49a3-876c-5e76e2440700 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.885823 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e13beee-9630-49a3-876c-5e76e2440700 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d/action" status: 202 len: 0 microversion: 2.25 time: 0.198792 Dec 18 20:48:25.887262 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 312/617] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:48:25 2021] POST /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:48:25.898200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:25.907245 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f257556-5c60-45ac-afcc-74a38946024f tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1316 microversion: 2.1 time: 0.371380 Dec 18 20:48:25.908473 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 306/618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:25.913916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.914727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: 0b8acb2d-06ca-4772-91e2-d13f92d112c3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:25.921740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.922490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.924673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-19441c4b-770c-46e6-bd2d-61d9197ba366 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f715c19af70>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.925076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.925844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.928540 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:25.928540 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:25.932452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19441c4b-770c-46e6-bd2d-61d9197ba366 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.933256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19441c4b-770c-46e6-bd2d-61d9197ba366 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.942454 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] HTTP exception thrown: Instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 could not be found. Dec 18 20:48:25.943498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Returning 404 to user: Instance 0b8acb2d-06ca-4772-91e2-d13f92d112c3 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:25.948994 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f1760bb-b1b7-4bd1-b126-f183482bdee9 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3" status: 404 len: 111 microversion: 2.1 time: 0.035552 Dec 18 20:48:25.950962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19441c4b-770c-46e6-bd2d-61d9197ba366 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.951648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19441c4b-770c-46e6-bd2d-61d9197ba366 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.953558 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 307/619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/servers/0b8acb2d-06ca-4772-91e2-d13f92d112c3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:25.959998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.960951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-19441c4b-770c-46e6-bd2d-61d9197ba366 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.072158 Dec 18 20:48:25.961108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:25.962652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 313/620] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:25.969362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.969911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:25.970311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.971379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:25.971626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.972327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.981153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.981715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:25.982764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:25.983699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:26.416563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 6b1389e6-a05e-4f01-aa45-405bf57c622d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:26.429119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:26.458610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-02c4feb7-d63e-4d23-a293-f01292b41798 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1391 microversion: 2.1 time: 0.501078 Dec 18 20:48:26.462926 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 308/621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1391 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:26.480789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b0cc736-da4a-48b7-8bda-2961bcddc709 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '.version_select at 0x7f714fb8d160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:26.486216 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a11a0ad-8628-4422-b12d-66bf97a557c7 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 2056 microversion: 2.25 time: 0.522051 Dec 18 20:48:26.496733 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 314/622] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:25 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 2056 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:26.513750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Calling method '.version_select at 0x7f715c1e58b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:26.515513 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:26.515513 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:26.517177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:26.517629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:26.548250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:26.548710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:26.561584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:26.562045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:26.628038 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e19c68a0-76b0-45c8-89aa-8870960e6924 tempest-HypervisorAdminTestJSON-1917426190 tempest-HypervisorAdminTestJSON-1917426190-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.119764 Dec 18 20:48:26.632637 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 315/623] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Dec 18 20:48:26 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:26.651677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1a6b2580-9986-46d0-bcd7-36191adcd82d req-8fd638d5-3f33-4f89-b7e9-a9bd3f196a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b52f544-8eb3-4f5e-a37c-c694695123bd", "name": "network-vif-plugged", "status": "completed", "tag": "a51358c4-71d5-40ec-bd5c-4e5e2bfda8e1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:26.653383 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:26.653383 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:26.679902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1a6b2580-9986-46d0-bcd7-36191adcd82d req-8fd638d5-3f33-4f89-b7e9-a9bd3f196a51 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:26.680811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1a6b2580-9986-46d0-bcd7-36191adcd82d req-8fd638d5-3f33-4f89-b7e9-a9bd3f196a51 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:26.696621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1a6b2580-9986-46d0-bcd7-36191adcd82d req-8fd638d5-3f33-4f89-b7e9-a9bd3f196a51 service nova] Creating event network-vif-plugged:a51358c4-71d5-40ec-bd5c-4e5e2bfda8e1 for instance 5b52f544-8eb3-4f5e-a37c-c694695123bd on nch2-master-1 Dec 18 20:48:26.705563 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1a6b2580-9986-46d0-bcd7-36191adcd82d req-8fd638d5-3f33-4f89-b7e9-a9bd3f196a51 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068851 Dec 18 20:48:26.707329 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 316/624] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:26.719056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:26.725230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:26.749178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:26.750441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:26.751584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:26.752228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.173128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:27.181240 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-42893f79-9d3a-4c66-b6b3-85aad7c11c42 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1504 microversion: 2.1 time: 0.471994 Dec 18 20:48:27.181816 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 317/625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:26 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:27.191341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:27.191536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:27.199714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.200172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.200969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.201452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.440964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:27.449323 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d1ad785-aab2-4862-a03f-55d9d7dd8052 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1316 microversion: 2.1 time: 0.266518 Dec 18 20:48:27.450155 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 318/626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:27 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:27.659447 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b0cc736-da4a-48b7-8bda-2961bcddc709 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/6d392644-2ab7-4e37-a803-fa390564bfc9" status: 202 len: 0 microversion: 2.1 time: 1.191062 Dec 18 20:48:27.661292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 309/627] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:48:26 2021] DELETE /compute/v2.1/os-floating-ips/6d392644-2ab7-4e37-a803-fa390564bfc9 => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:48:27.672588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:27.677575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:27.691260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.691717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.692547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.692992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.750434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22906a46-5313-48f2-94c2-2002bb5b5594 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:27.752594 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:27.752594 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:27.755043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22906a46-5313-48f2-94c2-2002bb5b5594 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.755599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22906a46-5313-48f2-94c2-2002bb5b5594 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.756522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22906a46-5313-48f2-94c2-2002bb5b5594 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.756961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22906a46-5313-48f2-94c2-2002bb5b5594 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.819910 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22906a46-5313-48f2-94c2-2002bb5b5594 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.368398 Dec 18 20:48:27.820511 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 319/628] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:48:27 2021] GET /compute/v2.1/os-services => generated 947 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:27.831715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:27.832262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:27.847715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.850174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.852475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.854223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.865976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:27.875702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc6de687-c09e-4c9f-b28f-ae43c2b8f84f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1391 microversion: 2.1 time: 0.212827 Dec 18 20:48:27.885763 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 310/629] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:27 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:27.890391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-548cf26b-f9b2-4a73-b6af-3e344df8eb6a req-90377c04-4d4f-4189-8a58-1c7aa86add77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5985b52a-141c-483c-ab38-8b1e38a0278f", "name": "network-vif-unplugged", "status": "completed", "tag": "9426e501-39e7-4a02-84c3-cc79d30a84ff"}, {"name": "network-changed", "server_uuid": "5985b52a-141c-483c-ab38-8b1e38a0278f", "tag": "9426e501-39e7-4a02-84c3-cc79d30a84ff"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:27.892220 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:27.892220 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:27.900546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-548cf26b-f9b2-4a73-b6af-3e344df8eb6a req-90377c04-4d4f-4189-8a58-1c7aa86add77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.901165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-548cf26b-f9b2-4a73-b6af-3e344df8eb6a req-90377c04-4d4f-4189-8a58-1c7aa86add77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.912948 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-548cf26b-f9b2-4a73-b6af-3e344df8eb6a req-90377c04-4d4f-4189-8a58-1c7aa86add77 service nova] Creating event network-vif-unplugged:9426e501-39e7-4a02-84c3-cc79d30a84ff for instance 5985b52a-141c-483c-ab38-8b1e38a0278f on nch1-master-1 Dec 18 20:48:27.914340 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-548cf26b-f9b2-4a73-b6af-3e344df8eb6a req-90377c04-4d4f-4189-8a58-1c7aa86add77 service nova] Creating event network-changed:9426e501-39e7-4a02-84c3-cc79d30a84ff for instance 5985b52a-141c-483c-ab38-8b1e38a0278f on nch1-master-1 Dec 18 20:48:27.920975 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-548cf26b-f9b2-4a73-b6af-3e344df8eb6a req-90377c04-4d4f-4189-8a58-1c7aa86add77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.033905 Dec 18 20:48:27.927082 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 311/630] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:27 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:27.933240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:27.934150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:27.963211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.974037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:27.975347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:27.975972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.029577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:48:28.111945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 6b1389e6-a05e-4f01-aa45-405bf57c622d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:28.128079 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf189107-58f5-4ea8-8893-c2706cd66ecb tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 2036 microversion: 2.25 time: 0.306498 Dec 18 20:48:28.128796 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 320/631] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:27 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 2036 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:28.150991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5df1e34f-8622-4967-827c-665e1afb7786 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:28.153198 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:28.153198 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:28.154951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df1e34f-8622-4967-827c-665e1afb7786 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.155475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df1e34f-8622-4967-827c-665e1afb7786 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.156438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df1e34f-8622-4967-827c-665e1afb7786 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.156884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df1e34f-8622-4967-827c-665e1afb7786 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.163644 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60e0ea26-54cc-4563-ab86-28138ad9c0e4 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 204 len: 0 microversion: 2.1 time: 0.232583 Dec 18 20:48:28.165426 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 312/632] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:48:27 2021] DELETE /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:48:28.189552 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5df1e34f-8622-4967-827c-665e1afb7786 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.046096 Dec 18 20:48:28.198010 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 321/633] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 20:48:28 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:28.204815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:28.205979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:28.212825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.213277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.214070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.214531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.240871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'flavor' on Instance uuid 6b1389e6-a05e-4f01-aa45-405bf57c622d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:28.255304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Going to try to live migrate instance to nch1-master-1 {{(pid=140731) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:48:28.355480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-14adbc15-37bb-44b8-b1d0-a70e5999f2d6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Calling method '.version_select at 0x7f714fc73790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:28.441191 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-14adbc15-37bb-44b8-b1d0-a70e5999f2d6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 371 microversion: 2.1 time: 0.272124 Dec 18 20:48:28.448259 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 313/634] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 20:48:28 2021] GET /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:28.454835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:28.455830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:28.464642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.465587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.466903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.468895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.690305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:28.697784 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb083a99-17e4-4bb2-9ef3-2658a78d4cde tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1525 microversion: 2.1 time: 0.248248 Dec 18 20:48:28.698395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 314/635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:28 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1525 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:28.702933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5c12c97f-a146-4656-b58c-69c8a9225ec5 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:28.704464 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:28.704464 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:28.706296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c12c97f-a146-4656-b58c-69c8a9225ec5 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.706966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c12c97f-a146-4656-b58c-69c8a9225ec5 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.708046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c12c97f-a146-4656-b58c-69c8a9225ec5 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.708487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c12c97f-a146-4656-b58c-69c8a9225ec5 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.733452 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5c12c97f-a146-4656-b58c-69c8a9225ec5 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.033798 Dec 18 20:48:28.734066 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 315/636] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:48:28 2021] GET /compute/v2.1/os-services => generated 947 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:28.744898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:28.745541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:28.751923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.752566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.753351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:28.753976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:28.905652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:28.914156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f7e224b-2719-4ba2-9e3e-2a218667fc7a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1504 microversion: 2.1 time: 0.179064 Dec 18 20:48:28.914748 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 316/637] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:28 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:28.923101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2658bb4-7022-44a4-8929-53291e3638ec tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Action: 'update', calling method: .version_select at 0x7f714fb0e820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:28.925248 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:28.925248 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:29.150034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2658bb4-7022-44a4-8929-53291e3638ec tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.150519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2658bb4-7022-44a4-8929-53291e3638ec tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.151339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2658bb4-7022-44a4-8929-53291e3638ec tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.151943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2658bb4-7022-44a4-8929-53291e3638ec tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.215733 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2658bb4-7022-44a4-8929-53291e3638ec tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 328 microversion: 2.1 time: 0.297636 Dec 18 20:48:29.216382 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 317/638] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:28 2021] PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:29.221299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:29.221911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:29.236033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.236731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.238186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.239005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.762017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:29.770100 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-69c0f8b6-79cd-43a4-8149-6a931975427c tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1506 microversion: 2.1 time: 0.552355 Dec 18 20:48:29.771327 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 318/639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:29 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:29.776033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-aa02b7f1-cefe-4d09-9c4f-031e78fff135 req-34e74fb2-cfbc-4181-b921-0d90a6798974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d9725-ba21-477e-9e70-c7e9c733e54e", "name": "network-vif-plugged", "status": "completed", "tag": "ac8166be-db9c-48d7-aed1-022cd6d22a09"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:29.777912 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:29.777912 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:29.791525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-aa02b7f1-cefe-4d09-9c4f-031e78fff135 req-34e74fb2-cfbc-4181-b921-0d90a6798974 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.791979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-aa02b7f1-cefe-4d09-9c4f-031e78fff135 req-34e74fb2-cfbc-4181-b921-0d90a6798974 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.815568 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-aa02b7f1-cefe-4d09-9c4f-031e78fff135 req-34e74fb2-cfbc-4181-b921-0d90a6798974 service nova] Creating event network-vif-plugged:ac8166be-db9c-48d7-aed1-022cd6d22a09 for instance bf9d9725-ba21-477e-9e70-c7e9c733e54e on nch2-master-1 Dec 18 20:48:29.821902 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-aa02b7f1-cefe-4d09-9c4f-031e78fff135 req-34e74fb2-cfbc-4181-b921-0d90a6798974 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049102 Dec 18 20:48:29.826416 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 319/640] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:29.843246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbdb7a06-79b3-4b4e-9095-5cf69eceb428 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:29.845317 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:29.845317 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:29.847357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbdb7a06-79b3-4b4e-9095-5cf69eceb428 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.848029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbdb7a06-79b3-4b4e-9095-5cf69eceb428 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.849043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbdb7a06-79b3-4b4e-9095-5cf69eceb428 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.849645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbdb7a06-79b3-4b4e-9095-5cf69eceb428 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.875833 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbdb7a06-79b3-4b4e-9095-5cf69eceb428 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.048109 Dec 18 20:48:29.876463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 320/641] 10.222.0.13 () {58 vars in 1195 bytes} [Sat Dec 18 20:48:29 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:29.881676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:29.883659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:29.892978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.894052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.895134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:29.895791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:29.965081 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57782605-ca4a-440a-bc93-3eb84d63435b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d/action" status: 202 len: 0 microversion: 2.25 time: 1.764519 Dec 18 20:48:29.966471 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 322/642] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:48:28 2021] POST /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d/action => generated 0 bytes in 1768 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:48:30.288034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:30.296873 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4bfe4ce6-df7b-4056-a99d-7fe797b00417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1391 microversion: 2.1 time: 0.419139 Dec 18 20:48:30.306401 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 321/643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:29 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1391 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:30.309664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:30.310145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:30.327092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:30.327433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:30.331731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:30.332136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:30.385199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1470785006", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:30.468290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:30.955824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6992d255e81c499a8373dd4c727e1f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e622a6218cdd40c8861466b0d36c1ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:30.965545 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-17eadaed-6c9e-4815-b12f-4b7424852e87 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 200 len: 1525 microversion: 2.1 time: 0.667002 Dec 18 20:48:30.966383 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 322/644] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:30 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 1525 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:30.971537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2da296ad-826d-4406-a8f3-f0f3dbd39201 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:30.973138 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:30.973138 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:30.975228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2da296ad-826d-4406-a8f3-f0f3dbd39201 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:30.975810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2da296ad-826d-4406-a8f3-f0f3dbd39201 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:30.976818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2da296ad-826d-4406-a8f3-f0f3dbd39201 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:30.977270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2da296ad-826d-4406-a8f3-f0f3dbd39201 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.000703 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2da296ad-826d-4406-a8f3-f0f3dbd39201 tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.033078 Dec 18 20:48:31.001313 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 323/645] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:48:30 2021] GET /compute/v2.1/os-services => generated 947 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:31.006465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:31.007072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:31.018334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.019091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.020671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.021105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.032257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:31.033407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:31.034040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:31.034673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:31.035526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:31.046367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.046823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.048002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.048765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.068572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Getting quotas for project 14b8df9c30264bf38f9d671b5f018ef9. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:31.073684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Getting quotas for user a7d32a19e0c44459a1c8ac12fc7a0f9e and project 14b8df9c30264bf38f9d671b5f018ef9. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:31.086654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.utils [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] cores quota exceeded for 14b8df9c30264bf38f9d671b5f018ef9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140731) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Dec 18 20:48:31.087456 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Dec 18 20:48:31.088058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:31.088923 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-847c11cd-21f5-450f-8d52-00ee887f50af tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.121354 Dec 18 20:48:31.089505 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 323/646] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:29 2021] POST /compute/v2.1/servers => generated 111 bytes in 1122 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:31.093964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:31.094647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:31.101253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.101986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.103309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.103942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.450635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:31.458912 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-23fffe52-36e6-4247-b3df-884f8a8ef59c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1504 microversion: 2.1 time: 0.456465 Dec 18 20:48:31.459555 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 324/647] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:31 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1504 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:31.524003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:31.532841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:31.534453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:31.536594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-759b4698-d98c-4aa6-91a9-06a6fec0dde2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1568 microversion: 2.25 time: 0.445855 Dec 18 20:48:31.537220 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 324/648] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:31 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:31.552092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-eecb283e-6853-4042-a5a0-3aa783f14341 req-b219d5c7-2cdb-4c59-9415-95ec2e16f5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5", "name": "network-vif-deleted", "tag": "d5d720a6-0889-449d-a427-b3d33c3e0143"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:31.553820 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:31.553820 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:31.560592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-eecb283e-6853-4042-a5a0-3aa783f14341 req-b219d5c7-2cdb-4c59-9415-95ec2e16f5bf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.561497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-eecb283e-6853-4042-a5a0-3aa783f14341 req-b219d5c7-2cdb-4c59-9415-95ec2e16f5bf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.572300 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-eecb283e-6853-4042-a5a0-3aa783f14341 req-b219d5c7-2cdb-4c59-9415-95ec2e16f5bf service nova] Creating event network-vif-deleted:d5d720a6-0889-449d-a427-b3d33c3e0143 for instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 on nch1-master-1 Dec 18 20:48:31.577487 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-eecb283e-6853-4042-a5a0-3aa783f14341 req-b219d5c7-2cdb-4c59-9415-95ec2e16f5bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038963 Dec 18 20:48:31.578544 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 325/649] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:31.584553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9fdd89a2-3cb5-4e2d-991f-2ecb90ba106d tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:31.585749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Calling method '.version_select at 0x7f714fb751f0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:31.586503 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:31.586503 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:31.588307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fdd89a2-3cb5-4e2d-991f-2ecb90ba106d tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.588969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fdd89a2-3cb5-4e2d-991f-2ecb90ba106d tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.589241 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:31.589241 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:31.590225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fdd89a2-3cb5-4e2d-991f-2ecb90ba106d tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.590840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fdd89a2-3cb5-4e2d-991f-2ecb90ba106d tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.591177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.591658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.607495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.607946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.616841 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9fdd89a2-3cb5-4e2d-991f-2ecb90ba106d tempest-ServicesAdminNegativeTestJSON-1621795350 tempest-ServicesAdminNegativeTestJSON-1621795350-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.036968 Dec 18 20:48:31.617762 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 326/650] 10.222.0.13 () {58 vars in 1197 bytes} [Sat Dec 18 20:48:31 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:31.626279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-402acaaf-0dc3-4697-8753-170d2c43af32 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Action: 'update', calling method: .version_select at 0x7f715c495430>, body: {"quota_set": {"cores": 20}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:31.628603 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:31.628603 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:31.629778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.630239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.637886 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-567a7f2b-e73a-4d92-86dc-437e1602e92e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.176907 Dec 18 20:48:31.638161 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 325/651] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:48:31 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:31.644614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:31.645569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:31.653360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.653903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.654805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.655248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.791328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402acaaf-0dc3-4697-8753-170d2c43af32 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.791911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402acaaf-0dc3-4697-8753-170d2c43af32 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.792730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402acaaf-0dc3-4697-8753-170d2c43af32 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:31.793170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402acaaf-0dc3-4697-8753-170d2c43af32 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:31.860504 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-402acaaf-0dc3-4697-8753-170d2c43af32 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 329 microversion: 2.1 time: 0.241641 Dec 18 20:48:31.861079 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 327/652] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:31 2021] PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 329 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:31.959389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:31.967008 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4e547b3-1411-4715-bd2f-6deea954f37e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1590 microversion: 2.1 time: 0.327418 Dec 18 20:48:31.972940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a090160-3e8c-4c26-a8c1-1be0d5381643 tempest-ServicesAdminNegativeTestJSON-1206674700 tempest-ServicesAdminNegativeTestJSON-1206674700-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:31.974199 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:31.974199 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:31.975652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a090160-3e8c-4c26-a8c1-1be0d5381643 tempest-ServicesAdminNegativeTestJSON-1206674700 tempest-ServicesAdminNegativeTestJSON-1206674700-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7e20aee17ac54455ac1d3e397fabe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b188787cdec4c93a20c443b630076f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:31.977676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a090160-3e8c-4c26-a8c1-1be0d5381643 tempest-ServicesAdminNegativeTestJSON-1206674700 tempest-ServicesAdminNegativeTestJSON-1206674700-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:31.978601 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a090160-3e8c-4c26-a8c1-1be0d5381643 tempest-ServicesAdminNegativeTestJSON-1206674700 tempest-ServicesAdminNegativeTestJSON-1206674700-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.116409 Dec 18 20:48:31.978997 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 326/653] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:31 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1590 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:31.979311 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 328/654] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:48:31 2021] GET /compute/v2.1/os-services => generated 112 bytes in 118 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:31.988383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93b5b63c-689d-42e5-a760-7404f561c1cb tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd7ff98c-6407-4674-9e06-de293ba3baf9"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:31.996172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93b5b63c-689d-42e5-a760-7404f561c1cb tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:32.012671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93b5b63c-689d-42e5-a760-7404f561c1cb tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.013543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93b5b63c-689d-42e5-a760-7404f561c1cb tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.014737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93b5b63c-689d-42e5-a760-7404f561c1cb tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.015367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93b5b63c-689d-42e5-a760-7404f561c1cb tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.136686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0c6d9ff8-2c80-46ae-83c3-692807a02a45 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] Calling method '.version_select at 0x7f714fbf6670>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:32.137882 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:32.137882 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:32.140145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0c6d9ff8-2c80-46ae-83c3-692807a02a45 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '809a6f3ba0674ba88afbf609ef0ab56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c907e3cc64b1d80a56d41b3a9dee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:32.141337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0c6d9ff8-2c80-46ae-83c3-692807a02a45 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:32.142796 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0c6d9ff8-2c80-46ae-83c3-692807a02a45 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.162463 Dec 18 20:48:32.148685 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 327/655] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 20:48:31 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:32.153988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9278dcb3-3378-4cf0-9266-9b6eb8fa9907 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Calling method '.version_select at 0x7f714fb75dc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:32.248678 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9278dcb3-3378-4cf0-9266-9b6eb8fa9907 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 371 microversion: 2.1 time: 0.098679 Dec 18 20:48:32.250492 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 328/656] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 20:48:32 2021] GET /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:32.256407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:32.257475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] [instance: ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:32.265046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.266036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.268173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.268932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.291240 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] HTTP exception thrown: Instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 could not be found. Dec 18 20:48:32.292216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] Returning 404 to user: Instance ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:32.293263 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2a43ae2e-c0a3-4b49-9f25-397ea31c9d43 tempest-FloatingIPsAssociationTestJSON-739103927 tempest-FloatingIPsAssociationTestJSON-739103927-project] 10.222.0.13 "GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5" status: 404 len: 111 microversion: 2.1 time: 0.041461 Dec 18 20:48:32.294956 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 329/657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:32 2021] GET /compute/v2.1/servers/ca4ec84d-e07a-4f5b-a333-e6333cd2d2e5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:32.301549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d85378a-f803-441c-98c2-b9d3399e6083 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:32.302352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d85378a-f803-441c-98c2-b9d3399e6083 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:32.308842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d85378a-f803-441c-98c2-b9d3399e6083 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.309772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d85378a-f803-441c-98c2-b9d3399e6083 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.310843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d85378a-f803-441c-98c2-b9d3399e6083 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.311898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d85378a-f803-441c-98c2-b9d3399e6083 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.461865 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93b5b63c-689d-42e5-a760-7404f561c1cb tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "POST /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480509 Dec 18 20:48:32.463934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 329/658] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 20:48:31 2021] POST /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:32.510781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-569dc877-a3b6-43f3-8b49-7f53859ddb2e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Calling method '.version_select at 0x7f715c1a3e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:32.514275 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:32.514275 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:32.522310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-569dc877-a3b6-43f3-8b49-7f53859ddb2e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.523142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-569dc877-a3b6-43f3-8b49-7f53859ddb2e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.540728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-569dc877-a3b6-43f3-8b49-7f53859ddb2e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Dec 18 20:48:32.541948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-569dc877-a3b6-43f3-8b49-7f53859ddb2e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:32.543926 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-569dc877-a3b6-43f3-8b49-7f53859ddb2e tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.077260 Dec 18 20:48:32.548709 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d85378a-f803-441c-98c2-b9d3399e6083 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250265 Dec 18 20:48:32.548709 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 330/659] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:48:32 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:32.549418 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 330/660] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 20:48:32 2021] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:32.554873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cd49c174-42e1-4890-8374-0a5fdf360fac tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Action: 'update', calling method: .version_select at 0x7f714fb39af0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:32.557120 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:32.557120 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:32.558658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9defad70-d6c4-40be-b378-46d9379a1344 req-db1ad239-9e53-4b9d-8e69-17261c4c4382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1389e6-a05e-4f01-aa45-405bf57c622d", "name": "network-vif-unplugged", "status": "completed", "tag": "f4d2142c-df3c-4259-89f6-888e1edbf513"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:32.560870 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:32.560870 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:32.579032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9defad70-d6c4-40be-b378-46d9379a1344 req-db1ad239-9e53-4b9d-8e69-17261c4c4382 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.579032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9defad70-d6c4-40be-b378-46d9379a1344 req-db1ad239-9e53-4b9d-8e69-17261c4c4382 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.591909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9defad70-d6c4-40be-b378-46d9379a1344 req-db1ad239-9e53-4b9d-8e69-17261c4c4382 service nova] Creating event network-vif-unplugged:f4d2142c-df3c-4259-89f6-888e1edbf513 for instance 6b1389e6-a05e-4f01-aa45-405bf57c622d on nch2-master-1 Dec 18 20:48:32.596786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9defad70-d6c4-40be-b378-46d9379a1344 req-db1ad239-9e53-4b9d-8e69-17261c4c4382 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045797 Dec 18 20:48:32.597589 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 331/661] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:32.603172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:32.604106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:32.610986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.611840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.612837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.614029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.879672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd49c174-42e1-4890-8374-0a5fdf360fac tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.880860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd49c174-42e1-4890-8374-0a5fdf360fac tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.882610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd49c174-42e1-4890-8374-0a5fdf360fac tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.883157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd49c174-42e1-4890-8374-0a5fdf360fac tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:32.965231 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cd49c174-42e1-4890-8374-0a5fdf360fac tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 328 microversion: 2.1 time: 0.414474 Dec 18 20:48:32.966680 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 331/662] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:32 2021] PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 328 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:32.977815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Calling method '.version_select at 0x7f714fb75700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:32.979006 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:32.979006 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:32.982089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:32.984063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:33.008188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:33.008778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:33.025147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:33.025880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:33.034771 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b16340e3-255f-48cb-898f-cc04d1266abc tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.066823 Dec 18 20:48:33.037085 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 332/663] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:48:32 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:33.044033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:33.044844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:33.053648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:33.054228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:33.055288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:33.056408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:33.534850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:33.550857 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cbc485b5-a4db-4abd-9322-c2f5f4964068 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1504 microversion: 2.1 time: 0.951691 Dec 18 20:48:33.551736 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 332/664] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:32 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1504 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:33.556215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7fcf93d-a915-4e5e-a145-772043947232 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] Calling method '.version_select at 0x7f715c0f3c10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:33.557253 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:33.557253 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:33.562386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d7fcf93d-a915-4e5e-a145-772043947232 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '809a6f3ba0674ba88afbf609ef0ab56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c907e3cc64b1d80a56d41b3a9dee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:33.563230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7fcf93d-a915-4e5e-a145-772043947232 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:33.564246 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7fcf93d-a915-4e5e-a145-772043947232 tempest-HypervisorAdminNegativeUnderV252Test-561399225 tempest-HypervisorAdminNegativeUnderV252Test-561399225-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.011407 Dec 18 20:48:33.564729 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 333/665] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:48:33 2021] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:33.576510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1910474092", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:33.668495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:34.157827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:34.167806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:34.169645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:34.171082 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-530cb58f-ee06-4538-9111-eb7a28f3cb7e tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1568 microversion: 2.25 time: 1.132869 Dec 18 20:48:34.172337 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 333/666] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:33 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1568 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:34.178816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d4182281-3e2f-44ac-89a7-73294558846a tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Calling method '.version_select at 0x7f714fb75b80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:34.180736 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:34.180736 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:34.183253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4182281-3e2f-44ac-89a7-73294558846a tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:34.184028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4182281-3e2f-44ac-89a7-73294558846a tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:34.204542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d4182281-3e2f-44ac-89a7-73294558846a tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] HTTP exception thrown: No hypervisor matching '58ea1e5a-c0ee-4204-9812-b86fe6dcc0e9' could be found. Dec 18 20:48:34.205148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d4182281-3e2f-44ac-89a7-73294558846a tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] Returning 404 to user: No hypervisor matching '58ea1e5a-c0ee-4204-9812-b86fe6dcc0e9' could be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:34.205995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d4182281-3e2f-44ac-89a7-73294558846a tempest-HypervisorAdminNegativeUnderV252Test-1297325463 tempest-HypervisorAdminNegativeUnderV252Test-1297325463-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/58ea1e5a-c0ee-4204-9812-b86fe6dcc0e9/servers" status: 404 len: 123 microversion: 2.1 time: 0.032526 Dec 18 20:48:34.207051 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 334/667] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Dec 18 20:48:34 2021] GET /compute/v2.1/os-hypervisors/58ea1e5a-c0ee-4204-9812-b86fe6dcc0e9/servers => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:34.427288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:34.427716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:34.428182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:34.428786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:34.430008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:34.444498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:34.445483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:34.445772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:34.446214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:34.514418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Getting quotas for project 14b8df9c30264bf38f9d671b5f018ef9. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:34.534453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Getting quotas for user a7d32a19e0c44459a1c8ac12fc7a0f9e and project 14b8df9c30264bf38f9d671b5f018ef9. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:34.568638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:34.569592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:34.583046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:34.583455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:34.585475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:34.585475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:34.602718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.utils [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] instances quota exceeded for 14b8df9c30264bf38f9d671b5f018ef9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140731) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Dec 18 20:48:34.603809 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Dec 18 20:48:34.605493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:34.608416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-221e466a-c2bd-4194-891c-e93b5c57a57c tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.040624 Dec 18 20:48:34.609747 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 334/668] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:33 2021] POST /compute/v2.1/servers => generated 119 bytes in 1042 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:34.626889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ec0a03d-8383-4f82-a635-e2f501b782ea tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Action: 'update', calling method: .version_select at 0x7f715c0f3670>, body: {"quota_set": {"instances": 10}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:34.632563 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:34.632563 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:34.932525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:34.940103 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e4b1262a-5914-4035-ae8f-33606db210a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1479 microversion: 2.1 time: 0.375700 Dec 18 20:48:34.944106 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 335/669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:34 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1479 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:48:34.952693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b09fac98-80e8-4d99-a07d-596171d21db9 req-c16a20ea-2388-4667-a45e-05c7eafe0666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1389e6-a05e-4f01-aa45-405bf57c622d", "tag": "f4d2142c-df3c-4259-89f6-888e1edbf513"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:34.957367 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:34.957367 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:34.974666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b09fac98-80e8-4d99-a07d-596171d21db9 req-c16a20ea-2388-4667-a45e-05c7eafe0666 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:34.975186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b09fac98-80e8-4d99-a07d-596171d21db9 req-c16a20ea-2388-4667-a45e-05c7eafe0666 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.008643 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b09fac98-80e8-4d99-a07d-596171d21db9 req-c16a20ea-2388-4667-a45e-05c7eafe0666 service nova] Creating event network-changed:f4d2142c-df3c-4259-89f6-888e1edbf513 for instance 6b1389e6-a05e-4f01-aa45-405bf57c622d on nch2-master-1 Dec 18 20:48:35.014321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b09fac98-80e8-4d99-a07d-596171d21db9 req-c16a20ea-2388-4667-a45e-05c7eafe0666 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068801 Dec 18 20:48:35.015117 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 336/670] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:35.021928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18a40a30-2cc4-46aa-995b-2720f843db96 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '.version_select at 0x7f714fafd430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:35.025330 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:35.025330 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:35.028296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18a40a30-2cc4-46aa-995b-2720f843db96 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:35.028905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18a40a30-2cc4-46aa-995b-2720f843db96 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.044359 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18a40a30-2cc4-46aa-995b-2720f843db96 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1548 microversion: 2.1 time: 0.027702 Dec 18 20:48:35.045601 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 337/671] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:48:35 2021] GET /compute/v2.1/os-migrations => generated 1548 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:35.059709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1f254fac-a650-40e9-b72a-183b60d7fa34 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:35.061649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1f254fac-a650-40e9-b72a-183b60d7fa34 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:35.079996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f254fac-a650-40e9-b72a-183b60d7fa34 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:35.080621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f254fac-a650-40e9-b72a-183b60d7fa34 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.081790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f254fac-a650-40e9-b72a-183b60d7fa34 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:35.084099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f254fac-a650-40e9-b72a-183b60d7fa34 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.101822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec0a03d-8383-4f82-a635-e2f501b782ea tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:35.103602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec0a03d-8383-4f82-a635-e2f501b782ea tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.108963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec0a03d-8383-4f82-a635-e2f501b782ea tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:35.109584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec0a03d-8383-4f82-a635-e2f501b782ea tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.219497 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ec0a03d-8383-4f82-a635-e2f501b782ea tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 329 microversion: 2.1 time: 0.605252 Dec 18 20:48:35.223839 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 335/672] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:34 2021] PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 329 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:35.228654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:35.237135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:35.249848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:35.259162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.260602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:35.261224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:35.948918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1f254fac-a650-40e9-b72a-183b60d7fa34 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1630 microversion: 2.1 time: 0.890803 Dec 18 20:48:35.950303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 338/673] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:35 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1630 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:35.964092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66518776-bbdb-4513-8c3a-c772e894ead3 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Calling method '.version_select at 0x7f714fb8d9d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:36.028550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:36.042018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:36.048465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:36.050599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67ae93fb-bc6b-470a-8d0a-dad459d1921f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1568 microversion: 2.25 time: 0.825240 Dec 18 20:48:36.064776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 336/674] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:35 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1568 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:36.119494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1400507028", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5cbb2c71-d950-4efd-806f-e5446059ac55"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:36.187547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] validate_networks() for [('5cbb2c71-d950-4efd-806f-e5446059ac55', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:36.540036 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66518776-bbdb-4513-8c3a-c772e894ead3 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 371 microversion: 2.1 time: 0.576875 Dec 18 20:48:36.541311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 339/675] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 20:48:35 2021] GET /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:36.557602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ebeabc49-7125-424a-bfb0-f59dcf7f81be tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:36.562806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ebeabc49-7125-424a-bfb0-f59dcf7f81be tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:36.570665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebeabc49-7125-424a-bfb0-f59dcf7f81be tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:36.571287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebeabc49-7125-424a-bfb0-f59dcf7f81be tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:36.572970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebeabc49-7125-424a-bfb0-f59dcf7f81be tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:36.573572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebeabc49-7125-424a-bfb0-f59dcf7f81be tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:36.723610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ebeabc49-7125-424a-bfb0-f59dcf7f81be tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 14 microversion: 2.1 time: 0.172702 Dec 18 20:48:36.728099 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 340/676] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:36 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:36.737676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3a9f780-e6aa-43bf-aca9-c87d9c4800e5 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Action: 'update', calling method: .version_select at 0x7f714fb755e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:36.740581 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:36.740581 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:37.112219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3a9f780-e6aa-43bf-aca9-c87d9c4800e5 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:37.112774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3a9f780-e6aa-43bf-aca9-c87d9c4800e5 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:37.114204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3a9f780-e6aa-43bf-aca9-c87d9c4800e5 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:37.114686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3a9f780-e6aa-43bf-aca9-c87d9c4800e5 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:37.186182 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3a9f780-e6aa-43bf-aca9-c87d9c4800e5 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 325 microversion: 2.1 time: 0.455694 Dec 18 20:48:37.189044 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 341/677] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:36 2021] PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 325 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:37.458728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1087777592", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:37.531534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:37.801950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:37.803181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:37.803669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:37.804077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:37.804489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:37.825128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:37.825592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:37.826433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:37.826872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:37.870638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:37.880153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for user 5aaf1ced6baf4e1d9c940cfe96b2c254 and project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:37.916560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:37.920938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:48:37.924001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:48:37.942993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:37.943846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:37.944798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:37.945413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:37.969077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:37.969898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:37.971145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:37.979158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:38.001490 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ac7af8d-828a-42cc-9f14-cb8e2c8a9682 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.885588 Dec 18 20:48:38.007620 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 337/678] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:48:38.013480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:38.019164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:38.038406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Getting quotas for project 2e459a051d234475b150b36857974efb. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:38.038828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:38.039286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:38.056533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Getting quotas for user 015a3244598f429fbe145939f9624206 and project 2e459a051d234475b150b36857974efb. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:38.062990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:38.068156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:38.103007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:48:38.112656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:48:38.244756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cd261c0d-5a11-41f3-8733-c0f57572f757 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053361 Dec 18 20:48:38.248603 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 342/679] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:48:38.279384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8db5f182-0e1b-407c-b930-95b87a204708 req-7fb460d6-d18b-46c3-a361-45fcb63f2584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9d9725-ba21-477e-9e70-c7e9c733e54e", "tag": "ac8166be-db9c-48d7-aed1-022cd6d22a09"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:38.293165 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:38.293165 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:38.323689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8db5f182-0e1b-407c-b930-95b87a204708 req-7fb460d6-d18b-46c3-a361-45fcb63f2584 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:38.326507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8db5f182-0e1b-407c-b930-95b87a204708 req-7fb460d6-d18b-46c3-a361-45fcb63f2584 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:38.350105 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8db5f182-0e1b-407c-b930-95b87a204708 req-7fb460d6-d18b-46c3-a361-45fcb63f2584 service nova] Creating event network-changed:ac8166be-db9c-48d7-aed1-022cd6d22a09 for instance bf9d9725-ba21-477e-9e70-c7e9c733e54e on nch2-master-1 Dec 18 20:48:38.365894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8db5f182-0e1b-407c-b930-95b87a204708 req-7fb460d6-d18b-46c3-a361-45fcb63f2584 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108627 Dec 18 20:48:38.371064 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 343/680] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:38.379972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-244825272", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:38.468229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:39.095484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:39.106992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:39.112406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:39.114369 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-369c7f97-a144-44ae-9dfd-6ec8e17946c7 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1568 microversion: 2.25 time: 1.105327 Dec 18 20:48:39.120670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 338/681] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:38 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1568 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:39.125888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:39.126992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:39.127939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:39.128435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:39.129325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:39.140317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a7e3637-743d-4403-9257-c8b730a32d3c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:39.151597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a7e3637-743d-4403-9257-c8b730a32d3c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:39.155265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.160788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.161772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.163880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a7e3637-743d-4403-9257-c8b730a32d3c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.164394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.171164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a7e3637-743d-4403-9257-c8b730a32d3c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.175449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a7e3637-743d-4403-9257-c8b730a32d3c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.177295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a7e3637-743d-4403-9257-c8b730a32d3c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.242354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Getting quotas for project 14b8df9c30264bf38f9d671b5f018ef9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:39.262876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Getting quotas for user a7d32a19e0c44459a1c8ac12fc7a0f9e and project 14b8df9c30264bf38f9d671b5f018ef9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:39.273038 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a7e3637-743d-4403-9257-c8b730a32d3c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 14 microversion: 2.1 time: 0.150775 Dec 18 20:48:39.280323 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 339/682] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:39 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:39.286747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:39.287904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:39.298936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.299634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.300655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.301900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.305845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.utils [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] ram quota exceeded for 14b8df9c30264bf38f9d671b5f018ef9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140732) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Dec 18 20:48:39.310369 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Dec 18 20:48:39.311257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:39.316582 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dcc6deb0-e78b-4cd8-b566-e6ea164d709f tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.939677 Dec 18 20:48:39.322086 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 344/683] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:38 2021] POST /compute/v2.1/servers => generated 110 bytes in 950 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:39.329651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:39.330422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:39.364351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.364814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.365827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.366322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.458286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:39.470583 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e33c81f-b0a2-4d12-8feb-f97617395678 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1207 microversion: 2.1 time: 0.187269 Dec 18 20:48:39.472221 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 340/684] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:39 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1207 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:39.500643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:39.510242 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c79c3df7-8d9d-452b-8030-a28cb6f06a1f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1210 microversion: 2.1 time: 0.186847 Dec 18 20:48:39.512515 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 345/685] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:39 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:39.522076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f96415b-5593-4d61-a1a3-a0b9f1541d53 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Action: 'update', calling method: .version_select at 0x7f714fa8d280>, body: {"quota_set": {"ram": 51200}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:39.524725 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:39.524725 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:39.875742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4305d0b9-00a7-4c18-842b-c2bc3b85aa74"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:39.877522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:39.888274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.895751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.899582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.900462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.923025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f96415b-5593-4d61-a1a3-a0b9f1541d53 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.929587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f96415b-5593-4d61-a1a3-a0b9f1541d53 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.932654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f96415b-5593-4d61-a1a3-a0b9f1541d53 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:39.933856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f96415b-5593-4d61-a1a3-a0b9f1541d53 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:39.980818 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:39.980818 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:40.054760 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f96415b-5593-4d61-a1a3-a0b9f1541d53 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 200 len: 329 microversion: 2.1 time: 0.540634 Dec 18 20:48:40.055553 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 346/686] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:39 2021] PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 329 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:40.083938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16c685b5-7784-4165-8523-0260e12546ed tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Action: 'update', calling method: .version_select at 0x7f714fa9e940>, body: {"quota_set": {"ram": 0}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:40.086625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-16c685b5-7784-4165-8523-0260e12546ed tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a7d32a19e0c44459a1c8ac12fc7a0f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b8df9c30264bf38f9d671b5f018ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:40.087271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16c685b5-7784-4165-8523-0260e12546ed tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:40.088088 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-16c685b5-7784-4165-8523-0260e12546ed tempest-QuotasAdminNegativeTest-732802204 tempest-QuotasAdminNegativeTest-732802204-project] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9" status: 403 len: 116 microversion: 2.1 time: 0.019995 Dec 18 20:48:40.093969 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 347/687] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 20:48:40 2021] PUT /compute/v2.1/os-quota-sets/14b8df9c30264bf38f9d671b5f018ef9 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:40.138621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:40.139222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:40.158705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.159157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.159991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.160430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.271444 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] HTTP exception thrown: Volume 4305d0b9-00a7-4c18-842b-c2bc3b85aa74 could not be found. Dec 18 20:48:40.273078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Returning 400 to user: Volume 4305d0b9-00a7-4c18-842b-c2bc3b85aa74 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:40.274215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a292342a-6869-4d95-b789-08d937f9f86f tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments/cd7ff98c-6407-4674-9e06-de293ba3baf9" status: 400 len: 107 microversion: 2.1 time: 0.800224 Dec 18 20:48:40.286596 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 341/688] 10.222.0.13 () {60 vars in 1432 bytes} [Sat Dec 18 20:48:39 2021] PUT /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments/cd7ff98c-6407-4674-9e06-de293ba3baf9 => generated 107 bytes in 813 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:48:40.304688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6f8d3bf-6631-471f-8c91-6b2bc25898b3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:40.307092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6f8d3bf-6631-471f-8c91-6b2bc25898b3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:40.326192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6f8d3bf-6631-471f-8c91-6b2bc25898b3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.327636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6f8d3bf-6631-471f-8c91-6b2bc25898b3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.329162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6f8d3bf-6631-471f-8c91-6b2bc25898b3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.329855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6f8d3bf-6631-471f-8c91-6b2bc25898b3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.397599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6f8d3bf-6631-471f-8c91-6b2bc25898b3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 14 microversion: 2.1 time: 0.106322 Dec 18 20:48:40.398241 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 342/689] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:40 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:40.407245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:40.407888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:40.416066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.416518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.417317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.418004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.575380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lazy-loading 'services' on Instance uuid 5b52f544-8eb3-4f5e-a37c-c694695123bd {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:40.662929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:40.672662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:40.676529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:40.686776 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3472ae68-ef15-44d8-b0a6-568292aca62f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1568 microversion: 2.25 time: 0.552434 Dec 18 20:48:40.687778 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 348/690] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:40 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1568 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:48:40.749556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4a21f15-abe9-40b9-a6f5-f7ba97f0e807 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments/cd7ff98c-6407-4674-9e06-de293ba3baf9" status: 202 len: 0 microversion: 2.1 time: 0.348358 Dec 18 20:48:40.751496 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 343/691] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 20:48:40 2021] DELETE /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments/cd7ff98c-6407-4674-9e06-de293ba3baf9 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:48:40.770769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:40.772409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:40.782935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.783779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.784882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.785632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.951364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:40.959245 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e24223c-35ef-4477-b68f-34b640d44012 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1269 microversion: 2.1 time: 0.206556 Dec 18 20:48:40.961105 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 344/692] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:40 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:40.965713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:40.968623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:40.975513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.976208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:40.977241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:40.978050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.071688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:41.079325 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c8b42dc4-082a-47b2-8339-17234ea0ec1c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1272 microversion: 2.1 time: 0.116974 Dec 18 20:48:41.079969 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 345/693] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:40 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:41.084673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bb0382e2-723a-465d-af3f-c3d02b16c5f0 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:41.085631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bb0382e2-723a-465d-af3f-c3d02b16c5f0 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:41.114360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb0382e2-723a-465d-af3f-c3d02b16c5f0 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:41.114806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb0382e2-723a-465d-af3f-c3d02b16c5f0 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.115603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb0382e2-723a-465d-af3f-c3d02b16c5f0 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:41.116039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb0382e2-723a-465d-af3f-c3d02b16c5f0 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.133837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6cc38a5-0111-4379-acf4-1462d619f442 tempest-InstanceUsageAuditLogTestJSON-503481849 tempest-InstanceUsageAuditLogTestJSON-503481849-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:41.134612 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:41.134612 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:41.157554 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bb0382e2-723a-465d-af3f-c3d02b16c5f0 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076267 Dec 18 20:48:41.164618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 346/694] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:48:41 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:41.171966 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6cc38a5-0111-4379-acf4-1462d619f442 tempest-InstanceUsageAuditLogTestJSON-503481849 tempest-InstanceUsageAuditLogTestJSON-503481849-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2021-12-18 20:48:40" status: 200 len: 318 microversion: 2.1 time: 0.482714 Dec 18 20:48:41.172830 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 349/695] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 20:48:40 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-12-18%2020%3A48%3A40 => generated 318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:41.192864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5ab5ab0-a819-4150-8187-e9c49754a9de tempest-InstanceUsageAuditLogTestJSON-503481849 tempest-InstanceUsageAuditLogTestJSON-503481849-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:41.194386 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:41.194386 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:41.219376 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5ab5ab0-a819-4150-8187-e9c49754a9de tempest-InstanceUsageAuditLogTestJSON-503481849 tempest-InstanceUsageAuditLogTestJSON-503481849-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034142 Dec 18 20:48:41.228097 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 347/696] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Dec 18 20:48:41 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:41.409088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-73c10923-6ff5-4ca6-a5fe-d4a25b1fe412 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:41.411044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-73c10923-6ff5-4ca6-a5fe-d4a25b1fe412 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:41.421274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c10923-6ff5-4ca6-a5fe-d4a25b1fe412 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:41.422936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c10923-6ff5-4ca6-a5fe-d4a25b1fe412 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.426794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c10923-6ff5-4ca6-a5fe-d4a25b1fe412 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:41.427552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c10923-6ff5-4ca6-a5fe-d4a25b1fe412 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.501958 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-73c10923-6ff5-4ca6-a5fe-d4a25b1fe412 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 14 microversion: 2.1 time: 0.096681 Dec 18 20:48:41.503834 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 350/697] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:41 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:48:41.711038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:41.713070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:41.741488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:41.743692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.744702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:41.747470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.978485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:41.979282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:41.985752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:41.986195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:41.999831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:42.000689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:42.181782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:42.194425 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-266df3b5-2f5e-4670-aa1e-fc4aad0ac976 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1269 microversion: 2.1 time: 0.219843 Dec 18 20:48:42.195330 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 351/698] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:41 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:48:42.200665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:42.201498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:42.210533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:42.211295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:42.212591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:42.213227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:42.384369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:42.393228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:42.395411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:42.400841 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b3578c1-5606-44d9-8e5d-04d2eda61611 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1568 microversion: 2.25 time: 0.691410 Dec 18 20:48:42.413012 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 348/699] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:41 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1568 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:42.418177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-83ba2e6f-f534-44cb-a809-51a19fc5d0a9 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:42.419396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-83ba2e6f-f534-44cb-a809-51a19fc5d0a9 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:42.427520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ba2e6f-f534-44cb-a809-51a19fc5d0a9 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:42.428304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ba2e6f-f534-44cb-a809-51a19fc5d0a9 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:42.429463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ba2e6f-f534-44cb-a809-51a19fc5d0a9 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:42.430111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ba2e6f-f534-44cb-a809-51a19fc5d0a9 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:42.471952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-83ba2e6f-f534-44cb-a809-51a19fc5d0a9 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057528 Dec 18 20:48:42.481659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 349/700] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:48:42 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:42.513889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9a3429f-3e71-47c8-ac34-96faa0cded0b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:42.515337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9a3429f-3e71-47c8-ac34-96faa0cded0b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:42.524139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a3429f-3e71-47c8-ac34-96faa0cded0b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:42.526295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a3429f-3e71-47c8-ac34-96faa0cded0b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:42.527183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a3429f-3e71-47c8-ac34-96faa0cded0b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:42.527635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a3429f-3e71-47c8-ac34-96faa0cded0b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:42.602640 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9a3429f-3e71-47c8-ac34-96faa0cded0b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 14 microversion: 2.1 time: 0.092329 Dec 18 20:48:42.606102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 350/701] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:42 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:48:42.820517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:42.839523 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-00089e05-9b65-43ad-b378-c6343f17fedd tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1314 microversion: 2.1 time: 0.641733 Dec 18 20:48:42.841954 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 352/702] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:42 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:43.213375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:43.214045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:43.231429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.231888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:43.232698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.233146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:43.418407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:43.420566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:43.429652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.430770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:43.440083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.440903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:43.899656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:43.913061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-89d0eaa1-af3c-4683-b2d4-756da5fba576 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1311 microversion: 2.1 time: 0.702199 Dec 18 20:48:43.914460 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 351/703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:43 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1311 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:43.928224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2174050-d720-4e3f-8699-c1ecb02673a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:43.928780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:43.930156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d2174050-d720-4e3f-8699-c1ecb02673a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:43.943035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:43.945563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2174050-d720-4e3f-8699-c1ecb02673a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.946089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2174050-d720-4e3f-8699-c1ecb02673a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:43.949085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:43.951085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2174050-d720-4e3f-8699-c1ecb02673a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.951497 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2099488d-6215-43d5-88c6-0d7f67c358ab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1543 microversion: 2.25 time: 0.536770 Dec 18 20:48:43.951684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2174050-d720-4e3f-8699-c1ecb02673a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:43.954607 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 353/704] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:43 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1543 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:48:43.963966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:43.964633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:43.980837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.981762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:43.982766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:43.983393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.032150 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2174050-d720-4e3f-8699-c1ecb02673a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 14 microversion: 2.1 time: 0.116198 Dec 18 20:48:44.033395 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 352/705] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:43 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:44.071598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-229dfef7-12b0-491f-8fa0-75de07037059 req-a16cbc0b-5da4-4f23-81e2-8e57101b4717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42214d7-4bc6-41e2-86d4-b9847894de7b", "tag": "6e9be9b3-0f89-4ed8-b239-a85df360079d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:44.073679 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:44.073679 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:44.084499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-229dfef7-12b0-491f-8fa0-75de07037059 req-a16cbc0b-5da4-4f23-81e2-8e57101b4717 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.085280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-229dfef7-12b0-491f-8fa0-75de07037059 req-a16cbc0b-5da4-4f23-81e2-8e57101b4717 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.105322 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-229dfef7-12b0-491f-8fa0-75de07037059 req-a16cbc0b-5da4-4f23-81e2-8e57101b4717 service nova] Creating event network-changed:6e9be9b3-0f89-4ed8-b239-a85df360079d for instance d42214d7-4bc6-41e2-86d4-b9847894de7b on nch1-master-1 Dec 18 20:48:44.112726 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-229dfef7-12b0-491f-8fa0-75de07037059 req-a16cbc0b-5da4-4f23-81e2-8e57101b4717 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060255 Dec 18 20:48:44.129201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 353/706] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:44.145331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-acd3b44a-733d-4e08-8f17-607a82f15050 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '.version_select at 0x7f715c2c2700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:44.147782 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:44.147782 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:44.149661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acd3b44a-733d-4e08-8f17-607a82f15050 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.150449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acd3b44a-733d-4e08-8f17-607a82f15050 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.161905 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-acd3b44a-733d-4e08-8f17-607a82f15050 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.028251 Dec 18 20:48:44.163804 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 354/707] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Dec 18 20:48:44 2021] GET /compute/v2.1/os-migrations => generated 1940 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:44.196539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:44.199585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:44.221546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.222242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.223945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.224386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.672468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:44.702040 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a70eb15-a44b-4213-9179-633609a88fd4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1314 microversion: 2.1 time: 0.745120 Dec 18 20:48:44.702693 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 354/708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:43 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:44.713949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "973f4497-ef23-44b8-912b-4395a8af4097"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:44.720242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:44.733048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.733549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.737501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.738741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.778434 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:44.778434 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:44.828860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 6b1389e6-a05e-4f01-aa45-405bf57c622d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:48:44.835992 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] HTTP exception thrown: Volume aa5d3ee4-d7f0-4862-87eb-61b4b3e3a1bb could not be found. Dec 18 20:48:44.837219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] Returning 404 to user: Volume aa5d3ee4-d7f0-4862-87eb-61b4b3e3a1bb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:44.838434 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b876ab29-61be-486e-9ab9-4ad2bbea4dfa tempest-VolumesAdminNegativeTest-764128521 tempest-VolumesAdminNegativeTest-764128521-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments/aa5d3ee4-d7f0-4862-87eb-61b4b3e3a1bb" status: 404 len: 109 microversion: 2.1 time: 0.131950 Dec 18 20:48:44.843502 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 355/709] 10.222.0.13 () {60 vars in 1432 bytes} [Sat Dec 18 20:48:44 2021] PUT /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd/os-volume_attachments/aa5d3ee4-d7f0-4862-87eb-61b4b3e3a1bb => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:44.858191 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-de119006-f2a1-44b6-b6ac-dfd2e8070904 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 2036 microversion: 2.25 time: 0.685192 Dec 18 20:48:44.858814 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 355/710] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:44 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 2036 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:44.933341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:44.934015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:44.947143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.950221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:44.951456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:44.953333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:45.043856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e08fcd64-52e0-477f-beb3-2bdfcb5b34d1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:45.045110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e08fcd64-52e0-477f-beb3-2bdfcb5b34d1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:45.057569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e08fcd64-52e0-477f-beb3-2bdfcb5b34d1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:45.058025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e08fcd64-52e0-477f-beb3-2bdfcb5b34d1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:45.058859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e08fcd64-52e0-477f-beb3-2bdfcb5b34d1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:45.059312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e08fcd64-52e0-477f-beb3-2bdfcb5b34d1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:45.208175 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e08fcd64-52e0-477f-beb3-2bdfcb5b34d1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 8206 microversion: 2.1 time: 0.167770 Dec 18 20:48:45.209142 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 356/711] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:45 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 8206 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:45.217338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1260095800", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "fab4d786-81c4-48dc-b51f-790f7e93cb03"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:45.328747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] validate_networks() for [('fab4d786-81c4-48dc-b51f-790f7e93cb03', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:45.736121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:45.750028 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d242e188-b7e0-4abc-92b7-5eb70654aff0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1311 microversion: 2.1 time: 0.820565 Dec 18 20:48:45.759611 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 356/712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:44 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1311 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:45.765609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-20551301-57f6-477b-afe3-b56751fd19fd req-7a32d5db-a771-495b-aca5-f83f9dc1a497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3c9fff-7539-4d85-9102-827366dbb6cd", "tag": "12a3229b-b407-4f8f-9557-f1a6978d54bb"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:45.767421 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:45.767421 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:45.785458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-20551301-57f6-477b-afe3-b56751fd19fd req-7a32d5db-a771-495b-aca5-f83f9dc1a497 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:45.786295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-20551301-57f6-477b-afe3-b56751fd19fd req-7a32d5db-a771-495b-aca5-f83f9dc1a497 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:45.813196 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-20551301-57f6-477b-afe3-b56751fd19fd req-7a32d5db-a771-495b-aca5-f83f9dc1a497 service nova] Creating event network-changed:12a3229b-b407-4f8f-9557-f1a6978d54bb for instance db3c9fff-7539-4d85-9102-827366dbb6cd on nch1-master-1 Dec 18 20:48:45.823833 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-20551301-57f6-477b-afe3-b56751fd19fd req-7a32d5db-a771-495b-aca5-f83f9dc1a497 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062085 Dec 18 20:48:45.824741 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 357/713] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:45.861996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:45.864034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:45.922883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:45.923537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:45.924448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:45.925135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:46.683620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:46.698499 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dac0c37d-823b-453d-8139-2dcd24e1d10e tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1314 microversion: 2.1 time: 0.866997 Dec 18 20:48:46.708686 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 358/714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:45 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:46.714909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60d65a16-8ec7-474f-ac54-2fa4a18d1b2a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:46.715376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60d65a16-8ec7-474f-ac54-2fa4a18d1b2a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:46.757155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d65a16-8ec7-474f-ac54-2fa4a18d1b2a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:46.757853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d65a16-8ec7-474f-ac54-2fa4a18d1b2a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:46.760633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d65a16-8ec7-474f-ac54-2fa4a18d1b2a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:46.761340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60d65a16-8ec7-474f-ac54-2fa4a18d1b2a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:46.856659 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60d65a16-8ec7-474f-ac54-2fa4a18d1b2a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 16400 microversion: 2.1 time: 0.147435 Dec 18 20:48:46.862228 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 359/715] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:46 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 16400 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:46.868599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:46.870919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:46.886933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:46.887843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:46.889002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:46.889601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:46.951829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:48:46.953319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:48:46.955665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:48:46.958960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:48:46.960667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:48:46.975703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:46.976749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:46.977952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:46.978612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:47.012023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:48:47.020530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for user 8042de28328d4b26b910f1be4b499879 and project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:48:47.051801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:48:47.056225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:48:47.163344 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d941d68f-722f-4cb6-a671-62a2dd9e21bb tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.952332 Dec 18 20:48:47.177237 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 357/716] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 20:48:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1963 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 20:48:47.710803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ff5292d-9283-4c6e-900a-0df8e43ddf26 tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] Action: 'create', calling method: .version_select at 0x7f715c4725e0>, body: {"security_group": {"name": "tempest-securitygroup-1018685626", "description": "tempest-description-1101347218"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:48.219546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:48.237892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7bc8722f-6f6a-4368-a733-537f0feb40c6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1311 microversion: 2.1 time: 1.364347 Dec 18 20:48:48.247727 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 360/717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:46 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1311 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:48.247727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:48.247727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:48.261498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:48.261953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:48.262763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:48.263378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:48.352862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:48.364133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:48.365778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:48.367027 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c119899-927d-443e-9485-a4e199640a2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1314 microversion: 2.25 time: 0.126543 Dec 18 20:48:48.377552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 361/718] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:48 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:48.387758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:48.388602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:48.398291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:48.398895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:48.399817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:48.400488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:48.955685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:48.969304 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-621e7613-e648-4af4-8a55-5fc61457286f tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1314 microversion: 2.1 time: 0.590574 Dec 18 20:48:48.969893 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 362/719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:48 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:48.981452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:48.982137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:48.988416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ff5292d-9283-4c6e-900a-0df8e43ddf26 tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.813414 Dec 18 20:48:48.989524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 358/720] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:48:47 2021] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:48.994348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b92fecc-cea9-4ca6-954b-56f2edcabb7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:48.995848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b92fecc-cea9-4ca6-954b-56f2edcabb7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:49.002547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.003220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.004704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.005277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.016022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b92fecc-cea9-4ca6-954b-56f2edcabb7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.016630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b92fecc-cea9-4ca6-954b-56f2edcabb7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.017559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b92fecc-cea9-4ca6-954b-56f2edcabb7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.018110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b92fecc-cea9-4ca6-954b-56f2edcabb7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.053166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:48:49.085598 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b92fecc-cea9-4ca6-954b-56f2edcabb7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 16400 microversion: 2.1 time: 0.091359 Dec 18 20:48:49.090361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 359/721] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:48 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 16400 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:49.181342 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a95d89c9-8d1a-40e9-b1c4-6a38ee1ffa0d tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 204 len: 0 microversion: 2.1 time: 0.202003 Dec 18 20:48:49.184041 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 363/722] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:48:48 2021] DELETE /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:48:49.193427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5c8b2875-a556-4619-a3f4-6256fb946b04 tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] Action: 'create', calling method: .version_select at 0x7f714fa26af0>, body: {"security_group": {"name": "tempest-securitygroup-2110477195", "description": "tempest-description-1713718905"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:49.298419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Action: 'update', calling method: .version_select at 0x7f715c45c040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:49.300111 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:49.300111 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:49.302456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.303065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.311800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.312628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.321756 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] HTTP exception thrown: Service 74f7186a-64fd-4673-af3d-a6159510227c could not be found. Dec 18 20:48:49.323117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Returning 404 to user: Service 74f7186a-64fd-4673-af3d-a6159510227c could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:49.324892 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93af0da2-4ab2-4874-93be-57a6efe5f02e tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/74f7186a-64fd-4673-af3d-a6159510227c" status: 404 len: 110 microversion: 2.53 time: 0.233773 Dec 18 20:48:49.326528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 360/723] 10.222.0.13 () {62 vars in 1308 bytes} [Sat Dec 18 20:48:49 2021] PUT /compute/v2.1/os-services/74f7186a-64fd-4673-af3d-a6159510227c => generated 110 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:48:49.335717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:49.336623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:49.344463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.345268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.346220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.346828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.664301 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5c8b2875-a556-4619-a3f4-6256fb946b04 tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.478585 Dec 18 20:48:49.668482 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 364/724] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:48:49 2021] POST /compute/v2.1/os-security-groups => generated 221 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:49.694437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:49.699578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:49.701869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:49.718660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.719248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.721732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.722827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.724585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25e023df-6bcd-4051-866c-2e9b2b8bbd63 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1512 microversion: 2.1 time: 0.396194 Dec 18 20:48:49.726831 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 361/725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:49 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:49.741838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Action: 'update', calling method: .version_select at 0x7f715c3e5dc0>, body: {"status": "disabled"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:49.743410 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:49.743410 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:49.745277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.745950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.752164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.752933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.759388 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] HTTP exception thrown: Service 74f7186a-64fd-4673-af3d-a6159510227c could not be found. Dec 18 20:48:49.761156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Returning 404 to user: Service 74f7186a-64fd-4673-af3d-a6159510227c could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:49.762231 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1bd3b26d-fe48-403c-bb41-5dc97c49d95d tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/74f7186a-64fd-4673-af3d-a6159510227c" status: 404 len: 110 microversion: 2.53 time: 0.033166 Dec 18 20:48:49.763080 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 362/726] 10.222.0.13 () {62 vars in 1308 bytes} [Sat Dec 18 20:48:49 2021] PUT /compute/v2.1/os-services/74f7186a-64fd-4673-af3d-a6159510227c => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:48:49.771878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:49.780039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:49.790581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.792075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.795860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:49.797746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:49.917965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:49.930690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:49.934367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:49.938660 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d271bdb7-8f15-4681-86fc-ad3ef480c541 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1320 microversion: 2.25 time: 0.172271 Dec 18 20:48:49.947469 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 363/727] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:49 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:50.027259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:50.036795 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ddca35e-92d7-4463-b310-36c06399ff01 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1311 microversion: 2.1 time: 0.366532 Dec 18 20:48:50.039587 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 365/728] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:49 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1311 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:50.046790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Action: 'update', calling method: .version_select at 0x7f714fa26700>, body: {"status": "enabled"} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:50.049035 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:50.049035 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:50.053705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.056182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.077049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.077426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.096759 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] HTTP exception thrown: Service 74f7186a-64fd-4673-af3d-a6159510227c could not be found. Dec 18 20:48:50.097908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Returning 404 to user: Service 74f7186a-64fd-4673-af3d-a6159510227c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:50.098791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fad2bbe0-700a-4aba-aea7-5721769143b7 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/74f7186a-64fd-4673-af3d-a6159510227c" status: 404 len: 110 microversion: 2.53 time: 0.056967 Dec 18 20:48:50.104125 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 366/729] 10.222.0.13 () {62 vars in 1308 bytes} [Sat Dec 18 20:48:50 2021] PUT /compute/v2.1/os-services/74f7186a-64fd-4673-af3d-a6159510227c => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:48:50.113367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9f5a145d-3522-4f06-93ea-5c2e96f98f29 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Action: 'create', calling method: .version_select at 0x7f715c208430>, body: {"security_group": {"name": "tempest-securitygroup-519527941", "description": "tempest-description-793738221"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:50.117776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:50.118545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:50.133714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.135131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.137446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.138381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.524376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:50.532091 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9dd0b791-9ad3-437d-b76b-dd3b34dfe4e4 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1314 microversion: 2.1 time: 0.420633 Dec 18 20:48:50.532889 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 367/730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:50 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:50.541718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f105d03c-bdd9-438b-86c2-bcabfaa57ecf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:50.543044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f105d03c-bdd9-438b-86c2-bcabfaa57ecf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:50.557708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f105d03c-bdd9-438b-86c2-bcabfaa57ecf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.558533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f105d03c-bdd9-438b-86c2-bcabfaa57ecf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.562633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f105d03c-bdd9-438b-86c2-bcabfaa57ecf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.563332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f105d03c-bdd9-438b-86c2-bcabfaa57ecf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.645189 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f105d03c-bdd9-438b-86c2-bcabfaa57ecf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 16400 microversion: 2.1 time: 0.110078 Dec 18 20:48:50.651031 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 368/731] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:50 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 16400 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:50.666388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bed84ef3-f5e5-4f76-8b8d-ab4f56299524 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:50.669042 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:50.669042 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:50.671668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bed84ef3-f5e5-4f76-8b8d-ab4f56299524 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.672706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bed84ef3-f5e5-4f76-8b8d-ab4f56299524 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.673724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bed84ef3-f5e5-4f76-8b8d-ab4f56299524 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.675614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bed84ef3-f5e5-4f76-8b8d-ab4f56299524 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.739228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bed84ef3-f5e5-4f76-8b8d-ab4f56299524 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.084294 Dec 18 20:48:50.739918 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 369/732] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Dec 18 20:48:50 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:50.745310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:50.746412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:50.755660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.756740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:50.758490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:50.760486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:51.365772 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9f5a145d-3522-4f06-93ea-5c2e96f98f29 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.415454 Dec 18 20:48:51.367676 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 364/733] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:48:49 2021] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:51.372767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a45b4bb-3b5d-45b0-b866-cf0d250f4933 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:51.374830 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:51.374830 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:51.378973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a45b4bb-3b5d-45b0-b866-cf0d250f4933 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:51.379655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a45b4bb-3b5d-45b0-b866-cf0d250f4933 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:51.380805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a45b4bb-3b5d-45b0-b866-cf0d250f4933 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:51.381647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a45b4bb-3b5d-45b0-b866-cf0d250f4933 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:51.399419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c971aa1884174ed0acec9d140f2eda87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47584e2b5b674fc295b6a63ffe8df191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:51.406721 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-723bce0f-9320-436c-b5fe-642404cbc7a6 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 200 len: 1512 microversion: 2.1 time: 0.665446 Dec 18 20:48:51.407294 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 370/734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:50 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 1512 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:51.419879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:51.420758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:51.423672 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a45b4bb-3b5d-45b0-b866-cf0d250f4933 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.054740 Dec 18 20:48:51.424414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 365/735] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Dec 18 20:48:51 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:51.432704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:51.434233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:51.436719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:51.437392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:51.438541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:51.439117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:51.444305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:51.444894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:51.446582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:51.447257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:51.839436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:51.848937 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db79112a-6738-4941-b527-0f620e70ff7d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1311 microversion: 2.1 time: 0.422208 Dec 18 20:48:51.849627 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 366/736] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:51 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1311 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:51.908929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd9d95ee-a4e1-420f-a42a-0f78e504cdce tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] Calling method '.version_select at 0x7f715c7bfee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:52.029377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd9d95ee-a4e1-420f-a42a-0f78e504cdce tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.178401 Dec 18 20:48:52.029993 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 367/737] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 20:48:51 2021] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:48:52.035549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3cb207d9-70d2-45b5-996c-cc784a066aba req-eb855f20-42a1-4a50-853f-2fee2e815a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42214d7-4bc6-41e2-86d4-b9847894de7b", "name": "network-vif-plugged", "status": "completed", "tag": "6e9be9b3-0f89-4ed8-b239-a85df360079d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:52.037472 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:52.037472 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:52.045397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3cb207d9-70d2-45b5-996c-cc784a066aba req-eb855f20-42a1-4a50-853f-2fee2e815a2b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:52.045848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3cb207d9-70d2-45b5-996c-cc784a066aba req-eb855f20-42a1-4a50-853f-2fee2e815a2b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:52.058852 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3cb207d9-70d2-45b5-996c-cc784a066aba req-eb855f20-42a1-4a50-853f-2fee2e815a2b service nova] Creating event network-vif-plugged:6e9be9b3-0f89-4ed8-b239-a85df360079d for instance d42214d7-4bc6-41e2-86d4-b9847894de7b on nch1-master-1 Dec 18 20:48:52.064753 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3cb207d9-70d2-45b5-996c-cc784a066aba req-eb855f20-42a1-4a50-853f-2fee2e815a2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033157 Dec 18 20:48:52.065470 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 368/738] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:52.070498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7577256-67b2-485b-af05-d9b098452582 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Action: 'create', calling method: .version_select at 0x7f715c61d160>, body: {"security_group": {"name": "tempest-securitygroup-190429130", "description": "tempest-description-411378879"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:52.114808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:52.127371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:52.128963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:52.130336 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ce1c7ba-e8ce-444d-aa73-4950ce1fb925 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1362 microversion: 2.25 time: 0.718052 Dec 18 20:48:52.130997 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 371/739] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:51 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:52.135798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9bdfb44-52d2-4b64-ab7b-bd33b51d6cb0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:52.137169 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:52.137169 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:52.138720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb44-52d2-4b64-ab7b-bd33b51d6cb0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:52.139169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb44-52d2-4b64-ab7b-bd33b51d6cb0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:52.140140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb44-52d2-4b64-ab7b-bd33b51d6cb0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:52.140789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb44-52d2-4b64-ab7b-bd33b51d6cb0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:52.165194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9bdfb44-52d2-4b64-ab7b-bd33b51d6cb0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.032990 Dec 18 20:48:52.165800 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 372/740] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Dec 18 20:48:52 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:52.170035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:52.170657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:52.181128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:52.182021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:52.186563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:52.186563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:52.874819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:52.890039 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31b12ad9-dede-46d9-bb62-3a49c0626a3d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1314 microversion: 2.1 time: 0.722925 Dec 18 20:48:52.890983 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 373/741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:52 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:52.895998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34dd2061-4221-4684-afd2-9d3b53c6783c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:52.896961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-34dd2061-4221-4684-afd2-9d3b53c6783c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:52.912799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34dd2061-4221-4684-afd2-9d3b53c6783c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:52.913581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34dd2061-4221-4684-afd2-9d3b53c6783c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:52.914609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34dd2061-4221-4684-afd2-9d3b53c6783c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:52.917610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34dd2061-4221-4684-afd2-9d3b53c6783c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:52.988039 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-34dd2061-4221-4684-afd2-9d3b53c6783c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 24567 microversion: 2.1 time: 0.094777 Dec 18 20:48:52.988788 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 374/742] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:52 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 24567 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:52.994580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a014bb10-76c9-48bd-ab6c-6c91d6be7e29 req-79859960-e8b5-4394-9faf-20c2f16751d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919e413a-66ad-40fb-aad2-6d3392c35439", "tag": "c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:52.996715 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:52.996715 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:52.998046 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7577256-67b2-485b-af05-d9b098452582 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.931382 Dec 18 20:48:53.005508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a014bb10-76c9-48bd-ab6c-6c91d6be7e29 req-79859960-e8b5-4394-9faf-20c2f16751d4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.005906 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 369/743] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:48:52 2021] POST /compute/v2.1/os-security-groups => generated 219 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:53.006359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a014bb10-76c9-48bd-ab6c-6c91d6be7e29 req-79859960-e8b5-4394-9faf-20c2f16751d4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.016876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f58fc74d-1d03-42da-aa10-7bd84edc8509 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] Action: 'create', calling method: .version_select at 0x7f715c3e5e50>, body: {"pool": "non_exist_pool"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:53.021117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a014bb10-76c9-48bd-ab6c-6c91d6be7e29 req-79859960-e8b5-4394-9faf-20c2f16751d4 service nova] Creating event network-changed:c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a for instance 919e413a-66ad-40fb-aad2-6d3392c35439 on nch2-master-1 Dec 18 20:48:53.026737 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a014bb10-76c9-48bd-ab6c-6c91d6be7e29 req-79859960-e8b5-4394-9faf-20c2f16751d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036407 Dec 18 20:48:53.027679 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 375/744] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:53.033043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-791471d3-3ccc-41aa-be05-5b09b82d1cf0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:53.035208 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:53.035208 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:53.036799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791471d3-3ccc-41aa-be05-5b09b82d1cf0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.037260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791471d3-3ccc-41aa-be05-5b09b82d1cf0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.038073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791471d3-3ccc-41aa-be05-5b09b82d1cf0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.038533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791471d3-3ccc-41aa-be05-5b09b82d1cf0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.062621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-791471d3-3ccc-41aa-be05-5b09b82d1cf0 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.033684 Dec 18 20:48:53.063425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 376/745] 10.222.0.13 () {60 vars in 1236 bytes} [Sat Dec 18 20:48:53 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:53.068679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:53.069469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] [instance: 5b52f544-8eb3-4f5e-a37c-c694695123bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:53.075666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.076662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f58fc74d-1d03-42da-aa10-7bd84edc8509 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] HTTP exception thrown: Floating IP pool not found. Dec 18 20:48:53.077451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f58fc74d-1d03-42da-aa10-7bd84edc8509 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] Returning 404 to user: Floating IP pool not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:53.078394 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f58fc74d-1d03-42da-aa10-7bd84edc8509 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.071263 Dec 18 20:48:53.080431 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 370/746] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:48:53 2021] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:48:53.085292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.085902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:53.086242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.086715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.087576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:53.094982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.096755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.097886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.098661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.101365 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] HTTP exception thrown: Instance 5b52f544-8eb3-4f5e-a37c-c694695123bd could not be found. Dec 18 20:48:53.102329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] Returning 404 to user: Instance 5b52f544-8eb3-4f5e-a37c-c694695123bd could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:53.103306 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21770682-9f9e-4096-b467-4a2460290730 tempest-VolumesAdminNegativeTest-2110717882 tempest-VolumesAdminNegativeTest-2110717882-project] 10.222.0.13 "GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd" status: 404 len: 111 microversion: 2.1 time: 0.038718 Dec 18 20:48:53.104346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 377/747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:53 2021] GET /compute/v2.1/servers/5b52f544-8eb3-4f5e-a37c-c694695123bd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:53.109022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Calling method '.version_select at 0x7f714fa0bca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:53.504651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:53.519030 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-240ee7e3-b8bd-44f6-88b2-73b521f62029 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1311 microversion: 2.1 time: 0.434754 Dec 18 20:48:53.533014 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 371/748] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:53 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1311 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:53.541155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3c117ad-6f5a-4e4a-b7e6-cac97c5b4b24 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:53.543494 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:53.543494 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:53.546981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c117ad-6f5a-4e4a-b7e6-cac97c5b4b24 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.547662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c117ad-6f5a-4e4a-b7e6-cac97c5b4b24 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.548773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c117ad-6f5a-4e4a-b7e6-cac97c5b4b24 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.549377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c117ad-6f5a-4e4a-b7e6-cac97c5b4b24 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.586009 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3c117ad-6f5a-4e4a-b7e6-cac97c5b4b24 tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.049529 Dec 18 20:48:53.586798 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 372/749] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Dec 18 20:48:53 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:53.592425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad8d28fd-4832-4e58-8755-0ea63fa21859 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] Calling method '.version_select at 0x7f715c44cdc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:53.694497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-ad8d28fd-4832-4e58-8755-0ea63fa21859 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 54342315-f70b-4760-acc8-1a133ce6aeab could not be found", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:48:53.695259 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ad8d28fd-4832-4e58-8755-0ea63fa21859 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] HTTP exception thrown: Floating IP not found for ID 54342315-f70b-4760-acc8-1a133ce6aeab Dec 18 20:48:53.697006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad8d28fd-4832-4e58-8755-0ea63fa21859 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] Returning 404 to user: Floating IP not found for ID 54342315-f70b-4760-acc8-1a133ce6aeab {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:53.698883 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad8d28fd-4832-4e58-8755-0ea63fa21859 tempest-FloatingIPsNegativeTestJSON-565207000 tempest-FloatingIPsNegativeTestJSON-565207000-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/54342315-f70b-4760-acc8-1a133ce6aeab" status: 404 len: 111 microversion: 2.1 time: 0.110938 Dec 18 20:48:53.699503 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 373/750] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:48:53 2021] DELETE /compute/v2.1/os-floating-ips/54342315-f70b-4760-acc8-1a133ce6aeab => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:53.744504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:53.745327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:53.755102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.755744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:53.756570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:53.757017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:54.416386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:54.439439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:54.442700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:54.444087 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4c6c476-376b-48e6-a876-43c2dcf39b6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1362 microversion: 2.25 time: 0.742399 Dec 18 20:48:54.445252 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 374/751] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:53 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1362 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:54.455025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7d67484-e77f-4124-93b1-d3ed9d1311cf tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:54.457269 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:54.457269 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:54.459573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7d67484-e77f-4124-93b1-d3ed9d1311cf tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:54.460421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7d67484-e77f-4124-93b1-d3ed9d1311cf tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:54.461470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7d67484-e77f-4124-93b1-d3ed9d1311cf tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:54.462103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7d67484-e77f-4124-93b1-d3ed9d1311cf tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:54.508186 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7d67484-e77f-4124-93b1-d3ed9d1311cf tempest-ServicesAdminNegativeV253TestJSON-1726574785 tempest-ServicesAdminNegativeV253TestJSON-1726574785-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.061683 Dec 18 20:48:54.508812 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 375/752] 10.222.0.13 () {60 vars in 1238 bytes} [Sat Dec 18 20:48:54 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:54.522516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:54.523100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:54.531057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:54.531425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:54.532226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:54.532694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:54.916253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:54.923930 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51088177-0391-43fc-8bee-9a9192450f5b tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1464 microversion: 2.1 time: 0.413277 Dec 18 20:48:54.928283 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 376/753] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:54 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1464 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:54.934523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-956da788-764e-4769-b4c0-175ef14938db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:54.936116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-956da788-764e-4769-b4c0-175ef14938db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:54.958386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-956da788-764e-4769-b4c0-175ef14938db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:54.959027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-956da788-764e-4769-b4c0-175ef14938db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:54.960901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-956da788-764e-4769-b4c0-175ef14938db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:54.962983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-956da788-764e-4769-b4c0-175ef14938db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:55.009314 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-956da788-764e-4769-b4c0-175ef14938db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 24567 microversion: 2.1 time: 0.079364 Dec 18 20:48:55.011621 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 377/754] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:54 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 24567 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:55.019226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-82b243be-bca4-4685-8b77-42e2579081dc req-87747dbb-6c78-473a-a3ed-26e458a42224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3c9fff-7539-4d85-9102-827366dbb6cd", "name": "network-vif-plugged", "status": "completed", "tag": "12a3229b-b407-4f8f-9557-f1a6978d54bb"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:55.021304 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:55.021304 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:55.029285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-82b243be-bca4-4685-8b77-42e2579081dc req-87747dbb-6c78-473a-a3ed-26e458a42224 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:55.029990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-82b243be-bca4-4685-8b77-42e2579081dc req-87747dbb-6c78-473a-a3ed-26e458a42224 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:55.044091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-82b243be-bca4-4685-8b77-42e2579081dc req-87747dbb-6c78-473a-a3ed-26e458a42224 service nova] Creating event network-vif-plugged:12a3229b-b407-4f8f-9557-f1a6978d54bb for instance db3c9fff-7539-4d85-9102-827366dbb6cd on nch1-master-1 Dec 18 20:48:55.052776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-82b243be-bca4-4685-8b77-42e2579081dc req-87747dbb-6c78-473a-a3ed-26e458a42224 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037214 Dec 18 20:48:55.059092 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 378/755] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:55.324880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98e6509d-499d-4b5c-b7c4-128879572a31 tempest-ServicesAdminNegativeV253TestJSON-1309028795 tempest-ServicesAdminNegativeV253TestJSON-1309028795-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:55.326515 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:55.326515 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:55.328554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-98e6509d-499d-4b5c-b7c4-128879572a31 tempest-ServicesAdminNegativeV253TestJSON-1309028795 tempest-ServicesAdminNegativeV253TestJSON-1309028795-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2adbe528b7b94299b0f06ea3e4654c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bd8a61f8bf450290c7bacb16d71eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:55.328847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98e6509d-499d-4b5c-b7c4-128879572a31 tempest-ServicesAdminNegativeV253TestJSON-1309028795 tempest-ServicesAdminNegativeV253TestJSON-1309028795-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:55.339242 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98e6509d-499d-4b5c-b7c4-128879572a31 tempest-ServicesAdminNegativeV253TestJSON-1309028795 tempest-ServicesAdminNegativeV253TestJSON-1309028795-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.278627 Dec 18 20:48:55.339912 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 379/756] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Dec 18 20:48:55 2021] GET /compute/v2.1/os-services => generated 112 bytes in 280 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:48:55.348375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:55.352187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:55.372113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:55.372722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:55.374071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:55.375495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:55.996558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:56.008096 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac13c943-894f-4cd0-81a5-1a9a9c9febf1 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1311 microversion: 2.1 time: 0.666242 Dec 18 20:48:56.010404 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 380/757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:55 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1311 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:56.329116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3635367-484d-4b57-aab3-85a99d73d1a7 tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Calling method '.version_select at 0x7f715c45c1f0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:56.348525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3635367-484d-4b57-aab3-85a99d73d1a7 tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:56.349244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3635367-484d-4b57-aab3-85a99d73d1a7 tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:56.381790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3635367-484d-4b57-aab3-85a99d73d1a7 tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:56.382920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3635367-484d-4b57-aab3-85a99d73d1a7 tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:56.408853 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3635367-484d-4b57-aab3-85a99d73d1a7 tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/2e459a051d234475b150b36857974efb?start=2021-12-17T20%3A48%3A54.934225&end=2021-12-19T20%3A48%3A54.934225" status: 200 len: 695 microversion: 2.1 time: 0.397181 Dec 18 20:48:56.410081 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 381/758] 10.222.0.13 () {58 vars in 1411 bytes} [Sat Dec 18 20:48:56 2021] GET /compute/v2.1/os-simple-tenant-usage/2e459a051d234475b150b36857974efb?start=2021-12-17T20%3A48%3A54.934225&end=2021-12-19T20%3A48%3A54.934225 => generated 695 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:56.420233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-870df14d-6825-4c4b-9029-8111c3540df8 req-772a8c48-0e0e-4beb-b0f7-fb95b7ec307a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b52f544-8eb3-4f5e-a37c-c694695123bd", "name": "network-vif-deleted", "tag": "a51358c4-71d5-40ec-bd5c-4e5e2bfda8e1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:56.422634 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:56.422634 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:56.432511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-870df14d-6825-4c4b-9029-8111c3540df8 req-772a8c48-0e0e-4beb-b0f7-fb95b7ec307a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:56.433267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-870df14d-6825-4c4b-9029-8111c3540df8 req-772a8c48-0e0e-4beb-b0f7-fb95b7ec307a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:56.449891 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-870df14d-6825-4c4b-9029-8111c3540df8 req-772a8c48-0e0e-4beb-b0f7-fb95b7ec307a service nova] Creating event network-vif-deleted:a51358c4-71d5-40ec-bd5c-4e5e2bfda8e1 for instance 5b52f544-8eb3-4f5e-a37c-c694695123bd on nch2-master-1 Dec 18 20:48:56.455800 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-870df14d-6825-4c4b-9029-8111c3540df8 req-772a8c48-0e0e-4beb-b0f7-fb95b7ec307a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043904 Dec 18 20:48:56.457367 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 382/759] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:56.462995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:56.465660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:56.478315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:56.478999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:56.479956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:56.480545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:56.886243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf5fcdbb-62bf-4b88-bccd-22471f2a69b6 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:48:56.888819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Neutron security group cf5fcdbb-62bf-4b88-bccd-22471f2a69b6 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:48:56.890630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:56.890834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.security_groups [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Security Group ID cf5fcdbb-62bf-4b88-bccd-22471f2a69b6 does not exist {{(pid=140732) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Dec 18 20:48:56.898739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:56.912320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:56.913786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76f27440-4cb2-446a-8c95-d4bdcd967832 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1362 microversion: 2.25 time: 0.455117 Dec 18 20:48:56.924694 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 383/760] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:56 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:56.929969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae030d88-44cf-415f-a416-aa665c8747b7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:56.931184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae030d88-44cf-415f-a416-aa665c8747b7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:56.942748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae030d88-44cf-415f-a416-aa665c8747b7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:56.943493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae030d88-44cf-415f-a416-aa665c8747b7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:56.944487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae030d88-44cf-415f-a416-aa665c8747b7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:56.944932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae030d88-44cf-415f-a416-aa665c8747b7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.002522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf5fcdbb-62bf-4b88-bccd-22471f2a69b6 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:48:57.004114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Neutron security group cf5fcdbb-62bf-4b88-bccd-22471f2a69b6 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:48:57.004563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.security_groups [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Security Group ID cf5fcdbb-62bf-4b88-bccd-22471f2a69b6 does not exist {{(pid=140732) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Dec 18 20:48:57.027085 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae030d88-44cf-415f-a416-aa665c8747b7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 24567 microversion: 2.1 time: 0.093988 Dec 18 20:48:57.031524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 384/761] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:56 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 24567 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:57.045067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d0ecc2e-2176-499b-b275-b2084d710465 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '.version_select at 0x7f715c2fe8b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:57.058861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ecc2e-2176-499b-b275-b2084d710465 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.059472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ecc2e-2176-499b-b275-b2084d710465 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.073147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ecc2e-2176-499b-b275-b2084d710465 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.073672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ecc2e-2176-499b-b275-b2084d710465 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.087149 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d0ecc2e-2176-499b-b275-b2084d710465 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/2e459a051d234475b150b36857974efb?start=2021-12-17T20%3A48%3A54.934225&end=2021-12-19T20%3A48%3A54.934225" status: 200 len: 650 microversion: 2.1 time: 0.052926 Dec 18 20:48:57.088350 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 385/762] 10.222.0.13 () {58 vars in 1411 bytes} [Sat Dec 18 20:48:57 2021] GET /compute/v2.1/os-simple-tenant-usage/2e459a051d234475b150b36857974efb?start=2021-12-17T20%3A48%3A54.934225&end=2021-12-19T20%3A48%3A54.934225 => generated 650 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:57.357047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f518e65-e787-4137-9af2-d05304b8bd35 tempest-FlavorsV2NegativeTest-1391637449 tempest-FlavorsV2NegativeTest-1391637449-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:57.366490 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1f518e65-e787-4137-9af2-d05304b8bd35 tempest-FlavorsV2NegativeTest-1391637449 tempest-FlavorsV2NegativeTest-1391637449-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.276721 Dec 18 20:48:57.367462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 386/763] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:48:57 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:57.371359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:57.372085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:57.378541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.378994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.379783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.380222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.683013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:57.690620 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-577cc20b-d3a7-4304-bd95-5c8ffb3dd6a6 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1495 microversion: 2.1 time: 0.322489 Dec 18 20:48:57.693041 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 387/764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:57 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1495 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:57.699620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-277a9832-d584-41bc-8c72-d685aa22610e tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Calling method '.version_select at 0x7f715c33aca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:57.702227 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:57.702227 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:48:57.723708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea7b7542-7ce3-442a-a6fa-8cbf8ab05648 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:48:57.726550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Neutron security group ea7b7542-7ce3-442a-a6fa-8cbf8ab05648 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:48:57.727205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.security_groups [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Security Group ID ea7b7542-7ce3-442a-a6fa-8cbf8ab05648 does not exist {{(pid=140732) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Dec 18 20:48:57.745040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-277a9832-d584-41bc-8c72-d685aa22610e tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.745640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-277a9832-d584-41bc-8c72-d685aa22610e tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.767065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-277a9832-d584-41bc-8c72-d685aa22610e tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.767674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-277a9832-d584-41bc-8c72-d685aa22610e tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.799757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea7b7542-7ce3-442a-a6fa-8cbf8ab05648 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:48:57.800742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Neutron security group ea7b7542-7ce3-442a-a6fa-8cbf8ab05648 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:48:57.802667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.security_groups [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Security Group ID ea7b7542-7ce3-442a-a6fa-8cbf8ab05648 does not exist {{(pid=140732) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Dec 18 20:48:57.891838 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-277a9832-d584-41bc-8c72-d685aa22610e tempest-TenantUsagesTestJSON-714209822 tempest-TenantUsagesTestJSON-714209822-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-17T20%3A48%3A54.934225&end=2021-12-19T20%3A48%3A54.934225&detailed=1" status: 200 len: 9466 microversion: 2.1 time: 0.196092 Dec 18 20:48:57.901448 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 388/765] 10.222.0.13 () {58 vars in 1334 bytes} [Sat Dec 18 20:48:57 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-17T20%3A48%3A54.934225&end=2021-12-19T20%3A48%3A54.934225&detailed=1 => generated 9466 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:57.911118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57e79749-a6af-45c0-9785-4d0c393fb15d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:57.911319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57e79749-a6af-45c0-9785-4d0c393fb15d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:57.928206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57e79749-a6af-45c0-9785-4d0c393fb15d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.928706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57e79749-a6af-45c0-9785-4d0c393fb15d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:57.929460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57e79749-a6af-45c0-9785-4d0c393fb15d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:57.929902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57e79749-a6af-45c0-9785-4d0c393fb15d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.352253 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd0545c3-a0ec-498d-9101-fc5f5db9eb8b tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10709 microversion: 2.1 time: 5.239373 Dec 18 20:48:58.367203 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 378/766] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Dec 18 20:48:53 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10709 bytes in 5249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:58.367203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:58.367203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:58.375455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:58.376645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.378340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:58.379762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.390035 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57e79749-a6af-45c0-9785-4d0c393fb15d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1646 microversion: 2.1 time: 0.487226 Dec 18 20:48:58.392080 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 389/767] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:57 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1646 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:58.397169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:58.397789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:58.408793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:58.409311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.410644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:58.411089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.416561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:48:58.512881 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4deeff6c-0022-4724-ae3a-85f3076dfd2c tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 204 len: 0 microversion: 2.1 time: 0.154724 Dec 18 20:48:58.514812 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 379/768] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:48:58 2021] DELETE /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:48:58.522812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-94bb5ce0-83e6-47f3-924a-ae227e979da3 req-e6cd9aa3-4401-401e-a9e6-0604a851b3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919e413a-66ad-40fb-aad2-6d3392c35439", "name": "network-vif-plugged", "status": "completed", "tag": "c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:58.527115 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:58.527115 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:58.536390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-94bb5ce0-83e6-47f3-924a-ae227e979da3 req-e6cd9aa3-4401-401e-a9e6-0604a851b3f1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:58.537153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-94bb5ce0-83e6-47f3-924a-ae227e979da3 req-e6cd9aa3-4401-401e-a9e6-0604a851b3f1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.551244 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-94bb5ce0-83e6-47f3-924a-ae227e979da3 req-e6cd9aa3-4401-401e-a9e6-0604a851b3f1 service nova] Creating event network-vif-plugged:c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a for instance 919e413a-66ad-40fb-aad2-6d3392c35439 on nch2-master-1 Dec 18 20:48:58.556973 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-94bb5ce0-83e6-47f3-924a-ae227e979da3 req-e6cd9aa3-4401-401e-a9e6-0604a851b3f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040452 Dec 18 20:48:58.558431 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 380/769] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:48:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:58.567495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c56243f-73ff-498e-881e-f1ebe51d5489 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:58.568859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c56243f-73ff-498e-881e-f1ebe51d5489 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:58.577074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c56243f-73ff-498e-881e-f1ebe51d5489 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:58.577741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c56243f-73ff-498e-881e-f1ebe51d5489 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.578790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c56243f-73ff-498e-881e-f1ebe51d5489 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:58.579412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c56243f-73ff-498e-881e-f1ebe51d5489 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:58.632862 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c56243f-73ff-498e-881e-f1ebe51d5489 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 24567 microversion: 2.1 time: 0.072705 Dec 18 20:48:58.634944 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 381/770] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:58 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:48:58.642947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-378b68cf-5a28-4e00-880c-67346ab9f965 tempest-FlavorsV2NegativeTest-1391637449 tempest-FlavorsV2NegativeTest-1391637449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1991455290", "imageRef": "3723ab8d-99a5-4bec-84fe-7941997318bb", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:58.719616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-378b68cf-5a28-4e00-880c-67346ab9f965 tempest-FlavorsV2NegativeTest-1391637449 tempest-FlavorsV2NegativeTest-1391637449-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:48:58.733740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:58.748827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:58.753608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:58.760606 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af0755fc-97dc-416a-b118-b63d1709433c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1362 microversion: 2.25 time: 0.367707 Dec 18 20:48:58.771984 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 390/771] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:48:58 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:48:58.779776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41f44933-7de4-45e5-bdb2-27d0b4a354bf tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] Calling method '.version_select at 0x7f715c0f3940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:59.173283 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-378b68cf-5a28-4e00-880c-67346ab9f965 tempest-FlavorsV2NegativeTest-1391637449 tempest-FlavorsV2NegativeTest-1391637449-project] HTTP exception thrown: Flavor's memory is too small for requested image. Dec 18 20:48:59.178498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-378b68cf-5a28-4e00-880c-67346ab9f965 tempest-FlavorsV2NegativeTest-1391637449 tempest-FlavorsV2NegativeTest-1391637449-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:48:59.180672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-378b68cf-5a28-4e00-880c-67346ab9f965 tempest-FlavorsV2NegativeTest-1391637449 tempest-FlavorsV2NegativeTest-1391637449-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.544126 Dec 18 20:48:59.182647 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 382/772] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:48:58 2021] POST /compute/v2.1/servers => generated 93 bytes in 547 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:59.211498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89a4fe2d-776a-4374-bd53-83acea624be4 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:59.213014 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:48:59.213014 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:48:59.228333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89a4fe2d-776a-4374-bd53-83acea624be4 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:59.228937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89a4fe2d-776a-4374-bd53-83acea624be4 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:59.229966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89a4fe2d-776a-4374-bd53-83acea624be4 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:59.232576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89a4fe2d-776a-4374-bd53-83acea624be4 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:59.288960 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41f44933-7de4-45e5-bdb2-27d0b4a354bf tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.517428 Dec 18 20:48:59.289592 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 391/773] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Dec 18 20:48:58 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:59.301279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:59.301493 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89a4fe2d-776a-4374-bd53-83acea624be4 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.114929 Dec 18 20:48:59.302278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:59.302435 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 383/774] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:48:59 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:48:59.307949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d43d8fd-eec9-4990-a393-dda40e5a2212 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Calling method '.version_select at 0x7f714fb9b3a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:48:59.323140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:59.323857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:59.324911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:59.325571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:59.703952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:48:59.721223 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43021111-e7c1-4886-93ce-64f328918a1d tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1470 microversion: 2.1 time: 0.423528 Dec 18 20:48:59.725169 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 392/775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:48:59 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:48:59.910194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d43d8fd-eec9-4990-a393-dda40e5a2212 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a9f65829-6e39-4f58-a57a-55cb96beb7aa" status: 202 len: 0 microversion: 2.1 time: 0.606066 Dec 18 20:48:59.913991 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 384/776] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:48:59 2021] DELETE /compute/v2.1/os-security-groups/a9f65829-6e39-4f58-a57a-55cb96beb7aa => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:48:59.919441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-096bc9af-2ffb-4d95-bea9-bffd2d9f8956 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:48:59.920520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-096bc9af-2ffb-4d95-bea9-bffd2d9f8956 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:48:59.932355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-096bc9af-2ffb-4d95-bea9-bffd2d9f8956 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:59.934327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-096bc9af-2ffb-4d95-bea9-bffd2d9f8956 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:48:59.935614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-096bc9af-2ffb-4d95-bea9-bffd2d9f8956 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:48:59.936824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-096bc9af-2ffb-4d95-bea9-bffd2d9f8956 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:00.014236 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fbf20c35-e5fd-44fb-83e9-901e48bbcc3e tempest-TenantUsagesNegativeTestJSON-1250801839 tempest-TenantUsagesNegativeTestJSON-1250801839-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/?start=2021-12-17T20%3A48%3A59.597647&end=2021-12-19T20%3A48%3A59.597647" status: 404 len: 112 microversion: - time: 0.272028 Dec 18 20:49:00.015208 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 393/777] 10.222.0.13 () {58 vars in 1315 bytes} [Sat Dec 18 20:48:59 2021] GET /compute/v2.1/os-simple-tenant-usage/?start=2021-12-17T20%3A48%3A59.597647&end=2021-12-19T20%3A48%3A59.597647 => generated 112 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 18 20:49:00.022630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:00.023489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:00.029949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:00.030758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:00.031560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:00.032007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:00.046694 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-096bc9af-2ffb-4d95-bea9-bffd2d9f8956 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 24567 microversion: 2.1 time: 0.131968 Dec 18 20:49:00.048124 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 385/778] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:48:59 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 24567 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:00.058447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dbb41633-e8c0-4eca-85e1-6767f27d44b3 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] Calling method '.version_select at 0x7f714fb9b5e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:00.721285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:00.732322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:00.741311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:00.743568 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72199a2c-1106-4357-9704-858aecb4f0ec tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1362 microversion: 2.25 time: 0.725886 Dec 18 20:49:00.746525 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 394/779] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:00 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1362 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:00.763744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2cd4a4fc-aab7-4dd6-8e08-553729b067a7 tempest-TenantUsagesNegativeTestJSON-1250801839 tempest-TenantUsagesNegativeTestJSON-1250801839-project-admin] Calling method '.version_select at 0x7f715c45c550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:00.769226 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2cd4a4fc-aab7-4dd6-8e08-553729b067a7 tempest-TenantUsagesNegativeTestJSON-1250801839 tempest-TenantUsagesNegativeTestJSON-1250801839-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Dec 18 20:49:00.782929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2cd4a4fc-aab7-4dd6-8e08-553729b067a7 tempest-TenantUsagesNegativeTestJSON-1250801839 tempest-TenantUsagesNegativeTestJSON-1250801839-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:00.783856 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2cd4a4fc-aab7-4dd6-8e08-553729b067a7 tempest-TenantUsagesNegativeTestJSON-1250801839 tempest-TenantUsagesNegativeTestJSON-1250801839-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/be2f5d36556d48e0bcdb394734abe821?start=2021-12-19T20%3A48%3A59.597647&end=2021-12-17T20%3A48%3A59.597647" status: 400 len: 111 microversion: 2.1 time: 0.026309 Dec 18 20:49:00.785328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 395/780] 10.222.0.13 () {58 vars in 1411 bytes} [Sat Dec 18 20:49:00 2021] GET /compute/v2.1/os-simple-tenant-usage/be2f5d36556d48e0bcdb394734abe821?start=2021-12-19T20%3A48%3A59.597647&end=2021-12-17T20%3A48%3A59.597647 => generated 111 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:00.790623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:00.791469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:00.816724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:00.817407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:00.818479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:00.818929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.071307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dbb41633-e8c0-4eca-85e1-6767f27d44b3 tempest-SecurityGroupsTestAdminJSON-189086235 tempest-SecurityGroupsTestAdminJSON-189086235-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b575167c-23fb-43d1-a9ff-8e2729ec8903" status: 202 len: 0 microversion: 2.1 time: 1.019520 Dec 18 20:49:01.072042 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 386/781] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:49:00 2021] DELETE /compute/v2.1/os-security-groups/b575167c-23fb-43d1-a9ff-8e2729ec8903 => generated 0 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:49:01.145390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a3244598f429fbe145939f9624206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e459a051d234475b150b36857974efb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:01.160073 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d255b075-e494-4e12-837c-eda947ef9317 tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 200 len: 1470 microversion: 2.1 time: 0.368757 Dec 18 20:49:01.163458 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 396/782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:00 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 1470 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:01.175909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46a4ed97-0328-4e42-ace6-c68e2d603093 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f629430d-e738-4808-bf49-6063505a3490", "device": "/dev/xvdb"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:01.178953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46a4ed97-0328-4e42-ace6-c68e2d603093 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:01.187843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a4ed97-0328-4e42-ace6-c68e2d603093 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:01.193426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a4ed97-0328-4e42-ace6-c68e2d603093 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.194979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a4ed97-0328-4e42-ace6-c68e2d603093 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:01.197548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46a4ed97-0328-4e42-ace6-c68e2d603093 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.341523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78a0ae36-b9e6-43c8-b59a-2da8c42bbc00 tempest-TenantUsagesNegativeTestJSON-1658024984 tempest-TenantUsagesNegativeTestJSON-1658024984-project] Calling method '.version_select at 0x7f714fb32e50>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:01.343116 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:01.343116 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:01.344169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-78a0ae36-b9e6-43c8-b59a-2da8c42bbc00 tempest-TenantUsagesNegativeTestJSON-1658024984 tempest-TenantUsagesNegativeTestJSON-1658024984-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '766553a35835435f9d4daf760058b82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2f5d36556d48e0bcdb394734abe821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:01.345050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78a0ae36-b9e6-43c8-b59a-2da8c42bbc00 tempest-TenantUsagesNegativeTestJSON-1658024984 tempest-TenantUsagesNegativeTestJSON-1658024984-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:01.345861 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78a0ae36-b9e6-43c8-b59a-2da8c42bbc00 tempest-TenantUsagesNegativeTestJSON-1658024984 tempest-TenantUsagesNegativeTestJSON-1658024984-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-17T20%3A48%3A59.597647&end=2021-12-19T20%3A48%3A59.597647&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.272852 Dec 18 20:49:01.346432 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 387/783] 10.222.0.13 () {58 vars in 1334 bytes} [Sat Dec 18 20:49:01 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-17T20%3A48%3A59.597647&end=2021-12-19T20%3A48%3A59.597647&detailed=1 => generated 123 bytes in 274 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:01.356807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1131358-648d-44b4-af66-9738b1b9725b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:01.360931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1131358-648d-44b4-af66-9738b1b9725b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:01.378602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1131358-648d-44b4-af66-9738b1b9725b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:01.379975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1131358-648d-44b4-af66-9738b1b9725b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.383222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1131358-648d-44b4-af66-9738b1b9725b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:01.385637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1131358-648d-44b4-af66-9738b1b9725b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.479148 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1131358-648d-44b4-af66-9738b1b9725b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 24567 microversion: 2.1 time: 0.126043 Dec 18 20:49:01.480319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 388/784] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:01 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 24567 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:01.490495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-110230d4-4c52-42d5-b897-278e780512de tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] Calling method '.version_select at 0x7f714fb9bd30>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:01.599841 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46a4ed97-0328-4e42-ace6-c68e2d603093 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "POST /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432768 Dec 18 20:49:01.605560 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 397/785] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 20:49:01 2021] POST /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:01.630668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b10d5453-310e-4c9e-a141-4ab48c557cf4 req-80415a15-5df0-46dd-be6a-671a16bb1cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42214d7-4bc6-41e2-86d4-b9847894de7b", "name": "network-vif-deleted", "tag": "6e9be9b3-0f89-4ed8-b239-a85df360079d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:01.640797 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:01.640797 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:01.649366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b10d5453-310e-4c9e-a141-4ab48c557cf4 req-80415a15-5df0-46dd-be6a-671a16bb1cb3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:01.649827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b10d5453-310e-4c9e-a141-4ab48c557cf4 req-80415a15-5df0-46dd-be6a-671a16bb1cb3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.663677 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b10d5453-310e-4c9e-a141-4ab48c557cf4 req-80415a15-5df0-46dd-be6a-671a16bb1cb3 service nova] Creating event network-vif-deleted:6e9be9b3-0f89-4ed8-b239-a85df360079d for instance d42214d7-4bc6-41e2-86d4-b9847894de7b on nch1-master-1 Dec 18 20:49:01.669130 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b10d5453-310e-4c9e-a141-4ab48c557cf4 req-80415a15-5df0-46dd-be6a-671a16bb1cb3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062054 Dec 18 20:49:01.669735 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 398/786] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:01.764945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:01.765645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:01.777424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:01.777888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.778730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:01.779178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:01.947833 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-110230d4-4c52-42d5-b897-278e780512de tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/68821248-001c-401e-9b75-881cc1ec9fda" status: 202 len: 0 microversion: 2.1 time: 0.465883 Dec 18 20:49:01.951380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 389/787] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:49:01 2021] DELETE /compute/v2.1/os-security-groups/68821248-001c-401e-9b75-881cc1ec9fda => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:49:01.958372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed7bff8e-d506-4ebe-8da7-0f3f19f30967 tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] Calling method '.version_select at 0x7f715daf2af0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:02.116843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:02.135169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:02.142796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:02.146964 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81df7fc6-955b-4385-8365-62b9a5c87cd5 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1557 microversion: 2.25 time: 0.386406 Dec 18 20:49:02.149700 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 399/788] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:01 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1557 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:49:02.172327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:02.173277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:02.195138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.198600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.199657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.204332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.435509 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed7bff8e-d506-4ebe-8da7-0f3f19f30967 tempest-SecurityGroupsTestAdminJSON-166934568 tempest-SecurityGroupsTestAdminJSON-166934568-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/64b31196-3a5f-4e53-b9b3-b01431dcc38b" status: 202 len: 0 microversion: 2.1 time: 0.482552 Dec 18 20:49:02.436872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 390/789] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:49:01 2021] DELETE /compute/v2.1/os-security-groups/64b31196-3a5f-4e53-b9b3-b01431dcc38b => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:49:02.446581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:02.447705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] [instance: d42214d7-4bc6-41e2-86d4-b9847894de7b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:02.455137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.459050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.459956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.460410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.479283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 919e413a-66ad-40fb-aad2-6d3392c35439 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:02.482341 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] HTTP exception thrown: Instance d42214d7-4bc6-41e2-86d4-b9847894de7b could not be found. Dec 18 20:49:02.483752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] Returning 404 to user: Instance d42214d7-4bc6-41e2-86d4-b9847894de7b could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:02.485252 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a74090a-e2c5-4979-9d55-ece3cfeed8ec tempest-TenantUsagesTestJSON-1887380063 tempest-TenantUsagesTestJSON-1887380063-project] 10.222.0.13 "GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b" status: 404 len: 111 microversion: 2.1 time: 0.047066 Dec 18 20:49:02.486599 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 391/790] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:02 2021] GET /compute/v2.1/servers/d42214d7-4bc6-41e2-86d4-b9847894de7b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:02.498608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-208b9e59-0b78-4c48-ace4-3f457276a168 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:02.501355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-208b9e59-0b78-4c48-ace4-3f457276a168 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:02.508242 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6636e1a3-6d00-4b35-a3e5-918276fa8e87 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 2050 microversion: 2.25 time: 0.345522 Dec 18 20:49:02.509416 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 400/791] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:02 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 2050 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:49:02.522424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-208b9e59-0b78-4c48-ace4-3f457276a168 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.523073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-208b9e59-0b78-4c48-ace4-3f457276a168 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.524170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-208b9e59-0b78-4c48-ace4-3f457276a168 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.524768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-208b9e59-0b78-4c48-ace4-3f457276a168 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.527823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c381915b-820a-44b0-b4d2-a5fe574dc324 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:02.530159 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:02.530159 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:02.531954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c381915b-820a-44b0-b4d2-a5fe574dc324 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.532687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c381915b-820a-44b0-b4d2-a5fe574dc324 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.533635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c381915b-820a-44b0-b4d2-a5fe574dc324 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:02.535350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c381915b-820a-44b0-b4d2-a5fe574dc324 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:02.572351 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c381915b-820a-44b0-b4d2-a5fe574dc324 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050357 Dec 18 20:49:02.573253 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 401/792] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Dec 18 20:49:02 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:49:02.604171 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-208b9e59-0b78-4c48-ace4-3f457276a168 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 24567 microversion: 2.1 time: 0.114699 Dec 18 20:49:02.604826 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 392/793] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:02 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 24567 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:03.617169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-08d1fe16-db41-4f18-a54a-87bb7487ebec tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:03.618083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-08d1fe16-db41-4f18-a54a-87bb7487ebec tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:03.638670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d1fe16-db41-4f18-a54a-87bb7487ebec tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:03.642712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d1fe16-db41-4f18-a54a-87bb7487ebec tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:03.643687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d1fe16-db41-4f18-a54a-87bb7487ebec tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:03.644139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d1fe16-db41-4f18-a54a-87bb7487ebec tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:03.737947 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-08d1fe16-db41-4f18-a54a-87bb7487ebec tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.124632 Dec 18 20:49:03.738761 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 402/794] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:03 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:04.439905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bccc95da-208f-4121-b00e-ae0b389102aa tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f2dfe88-6eae-4206-aa00-4d39eb37326e", "device": "/dev/xvdb"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:04.441374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bccc95da-208f-4121-b00e-ae0b389102aa tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:04.455631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bccc95da-208f-4121-b00e-ae0b389102aa tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:04.457799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bccc95da-208f-4121-b00e-ae0b389102aa tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:04.462359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bccc95da-208f-4121-b00e-ae0b389102aa tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:04.464538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bccc95da-208f-4121-b00e-ae0b389102aa tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:04.513357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1157054301", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:04.634953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:49:04.868566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bccc95da-208f-4121-b00e-ae0b389102aa tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "POST /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.433299 Dec 18 20:49:04.878921 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 403/795] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Dec 18 20:49:04 2021] POST /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:04.888557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-258f9f87-60f0-4c33-b67e-f4ea2888c83f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:04.894449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-258f9f87-60f0-4c33-b67e-f4ea2888c83f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:04.905712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-258f9f87-60f0-4c33-b67e-f4ea2888c83f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:04.906162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-258f9f87-60f0-4c33-b67e-f4ea2888c83f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:04.906988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-258f9f87-60f0-4c33-b67e-f4ea2888c83f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:04.907425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-258f9f87-60f0-4c33-b67e-f4ea2888c83f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:04.995112 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-258f9f87-60f0-4c33-b67e-f4ea2888c83f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.114408 Dec 18 20:49:04.998740 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 404/796] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:04 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:05.115102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:49:05.115547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:49:05.115975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:49:05.116573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:49:05.117139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:49:05.130941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:05.134184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:05.135262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:05.136582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:05.183540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Getting quotas for project 89a9543eaffc44858c8674e4b6f660cf. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:05.195392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Getting quotas for user 472035f568124561bde5223c47dd07be and project 89a9543eaffc44858c8674e4b6f660cf. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:05.222789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:49:05.226623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:05.318364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52016341-e75f-445e-abbe-9b8e598f3274 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214076 Dec 18 20:49:05.334184 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 393/797] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:49:05.341097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c49bcb3-ee0b-4c42-ab67-2746c40f60e8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:05.341927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c49bcb3-ee0b-4c42-ab67-2746c40f60e8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:05.500723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4c49bcb3-ee0b-4c42-ab67-2746c40f60e8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:05.514884 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c49bcb3-ee0b-4c42-ab67-2746c40f60e8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1216 microversion: 2.1 time: 0.179328 Dec 18 20:49:05.517715 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 405/798] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:05 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:06.007366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3816b410-b046-4aff-b732-d3a2540d6f66 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:06.019726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3816b410-b046-4aff-b732-d3a2540d6f66 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:06.045181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3816b410-b046-4aff-b732-d3a2540d6f66 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:06.046599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3816b410-b046-4aff-b732-d3a2540d6f66 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:06.055188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3816b410-b046-4aff-b732-d3a2540d6f66 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:06.057917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3816b410-b046-4aff-b732-d3a2540d6f66 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:06.215642 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3816b410-b046-4aff-b732-d3a2540d6f66 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.212619 Dec 18 20:49:06.217951 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 394/799] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:06 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:06.532359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:06.532947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:06.558222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:06.558748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:06.559587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:06.560022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:06.717501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:06.727585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60966a73-7973-4b14-a3c1-f29e3da352c8 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1212 microversion: 2.1 time: 0.197342 Dec 18 20:49:06.728145 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 406/800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:06 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1212 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:06.778551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-47d01c2f-7a57-4416-840f-11f40c42979a tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:06.780564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-47d01c2f-7a57-4416-840f-11f40c42979a tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:06.796517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47d01c2f-7a57-4416-840f-11f40c42979a tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:06.802421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47d01c2f-7a57-4416-840f-11f40c42979a tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:06.803524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47d01c2f-7a57-4416-840f-11f40c42979a tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:06.808514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47d01c2f-7a57-4416-840f-11f40c42979a tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.233701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-16abcb19-a1f5-4d79-955a-996c1e900983 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:07.235663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-16abcb19-a1f5-4d79-955a-996c1e900983 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:07.255378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16abcb19-a1f5-4d79-955a-996c1e900983 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.255890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16abcb19-a1f5-4d79-955a-996c1e900983 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.256642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16abcb19-a1f5-4d79-955a-996c1e900983 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.257092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16abcb19-a1f5-4d79-955a-996c1e900983 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.299183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-47d01c2f-7a57-4416-840f-11f40c42979a tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1692 microversion: 2.1 time: 0.525640 Dec 18 20:49:07.300291 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 395/801] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:06 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1692 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:07.356872 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-16abcb19-a1f5-4d79-955a-996c1e900983 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.129105 Dec 18 20:49:07.358407 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 407/802] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:07 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:07.366926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:07.368995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:07.383783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.388696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.392325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.393202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.435992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lazy-loading 'flavor' on Instance uuid db3c9fff-7539-4d85-9102-827366dbb6cd {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:07.451844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Going to try to live migrate instance to nch2-master-1 {{(pid=140731) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:49:07.694064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e55c10d5-0e24-48e0-809b-785d6ffedde3 tempest-AZV2TestJSON-1651356543 tempest-AZV2TestJSON-1651356543-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:07.695995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e55c10d5-0e24-48e0-809b-785d6ffedde3 tempest-AZV2TestJSON-1651356543 tempest-AZV2TestJSON-1651356543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.696195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e55c10d5-0e24-48e0-809b-785d6ffedde3 tempest-AZV2TestJSON-1651356543 tempest-AZV2TestJSON-1651356543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.697022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e55c10d5-0e24-48e0-809b-785d6ffedde3 tempest-AZV2TestJSON-1651356543 tempest-AZV2TestJSON-1651356543-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.697465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e55c10d5-0e24-48e0-809b-785d6ffedde3 tempest-AZV2TestJSON-1651356543 tempest-AZV2TestJSON-1651356543-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.744405 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e55c10d5-0e24-48e0-809b-785d6ffedde3 tempest-AZV2TestJSON-1651356543 tempest-AZV2TestJSON-1651356543-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.442877 Dec 18 20:49:07.745190 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 396/803] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Dec 18 20:49:07 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:49:07.755624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:07.758333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:07.789644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.790104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.792010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:07.793366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:07.987248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:08.006303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f6fdb99b-7ae8-4a48-83e5-2928e52a0b5c tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1274 microversion: 2.1 time: 0.259840 Dec 18 20:49:08.009512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 397/804] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:07 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:08.370316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a61debaf-74c8-4e6a-8ee2-aafbf67c9031 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:08.372268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a61debaf-74c8-4e6a-8ee2-aafbf67c9031 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:08.384037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a61debaf-74c8-4e6a-8ee2-aafbf67c9031 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:08.390895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a61debaf-74c8-4e6a-8ee2-aafbf67c9031 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:08.396114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a61debaf-74c8-4e6a-8ee2-aafbf67c9031 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:08.400879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a61debaf-74c8-4e6a-8ee2-aafbf67c9031 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:08.488578 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a61debaf-74c8-4e6a-8ee2-aafbf67c9031 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.123200 Dec 18 20:49:08.494054 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 398/805] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:08 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:08.500130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:08.501177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:08.509907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:08.510874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:08.512219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:08.513228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:09.007001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 919e413a-66ad-40fb-aad2-6d3392c35439 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:09.037525 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11bd99cf-ea49-4be0-90b4-a2bb15cf11ec tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 2128 microversion: 2.25 time: 0.541769 Dec 18 20:49:09.039100 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 399/806] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:08 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 2128 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:09.207265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-223039027", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:09.303516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:49:10.267095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:49:10.268262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:49:10.268743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:49:10.270307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:49:10.270661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:49:10.295923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:10.299837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:10.302975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:10.303635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:10.369008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:10.374654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:10.400174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:49:10.404748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:10.496115 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6937100-6270-4772-b170-6dc699bfae4e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455527 Dec 18 20:49:10.496758 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 400/807] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:49:10.501751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:10.502658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:10.514565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:10.516676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:10.517677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:10.518337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.356058 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a566bb05-f8dd-4044-b71e-10b8b138af8d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/action" status: 202 len: 0 microversion: 2.1 time: 3.995968 Dec 18 20:49:11.357669 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 408/808] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:07 2021] POST /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/action => generated 0 bytes in 3999 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:49:11.376528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:11.380371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:11.409478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.423076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.426757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.427316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.439876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:11.447414 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4bdf194-10fe-465e-8431-5f9c4a695c8e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1316 microversion: 2.1 time: 0.949011 Dec 18 20:49:11.462628 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 401/809] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:10 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1316 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:11.478547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea78cb86-52a4-4909-8572-5feb6fb27f7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:11.489900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ea78cb86-52a4-4909-8572-5feb6fb27f7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:11.514196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea78cb86-52a4-4909-8572-5feb6fb27f7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.519160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea78cb86-52a4-4909-8572-5feb6fb27f7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.521368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea78cb86-52a4-4909-8572-5feb6fb27f7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.521921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea78cb86-52a4-4909-8572-5feb6fb27f7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.543097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'flavor' on Instance uuid 919e413a-66ad-40fb-aad2-6d3392c35439 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:11.583142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Going to try to live migrate instance to nch1-master-1 {{(pid=140731) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:49:11.607208 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ea78cb86-52a4-4909-8572-5feb6fb27f7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.142968 Dec 18 20:49:11.615481 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 402/810] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:11 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:11.624868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:11.627057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:11.641193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.654976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.656202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.656866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.857766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:11.870757 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed5ddc0a-f877-41f3-9ca8-8aa9e52689d5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1212 microversion: 2.1 time: 0.251492 Dec 18 20:49:11.879064 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 403/811] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:11 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1212 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:11.886983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:11.886983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:11.897750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.898599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:11.899621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:11.900267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:12.637217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:12.649854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8097995f-293e-4fe7-b8ff-42670b10b3b0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1551 microversion: 2.1 time: 0.769710 Dec 18 20:49:12.650657 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 404/812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:11 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1551 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:12.656194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:12.656970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:12.664614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:12.665573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:12.666703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:12.667457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:13.678316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:13.686444 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da478710-e05d-4a97-a128-4d8b3ed9f98d tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1316 microversion: 2.1 time: 1.034267 Dec 18 20:49:13.697134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 405/813] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:12 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1316 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:13.702295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f2dd782-282b-4443-a1a6-6888961afe9b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:13.704206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f2dd782-282b-4443-a1a6-6888961afe9b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:13.720252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f2dd782-282b-4443-a1a6-6888961afe9b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:13.721242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f2dd782-282b-4443-a1a6-6888961afe9b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:13.722342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f2dd782-282b-4443-a1a6-6888961afe9b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:13.722971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f2dd782-282b-4443-a1a6-6888961afe9b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:13.773423 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f2dd782-282b-4443-a1a6-6888961afe9b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.074699 Dec 18 20:49:13.774970 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 406/814] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:13 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:13.983288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5814c825-bea4-4392-94a9-b34516f8ced1 tempest-FloatingIPDetailsNegativeTestJSON-11658323 tempest-FloatingIPDetailsNegativeTestJSON-11658323-project] Calling method '.version_select at 0x7f714fa7be50>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:14.135082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-5814c825-bea4-4392-94a9-b34516f8ced1 tempest-FloatingIPDetailsNegativeTestJSON-11658323 tempest-FloatingIPDetailsNegativeTestJSON-11658323-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cf2191c6-f538-4798-91a6-5f4e76c0d630 could not be found", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:49:14.136082 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5814c825-bea4-4392-94a9-b34516f8ced1 tempest-FloatingIPDetailsNegativeTestJSON-11658323 tempest-FloatingIPDetailsNegativeTestJSON-11658323-project] HTTP exception thrown: Floating IP not found for ID cf2191c6-f538-4798-91a6-5f4e76c0d630 Dec 18 20:49:14.136685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5814c825-bea4-4392-94a9-b34516f8ced1 tempest-FloatingIPDetailsNegativeTestJSON-11658323 tempest-FloatingIPDetailsNegativeTestJSON-11658323-project] Returning 404 to user: Floating IP not found for ID cf2191c6-f538-4798-91a6-5f4e76c0d630 {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:14.137683 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5814c825-bea4-4392-94a9-b34516f8ced1 tempest-FloatingIPDetailsNegativeTestJSON-11658323 tempest-FloatingIPDetailsNegativeTestJSON-11658323-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/cf2191c6-f538-4798-91a6-5f4e76c0d630" status: 404 len: 111 microversion: 2.1 time: 0.361414 Dec 18 20:49:14.138276 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 407/815] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:49:13 2021] GET /compute/v2.1/os-floating-ips/cf2191c6-f538-4798-91a6-5f4e76c0d630 => generated 111 bytes in 363 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:14.145392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:14.146131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:14.156048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:14.156642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:14.158640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:14.159471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:14.307624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:14.317903 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ac034e7-11b3-42dd-bbd7-08f721432730 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1274 microversion: 2.1 time: 0.178321 Dec 18 20:49:14.328712 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 408/816] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:14 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:14.394152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-465163954", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "f8fc58a9-9fb6-4f40-9b3d-5ec7ce0e7211"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:14.459138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] validate_networks() for [('f8fc58a9-9fb6-4f40-9b3d-5ec7ce0e7211', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:49:15.134558 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5eadd404-98f6-445b-bc1a-5058029eb83e tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/action" status: 202 len: 0 microversion: 2.25 time: 3.773753 Dec 18 20:49:15.135934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 409/817] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:49:11 2021] POST /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/action => generated 0 bytes in 3777 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:15.146856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:15.148075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:15.160458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:15.161352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:15.162739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:15.163440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.003494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:16.013004 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1087316-4f36-479e-ac56-a54e354d6256 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1551 microversion: 2.1 time: 0.875662 Dec 18 20:49:16.016882 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 410/818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:15 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1551 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:16.046979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:16.050156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:16.064339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.066641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.067473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.067914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.243119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:49:16.243690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:49:16.244056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:49:16.244641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:49:16.245199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:49:16.256267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.257006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.258072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.258730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.278848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Getting quotas for project 738d51b548fb479f889bd3bb54ca33d5. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:16.285462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Getting quotas for user e2857cd622364f4db1c1bc7b6065f9ba and project 738d51b548fb479f889bd3bb54ca33d5. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:16.301046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Going to run 3 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:49:16.304650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:16.343437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:16.396967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=cb62603f-da79-4c9b-adf0-119ab616bbb3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:16.589090 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5564da85-57d3-435b-913f-8edc75e4f44c tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.258072 Dec 18 20:49:16.590847 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 409/819] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:49:16.606854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f1fbadb-a341-4ca9-b6aa-bad5d2977ad7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:16.608402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f1fbadb-a341-4ca9-b6aa-bad5d2977ad7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:16.621502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1fbadb-a341-4ca9-b6aa-bad5d2977ad7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.624081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1fbadb-a341-4ca9-b6aa-bad5d2977ad7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.628254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1fbadb-a341-4ca9-b6aa-bad5d2977ad7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.630962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1fbadb-a341-4ca9-b6aa-bad5d2977ad7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.650790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:16.667946 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46468cf3-cd70-4276-9efe-4bcfdd4eed16 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1316 microversion: 2.1 time: 0.649731 Dec 18 20:49:16.671064 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 411/820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:16 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:16.698388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ecbad130-fd8a-4348-a610-d1f60725b11b req-6ffa88d3-4fe5-434e-b056-f76f94a8bd1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae440d5-c58e-40af-bb73-73999aa7b795", "tag": "6558f70a-e9c0-470e-9b2d-8f8a5896b942"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:16.708632 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:16.708632 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:16.735526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ecbad130-fd8a-4348-a610-d1f60725b11b req-6ffa88d3-4fe5-434e-b056-f76f94a8bd1a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.736610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ecbad130-fd8a-4348-a610-d1f60725b11b req-6ffa88d3-4fe5-434e-b056-f76f94a8bd1a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.758673 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ecbad130-fd8a-4348-a610-d1f60725b11b req-6ffa88d3-4fe5-434e-b056-f76f94a8bd1a service nova] Creating event network-changed:6558f70a-e9c0-470e-9b2d-8f8a5896b942 for instance 1ae440d5-c58e-40af-bb73-73999aa7b795 on nch1-master-1 Dec 18 20:49:16.763483 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f1fbadb-a341-4ca9-b6aa-bad5d2977ad7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.169142 Dec 18 20:49:16.767516 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 410/821] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:16 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:16.767694 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ecbad130-fd8a-4348-a610-d1f60725b11b req-6ffa88d3-4fe5-434e-b056-f76f94a8bd1a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093040 Dec 18 20:49:16.767694 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 412/822] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:16.776846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:16.779205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:16.781965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:16.788318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:16.789316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.790178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.791229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.792861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.821120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.821120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:16.833050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:16.833542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:17.401195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:17.410983 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d9516c9-d8e8-425e-988e-3d6f98e0611e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1274 microversion: 2.1 time: 0.641613 Dec 18 20:49:17.411557 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 413/823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:16 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1274 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:17.435165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:17.441100 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:17.441100 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:17.442692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:17.455739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:17.500376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:17.503171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:17.504820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:17.508040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:17.812614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Listed batch of 1 results from cell out of 997 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:49:18.087741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:18.105556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:18.107565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:18.112344 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5309a796-6afd-4d94-898e-f45c443751e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1645 microversion: 2.25 time: 1.345599 Dec 18 20:49:18.129192 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 411/824] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:16 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1645 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:18.144555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:18.147544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:18.154734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Listed batch of 1 results from cell out of 997 limit. Returned 2 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:49:18.164167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:18.166762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:18.167808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:18.168345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:18.217048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-456eff07-b86c-4b75-bd46-727d2b556ace tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.783441 Dec 18 20:49:18.219318 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 414/825] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:49:17 2021] GET /compute/v2.1/servers => generated 1015 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:18.230676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:18.232118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:18.245037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:18.245736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:18.246806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:18.247664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:19.442117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:19.456608 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f7ea990b-4a12-498a-9c07-510d67eb0691 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1551 microversion: 2.1 time: 1.325588 Dec 18 20:49:19.471240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 412/826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:18 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1551 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:19.476648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-582a66af-6617-4628-8985-481533be38d9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:19.478053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-582a66af-6617-4628-8985-481533be38d9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:19.503924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-582a66af-6617-4628-8985-481533be38d9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:19.504434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-582a66af-6617-4628-8985-481533be38d9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:19.506975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-582a66af-6617-4628-8985-481533be38d9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:19.507320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-582a66af-6617-4628-8985-481533be38d9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:19.594682 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-582a66af-6617-4628-8985-481533be38d9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.121249 Dec 18 20:49:19.596560 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 413/827] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:19 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:19.606894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:19.609889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:19.627713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:19.628183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:19.629689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:19.630146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:20.088263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:20.104361 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-386be3df-4c0b-4b70-b00d-948ce70284cc tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1274 microversion: 2.1 time: 0.506552 Dec 18 20:49:20.112196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:20.113364 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 414/828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:19 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1274 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:20.120216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:20.130803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:20.137156 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c2a6918b-ee47-46f6-9d8b-741d44eb71df tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1316 microversion: 2.1 time: 1.914460 Dec 18 20:49:20.138537 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 415/829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:18 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1316 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:20.154351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:20.154804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:20.159919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:20.160965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:20.161763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:20.169697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:20.186836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:20.192918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:20.195927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:20.197724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:21.791814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:21.802644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:21.804831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:21.808113 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ec4c958-c510-4e2c-b769-472a8915a66d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1645 microversion: 2.25 time: 1.666518 Dec 18 20:49:21.809057 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 416/830] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:20 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1645 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:21.815398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-23099637-2c7c-49d6-ba48-28e3a38f5497 req-6dfb2e84-59e8-47e5-b28a-c79c305211ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3c9fff-7539-4d85-9102-827366dbb6cd", "name": "network-vif-unplugged", "status": "completed", "tag": "12a3229b-b407-4f8f-9557-f1a6978d54bb"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:21.817218 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:21.817218 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:21.850890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:21.859025 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7545d929-15bb-4adf-8617-fb721b92f0c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1316 microversion: 2.1 time: 1.744453 Dec 18 20:49:21.859862 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 415/831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:20 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1316 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:21.868734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-23099637-2c7c-49d6-ba48-28e3a38f5497 req-6dfb2e84-59e8-47e5-b28a-c79c305211ac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:21.868734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-23099637-2c7c-49d6-ba48-28e3a38f5497 req-6dfb2e84-59e8-47e5-b28a-c79c305211ac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:21.878922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:21.883209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:21.890591 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-23099637-2c7c-49d6-ba48-28e3a38f5497 req-6dfb2e84-59e8-47e5-b28a-c79c305211ac service nova] Creating event network-vif-unplugged:12a3229b-b407-4f8f-9557-f1a6978d54bb for instance db3c9fff-7539-4d85-9102-827366dbb6cd on nch1-master-1 Dec 18 20:49:21.899731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:21.900678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:21.900920 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-23099637-2c7c-49d6-ba48-28e3a38f5497 req-6dfb2e84-59e8-47e5-b28a-c79c305211ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090130 Dec 18 20:49:21.901995 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 417/832] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:21.906338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:21.907156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:21.908586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b0b69dfc-69bd-40db-aaf1-4561bea489db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:21.910284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b0b69dfc-69bd-40db-aaf1-4561bea489db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:21.921086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0b69dfc-69bd-40db-aaf1-4561bea489db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:21.921552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0b69dfc-69bd-40db-aaf1-4561bea489db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:21.922457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0b69dfc-69bd-40db-aaf1-4561bea489db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:21.922902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0b69dfc-69bd-40db-aaf1-4561bea489db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:21.988528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b0b69dfc-69bd-40db-aaf1-4561bea489db tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.084753 Dec 18 20:49:21.994744 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 418/833] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:21 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:22.021546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:22.022546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:22.046535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:22.047267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:22.059654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:22.060505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:22.298176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:22.307861 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c3c261b7-245e-4737-b194-2a8f97cbe91a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1280 microversion: 2.1 time: 0.311577 Dec 18 20:49:22.311056 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 419/834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:21 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:22.326749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:22.327618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:22.341236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:22.341982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:22.343018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:22.343652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:22.860036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:22.879595 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1103b4da-68ef-4d38-bf5f-de690ab7b508 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1551 microversion: 2.1 time: 1.007600 Dec 18 20:49:22.881817 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 416/835] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:21 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1551 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:22.893104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8f4b8a99-1b7b-4d17-9521-480a84551a3e req-0a6b9924-1cb3-40bf-9f1f-543475c3992a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919e413a-66ad-40fb-aad2-6d3392c35439", "name": "network-vif-unplugged", "status": "completed", "tag": "c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:22.899086 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:22.899086 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:22.926343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8f4b8a99-1b7b-4d17-9521-480a84551a3e req-0a6b9924-1cb3-40bf-9f1f-543475c3992a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:22.927153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8f4b8a99-1b7b-4d17-9521-480a84551a3e req-0a6b9924-1cb3-40bf-9f1f-543475c3992a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:22.963266 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8f4b8a99-1b7b-4d17-9521-480a84551a3e req-0a6b9924-1cb3-40bf-9f1f-543475c3992a service nova] Creating event network-vif-unplugged:c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a for instance 919e413a-66ad-40fb-aad2-6d3392c35439 on nch2-master-1 Dec 18 20:49:22.978561 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8f4b8a99-1b7b-4d17-9521-480a84551a3e req-0a6b9924-1cb3-40bf-9f1f-543475c3992a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091248 Dec 18 20:49:22.980861 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 417/836] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:22.992913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:22.999541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:23.012313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:23.012890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:23.014023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:23.015253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:23.114518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:23.125347 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3148fd23-f4ff-41cf-b6ff-58b1e9e0a135 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1316 microversion: 2.1 time: 0.808548 Dec 18 20:49:23.126105 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 420/837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:22 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1316 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:23.155510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:23.156273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:23.186492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:23.190702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:23.191964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:23.194580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:23.831119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:23.844751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:23.847211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:23.848922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b3855fe0-1695-491d-8262-888ad347a7b9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1645 microversion: 2.25 time: 0.866411 Dec 18 20:49:23.849486 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 418/838] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:22 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1645 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:23.868088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cbe14e6a-b55e-49cf-8f34-0fee57171b7b req-69cf01e1-ddbb-4d03-805b-f87daa77ae7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae440d5-c58e-40af-bb73-73999aa7b795", "name": "network-vif-plugged", "status": "completed", "tag": "6558f70a-e9c0-470e-9b2d-8f8a5896b942"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:23.870877 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:23.870877 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:23.878765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cbe14e6a-b55e-49cf-8f34-0fee57171b7b req-69cf01e1-ddbb-4d03-805b-f87daa77ae7f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:23.879315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cbe14e6a-b55e-49cf-8f34-0fee57171b7b req-69cf01e1-ddbb-4d03-805b-f87daa77ae7f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:23.891474 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cbe14e6a-b55e-49cf-8f34-0fee57171b7b req-69cf01e1-ddbb-4d03-805b-f87daa77ae7f service nova] Creating event network-vif-plugged:6558f70a-e9c0-470e-9b2d-8f8a5896b942 for instance 1ae440d5-c58e-40af-bb73-73999aa7b795 on nch1-master-1 Dec 18 20:49:23.899727 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cbe14e6a-b55e-49cf-8f34-0fee57171b7b req-69cf01e1-ddbb-4d03-805b-f87daa77ae7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036334 Dec 18 20:49:23.900431 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 419/839] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:23.905782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f0ac3d7b-b538-4b22-b6f2-f7ee2fd66d8f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:23.916380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f0ac3d7b-b538-4b22-b6f2-f7ee2fd66d8f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:23.927433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0ac3d7b-b538-4b22-b6f2-f7ee2fd66d8f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:23.927929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0ac3d7b-b538-4b22-b6f2-f7ee2fd66d8f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:23.928738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0ac3d7b-b538-4b22-b6f2-f7ee2fd66d8f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:23.929169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0ac3d7b-b538-4b22-b6f2-f7ee2fd66d8f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:23.985270 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f0ac3d7b-b538-4b22-b6f2-f7ee2fd66d8f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.082950 Dec 18 20:49:23.990971 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 420/840] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:23 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:23.998026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:23.999091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:24.008089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:24.008799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:24.009926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:24.011492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:24.015107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:24.029011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d31f27bc-9da5-4d99-99b6-d600e5488753 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1316 microversion: 2.1 time: 0.900668 Dec 18 20:49:24.031090 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 421/841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:23 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1316 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:24.172742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-beb222be-24e6-43e2-877f-21507ed31a8a tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f714ffc5e50>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:24.178061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-beb222be-24e6-43e2-877f-21507ed31a8a tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Dec 18 20:49:24.178666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-beb222be-24e6-43e2-877f-21507ed31a8a tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:24.179707 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-beb222be-24e6-43e2-877f-21507ed31a8a tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.146946 Dec 18 20:49:24.180905 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 422/842] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:49:24 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:24.208559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:24.211027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:24.224139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:24.225353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:24.228101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:24.229168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:24.752114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:24.762180 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b190a20-e61b-489d-b318-8bc7b2d6e528 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1322 microversion: 2.1 time: 0.769721 Dec 18 20:49:24.763291 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 421/843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:23 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1322 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:24.776160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-68033dee-21c8-4704-a975-7f91c61bae4e req-3137f491-73f6-49f0-bf54-e78fe5f0615f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3c9fff-7539-4d85-9102-827366dbb6cd", "tag": "12a3229b-b407-4f8f-9557-f1a6978d54bb"}, {"name": "network-changed", "server_uuid": "b07c26ad-bdd3-495d-bf73-2844e2824e78", "tag": "05ea3e02-3bf7-43f5-91c1-02487451a24d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:24.777997 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:24.777997 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:24.788174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-68033dee-21c8-4704-a975-7f91c61bae4e req-3137f491-73f6-49f0-bf54-e78fe5f0615f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:24.788748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-68033dee-21c8-4704-a975-7f91c61bae4e req-3137f491-73f6-49f0-bf54-e78fe5f0615f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:24.806810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-68033dee-21c8-4704-a975-7f91c61bae4e req-3137f491-73f6-49f0-bf54-e78fe5f0615f service nova] Creating event network-changed:12a3229b-b407-4f8f-9557-f1a6978d54bb for instance db3c9fff-7539-4d85-9102-827366dbb6cd on nch1-master-1 Dec 18 20:49:24.807602 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-68033dee-21c8-4704-a975-7f91c61bae4e req-3137f491-73f6-49f0-bf54-e78fe5f0615f service nova] Creating event network-changed:05ea3e02-3bf7-43f5-91c1-02487451a24d for instance b07c26ad-bdd3-495d-bf73-2844e2824e78 on nch2-master-1 Dec 18 20:49:24.846956 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-68033dee-21c8-4704-a975-7f91c61bae4e req-3137f491-73f6-49f0-bf54-e78fe5f0615f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071608 Dec 18 20:49:24.850471 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 422/844] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:24 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:24.865515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:24.866229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:24.887678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:24.888340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:24.889187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:24.889846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:24.979180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:24.992663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-80721bc1-7f10-4175-8604-54c4ca373e63 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1551 microversion: 2.1 time: 0.805675 Dec 18 20:49:25.004280 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 423/845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:24 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1551 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:25.009290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa758ec4-b63d-424a-a37a-7a3d58330875 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f715c7bf790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1588801363", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:25.024151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-fa758ec4-b63d-424a-a37a-7a3d58330875 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:25.029224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-fa758ec4-b63d-424a-a37a-7a3d58330875 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for user 40c68504c8154342905e4601809509df and project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:25.048018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-fa758ec4-b63d-424a-a37a-7a3d58330875 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Dec 18 20:49:25.050487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa758ec4-b63d-424a-a37a-7a3d58330875 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:25.051526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa758ec4-b63d-424a-a37a-7a3d58330875 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.046396 Dec 18 20:49:25.059586 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 424/846] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Dec 18 20:49:25 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:25.065440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:25.066288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:25.075846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:25.076635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:25.077636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:25.078298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:25.418950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:25.427775 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-959f4109-52d5-4c1b-a476-f89c38b48e77 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1316 microversion: 2.1 time: 0.575840 Dec 18 20:49:25.439887 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 423/847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:24 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:25.446012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5dc25042-d52a-4992-a7ff-76902ccf4d56 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:25.447521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5dc25042-d52a-4992-a7ff-76902ccf4d56 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:25.453918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc25042-d52a-4992-a7ff-76902ccf4d56 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:25.454745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc25042-d52a-4992-a7ff-76902ccf4d56 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:25.455840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc25042-d52a-4992-a7ff-76902ccf4d56 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:25.456480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dc25042-d52a-4992-a7ff-76902ccf4d56 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:25.508366 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5dc25042-d52a-4992-a7ff-76902ccf4d56 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.066340 Dec 18 20:49:25.512816 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 424/848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:25 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:25.516591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:25.517482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:25.524934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:25.525381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:25.526212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:25.526662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:25.634436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:25.644000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:25.645901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:25.655896 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99320121-e7d4-416b-b933-63c8bc59cccf tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1645 microversion: 2.25 time: 0.594803 Dec 18 20:49:25.657401 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 425/849] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:25 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1645 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:25.667973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd63a8ef-26d9-4c52-ac3c-25c4ec388205 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f714fe43af0>, body: {"keypair": {"name": "tempest-keypair-101393599"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:25.698239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-dd63a8ef-26d9-4c52-ac3c-25c4ec388205 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:25.723156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-dd63a8ef-26d9-4c52-ac3c-25c4ec388205 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for user 40c68504c8154342905e4601809509df and project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:26.022612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:26.034226 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d65fdb00-555b-41b1-8e94-816ea665480d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1316 microversion: 2.1 time: 0.522437 Dec 18 20:49:26.038007 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 425/850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:25 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:26.050187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ca2f74b6-bc3e-4e4a-89b2-3deadd479b67 req-d5a03e4e-c7d7-4af7-84e1-c56796c2dd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919e413a-66ad-40fb-aad2-6d3392c35439", "tag": "c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a"}, {"name": "network-changed", "server_uuid": "9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7", "tag": "11404954-527e-4497-8a08-c8e44c3d14a2"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:26.052500 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:26.052500 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:26.070301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ca2f74b6-bc3e-4e4a-89b2-3deadd479b67 req-d5a03e4e-c7d7-4af7-84e1-c56796c2dd14 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:26.072976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ca2f74b6-bc3e-4e4a-89b2-3deadd479b67 req-d5a03e4e-c7d7-4af7-84e1-c56796c2dd14 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:26.103966 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ca2f74b6-bc3e-4e4a-89b2-3deadd479b67 req-d5a03e4e-c7d7-4af7-84e1-c56796c2dd14 service nova] Creating event network-changed:c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a for instance 919e413a-66ad-40fb-aad2-6d3392c35439 on nch2-master-1 Dec 18 20:49:26.105348 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ca2f74b6-bc3e-4e4a-89b2-3deadd479b67 req-d5a03e4e-c7d7-4af7-84e1-c56796c2dd14 service nova] Creating event network-changed:11404954-527e-4497-8a08-c8e44c3d14a2 for instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 on nch1-master-1 Dec 18 20:49:26.123159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ca2f74b6-bc3e-4e4a-89b2-3deadd479b67 req-d5a03e4e-c7d7-4af7-84e1-c56796c2dd14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083504 Dec 18 20:49:26.124723 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 426/851] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:26 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:26.140938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:26.141916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:26.156192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:26.156939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:26.158041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:26.160570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:26.211741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-dd63a8ef-26d9-4c52-ac3c-25c4ec388205 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:26.217596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-dd63a8ef-26d9-4c52-ac3c-25c4ec388205 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for user 40c68504c8154342905e4601809509df and project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:26.250160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd63a8ef-26d9-4c52-ac3c-25c4ec388205 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.590852 Dec 18 20:49:26.251360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 426/852] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:49:25 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:26.386840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb393d69-bdaa-4c3a-aab8-c7cf509fc48d tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Action: 'create', calling method: .version_select at 0x7f715c0eb8b0>, body: {"pool": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:26.880278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:26.888814 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31514db6-95ac-483f-8162-29747df81bd3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1322 microversion: 2.1 time: 0.761201 Dec 18 20:49:26.889636 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 427/853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:26 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:26.898766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:26.899456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:26.911349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:26.913114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:26.914878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:26.916016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:27.481435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:27.490807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9abc43ce-1d17-40be-b430-7784f3bc649b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1551 microversion: 2.1 time: 0.599804 Dec 18 20:49:27.491471 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 428/854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:26 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1551 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:27.496709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9eec6bfa-2497-4675-8042-217a46f9c9e2 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f714fb32700>, body: {"keypair": {"name": "tempest-keypair-101393599"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:27.512150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-9eec6bfa-2497-4675-8042-217a46f9c9e2 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:27.517837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-9eec6bfa-2497-4675-8042-217a46f9c9e2 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for user 40c68504c8154342905e4601809509df and project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:27.642871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9eec6bfa-2497-4675-8042-217a46f9c9e2 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] HTTP exception thrown: Key pair 'tempest-keypair-101393599' already exists. Dec 18 20:49:27.643560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9eec6bfa-2497-4675-8042-217a46f9c9e2 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 409 to user: Key pair 'tempest-keypair-101393599' already exists. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:27.644476 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9eec6bfa-2497-4675-8042-217a46f9c9e2 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.151824 Dec 18 20:49:27.648376 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 429/855] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:49:27 2021] POST /compute/v2.1/os-keypairs => generated 104 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:49:27.652191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:27.652897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:27.660468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:27.660973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:27.661951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:27.662657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:28.272320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:28.282695 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2a2edb5-29eb-4f93-bf83-2c2b99b0fc3b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1465 microversion: 2.1 time: 0.634506 Dec 18 20:49:28.284189 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 430/856] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:27 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1465 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:28.295080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1df32214-e6f1-4d1e-9e95-d5115c019935 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:28.296349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1df32214-e6f1-4d1e-9e95-d5115c019935 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:28.303075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1df32214-e6f1-4d1e-9e95-d5115c019935 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:28.303797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1df32214-e6f1-4d1e-9e95-d5115c019935 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:28.305131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1df32214-e6f1-4d1e-9e95-d5115c019935 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:28.305939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1df32214-e6f1-4d1e-9e95-d5115c019935 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:28.352925 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1df32214-e6f1-4d1e-9e95-d5115c019935 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.067181 Dec 18 20:49:28.353960 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 431/857] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:28 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:28.361530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:28.362547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:28.370820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:28.371501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:28.372483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:28.373080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:28.841711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:28.851915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:28.854185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:28.856160 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2ce97c3-fbe5-4205-8d8f-9bb4621f682b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1645 microversion: 2.25 time: 0.500902 Dec 18 20:49:28.856969 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 432/858] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:28 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1645 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:28.861951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e48b42e0-1c8c-4cdf-adda-49d4d61ad6cb req-366085d9-b32e-44fa-a085-e1cf67a07ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd", "tag": "92764ad1-5e29-480d-8c4d-12d7121af278"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:28.864579 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:28.864579 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:28.879657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e48b42e0-1c8c-4cdf-adda-49d4d61ad6cb req-366085d9-b32e-44fa-a085-e1cf67a07ee1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:28.880111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e48b42e0-1c8c-4cdf-adda-49d4d61ad6cb req-366085d9-b32e-44fa-a085-e1cf67a07ee1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:28.893314 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e48b42e0-1c8c-4cdf-adda-49d4d61ad6cb req-366085d9-b32e-44fa-a085-e1cf67a07ee1 service nova] Creating event network-changed:92764ad1-5e29-480d-8c4d-12d7121af278 for instance 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd on nch1-master-1 Dec 18 20:49:28.898367 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e48b42e0-1c8c-4cdf-adda-49d4d61ad6cb req-366085d9-b32e-44fa-a085-e1cf67a07ee1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039959 Dec 18 20:49:28.899084 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 433/859] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:28.905034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:28.906565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:28.912882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:28.913343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:28.914460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:28.914910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:29.350007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:29.357273 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4e4ba24f-f4a7-44d6-bd0e-1f4822a9eee0 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1316 microversion: 2.1 time: 0.457011 Dec 18 20:49:29.357851 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 434/860] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:28 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:29.362195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71d31bc1-4f3b-40e5-a945-d8a7d760d8a6 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Calling method '.version_select at 0x7f714ff873a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:29.380853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71d31bc1-4f3b-40e5-a945-d8a7d760d8a6 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101393599" status: 202 len: 0 microversion: 2.1 time: 0.021938 Dec 18 20:49:29.381444 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 435/861] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 20:49:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101393599 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:49:29.385817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:29.386645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:29.393366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:29.393815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:29.394645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:29.395082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:29.868035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:29.877239 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50be8f59-10ce-4b2c-a8d1-7d8475c2874f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1322 microversion: 2.1 time: 0.494159 Dec 18 20:49:29.878002 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 436/862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:29 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:29.882529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-fae459ee-fe07-4633-8a18-ec1cc5969b9e req-afbeb70e-78f6-4989-bf87-e5bb31bdc1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb62603f-da79-4c9b-adf0-119ab616bbb3", "tag": "82974d62-28de-42c6-ad7d-6964ede5da22"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:29.885252 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:29.885252 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:29.893215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fae459ee-fe07-4633-8a18-ec1cc5969b9e req-afbeb70e-78f6-4989-bf87-e5bb31bdc1e7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:29.893663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fae459ee-fe07-4633-8a18-ec1cc5969b9e req-afbeb70e-78f6-4989-bf87-e5bb31bdc1e7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:29.909511 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-fae459ee-fe07-4633-8a18-ec1cc5969b9e req-afbeb70e-78f6-4989-bf87-e5bb31bdc1e7 service nova] Creating event network-changed:82974d62-28de-42c6-ad7d-6964ede5da22 for instance cb62603f-da79-4c9b-adf0-119ab616bbb3 on nch2-master-1 Dec 18 20:49:29.915321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-fae459ee-fe07-4633-8a18-ec1cc5969b9e req-afbeb70e-78f6-4989-bf87-e5bb31bdc1e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036145 Dec 18 20:49:29.916107 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 437/863] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:29.921014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:29.921684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:29.928438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:29.928904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:29.929699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:29.930139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:29.958171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:49:30.067293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c23fd7f9-2a8d-49cc-abc3-b7de767eec8b tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 204 len: 0 microversion: 2.1 time: 0.149647 Dec 18 20:49:30.073977 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 438/864] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:49:29 2021] DELETE /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:30.086388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:30.087173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:30.095975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.097723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:30.098862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.099474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:30.730970 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb393d69-bdaa-4c3a-aab8-c7cf509fc48d tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.477729 Dec 18 20:49:30.741236 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 427/865] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:49:26 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:30.769422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52dc7dcb-013f-4fdb-b85f-ad969cc5ff5f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:30.771019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52dc7dcb-013f-4fdb-b85f-ad969cc5ff5f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:30.780867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52dc7dcb-013f-4fdb-b85f-ad969cc5ff5f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.781758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52dc7dcb-013f-4fdb-b85f-ad969cc5ff5f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:30.783094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52dc7dcb-013f-4fdb-b85f-ad969cc5ff5f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.784328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52dc7dcb-013f-4fdb-b85f-ad969cc5ff5f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:30.840019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52dc7dcb-013f-4fdb-b85f-ad969cc5ff5f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.090584 Dec 18 20:49:30.841114 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 428/866] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:30 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:30.849951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e9e7e2e-5a15-4638-9e39-3593331b7a0f tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f715c681b80>, body: {"keypair": {"name": ""}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:30.855150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e9e7e2e-5a15-4638-9e39-3593331b7a0f tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:30.857469 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e9e7e2e-5a15-4638-9e39-3593331b7a0f tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.014319 Dec 18 20:49:30.858301 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 429/867] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:49:30 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:30.868400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:30.870103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:30.881378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.881976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:30.883080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.883722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:30.915597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:30.946319 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab66e7f6-017f-42e8-a267-d129986ce43a tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1551 microversion: 2.1 time: 0.867890 Dec 18 20:49:30.947415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 439/868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:30 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1551 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:30.954547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:30.956139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:30.962722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.963191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:30.964002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:30.964448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:31.312234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:31.328206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:31.330459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:31.331660 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45684d8c-13d3-434e-b910-81202d921885 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1645 microversion: 2.25 time: 0.471472 Dec 18 20:49:31.344408 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 430/869] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:30 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1645 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:31.349325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-07e68ed9-3827-4d74-bc91-2ef932d29f93 req-b43e9310-f91d-4ab2-b5cd-30f5182584b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07c26ad-bdd3-495d-bf73-2844e2824e78", "name": "network-vif-plugged", "status": "completed", "tag": "05ea3e02-3bf7-43f5-91c1-02487451a24d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:31.350903 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:31.350903 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:31.361764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-07e68ed9-3827-4d74-bc91-2ef932d29f93 req-b43e9310-f91d-4ab2-b5cd-30f5182584b1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:31.362208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-07e68ed9-3827-4d74-bc91-2ef932d29f93 req-b43e9310-f91d-4ab2-b5cd-30f5182584b1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:31.374035 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-07e68ed9-3827-4d74-bc91-2ef932d29f93 req-b43e9310-f91d-4ab2-b5cd-30f5182584b1 service nova] Creating event network-vif-plugged:05ea3e02-3bf7-43f5-91c1-02487451a24d for instance b07c26ad-bdd3-495d-bf73-2844e2824e78 on nch2-master-1 Dec 18 20:49:31.380941 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-07e68ed9-3827-4d74-bc91-2ef932d29f93 req-b43e9310-f91d-4ab2-b5cd-30f5182584b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Dec 18 20:49:31.381541 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 431/870] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:31.388920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:31.390176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:31.399048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:31.400337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:31.402006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:31.402629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:31.448555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472035f568124561bde5223c47dd07be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a9543eaffc44858c8674e4b6f660cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:31.457668 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-689672c7-6945-4ba2-8c9f-05442385bb1a tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 200 len: 1471 microversion: 2.1 time: 0.508470 Dec 18 20:49:31.458276 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 440/871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:30 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:31.462777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a41bac69-522a-4dea-8b6d-378255a99ddd tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Calling method '.version_select at 0x7f714fa20670>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:31.873514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:31.887576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0560b4e-9e2a-462c-9eb1-81ddf4639c5e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1316 microversion: 2.1 time: 0.501272 Dec 18 20:49:31.888537 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 432/872] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:31 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:31.899529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b732e448-145d-45d7-8570-75d4fb5b5727 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f714fff2040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-797396960", "public_key": " "}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:31.925000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b732e448-145d-45d7-8570-75d4fb5b5727 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:31.931311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b732e448-145d-45d7-8570-75d4fb5b5727 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for user 40c68504c8154342905e4601809509df and project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:31.931666 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a41bac69-522a-4dea-8b6d-378255a99ddd tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/b226499d-83a0-4069-a23c-2a7fc6db642b" status: 200 len: 141 microversion: 2.1 time: 0.472166 Dec 18 20:49:31.939404 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 441/873] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:49:31 2021] GET /compute/v2.1/os-floating-ips/b226499d-83a0-4069-a23c-2a7fc6db642b => generated 141 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:31.939404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:31.939404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:31.959731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:31.959731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:31.960694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:31.961895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:31.963640 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-b732e448-145d-45d7-8570-75d4fb5b5727 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Dec 18 20:49:31.964483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b732e448-145d-45d7-8570-75d4fb5b5727 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:31.965453 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b732e448-145d-45d7-8570-75d4fb5b5727 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.075857 Dec 18 20:49:31.966533 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 433/874] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:49:31 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:31.972162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3cecaf30-7ab1-4901-96f4-94a592fd2a18 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:31.973591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3cecaf30-7ab1-4901-96f4-94a592fd2a18 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:31.981551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cecaf30-7ab1-4901-96f4-94a592fd2a18 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:31.982330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cecaf30-7ab1-4901-96f4-94a592fd2a18 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:31.983590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cecaf30-7ab1-4901-96f4-94a592fd2a18 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:31.984238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cecaf30-7ab1-4901-96f4-94a592fd2a18 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.049825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3cecaf30-7ab1-4901-96f4-94a592fd2a18 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.081828 Dec 18 20:49:32.055275 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 434/875] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:31 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:32.066358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d42470b9-5429-4634-971f-fc70443f4612 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Calling method '.version_select at 0x7f714fea9790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.413134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:32.421029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e5f597a-dddd-416c-99fd-fa6dcfa6260b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1322 microversion: 2.1 time: 0.487507 Dec 18 20:49:32.421632 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 442/876] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:31 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:32.426561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.427489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:32.434912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.435367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.436420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.436859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.444151 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d42470b9-5429-4634-971f-fc70443f4612 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.383238 Dec 18 20:49:32.444726 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 435/877] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 20:49:32 2021] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:32.451195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fbdd3678-9e1c-48d1-8e59-06f410853559 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f714fe70670>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:32.452708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fbdd3678-9e1c-48d1-8e59-06f410853559 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:32.453695 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fbdd3678-9e1c-48d1-8e59-06f410853559 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.007771 Dec 18 20:49:32.454224 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 436/878] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Dec 18 20:49:32 2021] POST /compute/v2.1/os-keypairs => generated 627 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:32.459172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9e6b56cc-6628-4b26-86c2-e7a3d3e3bf05 req-e89242d8-310b-4b73-87c5-3358c23d9b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae440d5-c58e-40af-bb73-73999aa7b795", "name": "network-vif-deleted", "tag": "6558f70a-e9c0-470e-9b2d-8f8a5896b942"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:32.460737 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:32.460737 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:32.469137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9e6b56cc-6628-4b26-86c2-e7a3d3e3bf05 req-e89242d8-310b-4b73-87c5-3358c23d9b1b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.469692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9e6b56cc-6628-4b26-86c2-e7a3d3e3bf05 req-e89242d8-310b-4b73-87c5-3358c23d9b1b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.480492 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9e6b56cc-6628-4b26-86c2-e7a3d3e3bf05 req-e89242d8-310b-4b73-87c5-3358c23d9b1b service nova] Creating event network-vif-deleted:6558f70a-e9c0-470e-9b2d-8f8a5896b942 for instance 1ae440d5-c58e-40af-bb73-73999aa7b795 on nch1-master-1 Dec 18 20:49:32.485173 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9e6b56cc-6628-4b26-86c2-e7a3d3e3bf05 req-e89242d8-310b-4b73-87c5-3358c23d9b1b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029648 Dec 18 20:49:32.485766 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 437/879] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:32.491372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.492065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:32.498360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.498818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.499913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.500526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.713889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:32.728770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:32.731197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ef70629-e86f-4738-8a30-a460bc13b2d5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1541 microversion: 2.1 time: 0.303405 Dec 18 20:49:32.732111 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 443/880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:32 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1541 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:32.739782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:32.741425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-23501104-5692-4105-9e21-3f6e56f578cc tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Calling method '.version_select at 0x7f715cab53a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.742348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:32.743783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6d9f0e91-9b11-4774-840a-8050631352a1 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1645 microversion: 2.25 time: 0.256150 Dec 18 20:49:32.756647 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 438/881] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:32 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1645 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:32.764081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da10b112-8d85-48f2-bd9b-558f276c7ace tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Action: 'create', calling method: .version_select at 0x7f714fe57790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-106456486", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:32.809018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-da10b112-8d85-48f2-bd9b-558f276c7ace tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:32.821708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-da10b112-8d85-48f2-bd9b-558f276c7ace tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Getting quotas for user 40c68504c8154342905e4601809509df and project 793496da99a5486eb25d932d07db3d24. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:32.866749 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-da10b112-8d85-48f2-bd9b-558f276c7ace tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Dec 18 20:49:32.867405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da10b112-8d85-48f2-bd9b-558f276c7ace tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:32.868245 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da10b112-8d85-48f2-bd9b-558f276c7ace tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.110317 Dec 18 20:49:32.874095 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 439/882] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Dec 18 20:49:32 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:32.882480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.883720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:32.897842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.899953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.901022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.903119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.917961 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] HTTP exception thrown: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. Dec 18 20:49:32.918334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Returning 404 to user: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:32.919240 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d292c910-d42f-4907-a500-ad2cadfce549 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 404 len: 111 microversion: 2.1 time: 0.046714 Dec 18 20:49:32.920129 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 440/883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:32 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:32.925577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7aa983ea-182e-4590-b19b-3e85a3f801be tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '.version_select at 0x7f714ffc54c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.926894 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:32.926894 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:32.928701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aa983ea-182e-4590-b19b-3e85a3f801be tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.928944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aa983ea-182e-4590-b19b-3e85a3f801be tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.939614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7aa983ea-182e-4590-b19b-3e85a3f801be tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.018371 Dec 18 20:49:32.940526 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 441/884] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:49:32 2021] GET /compute/v2.1/os-migrations => generated 2318 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:32.944986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21c2affe-913a-46d9-aa7e-d0aa99e1a4d3 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Calling method '.version_select at 0x7f714fea9dc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.957725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-21c2affe-913a-46d9-aa7e-d0aa99e1a4d3 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-59209273 not found for user 40c68504c8154342905e4601809509df Dec 18 20:49:32.958356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21c2affe-913a-46d9-aa7e-d0aa99e1a4d3 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] Returning 404 to user: Keypair tempest-keypair-non-existent-59209273 not found for user 40c68504c8154342905e4601809509df {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:32.959212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21c2affe-913a-46d9-aa7e-d0aa99e1a4d3 tempest-KeyPairsNegativeTestJSON-1150200922 tempest-KeyPairsNegativeTestJSON-1150200922-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-59209273" status: 404 len: 143 microversion: 2.1 time: 0.017665 Dec 18 20:49:32.963519 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 442/885] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 20:49:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-59209273 => generated 143 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:32.966702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:32.966702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:32.972644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.973101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:32.973902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:32.974397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:33.671693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:33.680164 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9774433-a1d5-4bae-ac1c-8aafc1fd1c13 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1465 microversion: 2.1 time: 0.718877 Dec 18 20:49:33.681072 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 443/886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:32 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1465 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:33.694017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1591970659", "metadata": {"image_type": "test"}}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:33.695467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:33.701747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:33.702460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:33.703724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:33.705012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:33.724775 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] HTTP exception thrown: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. Dec 18 20:49:33.725377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Returning 404 to user: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:33.726210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0c52c62-0bf9-4269-806d-8627329d533e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "POST /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795/action" status: 404 len: 111 microversion: 2.1 time: 0.043976 Dec 18 20:49:33.732208 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 444/887] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Dec 18 20:49:33 2021] POST /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:33.739861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e506b10-5f94-4d46-9977-3f4c9be2891d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:33.747147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e506b10-5f94-4d46-9977-3f4c9be2891d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:33.755151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e506b10-5f94-4d46-9977-3f4c9be2891d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:33.755610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e506b10-5f94-4d46-9977-3f4c9be2891d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:33.756416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e506b10-5f94-4d46-9977-3f4c9be2891d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:33.756858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e506b10-5f94-4d46-9977-3f4c9be2891d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:33.977683 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e506b10-5f94-4d46-9977-3f4c9be2891d tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1692 microversion: 2.1 time: 0.243454 Dec 18 20:49:33.978478 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 445/888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:33 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1692 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:34.000134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43153bc3-6eaa-40cc-b3c0-98af6cd0a495 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:34.002451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-43153bc3-6eaa-40cc-b3c0-98af6cd0a495 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:34.015332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43153bc3-6eaa-40cc-b3c0-98af6cd0a495 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.016309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43153bc3-6eaa-40cc-b3c0-98af6cd0a495 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.018962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43153bc3-6eaa-40cc-b3c0-98af6cd0a495 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.019767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43153bc3-6eaa-40cc-b3c0-98af6cd0a495 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.081696 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43153bc3-6eaa-40cc-b3c0-98af6cd0a495 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.092181 Dec 18 20:49:34.085825 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 446/889] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:33 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:34.088452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b517f500-24d6-488a-a725-de3e35d2c13c req-bae3b4b8-d4bc-46f6-8ecb-a19f6d6308d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7", "name": "network-vif-plugged", "status": "completed", "tag": "11404954-527e-4497-8a08-c8e44c3d14a2"}, {"server_uuid": "cb62603f-da79-4c9b-adf0-119ab616bbb3", "name": "network-vif-plugged", "status": "completed", "tag": "82974d62-28de-42c6-ad7d-6964ede5da22"}, {"server_uuid": "0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd", "name": "network-vif-plugged", "status": "completed", "tag": "92764ad1-5e29-480d-8c4d-12d7121af278"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:34.090840 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:34.090840 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:34.100792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b517f500-24d6-488a-a725-de3e35d2c13c req-bae3b4b8-d4bc-46f6-8ecb-a19f6d6308d2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.101346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b517f500-24d6-488a-a725-de3e35d2c13c req-bae3b4b8-d4bc-46f6-8ecb-a19f6d6308d2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.115704 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-23501104-5692-4105-9e21-3f6e56f578cc tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/b226499d-83a0-4069-a23c-2a7fc6db642b" status: 202 len: 0 microversion: 2.1 time: 1.380764 Dec 18 20:49:34.116337 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 444/890] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:49:32 2021] DELETE /compute/v2.1/os-floating-ips/b226499d-83a0-4069-a23c-2a7fc6db642b => generated 0 bytes in 1384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:49:34.125256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:34.126342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:34.131526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b517f500-24d6-488a-a725-de3e35d2c13c req-bae3b4b8-d4bc-46f6-8ecb-a19f6d6308d2 service nova] Creating event network-vif-plugged:11404954-527e-4497-8a08-c8e44c3d14a2 for instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 on nch1-master-1 Dec 18 20:49:34.132437 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b517f500-24d6-488a-a725-de3e35d2c13c req-bae3b4b8-d4bc-46f6-8ecb-a19f6d6308d2 service nova] Creating event network-vif-plugged:82974d62-28de-42c6-ad7d-6964ede5da22 for instance cb62603f-da79-4c9b-adf0-119ab616bbb3 on nch2-master-1 Dec 18 20:49:34.133156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.133300 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b517f500-24d6-488a-a725-de3e35d2c13c req-bae3b4b8-d4bc-46f6-8ecb-a19f6d6308d2 service nova] Creating event network-vif-plugged:92764ad1-5e29-480d-8c4d-12d7121af278 for instance 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd on nch1-master-1 Dec 18 20:49:34.133959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.135145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.135720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.153230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b517f500-24d6-488a-a725-de3e35d2c13c req-bae3b4b8-d4bc-46f6-8ecb-a19f6d6308d2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.068091 Dec 18 20:49:34.154272 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 447/891] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:34 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:34.463448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d3ca92c-1be5-45da-9ff6-52ba0dcf78d8 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:34.464460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1d3ca92c-1be5-45da-9ff6-52ba0dcf78d8 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:34.471299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:34.473716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3ca92c-1be5-45da-9ff6-52ba0dcf78d8 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.474330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3ca92c-1be5-45da-9ff6-52ba0dcf78d8 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.475376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3ca92c-1be5-45da-9ff6-52ba0dcf78d8 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.476026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3ca92c-1be5-45da-9ff6-52ba0dcf78d8 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.481517 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c03c948-a886-43d3-a374-c49f2e931481 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1322 microversion: 2.1 time: 0.359365 Dec 18 20:49:34.505456 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 445/892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:34 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:34.513301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb0743ff-873b-4e91-86cf-c8a819440df7 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1781334881", "metadata": {"image_type": "test"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:34.518707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bb0743ff-873b-4e91-86cf-c8a819440df7 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Failed to fetch instance by id tempest-invalid-818873810 {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 18 20:49:34.519272 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-bb0743ff-873b-4e91-86cf-c8a819440df7 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] HTTP exception thrown: Instance tempest-invalid-818873810 could not be found. Dec 18 20:49:34.519855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb0743ff-873b-4e91-86cf-c8a819440df7 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Returning 404 to user: Instance tempest-invalid-818873810 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:34.520686 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb0743ff-873b-4e91-86cf-c8a819440df7 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "POST /compute/v2.1/servers/tempest-invalid-818873810/action" status: 404 len: 100 microversion: 2.1 time: 0.014064 Dec 18 20:49:34.521290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 446/893] 10.222.0.13 () {60 vars in 1245 bytes} [Sat Dec 18 20:49:34 2021] POST /compute/v2.1/servers/tempest-invalid-818873810/action => generated 100 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:34.530400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:34.531009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:34.538625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.539087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.539884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.540511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.731953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:34.749440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:34.750983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:34.753349 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fa3680b-921d-4f03-8b58-49e5452a8115 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1635 microversion: 2.25 time: 0.230655 Dec 18 20:49:34.754381 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 447/894] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:34 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1635 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:34.759536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a0d9964f-df3c-49b7-9fcf-7fe64dadd386 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:34.760302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a0d9964f-df3c-49b7-9fcf-7fe64dadd386 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:34.766670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0d9964f-df3c-49b7-9fcf-7fe64dadd386 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.768111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0d9964f-df3c-49b7-9fcf-7fe64dadd386 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.769165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0d9964f-df3c-49b7-9fcf-7fe64dadd386 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:34.769810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0d9964f-df3c-49b7-9fcf-7fe64dadd386 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:34.803916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d3ca92c-1be5-45da-9ff6-52ba0dcf78d8 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1616 microversion: 2.1 time: 0.647250 Dec 18 20:49:34.804881 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 448/895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:34 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1616 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:34.809469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9264a2e-f307-4786-8551-d7667dc266e6 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Action: 'create', calling method: .version_select at 0x7f715c0ebd30>, body: {"pool": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:35.003961 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a0d9964f-df3c-49b7-9fcf-7fe64dadd386 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1692 microversion: 2.1 time: 0.248378 Dec 18 20:49:35.004546 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 448/896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:34 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1692 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:35.015353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-51d4d79e-a07b-4949-8052-5ee4fa8b2004 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-471573861"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:35.015353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-51d4d79e-a07b-4949-8052-5ee4fa8b2004 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 18 20:49:35.015353 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-51d4d79e-a07b-4949-8052-5ee4fa8b2004 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Dec 18 20:49:35.015353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-51d4d79e-a07b-4949-8052-5ee4fa8b2004 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:35.015353 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-51d4d79e-a07b-4949-8052-5ee4fa8b2004 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.006535 Dec 18 20:49:35.016722 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 449/897] 10.222.0.13 () {60 vars in 1274 bytes} [Sat Dec 18 20:49:35 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:35.142693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83ce2821-5f3d-4178-9b4b-e28404b499e9 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f715c8ce160>, body: {"keypair": {"name": "tempest-keypair-1760909966"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:35.157235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-83ce2821-5f3d-4178-9b4b-e28404b499e9 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:35.162192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-83ce2821-5f3d-4178-9b4b-e28404b499e9 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:35.397875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-83ce2821-5f3d-4178-9b4b-e28404b499e9 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:35.402973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-83ce2821-5f3d-4178-9b4b-e28404b499e9 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:35.418685 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83ce2821-5f3d-4178-9b4b-e28404b499e9 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.400616 Dec 18 20:49:35.419297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 450/898] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Dec 18 20:49:35 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 402 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:35.424775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2646cf3c-c222-4b93-a2ea-c00bdcefca4b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '.version_select at 0x7f714fb9b8b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:35.426032 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:35.426032 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:35.427498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2646cf3c-c222-4b93-a2ea-c00bdcefca4b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.427961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2646cf3c-c222-4b93-a2ea-c00bdcefca4b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.438415 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2646cf3c-c222-4b93-a2ea-c00bdcefca4b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 2536 microversion: 2.25 time: 0.018097 Dec 18 20:49:35.439858 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 451/899] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Dec 18 20:49:35 2021] GET /compute/v2.1/os-migrations => generated 2536 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:35.448302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1cecf08c-6b67-45a9-a6cb-ccaaf046e75d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: .version_select at 0x7f715db364c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-544514872", "policies": ["affinity"]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:35.467588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1cecf08c-6b67-45a9-a6cb-ccaaf046e75d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:35.472652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1cecf08c-6b67-45a9-a6cb-ccaaf046e75d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:35.520479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1cecf08c-6b67-45a9-a6cb-ccaaf046e75d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:35.529666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1cecf08c-6b67-45a9-a6cb-ccaaf046e75d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:35.545888 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1cecf08c-6b67-45a9-a6cb-ccaaf046e75d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.102069 Dec 18 20:49:35.554449 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 452/900] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 20:49:35 2021] POST /compute/v2.1/os-server-groups => generated 187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:35.559920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5191218e-f746-4e7c-9d43-341af0a683b2 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1202892279"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:35.561238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5191218e-f746-4e7c-9d43-341af0a683b2 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 18 20:49:35.561942 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5191218e-f746-4e7c-9d43-341af0a683b2 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Dec 18 20:49:35.563141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5191218e-f746-4e7c-9d43-341af0a683b2 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:35.564630 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5191218e-f746-4e7c-9d43-341af0a683b2 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.008493 Dec 18 20:49:35.569042 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 453/901] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Dec 18 20:49:35 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:35.573807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:35.574334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:35.582461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.582929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.583740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.584180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.744636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lazy-loading 'services' on Instance uuid db3c9fff-7539-4d85-9102-827366dbb6cd {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:35.861611 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c18295ef-1a4f-48df-8667-51200c71656f tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "DELETE /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments/f629430d-e738-4808-bf49-6063505a3490" status: 202 len: 0 microversion: 2.1 time: 0.290767 Dec 18 20:49:35.862460 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 454/902] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 20:49:35 2021] DELETE /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments/f629430d-e738-4808-bf49-6063505a3490 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:49:35.867498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-359ef7df-936b-4910-bbde-eac1eacbdb95 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:35.868709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-359ef7df-936b-4910-bbde-eac1eacbdb95 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:35.875144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359ef7df-936b-4910-bbde-eac1eacbdb95 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.875693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359ef7df-936b-4910-bbde-eac1eacbdb95 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.877110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359ef7df-936b-4910-bbde-eac1eacbdb95 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.877616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359ef7df-936b-4910-bbde-eac1eacbdb95 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.920070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-359ef7df-936b-4910-bbde-eac1eacbdb95 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.056147 Dec 18 20:49:35.920727 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 455/903] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:35 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:35.927874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a88d80b8-5c8e-463a-a327-3895dd7c96b5 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f715daf2af0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:35.936977 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a88d80b8-5c8e-463a-a327-3895dd7c96b5 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1760909966" status: 200 len: 706 microversion: 2.2 time: 0.014966 Dec 18 20:49:35.937535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 456/904] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Dec 18 20:49:35 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1760909966 => generated 706 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:35.941884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:35.942766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:35.953058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.953508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.954329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.955300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.978816 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9264a2e-f307-4786-8551-d7667dc266e6 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.172724 Dec 18 20:49:35.984955 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 449/905] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:49:34 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:35.984955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:35.985135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:35.991644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.992124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:35.992900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:35.993332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.122072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 919e413a-66ad-40fb-aad2-6d3392c35439 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:36.135838 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70320cc4-9623-4cd3-9e49-01b047c7cee8 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 2128 microversion: 2.25 time: 0.197320 Dec 18 20:49:36.136415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 457/906] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:35 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 2128 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:36.141084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:36.141553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:36.147760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.148368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.149080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.149414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.156073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:36.162850 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] HTTP exception thrown: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. Dec 18 20:49:36.163436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Returning 404 to user: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:36.163725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ade6674b-977b-4c92-99bf-8fc2531891db tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 200 len: 1515 microversion: 2.1 time: 0.182833 Dec 18 20:49:36.174270 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 450/907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:35 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:36.174427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18ffaea4-aacb-4328-9e0b-09a0e8ddb06e tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 404 len: 111 microversion: 2.1 time: 0.026953 Dec 18 20:49:36.174427 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 458/908] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:49:36 2021] DELETE /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:36.174427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a11df63a-6b20-48a0-a6dd-b1b46f885511 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:36.174427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a11df63a-6b20-48a0-a6dd-b1b46f885511 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:36.175977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a11df63a-6b20-48a0-a6dd-b1b46f885511 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.176425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a11df63a-6b20-48a0-a6dd-b1b46f885511 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.177250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a11df63a-6b20-48a0-a6dd-b1b46f885511 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.177683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a11df63a-6b20-48a0-a6dd-b1b46f885511 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.178056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-608031115", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "240cf658-8624-46e5-9566-26dfa7b69a27"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:36.208467 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a11df63a-6b20-48a0-a6dd-b1b46f885511 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Dec 18 20:49:36.209064 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 459/909] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:49:36 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:36.213596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c873a5b-c676-4c74-b10b-026eec119a9e tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f715c0ab160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:36.228451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:49:36.237515 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c873a5b-c676-4c74-b10b-026eec119a9e tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760909966" status: 204 len: 0 microversion: 2.2 time: 0.027385 Dec 18 20:49:36.238088 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 460/910] 10.222.0.13 () {60 vars in 1260 bytes} [Sat Dec 18 20:49:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760909966 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:36.243558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-68a34556-76af-4e0b-a656-625f2b8ecc6f tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Calling method '.version_select at 0x7f714fa0c9d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:36.622629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:49:36.623129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:49:36.623815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:49:36.624329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:49:36.624907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:49:36.654410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.655113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.656198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.656767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.680117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:36.686101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:36.700317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Going to run 2 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:49:36.703256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:36.744331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140731) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Dec 18 20:49:36.762654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:36.767474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:36.809746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:36.814777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:36.828464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=facfd9bf-d901-4385-a082-8a8c8b44f452,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:36.883222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:36.887954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:36.921823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:36.927181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:36.960670 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-584c2dc1-0eee-4159-8ad5-08b741cded20 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.795323 Dec 18 20:49:36.961578 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 451/911] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:36 2021] POST /compute/v2.1/servers => generated 32 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Dec 18 20:49:36.968608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:36.969216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:36.975696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.976149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:36.976943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:36.977380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.127184 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-68a34556-76af-4e0b-a656-625f2b8ecc6f tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/18d8b834-6e50-4b29-b6d5-91ca301ecd43" status: 202 len: 0 microversion: 2.1 time: 0.888012 Dec 18 20:49:37.127938 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 461/912] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:49:36 2021] DELETE /compute/v2.1/os-floating-ips/18d8b834-6e50-4b29-b6d5-91ca301ecd43 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:49:37.132267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:37.132917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] [instance: 1ae440d5-c58e-40af-bb73-73999aa7b795] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:37.139946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.140394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.141213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.141654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.155702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] HTTP exception thrown: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. Dec 18 20:49:37.156306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] Returning 404 to user: Instance 1ae440d5-c58e-40af-bb73-73999aa7b795 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:37.157142 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4272825e-2bb2-4a00-bb14-5e9736ae5418 tempest-ImagesNegativeTestJSON-1429802738 tempest-ImagesNegativeTestJSON-1429802738-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795" status: 404 len: 111 microversion: 2.1 time: 0.028448 Dec 18 20:49:37.158538 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 462/913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:37 2021] GET /compute/v2.1/servers/1ae440d5-c58e-40af-bb73-73999aa7b795 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:37.162921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:37.163475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:37.169581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.170036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.170904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.171316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.185373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid 919e413a-66ad-40fb-aad2-6d3392c35439 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:37.200709 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d8023a0-6004-40a9-a678-7ce8a67fc931 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 2128 microversion: 2.25 time: 0.235538 Dec 18 20:49:37.201753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 452/914] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:49:36 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 2128 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:49:37.214405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6e55196-25f3-4415-ae78-af70ac3655b8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f715c495d30>, body: {"keypair": {"name": "tempest-keypair-381215318"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:37.241563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d6e55196-25f3-4415-ae78-af70ac3655b8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:37.248299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d6e55196-25f3-4415-ae78-af70ac3655b8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:37.384465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:37.394380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae6d9bde-762c-474b-8d06-5e00ba8f36f5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3" status: 200 len: 1515 microversion: 2.1 time: 0.234940 Dec 18 20:49:37.395729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 463/915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:37 2021] GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:37.401347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05176c6f-f1f6-45e1-9001-6d428ad0ebe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:37.402294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05176c6f-f1f6-45e1-9001-6d428ad0ebe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:37.409498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05176c6f-f1f6-45e1-9001-6d428ad0ebe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.410158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05176c6f-f1f6-45e1-9001-6d428ad0ebe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.411133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05176c6f-f1f6-45e1-9001-6d428ad0ebe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.412129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05176c6f-f1f6-45e1-9001-6d428ad0ebe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.457313 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05176c6f-f1f6-45e1-9001-6d428ad0ebe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.058951 Dec 18 20:49:37.458744 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 464/916] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:37 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:37.465805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:37.471184 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:37.471184 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:37.472464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:37.473295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Searching by: {'deleted': False, 'project_id': '9ce640720b084b84a86f590d354dad25'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:37.494759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.495352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.496348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.497162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.512079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d6e55196-25f3-4415-ae78-af70ac3655b8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:37.517786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d6e55196-25f3-4415-ae78-af70ac3655b8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:37.535632 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6e55196-25f3-4415-ae78-af70ac3655b8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.332540 Dec 18 20:49:37.540940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 453/917] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Dec 18 20:49:37 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 334 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:37.545386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ab69d02-5fe0-4dfa-a85c-323d9b7d607d tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Calling method '.version_select at 0x7f714fe43700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:37.603413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-4ab69d02-5fe0-4dfa-a85c-323d9b7d607d tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 18d8b834-6e50-4b29-b6d5-91ca301ecd43 could not be found", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:49:37.604121 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4ab69d02-5fe0-4dfa-a85c-323d9b7d607d tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] HTTP exception thrown: Floating IP not found for ID 18d8b834-6e50-4b29-b6d5-91ca301ecd43 Dec 18 20:49:37.604829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ab69d02-5fe0-4dfa-a85c-323d9b7d607d tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Returning 404 to user: Floating IP not found for ID 18d8b834-6e50-4b29-b6d5-91ca301ecd43 {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:37.606691 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ab69d02-5fe0-4dfa-a85c-323d9b7d607d tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/18d8b834-6e50-4b29-b6d5-91ca301ecd43" status: 404 len: 111 microversion: 2.1 time: 0.064186 Dec 18 20:49:37.607290 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 454/918] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:49:37 2021] GET /compute/v2.1/os-floating-ips/18d8b834-6e50-4b29-b6d5-91ca301ecd43 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:37.612592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:49:37.616679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3daf93d6-b299-45e5-98c9-7794380ad6c0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:37.617601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3daf93d6-b299-45e5-98c9-7794380ad6c0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:37.623697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3daf93d6-b299-45e5-98c9-7794380ad6c0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.624154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3daf93d6-b299-45e5-98c9-7794380ad6c0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.624957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3daf93d6-b299-45e5-98c9-7794380ad6c0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.625399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3daf93d6-b299-45e5-98c9-7794380ad6c0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.671368 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3daf93d6-b299-45e5-98c9-7794380ad6c0 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059718 Dec 18 20:49:37.672260 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 455/919] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:49:37 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:49:37.677541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:37.677740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:37.684511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.684824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.685895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.687619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.807622 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-456bb96a-1d7b-4f0d-8316-ca406dd0a62a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.346936 Dec 18 20:49:37.814356 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 465/920] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:49:37 2021] GET /compute/v2.1/servers => generated 1001 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:37.820118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lazy-loading 'services' on Instance uuid 919e413a-66ad-40fb-aad2-6d3392c35439 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:37.824169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:37.824953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:37.857243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.857711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.858558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:37.859010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:37.945382 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b87916a-d748-4f2b-8cca-993258aecdc9 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "DELETE /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments/2f2dfe88-6eae-4206-aa00-4d39eb37326e" status: 202 len: 0 microversion: 2.25 time: 0.268369 Dec 18 20:49:37.951391 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 456/921] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Dec 18 20:49:37 2021] DELETE /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments/2f2dfe88-6eae-4206-aa00-4d39eb37326e => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:37.969578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-821be099-cd88-4814-bc5f-2fe7f00a2353 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f715c472040>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:38.044185 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-821be099-cd88-4814-bc5f-2fe7f00a2353 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381215318" status: 204 len: 0 microversion: 2.2 time: 0.088272 Dec 18 20:49:38.049576 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 457/922] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Dec 18 20:49:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381215318 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:38.055177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73970635-1bee-4045-97e6-38b97daafb41 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Calling method '.version_select at 0x7f714ff84310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:38.119753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-73970635-1bee-4045-97e6-38b97daafb41 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 18d8b834-6e50-4b29-b6d5-91ca301ecd43 could not be found", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:49:38.120586 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-73970635-1bee-4045-97e6-38b97daafb41 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] HTTP exception thrown: Floating IP not found for ID 18d8b834-6e50-4b29-b6d5-91ca301ecd43 Dec 18 20:49:38.121518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73970635-1bee-4045-97e6-38b97daafb41 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] Returning 404 to user: Floating IP not found for ID 18d8b834-6e50-4b29-b6d5-91ca301ecd43 {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:38.122851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-73970635-1bee-4045-97e6-38b97daafb41 tempest-FloatingIPsTestJSON-236880002 tempest-FloatingIPsTestJSON-236880002-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/18d8b834-6e50-4b29-b6d5-91ca301ecd43" status: 404 len: 111 microversion: 2.1 time: 0.072134 Dec 18 20:49:38.126185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:38.134543 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 458/923] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:49:38 2021] DELETE /compute/v2.1/os-floating-ips/18d8b834-6e50-4b29-b6d5-91ca301ecd43 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:38.142304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:38.145580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:38.148865 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74b83ca2-7345-4e5d-9c4f-3f9e40fef7fb tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 200 len: 1516 microversion: 2.1 time: 0.331892 Dec 18 20:49:38.149947 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 466/924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:37 2021] GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 1516 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:38.159818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.160427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.163081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82928893-0c9f-47d3-8dd6-959e3626dc7f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:38.164271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82928893-0c9f-47d3-8dd6-959e3626dc7f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:38.164603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.165397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.187236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82928893-0c9f-47d3-8dd6-959e3626dc7f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.187609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82928893-0c9f-47d3-8dd6-959e3626dc7f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.193111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82928893-0c9f-47d3-8dd6-959e3626dc7f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.193942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82928893-0c9f-47d3-8dd6-959e3626dc7f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.243353 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82928893-0c9f-47d3-8dd6-959e3626dc7f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092188 Dec 18 20:49:38.244595 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 467/925] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Dec 18 20:49:38 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:38.249798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03d4bfe5-1405-4769-9ab5-6a627680153a tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f714fa8d940>, body: {"keypair": {"name": "tempest-keypair-652124275", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:38.264482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-03d4bfe5-1405-4769-9ab5-6a627680153a tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:38.271081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-03d4bfe5-1405-4769-9ab5-6a627680153a tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:38.271954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:38.293223 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c70816a1-83d1-48ac-adaf-0452705aef7f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1214 microversion: 2.1 time: 0.155375 Dec 18 20:49:38.295337 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 459/926] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:38 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:38.301087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:38.301234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:38.307823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.307990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.308762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.309199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.322661 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03d4bfe5-1405-4769-9ab5-6a627680153a tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.076155 Dec 18 20:49:38.323595 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 468/927] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Dec 18 20:49:38 2021] POST /compute/v2.1/os-keypairs => generated 588 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Dec 18 20:49:38.334684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-868a6e05-3bdc-4607-b95e-f11f1037e348 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714f9acee0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:38.345017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:49:38.358021 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-868a6e05-3bdc-4607-b95e-f11f1037e348 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-652124275" status: 204 len: 0 microversion: 2.2 time: 0.028387 Dec 18 20:49:38.359265 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 469/928] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Dec 18 20:49:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-652124275 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:38.372110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-53d14a70-87df-4e39-9ada-2c9614b037f6 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f714f8a9670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-89882307"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:38.389841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-53d14a70-87df-4e39-9ada-2c9614b037f6 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:38.397004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-53d14a70-87df-4e39-9ada-2c9614b037f6 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:38.495084 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c162a092-c435-4cc9-a5e3-3b0b4bdf6c02 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 204 len: 0 microversion: 2.1 time: 0.185285 Dec 18 20:49:38.495727 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 460/929] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:49:38 2021] DELETE /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:38.514533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74ba1a37-c1e6-4d26-bf8a-e96ccbf6c941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:38.516034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74ba1a37-c1e6-4d26-bf8a-e96ccbf6c941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:38.544507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74ba1a37-c1e6-4d26-bf8a-e96ccbf6c941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.545137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74ba1a37-c1e6-4d26-bf8a-e96ccbf6c941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.549718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74ba1a37-c1e6-4d26-bf8a-e96ccbf6c941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.551437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74ba1a37-c1e6-4d26-bf8a-e96ccbf6c941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.629177 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74ba1a37-c1e6-4d26-bf8a-e96ccbf6c941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.124315 Dec 18 20:49:38.634803 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 461/930] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:38 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:38.639271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:38.640038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:38.674623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.676227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.679853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:38.680882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:38.720313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-53d14a70-87df-4e39-9ada-2c9614b037f6 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:38.736772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-53d14a70-87df-4e39-9ada-2c9614b037f6 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:38.781258 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-53d14a70-87df-4e39-9ada-2c9614b037f6 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2334 microversion: 2.2 time: 0.413830 Dec 18 20:49:38.782970 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 470/931] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Dec 18 20:49:38 2021] POST /compute/v2.1/os-keypairs => generated 2334 bytes in 417 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:38.795773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abc304aa-e4d3-4f26-be07-e18b5dfd3b4c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f714f8b8a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1845027814"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:38.811824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-abc304aa-e4d3-4f26-be07-e18b5dfd3b4c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:38.818537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-abc304aa-e4d3-4f26-be07-e18b5dfd3b4c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:39.383111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-abc304aa-e4d3-4f26-be07-e18b5dfd3b4c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:39.412906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:39.413851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-abc304aa-e4d3-4f26-be07-e18b5dfd3b4c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:39.429137 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70af02a5-555c-4ceb-bca5-468fac1caab6 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 200 len: 1522 microversion: 2.1 time: 0.795875 Dec 18 20:49:39.429723 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 462/932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:38 2021] GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 1522 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:39.445206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a05fef7f-6c52-4a72-80f4-8e9264a13e13 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:39.446132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a05fef7f-6c52-4a72-80f4-8e9264a13e13 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:39.456337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a05fef7f-6c52-4a72-80f4-8e9264a13e13 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:39.456790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a05fef7f-6c52-4a72-80f4-8e9264a13e13 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:39.461165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a05fef7f-6c52-4a72-80f4-8e9264a13e13 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:39.464133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a05fef7f-6c52-4a72-80f4-8e9264a13e13 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:39.487818 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abc304aa-e4d3-4f26-be07-e18b5dfd3b4c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.693746 Dec 18 20:49:39.488812 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 471/933] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Dec 18 20:49:38 2021] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 698 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:39.498980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:39.499952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:39.511619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:39.512499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:39.513541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:39.514190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:39.532665 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a05fef7f-6c52-4a72-80f4-8e9264a13e13 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.101815 Dec 18 20:49:39.533585 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 463/934] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Dec 18 20:49:39 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:39.714576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:39.732037 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21b5eb16-c7ab-4ec8-99e2-c71e8894a054 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1278 microversion: 2.1 time: 0.241389 Dec 18 20:49:39.734695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 472/935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:39 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:39.740753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7761c53c-2559-4f29-aaeb-a215cdcad4ff tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f714fb8d8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-278696102"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:39.806089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7761c53c-2559-4f29-aaeb-a215cdcad4ff tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:39.820288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7761c53c-2559-4f29-aaeb-a215cdcad4ff tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:39.877121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-573600d9-de70-4ae4-a84b-e85af7a1ec6c tempest-ListImageFiltersNegativeTestJSON-1895296795 tempest-ListImageFiltersNegativeTestJSON-1895296795-project] Calling method '.version_select at 0x7f714fe71a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:39.913095 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-573600d9-de70-4ae4-a84b-e85af7a1ec6c tempest-ListImageFiltersNegativeTestJSON-1895296795 tempest-ListImageFiltersNegativeTestJSON-1895296795-project] HTTP exception thrown: Image not found. Dec 18 20:49:39.913721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-573600d9-de70-4ae4-a84b-e85af7a1ec6c tempest-ListImageFiltersNegativeTestJSON-1895296795 tempest-ListImageFiltersNegativeTestJSON-1895296795-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:39.915221 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-573600d9-de70-4ae4-a84b-e85af7a1ec6c tempest-ListImageFiltersNegativeTestJSON-1895296795 tempest-ListImageFiltersNegativeTestJSON-1895296795-project] 10.222.0.13 "GET /compute/v2.1/images/3a305d4e-c486-4c74-b5a1-64ed2982e3ed" status: 404 len: 62 microversion: 2.1 time: 0.380119 Dec 18 20:49:39.915776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 464/936] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:39 2021] GET /compute/v2.1/images/3a305d4e-c486-4c74-b5a1-64ed2982e3ed => generated 62 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:49:39.920710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1438d82b-70d6-4e78-81c8-94f38ed180a1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:39.922033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1438d82b-70d6-4e78-81c8-94f38ed180a1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:39.940150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1438d82b-70d6-4e78-81c8-94f38ed180a1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:39.940619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1438d82b-70d6-4e78-81c8-94f38ed180a1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:39.941436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1438d82b-70d6-4e78-81c8-94f38ed180a1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:39.941879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1438d82b-70d6-4e78-81c8-94f38ed180a1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:40.049897 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1438d82b-70d6-4e78-81c8-94f38ed180a1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.132713 Dec 18 20:49:40.054653 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 465/937] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:39 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:40.253448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7761c53c-2559-4f29-aaeb-a215cdcad4ff tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:40.259103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7761c53c-2559-4f29-aaeb-a215cdcad4ff tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:40.283917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7761c53c-2559-4f29-aaeb-a215cdcad4ff tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.546809 Dec 18 20:49:40.285703 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 473/938] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Dec 18 20:49:39 2021] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 550 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:40.296487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2c153f1-dc59-4d6b-9987-696f1ad42ac8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714fde4310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:40.299905 ncdv-master-1 devstack@n-api.service[140731]: WARNING oslo_db.sqlalchemy.utils [None req-b2c153f1-dc59-4d6b-9987-696f1ad42ac8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 18 20:49:40.343304 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2c153f1-dc59-4d6b-9987-696f1ad42ac8 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1721 microversion: 2.2 time: 0.051593 Dec 18 20:49:40.343900 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 466/939] 10.222.0.13 () {60 vars in 1176 bytes} [Sat Dec 18 20:49:40 2021] GET /compute/v2.1/os-keypairs => generated 1721 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:40.355677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa41da24-07a4-43b8-a8aa-318317f2688e tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714f8a9f70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:40.407948 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa41da24-07a4-43b8-a8aa-318317f2688e tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-278696102" status: 204 len: 0 microversion: 2.2 time: 0.055718 Dec 18 20:49:40.410307 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 474/940] 10.222.0.13 () {60 vars in 1317 bytes} [Sat Dec 18 20:49:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-278696102 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:40.417921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81c8cdd7-8cbf-428a-862b-43e564061694 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714fe60f70>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:40.447615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:40.448681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:40.462535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:40.464270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:40.465912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:40.466645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:40.474599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81c8cdd7-8cbf-428a-862b-43e564061694 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1845027814" status: 204 len: 0 microversion: 2.2 time: 0.060683 Dec 18 20:49:40.475483 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 467/941] 10.222.0.13 () {60 vars in 1320 bytes} [Sat Dec 18 20:49:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1845027814 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:40.485612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b32f3497-c125-41d0-8b25-f07546186952 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714fe60c10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:40.580617 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b32f3497-c125-41d0-8b25-f07546186952 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-89882307" status: 204 len: 0 microversion: 2.2 time: 0.100947 Dec 18 20:49:40.581573 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 468/942] 10.222.0.13 () {60 vars in 1314 bytes} [Sat Dec 18 20:49:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-89882307 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:49:40.592961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7cfc6b45-3ec5-4ed9-b82a-bb1b26981b34 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f715c61de50>, body: {"keypair": {"name": "tempest-keypair-1856684782"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:40.632133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7cfc6b45-3ec5-4ed9-b82a-bb1b26981b34 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:40.638123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7cfc6b45-3ec5-4ed9-b82a-bb1b26981b34 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:40.863026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7cfc6b45-3ec5-4ed9-b82a-bb1b26981b34 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:40.868847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7cfc6b45-3ec5-4ed9-b82a-bb1b26981b34 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:40.886506 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7cfc6b45-3ec5-4ed9-b82a-bb1b26981b34 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.297738 Dec 18 20:49:40.887837 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 469/943] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Dec 18 20:49:40 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 300 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:40.896319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:40.897159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:40.913648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:40.913648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:40.914439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:40.914884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:41.358468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:41.390111 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dbf2478e-f5de-4f7a-ae2d-a46707a426d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1276 microversion: 2.1 time: 0.500846 Dec 18 20:49:41.401702 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 470/944] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:40 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1276 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:41.410120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5195010b-cecf-4666-b685-f6f37bce23ed tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f715c8610d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:41.427663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5195010b-cecf-4666-b685-f6f37bce23ed tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1856684782" status: 200 len: 707 microversion: 2.2 time: 0.023373 Dec 18 20:49:41.430959 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 471/945] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Dec 18 20:49:41 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1856684782 => generated 707 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:41.440433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d3c3b8dc-8774-4058-8d42-0a36c3f47566 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:41.441358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d3c3b8dc-8774-4058-8d42-0a36c3f47566 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:41.458480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3c3b8dc-8774-4058-8d42-0a36c3f47566 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:41.460322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3c3b8dc-8774-4058-8d42-0a36c3f47566 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:41.461180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3c3b8dc-8774-4058-8d42-0a36c3f47566 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:41.461856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3c3b8dc-8774-4058-8d42-0a36c3f47566 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:41.560273 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d3c3b8dc-8774-4058-8d42-0a36c3f47566 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.127674 Dec 18 20:49:41.561636 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 472/946] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:41 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:41.572122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-680a4b57-a1fa-4ca4-8d50-685edfc8c962 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714fe71d30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:41.589748 ncdv-master-1 devstack@n-api.service[140731]: WARNING oslo_db.sqlalchemy.utils [None req-680a4b57-a1fa-4ca4-8d50-685edfc8c962 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 18 20:49:41.598110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-680a4b57-a1fa-4ca4-8d50-685edfc8c962 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.035154 Dec 18 20:49:41.604538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 473/947] 10.222.0.13 () {60 vars in 1176 bytes} [Sat Dec 18 20:49:41 2021] GET /compute/v2.1/os-keypairs => generated 564 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:41.614757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6edce84-0e2c-4d8f-9a68-8f8b81820919 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714fde4e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:41.661709 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6edce84-0e2c-4d8f-9a68-8f8b81820919 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856684782" status: 204 len: 0 microversion: 2.2 time: 0.051050 Dec 18 20:49:41.664846 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 474/948] 10.222.0.13 () {60 vars in 1260 bytes} [Sat Dec 18 20:49:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856684782 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:41.673691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Action: 'create', calling method: .version_select at 0x7f714fde4430>, body: {"keypair": {"name": "tempest-keypair-932554777", "type": "x509"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:41.707446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:41.722971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:41.764673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.processutils [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpq7e0l3pu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpq7e0l3pu/temp.key -subj /CN=80d2fe33b7664991a494b98128a3f98b -extensions v3_req_client {{(pid=140731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:49:41.812096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:41.848303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f4b5cdf-271c-4315-8d2e-579ff17e5cc5 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 200 len: 1522 microversion: 2.1 time: 1.404964 Dec 18 20:49:41.849978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 475/949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:40 2021] GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 1522 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:42.061080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.processutils [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpq7e0l3pu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpq7e0l3pu/temp.key -subj /CN=80d2fe33b7664991a494b98128a3f98b -extensions v3_req_client" returned: 0 in 0.296s {{(pid=140731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:49:42.062882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.processutils [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpq7e0l3pu/temp.key -password pass: {{(pid=140731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 18 20:49:42.131964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.processutils [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpq7e0l3pu/temp.key -password pass:" returned: 0 in 0.068s {{(pid=140731) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 18 20:49:42.195915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-854f63ca-0f4c-4fc0-962b-8a31135a086f req-7ddb0ab4-021e-4c0e-acc0-414f6ca37734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7", "name": "network-vif-deleted", "tag": "11404954-527e-4497-8a08-c8e44c3d14a2"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:42.197362 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:42.197362 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:42.224134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-854f63ca-0f4c-4fc0-962b-8a31135a086f req-7ddb0ab4-021e-4c0e-acc0-414f6ca37734 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:42.224551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-854f63ca-0f4c-4fc0-962b-8a31135a086f req-7ddb0ab4-021e-4c0e-acc0-414f6ca37734 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:42.271373 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-854f63ca-0f4c-4fc0-962b-8a31135a086f req-7ddb0ab4-021e-4c0e-acc0-414f6ca37734 service nova] Creating event network-vif-deleted:11404954-527e-4497-8a08-c8e44c3d14a2 for instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 on nch1-master-1 Dec 18 20:49:42.276255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:42.294644 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-854f63ca-0f4c-4fc0-962b-8a31135a086f req-7ddb0ab4-021e-4c0e-acc0-414f6ca37734 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092459 Dec 18 20:49:42.296560 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 476/950] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:42.310703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Getting quotas for user 80d2fe33b7664991a494b98128a3f98b and project b1c3c6cad11948f58170343d52ca3439. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:42.355718 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6db406a7-be47-45d4-8a82-93fbbc05c35d tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.682814 Dec 18 20:49:42.361704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 475/951] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Dec 18 20:49:41 2021] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 692 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:49:42.373850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0130248b-a4bb-4596-aa63-6f140a7bd9c7 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714f9acc10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:42.401101 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0130248b-a4bb-4596-aa63-6f140a7bd9c7 tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-932554777" status: 200 len: 1533 microversion: 2.2 time: 0.037169 Dec 18 20:49:42.409495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:42.410768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:42.420251 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 477/952] 10.222.0.13 () {60 vars in 1254 bytes} [Sat Dec 18 20:49:42 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-932554777 => generated 1533 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:42.431788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-314bf4d7-e0f6-47c8-91b3-6305dc07222c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714f9bbb80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:42.443817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:42.445272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:42.448306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:42.448958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:42.451899 ncdv-master-1 devstack@n-api.service[140732]: WARNING oslo_db.sqlalchemy.utils [None req-314bf4d7-e0f6-47c8-91b3-6305dc07222c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 18 20:49:42.476094 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-314bf4d7-e0f6-47c8-91b3-6305dc07222c tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.047923 Dec 18 20:49:42.477645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 478/953] 10.222.0.13 () {60 vars in 1176 bytes} [Sat Dec 18 20:49:42 2021] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:42.501773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-454b4ef8-9564-4ad6-b2b5-816b118787be tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] Calling method '.version_select at 0x7f714f852dc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:42.571996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-454b4ef8-9564-4ad6-b2b5-816b118787be tempest-KeyPairsV22TestJSON-654306132 tempest-KeyPairsV22TestJSON-654306132-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-932554777" status: 204 len: 0 microversion: 2.2 time: 0.088557 Dec 18 20:49:42.573727 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 479/954] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Dec 18 20:49:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-932554777 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:49:42.604222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9904d84d-0cf7-4adb-9ef8-e3618a4a12d7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:42.607552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9904d84d-0cf7-4adb-9ef8-e3618a4a12d7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:42.628938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9904d84d-0cf7-4adb-9ef8-e3618a4a12d7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:42.634988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9904d84d-0cf7-4adb-9ef8-e3618a4a12d7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:42.638877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9904d84d-0cf7-4adb-9ef8-e3618a4a12d7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:42.640765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9904d84d-0cf7-4adb-9ef8-e3618a4a12d7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:42.778705 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9904d84d-0cf7-4adb-9ef8-e3618a4a12d7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.199594 Dec 18 20:49:42.789798 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 480/955] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:42 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:42.867184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:42.868046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:42.894519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:42.895037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:42.897925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:42.898527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:42.985193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:42.995121 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45630a73-be14-464c-8431-4f60c05b79c5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1276 microversion: 2.1 time: 0.591413 Dec 18 20:49:43.011331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 476/956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:42 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1276 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:49:43.018150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:43.020030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:43.020533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lazy-loading 'fault' on Instance uuid 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:49:43.168942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:43.177760 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6b3d75cb-4412-4232-aa68-4b9accc81874 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 200 len: 1312 microversion: 2.1 time: 0.315223 Dec 18 20:49:43.179506 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 481/957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:42 2021] GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 1312 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:43.479156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-522faacb-f9d3-4f94-9797-460beae89097 tempest-AbsoluteLimitsTestJSON-718846023 tempest-AbsoluteLimitsTestJSON-718846023-project] Calling method '.version_select at 0x7f714fe21430>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:43.494725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-522faacb-f9d3-4f94-9797-460beae89097 tempest-AbsoluteLimitsTestJSON-718846023 tempest-AbsoluteLimitsTestJSON-718846023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:43.495179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-522faacb-f9d3-4f94-9797-460beae89097 tempest-AbsoluteLimitsTestJSON-718846023 tempest-AbsoluteLimitsTestJSON-718846023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:43.496008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-522faacb-f9d3-4f94-9797-460beae89097 tempest-AbsoluteLimitsTestJSON-718846023 tempest-AbsoluteLimitsTestJSON-718846023-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:43.496441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-522faacb-f9d3-4f94-9797-460beae89097 tempest-AbsoluteLimitsTestJSON-718846023 tempest-AbsoluteLimitsTestJSON-718846023-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:43.537696 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-522faacb-f9d3-4f94-9797-460beae89097 tempest-AbsoluteLimitsTestJSON-718846023 tempest-AbsoluteLimitsTestJSON-718846023-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.322405 Dec 18 20:49:43.539181 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 477/958] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:43 2021] GET /compute/v2.1/limits => generated 511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:43.792342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-47b8a80c-80e7-49ef-829e-033c4d5c5417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:43.794287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-47b8a80c-80e7-49ef-829e-033c4d5c5417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:43.808945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b8a80c-80e7-49ef-829e-033c4d5c5417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:43.816742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b8a80c-80e7-49ef-829e-033c4d5c5417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:43.817614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b8a80c-80e7-49ef-829e-033c4d5c5417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:43.818057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b8a80c-80e7-49ef-829e-033c4d5c5417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:43.941982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-47b8a80c-80e7-49ef-829e-033c4d5c5417 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.152609 Dec 18 20:49:43.943600 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 482/959] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:43 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:44.019178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:44.019967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:44.052124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.052747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.053575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.054021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.207473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:44.228509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:44.296212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.297519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.297652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.301580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.337839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] HTTP exception thrown: Instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 could not be found. Dec 18 20:49:44.338584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 404 to user: Instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:44.342313 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d1491057-c875-4fa2-ae37-305251abd94f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 404 len: 111 microversion: 2.1 time: 0.143470 Dec 18 20:49:44.342925 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 483/960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:44 2021] GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:44.354131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:44.374987 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:44.374987 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:44.381728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:44.383259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:44.398504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.401982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.406606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.409310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.597407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-06d09221-360b-41a0-ba1b-2b5321cf5ee8 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.248830 Dec 18 20:49:44.608575 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 484/961] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:49:44 2021] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:49:44.619170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b21da3df-290b-49e3-821a-ea034adf4fb4 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:44.623995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b21da3df-290b-49e3-821a-ea034adf4fb4 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:44.632230 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b21da3df-290b-49e3-821a-ea034adf4fb4 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.022122 Dec 18 20:49:44.637541 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 485/962] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Dec 18 20:49:44 2021] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:44.643570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:44.650699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:44.651709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:44.658081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.658952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.659963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.661937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.713896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:49:44.788945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ec95359-e101-45f4-8f25-aa1f3b9597cd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.150007 Dec 18 20:49:44.798000 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 486/963] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:49:44 2021] GET /compute/v2.1/servers => generated 681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:44.803735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:44.807271 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:44.807271 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:44.808618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:44.809317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.servers [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Removing options 'limit' from query {{(pid=140732) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 18 20:49:44.810199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:44.819975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.821873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.826070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:44.826822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:44.900048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:49:44.968831 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1c3f452-ee0f-4a8d-bb60-0f6acd9415b3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.169248 Dec 18 20:49:44.974993 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 487/964] 10.222.0.13 () {58 vars in 1143 bytes} [Sat Dec 18 20:49:44 2021] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:44.990152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c798d7bf-9637-4f14-8602-1ee1678d01aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:44.995803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c798d7bf-9637-4f14-8602-1ee1678d01aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:45.014574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c798d7bf-9637-4f14-8602-1ee1678d01aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.014852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c798d7bf-9637-4f14-8602-1ee1678d01aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.024314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c798d7bf-9637-4f14-8602-1ee1678d01aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.026809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c798d7bf-9637-4f14-8602-1ee1678d01aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.073814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:45.084123 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab6620e5-a48c-408f-a284-74807f3ea019 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 1.068228 Dec 18 20:49:45.095905 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 478/965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:44 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:45.101967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-38d8eb08-f628-4156-95c1-5a17584fc256 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:45.106034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-38d8eb08-f628-4156-95c1-5a17584fc256 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:45.111348 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-38d8eb08-f628-4156-95c1-5a17584fc256 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021934 Dec 18 20:49:45.111928 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 479/966] 10.222.0.13 () {58 vars in 1141 bytes} [Sat Dec 18 20:49:45 2021] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:45.125300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5ffe62d-b773-42bb-954f-476075381eba tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:45.128372 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c798d7bf-9637-4f14-8602-1ee1678d01aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.147280 Dec 18 20:49:45.130230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5ffe62d-b773-42bb-954f-476075381eba tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:45.135307 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 488/967] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:44 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:45.138565 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5ffe62d-b773-42bb-954f-476075381eba tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018024 Dec 18 20:49:45.140351 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 480/968] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:49:45 2021] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:45.161559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c410549-1d87-4a89-b747-39befe05a160 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:45.185813 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:45.185813 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:45.190754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1c410549-1d87-4a89-b747-39befe05a160 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:45.192504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c410549-1d87-4a89-b747-39befe05a160 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:45.203155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.servers [None req-1c410549-1d87-4a89-b747-39befe05a160 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Flavor 'non_existing_flavor' could not be found {{(pid=140732) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Dec 18 20:49:45.205375 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c410549-1d87-4a89-b747-39befe05a160 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.055974 Dec 18 20:49:45.206285 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 489/969] 10.222.0.13 () {58 vars in 1177 bytes} [Sat Dec 18 20:49:45 2021] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:49:45.217677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:45.226570 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:45.226570 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:45.229144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:45.230540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:45.245201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.246070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.247402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.248267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.464998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-288636e0-dc80-41da-97ad-2b1b5995dd2f tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.251074 Dec 18 20:49:45.476222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:45.481591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:45.482070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:45.482573 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 481/970] 10.222.0.13 () {58 vars in 1173 bytes} [Sat Dec 18 20:49:45 2021] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:49:45.496079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.498768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.502440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.502935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.555612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-68eeb8a3-42d4-4e0d-ba6e-fe690b7f040f req-a47ff0f8-d30d-4bb4-9d16-ed0fed79c21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facfd9bf-d901-4385-a082-8a8c8b44f452", "tag": "9dec9e11-2f64-410a-9138-c76a28139138"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:45.559423 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:45.559423 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:45.590229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-68eeb8a3-42d4-4e0d-ba6e-fe690b7f040f req-a47ff0f8-d30d-4bb4-9d16-ed0fed79c21b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.592121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-68eeb8a3-42d4-4e0d-ba6e-fe690b7f040f req-a47ff0f8-d30d-4bb4-9d16-ed0fed79c21b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.614608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-68eeb8a3-42d4-4e0d-ba6e-fe690b7f040f req-a47ff0f8-d30d-4bb4-9d16-ed0fed79c21b service nova] Creating event network-changed:9dec9e11-2f64-410a-9138-c76a28139138 for instance facfd9bf-d901-4385-a082-8a8c8b44f452 on nch2-master-1 Dec 18 20:49:45.623737 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-68eeb8a3-42d4-4e0d-ba6e-fe690b7f040f req-a47ff0f8-d30d-4bb4-9d16-ed0fed79c21b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077412 Dec 18 20:49:45.640142 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 482/971] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:45.767666 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e09ea4e-4c18-4691-97a2-3907b992ed1b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.294944 Dec 18 20:49:45.771595 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 490/972] 10.222.0.13 () {58 vars in 1183 bytes} [Sat Dec 18 20:49:45 2021] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:49:45.783883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:45.791289 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:45.791289 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:45.794531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:45.799882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:45.812180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.812856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:45.813911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:45.814570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.052531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:49:46.121264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:46.122888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:46.156243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.158177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.159270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.161220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.163915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:46.182640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.183762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.710586 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-381316dc-14e0-47ee-9580-4101cca42157 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.933131 Dec 18 20:49:46.711191 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 483/973] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:49:45 2021] GET /compute/v2.1/servers/detail => generated 3023 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:46.716237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99ef3548-fee0-4b09-ac8c-24e46fc4a884 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:46.717633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99ef3548-fee0-4b09-ac8c-24e46fc4a884 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:46.728662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:46.733832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99ef3548-fee0-4b09-ac8c-24e46fc4a884 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.734476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99ef3548-fee0-4b09-ac8c-24e46fc4a884 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.735496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99ef3548-fee0-4b09-ac8c-24e46fc4a884 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.735941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99ef3548-fee0-4b09-ac8c-24e46fc4a884 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.746141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7754b366-b97f-4ea6-914d-8b277651ca51 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.646360 Dec 18 20:49:46.747571 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 491/974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:46 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:49:46.761858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf033cc9-ba81-4bbe-ba0f-bd9b7a1a8f7e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:46.766001 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:46.766001 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:46.771856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bf033cc9-ba81-4bbe-ba0f-bd9b7a1a8f7e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:46.775724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bf033cc9-ba81-4bbe-ba0f-bd9b7a1a8f7e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.024612 Dec 18 20:49:46.779660 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 492/975] 10.222.0.13 () {58 vars in 1177 bytes} [Sat Dec 18 20:49:46 2021] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:49:46.792073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:46.796570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:46.797434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Searching by: {'deleted': False, 'project_id': '738d51b548fb479f889bd3bb54ca33d5'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:49:46.805348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.806512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.807757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.808354 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99ef3548-fee0-4b09-ac8c-24e46fc4a884 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.095449 Dec 18 20:49:46.808733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.819738 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 484/976] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:46 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:46.852518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:49:46.960125 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-214ab814-e79c-4f1a-a954-ff8e85dc640e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.173993 Dec 18 20:49:46.962292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 493/977] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:49:46 2021] GET /compute/v2.1/servers => generated 681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:46.974878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:46.975722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:46.984328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.985707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:46.987120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:46.987807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.031268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] HTTP exception thrown: Instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 could not be found. Dec 18 20:49:47.031884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 404 to user: Instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:47.032782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20656ded-f97a-4ac1-ad6d-5e17f06c8036 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 404 len: 111 microversion: 2.1 time: 0.062987 Dec 18 20:49:47.033366 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 485/978] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:49:46 2021] DELETE /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:47.042798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:47.046360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:47.071410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.072133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.073137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.075058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.109670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:49:47.251123 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5b85290-f6f4-41a3-bd16-2a9397250df3 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3" status: 204 len: 0 microversion: 2.1 time: 0.210727 Dec 18 20:49:47.252440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 486/979] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:49:47 2021] DELETE /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:47.272570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:47.274230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:47.290197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.294746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.297443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.300327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.338646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:49:47.456658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8966c061-c60c-43c9-a9cd-c22a670e9464 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 204 len: 0 microversion: 2.1 time: 0.198236 Dec 18 20:49:47.457391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82bbcbf5-d1de-4518-8e15-0792c7d67892 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1787958739", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:47.458346 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 487/980] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:49:47 2021] DELETE /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:47.460044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-82bbcbf5-d1de-4518-8e15-0792c7d67892 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] HTTP exception thrown: min_count must be <= max_count Dec 18 20:49:47.460606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82bbcbf5-d1de-4518-8e15-0792c7d67892 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Returning 400 to user: min_count must be <= max_count {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:47.462700 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82bbcbf5-d1de-4518-8e15-0792c7d67892 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.484236 Dec 18 20:49:47.463231 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 494/981] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:46 2021] POST /compute/v2.1/servers => generated 74 bytes in 486 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:47.480130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:47.481873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:47.494603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.495646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.497107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.497696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.523686 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] HTTP exception thrown: Instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 could not be found. Dec 18 20:49:47.524807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 404 to user: Instance 9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:47.526053 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35b32553-e2cd-4558-a119-b1d74947df3e tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7" status: 404 len: 111 microversion: 2.1 time: 0.063061 Dec 18 20:49:47.527462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 488/982] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:47 2021] GET /compute/v2.1/servers/9ed5fd79-297d-4edc-ac1b-b8c9e30c29d7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:49:47.540783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:47.541542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:47.557413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.557535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.558372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.558828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.729116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b98c6802-42c8-429d-baf5-832745b331da req-def090db-fb22-408c-aac7-97bf1baf7845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0b61b0-8c22-420f-9c24-f948a8967c70", "tag": "a52b9904-6215-4656-8796-8cca7fdd5a67"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:47.730642 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:47.730642 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:47.749883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b98c6802-42c8-429d-baf5-832745b331da req-def090db-fb22-408c-aac7-97bf1baf7845 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.750655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b98c6802-42c8-429d-baf5-832745b331da req-def090db-fb22-408c-aac7-97bf1baf7845 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.767605 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b98c6802-42c8-429d-baf5-832745b331da req-def090db-fb22-408c-aac7-97bf1baf7845 service nova] Creating event network-changed:a52b9904-6215-4656-8796-8cca7fdd5a67 for instance bc0b61b0-8c22-420f-9c24-f948a8967c70 on nch2-master-1 Dec 18 20:49:47.773582 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b98c6802-42c8-429d-baf5-832745b331da req-def090db-fb22-408c-aac7-97bf1baf7845 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048199 Dec 18 20:49:47.774641 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 489/983] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:47.780866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c4c043c-50f6-4c4e-a4ee-81db28c99295 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1821503019", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "max_count": 0}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:47.783100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c4c043c-50f6-4c4e-a4ee-81db28c99295 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:47.784063 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c4c043c-50f6-4c4e-a4ee-81db28c99295 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.008113 Dec 18 20:49:47.784903 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 490/984] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:47 2021] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:47.807189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:47.808112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:47.816684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.817329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.818310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.818902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.819023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:47.830389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97dacb27-ff32-48ef-a426-ef7b035ada47 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3" status: 200 len: 1521 microversion: 2.1 time: 0.297693 Dec 18 20:49:47.841404 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 495/985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:47 2021] GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:49:47.849270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed6f23b2-a2e2-423d-8a97-c7802ea61739 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:47.851895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ed6f23b2-a2e2-423d-8a97-c7802ea61739 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:47.871366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6f23b2-a2e2-423d-8a97-c7802ea61739 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.872829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6f23b2-a2e2-423d-8a97-c7802ea61739 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.875388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6f23b2-a2e2-423d-8a97-c7802ea61739 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:47.876949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6f23b2-a2e2-423d-8a97-c7802ea61739 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:47.930131 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed6f23b2-a2e2-423d-8a97-c7802ea61739 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.085830 Dec 18 20:49:47.931931 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 496/986] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:47 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:47.938570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e604411c-e967-49c1-83d0-50eab6edc175 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1970761100", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "max_count": 2.5}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:47.946198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e604411c-e967-49c1-83d0-50eab6edc175 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:47.947070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e604411c-e967-49c1-83d0-50eab6edc175 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013861 Dec 18 20:49:47.959889 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 497/987] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:47 2021] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:48.089223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa12b262-64b1-4d3b-9799-ed85d23a446f tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-867009784", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 0}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:48.090833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa12b262-64b1-4d3b-9799-ed85d23a446f tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:48.091621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa12b262-64b1-4d3b-9799-ed85d23a446f tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.006325 Dec 18 20:49:48.092126 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 498/988] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:48 2021] POST /compute/v2.1/servers => generated 130 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 18 20:49:48.176061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:48.194326 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d7d8e9a-7a35-4db6-ade3-6220e2fa8edb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.408219 Dec 18 20:49:48.195401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e0119ac-fb47-4b57-9d51-76e99a55f749 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-899437331", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 2.5}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:48.195836 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 491/989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:47 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:48.198502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e0119ac-fb47-4b57-9d51-76e99a55f749 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:48.199310 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e0119ac-fb47-4b57-9d51-76e99a55f749 tempest-MultipleCreateNegativeTestJSON-1420622342 tempest-MultipleCreateNegativeTestJSON-1420622342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010905 Dec 18 20:49:48.199854 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 499/990] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:48 2021] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 18 20:49:48.847441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:48.848124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:48.855673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:48.856341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:48.857293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:48.864301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:48.942834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40dcac99-a091-4015-95b7-a1a37cd7d1ed tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:48.945574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40dcac99-a091-4015-95b7-a1a37cd7d1ed tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:48.956527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40dcac99-a091-4015-95b7-a1a37cd7d1ed tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:48.957261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40dcac99-a091-4015-95b7-a1a37cd7d1ed tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:48.958389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40dcac99-a091-4015-95b7-a1a37cd7d1ed tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:48.958994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40dcac99-a091-4015-95b7-a1a37cd7d1ed tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:49.011183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40dcac99-a091-4015-95b7-a1a37cd7d1ed tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.072728 Dec 18 20:49:49.012623 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 500/991] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:48 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:49:49.213638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:49.214406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:49.242715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:49.243685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:49.246058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:49.248738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:49.355979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:49.404713 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6dc35477-985f-4fbd-b79b-8047b36678bd tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3" status: 200 len: 1521 microversion: 2.1 time: 0.557228 Dec 18 20:49:49.410613 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 492/992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:48 2021] GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3 => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:49.707506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:49.804692 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d5455a5-d780-46a6-9f51-b7449bffa18a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.596448 Dec 18 20:49:49.805549 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 501/993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:49 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:49:50.028143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-704fb437-ca43-4422-91a8-4532a438973a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:50.030219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-704fb437-ca43-4422-91a8-4532a438973a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:50.041607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-704fb437-ca43-4422-91a8-4532a438973a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:50.042305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-704fb437-ca43-4422-91a8-4532a438973a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:50.043971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-704fb437-ca43-4422-91a8-4532a438973a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:50.045287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-704fb437-ca43-4422-91a8-4532a438973a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:50.142204 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-704fb437-ca43-4422-91a8-4532a438973a tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.116967 Dec 18 20:49:50.146933 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 493/994] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:50 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:50.346313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78e5319c-8100-40ad-9650-7a92e3486ded tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Calling method '.version_select at 0x7f714f70c700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:50.361696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-651f06b5-73f4-4166-98cc-30deedbca7f0 req-aa8a5cb2-b133-4cb4-9bcc-46192979317d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb62603f-da79-4c9b-adf0-119ab616bbb3", "name": "network-vif-deleted", "tag": "82974d62-28de-42c6-ad7d-6964ede5da22"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:50.363781 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:50.363781 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:50.381749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-651f06b5-73f4-4166-98cc-30deedbca7f0 req-aa8a5cb2-b133-4cb4-9bcc-46192979317d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:50.382660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-651f06b5-73f4-4166-98cc-30deedbca7f0 req-aa8a5cb2-b133-4cb4-9bcc-46192979317d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:50.438786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-651f06b5-73f4-4166-98cc-30deedbca7f0 req-aa8a5cb2-b133-4cb4-9bcc-46192979317d service nova] Creating event network-vif-deleted:82974d62-28de-42c6-ad7d-6964ede5da22 for instance cb62603f-da79-4c9b-adf0-119ab616bbb3 on nch2-master-1 Dec 18 20:49:50.441658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-78e5319c-8100-40ad-9650-7a92e3486ded tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2a855b35-bb16-4cf2-a3d0-d8a4cae82173 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:49:50.442655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-78e5319c-8100-40ad-9650-7a92e3486ded tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Neutron security group 2a855b35-bb16-4cf2-a3d0-d8a4cae82173 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:49:50.443487 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-78e5319c-8100-40ad-9650-7a92e3486ded tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] HTTP exception thrown: Security group 2a855b35-bb16-4cf2-a3d0-d8a4cae82173 does not exist Dec 18 20:49:50.443487 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-627b8de0-c260-4e5a-8c16-c9e41d8ef4d1'] Dec 18 20:49:50.444705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78e5319c-8100-40ad-9650-7a92e3486ded tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Returning 404 to user: Security group 2a855b35-bb16-4cf2-a3d0-d8a4cae82173 does not exist Dec 18 20:49:50.444705 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-627b8de0-c260-4e5a-8c16-c9e41d8ef4d1'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:50.447603 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78e5319c-8100-40ad-9650-7a92e3486ded tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2a855b35-bb16-4cf2-a3d0-d8a4cae82173" status: 404 len: 194 microversion: 2.1 time: 0.353032 Dec 18 20:49:50.448802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 502/995] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:49:50 2021] DELETE /compute/v2.1/os-security-groups/2a855b35-bb16-4cf2-a3d0-d8a4cae82173 => generated 194 bytes in 356 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:50.463959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:50.465473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:50.467722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-651f06b5-73f4-4166-98cc-30deedbca7f0 req-aa8a5cb2-b133-4cb4-9bcc-46192979317d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110046 Dec 18 20:49:50.469138 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 494/996] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:50.481361 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1701f91-c04d-4847-89ad-50e036725236 tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.010549 Dec 18 20:49:50.484406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:50.486097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:50.487649 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 495/997] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Dec 18 20:49:50 2021] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 18 20:49:50.489673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:50.490550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:50.501860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79363ebf-a556-4b0f-a1db-c5ec757bbd4d tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Calling method '.version_select at 0x7f714fc5b8b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:50.741542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2857cd622364f4db1c1bc7b6065f9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738d51b548fb479f889bd3bb54ca33d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:50.761763 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28c69dd9-d4e6-4578-9c59-ca806bd188d2 tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3" status: 200 len: 1307 microversion: 2.1 time: 0.304645 Dec 18 20:49:50.762455 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 503/998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:50 2021] GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3 => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:50.834527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:50.837947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:50.851883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:50.853137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:50.862946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:50.863495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:51.119227 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-79363ebf-a556-4b0f-a1db-c5ec757bbd4d tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.624121 Dec 18 20:49:51.128689 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 496/999] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:49:50 2021] GET /compute/v2.1/os-security-groups => generated 707 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:51.144443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3c5fc26-4562-493a-b306-38c14a500a9b tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Calling method '.version_select at 0x7f714fcfb700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:51.245208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:51.258332 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30695569-624d-4651-8485-c6ffc2e575b6 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.436462 Dec 18 20:49:51.272420 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 504/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:50 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:49:51.274921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2e4c5f4-356c-47a0-9811-034affbac816 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:51.278363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2e4c5f4-356c-47a0-9811-034affbac816 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:51.296683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e4c5f4-356c-47a0-9811-034affbac816 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:51.304918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e4c5f4-356c-47a0-9811-034affbac816 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:51.306282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e4c5f4-356c-47a0-9811-034affbac816 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:51.311699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e4c5f4-356c-47a0-9811-034affbac816 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:51.412334 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2e4c5f4-356c-47a0-9811-034affbac816 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.146657 Dec 18 20:49:51.415454 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 505/1001] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:51 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:51.483252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-f3c5fc26-4562-493a-b306-38c14a500a9b tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:49:51.484312 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f3c5fc26-4562-493a-b306-38c14a500a9b tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] HTTP exception thrown: Insufficient rights for removing default security group. Dec 18 20:49:51.484312 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-83f29a1c-69f8-4f86-a1b6-2908340024fc'] Dec 18 20:49:51.485500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3c5fc26-4562-493a-b306-38c14a500a9b tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Returning 400 to user: Insufficient rights for removing default security group. Dec 18 20:49:51.485500 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-83f29a1c-69f8-4f86-a1b6-2908340024fc'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:51.486642 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3c5fc26-4562-493a-b306-38c14a500a9b tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/836f447d-3eef-4bc3-97ed-61f541682647" status: 400 len: 182 microversion: 2.1 time: 0.356583 Dec 18 20:49:51.487214 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 497/1002] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:49:51 2021] DELETE /compute/v2.1/os-security-groups/836f447d-3eef-4bc3-97ed-61f541682647 => generated 182 bytes in 358 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:49:51.501417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7c3ae121-ff9d-4712-9d2c-6b84a523b82c tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Calling method '.version_select at 0x7f714f7cc1f0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:51.540049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-7c3ae121-ff9d-4712-9d2c-6b84a523b82c tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e4fbd07-8b5e-43d4-a7e9-f78382322999 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:49:51.540652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-7c3ae121-ff9d-4712-9d2c-6b84a523b82c tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Neutron security group 2e4fbd07-8b5e-43d4-a7e9-f78382322999 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:49:51.541171 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-7c3ae121-ff9d-4712-9d2c-6b84a523b82c tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] HTTP exception thrown: Security group 2e4fbd07-8b5e-43d4-a7e9-f78382322999 does not exist Dec 18 20:49:51.541171 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-610e15f2-38e6-4542-a3ab-d07d760af20b'] Dec 18 20:49:51.541761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7c3ae121-ff9d-4712-9d2c-6b84a523b82c tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Returning 404 to user: Security group 2e4fbd07-8b5e-43d4-a7e9-f78382322999 does not exist Dec 18 20:49:51.541761 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-610e15f2-38e6-4542-a3ab-d07d760af20b'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:51.542627 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7c3ae121-ff9d-4712-9d2c-6b84a523b82c tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/2e4fbd07-8b5e-43d4-a7e9-f78382322999" status: 404 len: 194 microversion: 2.1 time: 0.046075 Dec 18 20:49:51.543188 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 506/1003] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 20:49:51 2021] GET /compute/v2.1/os-security-groups/2e4fbd07-8b5e-43d4-a7e9-f78382322999 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:51.556259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4de95686-8f7e-4da5-adf2-25ac6100e702 tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Action: 'update', calling method: .version_select at 0x7f714fd82040>, body: {"security_group": {"name": "tempest-sg-952357559", "description": "tempest-description-636130465"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:51.641014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-4de95686-8f7e-4da5-adf2-25ac6100e702 tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 21ef6feb-6b3e-40f3-a283-8be9ff4e4cda does not exist", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:49:51.642262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-4de95686-8f7e-4da5-adf2-25ac6100e702 tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Neutron security group 21ef6feb-6b3e-40f3-a283-8be9ff4e4cda not found {{(pid=140731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:49:51.642809 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4de95686-8f7e-4da5-adf2-25ac6100e702 tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] HTTP exception thrown: Security group 21ef6feb-6b3e-40f3-a283-8be9ff4e4cda does not exist Dec 18 20:49:51.642809 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-12a905b6-3b68-4585-ad67-ae81160c94a5'] Dec 18 20:49:51.643455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4de95686-8f7e-4da5-adf2-25ac6100e702 tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] Returning 404 to user: Security group 21ef6feb-6b3e-40f3-a283-8be9ff4e4cda does not exist Dec 18 20:49:51.643455 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-12a905b6-3b68-4585-ad67-ae81160c94a5'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:51.645182 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4de95686-8f7e-4da5-adf2-25ac6100e702 tempest-SecurityGroupsNegativeTestJSON-2005243026 tempest-SecurityGroupsNegativeTestJSON-2005243026-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/21ef6feb-6b3e-40f3-a283-8be9ff4e4cda" status: 404 len: 194 microversion: 2.1 time: 0.094448 Dec 18 20:49:51.646190 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 498/1004] 10.222.0.13 () {60 vars in 1289 bytes} [Sat Dec 18 20:49:51 2021] PUT /compute/v2.1/os-security-groups/21ef6feb-6b3e-40f3-a283-8be9ff4e4cda => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:51.780245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:51.781160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: cb62603f-da79-4c9b-adf0-119ab616bbb3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:51.791655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:51.794661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:51.795809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:51.805002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:51.821375 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] HTTP exception thrown: Instance cb62603f-da79-4c9b-adf0-119ab616bbb3 could not be found. Dec 18 20:49:51.822388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 404 to user: Instance cb62603f-da79-4c9b-adf0-119ab616bbb3 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:51.823512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88d36aa1-ee0d-4573-a7a2-6434c09df54b tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3" status: 404 len: 111 microversion: 2.1 time: 0.048179 Dec 18 20:49:51.824290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 507/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:51 2021] GET /compute/v2.1/servers/cb62603f-da79-4c9b-adf0-119ab616bbb3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:51.834875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:51.835631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] [instance: 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:51.844419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:51.845388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:51.846820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:51.847695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:51.889403 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] HTTP exception thrown: Instance 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd could not be found. Dec 18 20:49:51.895933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] Returning 404 to user: Instance 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:49:51.897017 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb18ec64-6060-4660-bc50-c66a1fa72e1a tempest-ListServersNegativeTestJSON-2035833015 tempest-ListServersNegativeTestJSON-2035833015-project] 10.222.0.13 "GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd" status: 404 len: 111 microversion: 2.1 time: 0.066816 Dec 18 20:49:51.898399 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 499/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:51 2021] GET /compute/v2.1/servers/0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:49:52.280047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:52.280619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:52.294535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:52.295091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:52.299093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:52.299815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:52.425034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ded149e-b5af-409d-928f-8296a3a3a3ce tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:52.426006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ded149e-b5af-409d-928f-8296a3a3a3ce tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:52.438703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ded149e-b5af-409d-928f-8296a3a3a3ce tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:52.439162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ded149e-b5af-409d-928f-8296a3a3a3ce tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:52.440031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ded149e-b5af-409d-928f-8296a3a3a3ce tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:52.445142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ded149e-b5af-409d-928f-8296a3a3a3ce tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:52.513359 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ded149e-b5af-409d-928f-8296a3a3a3ce tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.091840 Dec 18 20:49:52.514508 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 500/1007] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:52 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:49:52.543389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c126cd8d-ab98-4fa2-ba86-b0f6b3ea2ed1 req-8d4c6960-bc52-4256-8fe2-b4f7a69cada6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd", "name": "network-vif-deleted", "tag": "92764ad1-5e29-480d-8c4d-12d7121af278"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:52.545639 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:52.545639 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:52.564108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c126cd8d-ab98-4fa2-ba86-b0f6b3ea2ed1 req-8d4c6960-bc52-4256-8fe2-b4f7a69cada6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:52.564570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c126cd8d-ab98-4fa2-ba86-b0f6b3ea2ed1 req-8d4c6960-bc52-4256-8fe2-b4f7a69cada6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:52.608818 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c126cd8d-ab98-4fa2-ba86-b0f6b3ea2ed1 req-8d4c6960-bc52-4256-8fe2-b4f7a69cada6 service nova] Creating event network-vif-deleted:92764ad1-5e29-480d-8c4d-12d7121af278 for instance 0d0e8e45-b20a-4058-bcb5-4c4fdaeecadd on nch1-master-1 Dec 18 20:49:52.626438 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c126cd8d-ab98-4fa2-ba86-b0f6b3ea2ed1 req-8d4c6960-bc52-4256-8fe2-b4f7a69cada6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075285 Dec 18 20:49:52.627174 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 501/1008] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:52.956879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:52.974884 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4e99b8e-57be-48cd-a546-2c3549f11bb4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.698466 Dec 18 20:49:53.004721 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 508/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:52 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:53.528784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9872a909-fcd0-430d-a577-e54a7a47ab77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:53.529871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9872a909-fcd0-430d-a577-e54a7a47ab77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:53.550869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9872a909-fcd0-430d-a577-e54a7a47ab77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:53.552647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9872a909-fcd0-430d-a577-e54a7a47ab77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:53.554783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9872a909-fcd0-430d-a577-e54a7a47ab77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:53.556690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9872a909-fcd0-430d-a577-e54a7a47ab77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:53.660138 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9872a909-fcd0-430d-a577-e54a7a47ab77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.136814 Dec 18 20:49:53.676371 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 502/1010] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:53 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:53.992516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:53.993507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:54.012771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:54.019509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:54.020376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:54.020820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:54.324256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:54.338480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35291ffc-07e0-4011-9511-7c82ed8aabfd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.345278 Dec 18 20:49:54.339377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 503/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:53 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:54.398066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f79dc0c-a33c-4629-8355-86007297cfcd tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Action: 'create', calling method: .version_select at 0x7f714f877f70>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-842702607", "policies": ["affinity"]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:54.418888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4f79dc0c-a33c-4629-8355-86007297cfcd tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:54.439782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4f79dc0c-a33c-4629-8355-86007297cfcd tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:54.493387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4f79dc0c-a33c-4629-8355-86007297cfcd tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:54.498659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4f79dc0c-a33c-4629-8355-86007297cfcd tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:54.513029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f79dc0c-a33c-4629-8355-86007297cfcd tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.575932 Dec 18 20:49:54.519671 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 509/1012] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 20:49:53 2021] POST /compute/v2.1/os-server-groups => generated 183 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:54.525204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f8f0c78-74ad-488b-bae7-cf649e34d6d3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Action: 'create', calling method: .version_select at 0x7f714fcbf5e0>, body: {"server_group": {"name": "tempest-server-group-1391407462", "policies": ["affinity"]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:54.554431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4f8f0c78-74ad-488b-bae7-cf649e34d6d3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:54.565289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4f8f0c78-74ad-488b-bae7-cf649e34d6d3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:54.633416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4f8f0c78-74ad-488b-bae7-cf649e34d6d3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:54.643603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4f8f0c78-74ad-488b-bae7-cf649e34d6d3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:54.661568 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4f8f0c78-74ad-488b-bae7-cf649e34d6d3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.140254 Dec 18 20:49:54.663341 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 504/1013] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Dec 18 20:49:54 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:54.671962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-26715be3-ff19-4cb3-befc-5985678be624 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Action: 'create', calling method: .version_select at 0x7f714fbad310>, body: {"server_group": {"name": "tempest-server-group-1391407462", "policies": ["affinity"]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:54.710776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26a802e2-ccd0-4101-90d3-87fc2f66a87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:54.714169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26a802e2-ccd0-4101-90d3-87fc2f66a87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:54.716408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-26715be3-ff19-4cb3-befc-5985678be624 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:54.751685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a802e2-ccd0-4101-90d3-87fc2f66a87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:54.752428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a802e2-ccd0-4101-90d3-87fc2f66a87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:54.754787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a802e2-ccd0-4101-90d3-87fc2f66a87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:54.756661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a802e2-ccd0-4101-90d3-87fc2f66a87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:54.783937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-26715be3-ff19-4cb3-befc-5985678be624 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:54.853133 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26a802e2-ccd0-4101-90d3-87fc2f66a87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.168251 Dec 18 20:49:54.856164 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 505/1014] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:54 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:54.916838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-26715be3-ff19-4cb3-befc-5985678be624 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:54.929330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-26715be3-ff19-4cb3-befc-5985678be624 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:54.991494 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-26715be3-ff19-4cb3-befc-5985678be624 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.314290 Dec 18 20:49:54.995706 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 510/1015] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Dec 18 20:49:54 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:55.006977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a325502-6c37-47d1-a295-a05b7d9c9db6 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.083852 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a325502-6c37-47d1-a295-a05b7d9c9db6 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/f2328f19-dc02-462b-9bd1-8de50ced1187" status: 204 len: 0 microversion: 2.1 time: 0.081747 Dec 18 20:49:55.085066 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 506/1016] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:49:55 2021] DELETE /compute/v2.1/os-server-groups/f2328f19-dc02-462b-9bd1-8de50ced1187 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:55.092492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ee878fa-decd-45d0-8dd8-783c4cd3ec12 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.122063 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ee878fa-decd-45d0-8dd8-783c4cd3ec12 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.032246 Dec 18 20:49:55.122603 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 511/1017] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:49:55 2021] GET /compute/v2.1/os-server-groups => generated 334 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:55.141516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-268969b7-c87d-4e86-a3d3-b3d262ef77ef tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.190807 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-268969b7-c87d-4e86-a3d3-b3d262ef77ef tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/17abe55e-4fed-4673-b479-52503bdee27c" status: 204 len: 0 microversion: 2.1 time: 0.061641 Dec 18 20:49:55.192326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 507/1018] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:49:55 2021] DELETE /compute/v2.1/os-server-groups/17abe55e-4fed-4673-b479-52503bdee27c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:55.201226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c817275c-0f5c-4e77-94b6-ee2772111d41 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.215812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c817275c-0f5c-4e77-94b6-ee2772111d41 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018920 Dec 18 20:49:55.229650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3f46a70f-675d-48d7-a98e-19424cd12baa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Action: 'create', calling method: .version_select at 0x7f714fcbfca0>, body: {"server_group": {"name": "tempest-server-group-2069854773", "policies": ["affinity"]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:55.234112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 512/1019] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:49:55 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:55.266065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3f46a70f-675d-48d7-a98e-19424cd12baa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:55.276611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3f46a70f-675d-48d7-a98e-19424cd12baa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:55.340548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3f46a70f-675d-48d7-a98e-19424cd12baa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:55.348364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3f46a70f-675d-48d7-a98e-19424cd12baa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:55.359397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.360703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:55.366169 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3f46a70f-675d-48d7-a98e-19424cd12baa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.141656 Dec 18 20:49:55.368225 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 508/1020] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Dec 18 20:49:55 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:55.369757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:55.372039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:55.373107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:55.378405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:55.384632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed18de59-7eff-4ceb-9d9f-035e7d1d659b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.428637 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed18de59-7eff-4ceb-9d9f-035e7d1d659b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/0ae2b6aa-38c2-4a1f-baa9-3792c14d3ab0" status: 204 len: 0 microversion: 2.1 time: 0.054405 Dec 18 20:49:55.432212 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 509/1021] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:49:55 2021] DELETE /compute/v2.1/os-server-groups/0ae2b6aa-38c2-4a1f-baa9-3792c14d3ab0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:55.440334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-194adfad-59a3-430a-9348-ae5a3b294679 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.465925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-194adfad-59a3-430a-9348-ae5a3b294679 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032003 Dec 18 20:49:55.467761 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 510/1022] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:49:55 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:55.483544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43912395-6f57-493b-a131-7ea0b37c2db4 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Action: 'create', calling method: .version_select at 0x7f714fcfb1f0>, body: {"server_group": {"name": "tempest-server-group-1270098973", "policies": ["anti-affinity"]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:55.532043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43912395-6f57-493b-a131-7ea0b37c2db4 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:55.547851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43912395-6f57-493b-a131-7ea0b37c2db4 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:55.688859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43912395-6f57-493b-a131-7ea0b37c2db4 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:55.702323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43912395-6f57-493b-a131-7ea0b37c2db4 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_groups'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:55.731400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:55.743706 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43912395-6f57-493b-a131-7ea0b37c2db4 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.268357 Dec 18 20:49:55.745960 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 511/1023] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Dec 18 20:49:55 2021] POST /compute/v2.1/os-server-groups => generated 169 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:55.751810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c4a538e-7874-4777-9980-079ed6c0e934 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.397074 Dec 18 20:49:55.754080 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 513/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:55 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:49:55.765727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-374ffd26-3a7c-41b3-b940-4c737c22e9ba tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.768311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ebe751f1-5a51-4897-9147-e1ba133fde9d req-99802a3c-2cfa-40c5-984c-f7308b36ea7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facfd9bf-d901-4385-a082-8a8c8b44f452", "name": "network-vif-plugged", "status": "completed", "tag": "9dec9e11-2f64-410a-9138-c76a28139138"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:55.772441 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:55.772441 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:49:55.801677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ebe751f1-5a51-4897-9147-e1ba133fde9d req-99802a3c-2cfa-40c5-984c-f7308b36ea7a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:55.802806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ebe751f1-5a51-4897-9147-e1ba133fde9d req-99802a3c-2cfa-40c5-984c-f7308b36ea7a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:55.829196 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ebe751f1-5a51-4897-9147-e1ba133fde9d req-99802a3c-2cfa-40c5-984c-f7308b36ea7a service nova] Creating event network-vif-plugged:9dec9e11-2f64-410a-9138-c76a28139138 for instance facfd9bf-d901-4385-a082-8a8c8b44f452 on nch2-master-1 Dec 18 20:49:55.848248 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ebe751f1-5a51-4897-9147-e1ba133fde9d req-99802a3c-2cfa-40c5-984c-f7308b36ea7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090651 Dec 18 20:49:55.849171 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 512/1025] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:55.866663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55a8db79-3432-419d-bccf-dc4035e36587 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:55.869186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-55a8db79-3432-419d-bccf-dc4035e36587 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:55.886719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55a8db79-3432-419d-bccf-dc4035e36587 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:55.890561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55a8db79-3432-419d-bccf-dc4035e36587 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:55.893601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55a8db79-3432-419d-bccf-dc4035e36587 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:55.895234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55a8db79-3432-419d-bccf-dc4035e36587 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:55.911368 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-374ffd26-3a7c-41b3-b940-4c737c22e9ba tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/4a5d08bb-1b45-42e7-bc73-40558274ca56" status: 204 len: 0 microversion: 2.1 time: 0.152363 Dec 18 20:49:55.915375 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 514/1026] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:49:55 2021] DELETE /compute/v2.1/os-server-groups/4a5d08bb-1b45-42e7-bc73-40558274ca56 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:49:55.956199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5df45c29-8db4-490d-9c70-fd119d80574b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:55.995073 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55a8db79-3432-419d-bccf-dc4035e36587 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.132617 Dec 18 20:49:55.995963 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 513/1027] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:55 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:49:56.008302 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5df45c29-8db4-490d-9c70-fd119d80574b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.088861 Dec 18 20:49:56.009185 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 515/1028] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:49:55 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:49:56.356236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-785529265", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5add456a-9bbd-4aa2-9bf5-99911f13e36c"}]}, "os:scheduler_hints": {"group": "dab84d10-6689-462b-98bd-114ee80923ce"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:56.522401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] validate_networks() for [('5add456a-9bbd-4aa2-9bf5-99911f13e36c', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:49:56.770442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:56.772276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:56.784435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:56.785142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:56.787426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:56.788505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:57.495830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:57.507350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80b54d36-6e64-4b4a-b71b-99bf7a0ee955 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.742313 Dec 18 20:49:57.510396 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 516/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:56 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:49:57.519500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5df72fb7-c7fe-4687-8c2f-0c3caa8fd8d4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:57.524496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5df72fb7-c7fe-4687-8c2f-0c3caa8fd8d4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:57.557254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5df72fb7-c7fe-4687-8c2f-0c3caa8fd8d4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:57.560603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5df72fb7-c7fe-4687-8c2f-0c3caa8fd8d4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:57.581600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5df72fb7-c7fe-4687-8c2f-0c3caa8fd8d4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:57.584023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5df72fb7-c7fe-4687-8c2f-0c3caa8fd8d4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:57.706057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5df72fb7-c7fe-4687-8c2f-0c3caa8fd8d4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.194191 Dec 18 20:49:57.706730 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 517/1030] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:57 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:57.728393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:49:57.729441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:49:57.730460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:49:57.731344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:49:57.732580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:49:57.775109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:57.780104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:57.781045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:57.781488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:57.842114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:57.858644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:57.885231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:49:57.891897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:57.933283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c5106df4-01e1-4ea3-a0cd-24752dbd3301 req-6870b97d-9d06-47b0-b273-4ad2849ca3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0b61b0-8c22-420f-9c24-f948a8967c70", "name": "network-vif-plugged", "status": "completed", "tag": "a52b9904-6215-4656-8796-8cca7fdd5a67"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:57.937555 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:49:57.937555 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:49:57.988435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:57.994853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:58.000024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c5106df4-01e1-4ea3-a0cd-24752dbd3301 req-6870b97d-9d06-47b0-b273-4ad2849ca3f8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:58.004184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c5106df4-01e1-4ea3-a0cd-24752dbd3301 req-6870b97d-9d06-47b0-b273-4ad2849ca3f8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:58.044105 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c5106df4-01e1-4ea3-a0cd-24752dbd3301 req-6870b97d-9d06-47b0-b273-4ad2849ca3f8 service nova] Creating event network-vif-plugged:a52b9904-6215-4656-8796-8cca7fdd5a67 for instance bc0b61b0-8c22-420f-9c24-f948a8967c70 on nch2-master-1 Dec 18 20:49:58.058770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:58.064846 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c5106df4-01e1-4ea3-a0cd-24752dbd3301 req-6870b97d-9d06-47b0-b273-4ad2849ca3f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139906 Dec 18 20:49:58.065773 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 518/1031] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:49:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:49:58.077092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Getting quotas for user 1fe3e4b89a9d489783a83b38a7a70c8b and project 0793f7505c664b34adc128f8bd38e5b6. Resources: {'server_group_members'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:58.148302 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95a9b0b5-c365-4d4c-9954-df047c8d919b tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.797865 Dec 18 20:49:58.149503 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 514/1032] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:49:58.162617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d8bf130-367f-4d0c-bfb0-0d543167a8cf tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:58.166739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d8bf130-367f-4d0c-bfb0-0d543167a8cf tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:58.355958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-631543423", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "59f40b0b-9ec4-4ee7-b7f3-f7178ec0b215"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:58.474916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] validate_networks() for [('59f40b0b-9ec4-4ee7-b7f3-f7178ec0b215', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:49:58.790136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8d8bf130-367f-4d0c-bfb0-0d543167a8cf tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:58.799400 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d8bf130-367f-4d0c-bfb0-0d543167a8cf tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1212 microversion: 2.1 time: 0.644137 Dec 18 20:49:58.800635 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 515/1033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:58 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1212 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:58.805294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:58.807989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:58.820990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:58.822735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:58.823755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:58.824382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:59.209722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:49:59.225724 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7c76537-df5c-463b-bdee-701dcc632881 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.423735 Dec 18 20:49:59.239374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 516/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:58 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:49:59.251705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fbe8b69-f76d-47eb-b339-1eecddd6b1e6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:49:59.261444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8fbe8b69-f76d-47eb-b339-1eecddd6b1e6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:59.284014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbe8b69-f76d-47eb-b339-1eecddd6b1e6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:59.288160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbe8b69-f76d-47eb-b339-1eecddd6b1e6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:59.288160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbe8b69-f76d-47eb-b339-1eecddd6b1e6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:59.288160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbe8b69-f76d-47eb-b339-1eecddd6b1e6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:59.396063 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fbe8b69-f76d-47eb-b339-1eecddd6b1e6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.151184 Dec 18 20:49:59.407654 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 517/1035] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:49:59 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:49:59.667403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:49:59.668011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:49:59.668634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:49:59.669148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:49:59.669674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:49:59.680205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:59.680957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:59.683311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:59.684045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:59.710751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Getting quotas for project 835793f458834c0387829e418f6e3b4c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:49:59.717995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Getting quotas for user 1906a27b85764875af7fe46c07b32595 and project 835793f458834c0387829e418f6e3b4c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:49:59.741179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:49:59.744023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:49:59.818781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:59.819496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:59.833803 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-33458494-555b-4eb7-b4a8-1ee8a71e6313 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763273 Dec 18 20:49:59.840259 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 519/1036] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:49:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:49:59.848290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25bf85a6-2e4e-455e-a9a1-1186e17bfd69 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:49:59.849154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25bf85a6-2e4e-455e-a9a1-1186e17bfd69 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:49:59.855294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:59.855751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:49:59.858371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:49:59.858834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:00.164026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:00.188824 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b19521f5-a6ae-49db-b303-d81635f766e3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1264 microversion: 2.1 time: 0.373838 Dec 18 20:50:00.189035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-25bf85a6-2e4e-455e-a9a1-1186e17bfd69 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:00.194523 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 518/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:59 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1264 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:00.221203 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25bf85a6-2e4e-455e-a9a1-1186e17bfd69 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1216 microversion: 2.1 time: 0.378759 Dec 18 20:50:00.225537 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 520/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:49:59 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1216 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:00.245156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:00.246106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:00.270064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:00.272701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:00.273812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:00.274446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:00.417603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e03f2f5-f0af-4470-aed2-72cc7e5b4b8e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:00.418617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0e03f2f5-f0af-4470-aed2-72cc7e5b4b8e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:00.442986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e03f2f5-f0af-4470-aed2-72cc7e5b4b8e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:00.443226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e03f2f5-f0af-4470-aed2-72cc7e5b4b8e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:00.459101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e03f2f5-f0af-4470-aed2-72cc7e5b4b8e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:00.462860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e03f2f5-f0af-4470-aed2-72cc7e5b4b8e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:00.645577 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e03f2f5-f0af-4470-aed2-72cc7e5b4b8e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.230444 Dec 18 20:50:00.650357 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 521/1039] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:00 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:50:01.210001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:01.210991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:01.228080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:01.239405 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ea83e91-2548-4ff0-9c2d-6f7f8c003b9b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1318 microversion: 2.1 time: 0.998111 Dec 18 20:50:01.240722 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 519/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:00 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1318 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:01.248685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:01.251159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:01.252656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:01.255834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:01.260115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:01.262911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:01.267265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:01.268409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:01.272719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:01.273279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:01.444781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:01.456042 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d2d9457-3398-4e0d-86e4-7a70cbdc4ba2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1268 microversion: 2.1 time: 0.212957 Dec 18 20:50:01.456676 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 520/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:01 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1268 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:01.464643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:01.483505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f8cf32e-70c2-4022-b0d4-168f68f7f706 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1270 microversion: 2.1 time: 0.270825 Dec 18 20:50:01.483505 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 522/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:01 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1270 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:50:01.601663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-829575658", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "e8ba14b5-3312-482e-8a8a-ef9381273d02"}, {"uuid": "d59d55b4-8f6a-4b3c-83fa-e38eff3905d0"}, {"uuid": "e8ba14b5-3312-482e-8a8a-ef9381273d02"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:01.661353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b683fc4-eb1f-4225-8aca-048937c3f406 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:01.662748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b683fc4-eb1f-4225-8aca-048937c3f406 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:01.669438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b683fc4-eb1f-4225-8aca-048937c3f406 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:01.691036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b683fc4-eb1f-4225-8aca-048937c3f406 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:01.691917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b683fc4-eb1f-4225-8aca-048937c3f406 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:01.692368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b683fc4-eb1f-4225-8aca-048937c3f406 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:01.720614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] validate_networks() for [('e8ba14b5-3312-482e-8a8a-ef9381273d02', None, None, None, None, None), ('d59d55b4-8f6a-4b3c-83fa-e38eff3905d0', None, None, None, None, None), ('e8ba14b5-3312-482e-8a8a-ef9381273d02', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:01.824196 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b683fc4-eb1f-4225-8aca-048937c3f406 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.167520 Dec 18 20:50:01.825146 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 523/1043] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:01 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:02.257677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:02.258825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:02.275304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:02.275770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:02.278676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:02.282226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:02.708423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:02.723647 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32d32da2-3dea-4c3e-847d-154579c7697c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1468 microversion: 2.1 time: 0.470244 Dec 18 20:50:02.739093 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 524/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:02 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:50:02.748161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:02.751404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:02.767589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:02.768406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:02.772702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:02.773633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:02.940062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:02.955126 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9fa99239-2eee-4b12-8953-6093ea8acfba tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1274 microversion: 2.1 time: 0.214329 Dec 18 20:50:02.963304 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 525/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:02 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:02.983268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:02.984345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:03.003473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:03.004076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:03.005004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:03.007378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:04.175942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:04.188570 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8baf8b1a-5142-4d16-aa6b-fe66425d932c tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 1.211196 Dec 18 20:50:04.192616 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 526/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:02 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:04.215981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:04.219141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:04.243828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:04.243828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:04.244748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:04.249282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:04.966969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:04.974477 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72115f56-951b-4ab2-bf09-7b6ff96af026 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452" status: 200 len: 1468 microversion: 2.1 time: 0.778144 Dec 18 20:50:04.986392 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 527/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:04 2021] GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452 => generated 1468 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:04.991358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-884c2d70-6cda-46ee-a064-ccaf1bcd0681 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:04.992335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-884c2d70-6cda-46ee-a064-ccaf1bcd0681 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:05.029796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-884c2d70-6cda-46ee-a064-ccaf1bcd0681 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:05.030240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-884c2d70-6cda-46ee-a064-ccaf1bcd0681 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:05.035797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-884c2d70-6cda-46ee-a064-ccaf1bcd0681 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:05.036483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-884c2d70-6cda-46ee-a064-ccaf1bcd0681 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:05.135839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-884c2d70-6cda-46ee-a064-ccaf1bcd0681 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.147860 Dec 18 20:50:05.137147 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 528/1048] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:04 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:05.158159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:05.158957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:05.179127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:05.179746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:05.181980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:05.182738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:06.190964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:06.192235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:06.193280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:06.193850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:06.194478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:06.213041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:06.214199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:06.217929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:06.218423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:06.263495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:06.267970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Getting quotas for project 260f5423c9c44b499073e360e0e66264. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:06.280564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Getting quotas for user 8cf273e7f6d646c4a6c46bc7a197c6a3 and project 260f5423c9c44b499073e360e0e66264. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:06.288337 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab94e1ab-464a-44c9-84f5-9d9baa779c95 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1316 microversion: 2.1 time: 1.145900 Dec 18 20:50:06.290895 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 529/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:05 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1316 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:06.314232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:06.324755 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:06.324755 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:06.330146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:06.333581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:06.336511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:06.340323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Searching by: {'reservation_id': 'r-r7f04utk', 'deleted': False, 'project_id': '9ce640720b084b84a86f590d354dad25'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:50:06.366882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:06.389327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:06.395173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:06.399527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:06.443072 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c68c8df8-6685-493c-afb3-574fefe97f9d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.845693 Dec 18 20:50:06.443730 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 521/1050] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 4847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:06.499272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:06.505023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:06.526387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:06.527325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:06.530168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:06.533346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:06.625697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:50:06.834537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:06.863155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:06.865403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.352008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:07.374145 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7cccc391-e66d-4993-8256-3d10f88acc68 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 0.914419 Dec 18 20:50:07.377031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 522/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:06 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:07.388174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c87e741-ed12-4415-a12a-3fd5cf557941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:07.389534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c87e741-ed12-4415-a12a-3fd5cf557941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:07.439144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c87e741-ed12-4415-a12a-3fd5cf557941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.440842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c87e741-ed12-4415-a12a-3fd5cf557941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.446615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c87e741-ed12-4415-a12a-3fd5cf557941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.449250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c87e741-ed12-4415-a12a-3fd5cf557941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.553600 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c87e741-ed12-4415-a12a-3fd5cf557941 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.174288 Dec 18 20:50:07.554364 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 523/1052] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:07 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:07.581648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:07.590912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:07.612140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.612610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.614426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.615338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.755835 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac5fedfc-456b-4b16-9445-87ea253a68b1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-r7f04utk" status: 200 len: 2929 microversion: 2.1 time: 1.456679 Dec 18 20:50:07.757430 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 530/1053] 10.222.0.13 () {58 vars in 1196 bytes} [Sat Dec 18 20:50:06 2021] GET /compute/v2.1/servers/detail?reservation_id=r-r7f04utk => generated 2929 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:07.762522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b9ab1333-20e2-423f-a15b-f83263a53e4d req-fdeda23b-36f6-4b9b-abc5-5d011c34e551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d2c622-4e87-45cc-aac2-313c30dd4c88", "tag": "3cb32a2c-a146-40ee-826d-31f36365ea91"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:07.767614 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:07.767614 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:07.787283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9ab1333-20e2-423f-a15b-f83263a53e4d req-fdeda23b-36f6-4b9b-abc5-5d011c34e551 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.787629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:07.788090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9ab1333-20e2-423f-a15b-f83263a53e4d req-fdeda23b-36f6-4b9b-abc5-5d011c34e551 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.799982 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-957c63a5-ca4c-4324-bc94-b019a9394a1b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1208 microversion: 2.1 time: 0.243951 Dec 18 20:50:07.802494 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 524/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:07 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1208 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:07.813281 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b9ab1333-20e2-423f-a15b-f83263a53e4d req-fdeda23b-36f6-4b9b-abc5-5d011c34e551 service nova] Creating event network-changed:3cb32a2c-a146-40ee-826d-31f36365ea91 for instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 on nch1-master-1 Dec 18 20:50:07.814110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3b3a6a91-c832-490d-8c34-0081b44bd028 req-65f2640d-1298-47ad-a15d-0452162e0cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930716df-900f-446a-8ca4-f1bc174e3345", "tag": "713b1105-c226-474e-8fd2-e067be484d6a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:07.818176 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:07.818176 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:07.820215 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b9ab1333-20e2-423f-a15b-f83263a53e4d req-fdeda23b-36f6-4b9b-abc5-5d011c34e551 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061303 Dec 18 20:50:07.827049 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 531/1055] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:07.832993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:07.838178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3b3a6a91-c832-490d-8c34-0081b44bd028 req-65f2640d-1298-47ad-a15d-0452162e0cc2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.839320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:07.839864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3b3a6a91-c832-490d-8c34-0081b44bd028 req-65f2640d-1298-47ad-a15d-0452162e0cc2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.849390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.853819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.854905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.855507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:07.872015 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3b3a6a91-c832-490d-8c34-0081b44bd028 req-65f2640d-1298-47ad-a15d-0452162e0cc2 service nova] Creating event network-changed:713b1105-c226-474e-8fd2-e067be484d6a for instance 930716df-900f-446a-8ca4-f1bc174e3345 on nch1-master-1 Dec 18 20:50:07.879946 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3b3a6a91-c832-490d-8c34-0081b44bd028 req-65f2640d-1298-47ad-a15d-0452162e0cc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075139 Dec 18 20:50:07.881605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 525/1056] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:07.889410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac9fe85f-f0d9-40c3-a410-d6787ea36bfb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:07.936519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.compute.server_groups [None req-ac9fe85f-f0d9-40c3-a410-d6787ea36bfb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Querying cell cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) for 2 instances {{(pid=140731) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 18 20:50:07.948744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac9fe85f-f0d9-40c3-a410-d6787ea36bfb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:07.950172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac9fe85f-f0d9-40c3-a410-d6787ea36bfb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.061708 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac9fe85f-f0d9-40c3-a410-d6787ea36bfb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/240cf658-8624-46e5-9566-26dfa7b69a27" status: 200 len: 265 microversion: 2.1 time: 0.178485 Dec 18 20:50:08.062875 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 526/1057] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:50:07 2021] GET /compute/v2.1/os-server-groups/240cf658-8624-46e5-9566-26dfa7b69a27 => generated 265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:08.075316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e199c091-3df1-4407-b438-e1be0e563ec4 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:08.077081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e199c091-3df1-4407-b438-e1be0e563ec4 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:08.110168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e199c091-3df1-4407-b438-e1be0e563ec4 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.111070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e199c091-3df1-4407-b438-e1be0e563ec4 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.112469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e199c091-3df1-4407-b438-e1be0e563ec4 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.113110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e199c091-3df1-4407-b438-e1be0e563ec4 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.591639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:08.613682 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ae1a39a-78d5-46d5-8116-fb31a39cfb3e tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1316 microversion: 2.1 time: 0.776609 Dec 18 20:50:08.614764 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 532/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:07 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:08.631067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:08.644027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:08.660604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.661796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.664182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.666979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.779023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e199c091-3df1-4407-b438-e1be0e563ec4 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 200 len: 1619 microversion: 2.1 time: 0.709400 Dec 18 20:50:08.786037 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 527/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:08 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 1619 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:08.791467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bec1bff6-7b3f-4cac-b9bd-6c009eb792f9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:08.794895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bec1bff6-7b3f-4cac-b9bd-6c009eb792f9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:08.801517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bec1bff6-7b3f-4cac-b9bd-6c009eb792f9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.802344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bec1bff6-7b3f-4cac-b9bd-6c009eb792f9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.803322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bec1bff6-7b3f-4cac-b9bd-6c009eb792f9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.803916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bec1bff6-7b3f-4cac-b9bd-6c009eb792f9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.868427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bec1bff6-7b3f-4cac-b9bd-6c009eb792f9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.080714 Dec 18 20:50:08.869131 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 528/1060] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:08 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:08.887559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6f8defe-507f-421e-9307-a0a51531afdc tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:08.895575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6f8defe-507f-421e-9307-a0a51531afdc tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:08.907314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f8defe-507f-421e-9307-a0a51531afdc tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.908027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f8defe-507f-421e-9307-a0a51531afdc tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:08.909217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f8defe-507f-421e-9307-a0a51531afdc tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:08.909833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f8defe-507f-421e-9307-a0a51531afdc tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:09.178668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:09.188469 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0fb8ac76-f670-482d-8c56-ddcd953b0b95 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 0.571999 Dec 18 20:50:09.194165 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 533/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:08 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:09.212952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:09.217984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:09.231652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:09.232104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:09.232895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:09.233335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:09.357376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:09.366033 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5fe4a6a4-9042-4f17-8c7c-34ed5811aee4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1270 microversion: 2.1 time: 0.170527 Dec 18 20:50:09.375160 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 534/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:09 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:09.404172 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6f8defe-507f-421e-9307-a0a51531afdc tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452" status: 200 len: 1619 microversion: 2.1 time: 0.530177 Dec 18 20:50:09.404751 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 529/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:08 2021] GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452 => generated 1619 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:09.422681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ce9e968-66af-486d-95a4-f18dfaa3d757 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: .version_select at 0x7f714f6df280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1716121479", "policies": ["anti-affinity"]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:09.453678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7ce9e968-66af-486d-95a4-f18dfaa3d757 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:09.477782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7ce9e968-66af-486d-95a4-f18dfaa3d757 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:09.584724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7ce9e968-66af-486d-95a4-f18dfaa3d757 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:09.591714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7ce9e968-66af-486d-95a4-f18dfaa3d757 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_groups'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:09.622492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ce9e968-66af-486d-95a4-f18dfaa3d757 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.203333 Dec 18 20:50:09.623344 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 535/1064] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 20:50:09 2021] POST /compute/v2.1/os-server-groups => generated 193 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:09.641033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:09.641710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:09.656914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:09.657372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:09.665791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:09.666574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:09.831820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-505719994", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0e39aefe-f4e1-48eb-8293-0ba96f3d68a1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:09.908754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:09.951800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:09.960894 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-338f50ce-5bc5-4c7f-81b6-0062c08514e2 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1316 microversion: 2.1 time: 0.325726 Dec 18 20:50:09.964497 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 530/1065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:09 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:09.973655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-96cb187e-c284-4dc0-8542-e5b7ffccf399 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:09.973655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-96cb187e-c284-4dc0-8542-e5b7ffccf399 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:10.001956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96cb187e-c284-4dc0-8542-e5b7ffccf399 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.002994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96cb187e-c284-4dc0-8542-e5b7ffccf399 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.004311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96cb187e-c284-4dc0-8542-e5b7ffccf399 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.005038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96cb187e-c284-4dc0-8542-e5b7ffccf399 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.083444 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-96cb187e-c284-4dc0-8542-e5b7ffccf399 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.117145 Dec 18 20:50:10.084884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 531/1066] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:09 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:10.222516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:10.223456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:10.232662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.233139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.234162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.234878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.291290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:10.292579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:10.293278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:10.296278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:10.298209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:10.324784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.325641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.326745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.327363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.353175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:10.361020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:10.381275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Going to run 2 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:10.384913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:10.448068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140732) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Dec 18 20:50:10.473440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:10.479600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:10.564701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:10.572021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:10.582029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:10.622285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=6cadd365-eceb-4a91-93b6-4514be9ac919,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:10.623349 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-faf9beff-6756-41a3-803b-03cf77103230 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 0.413956 Dec 18 20:50:10.624118 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 532/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:10 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:50:10.635948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:10.648263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:10.673540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.693618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.698244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.704792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.705714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:10.714020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:10.808495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:10.817733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'server_group_members'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:10.881981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:10.890480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-533ad32b-1162-4b1e-99dd-87cd27cf9d20 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1270 microversion: 2.1 time: 0.263404 Dec 18 20:50:10.917063 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 533/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:10 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1270 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:10.919834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e75c9c1-458d-4b86-b3d1-cc941b64dede tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.091738 Dec 18 20:50:10.929491 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 536/1069] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:09 2021] POST /compute/v2.1/servers => generated 32 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Dec 18 20:50:10.934129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:10.939223 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:10.939223 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:10.940321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:10.941256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Searching by: {'deleted': False, 'project_id': '9ce640720b084b84a86f590d354dad25'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:50:10.981229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:10.982159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:10.995363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.996075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:10.997947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:10.998681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.053052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.053824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.063848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.064489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.141183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:50:11.173250 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98b80a14-df9a-4fc3-8a8f-e2ef8024b410 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.243805 Dec 18 20:50:11.174204 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 534/1070] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:50:10 2021] GET /compute/v2.1/servers => generated 1661 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:11.179424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-63ddbb87-1b55-45aa-ab01-a818c0d10c46 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:11.181657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-63ddbb87-1b55-45aa-ab01-a818c0d10c46 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:11.189316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63ddbb87-1b55-45aa-ab01-a818c0d10c46 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.189872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63ddbb87-1b55-45aa-ab01-a818c0d10c46 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.191237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63ddbb87-1b55-45aa-ab01-a818c0d10c46 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.191772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63ddbb87-1b55-45aa-ab01-a818c0d10c46 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.255748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-63ddbb87-1b55-45aa-ab01-a818c0d10c46 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 32641 microversion: 2.1 time: 0.080091 Dec 18 20:50:11.256738 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 535/1071] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:11 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 32641 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:11.264837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2448632f-5f8f-49ad-99a0-446a3157a3a9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:11.265580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2448632f-5f8f-49ad-99a0-446a3157a3a9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:11.317309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:11.336552 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-421c9b34-f2d0-4e11-806a-570743f06a99 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1316 microversion: 2.1 time: 0.359050 Dec 18 20:50:11.343070 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 537/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:10 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:50:11.439160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2448632f-5f8f-49ad-99a0-446a3157a3a9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:11.456769 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2448632f-5f8f-49ad-99a0-446a3157a3a9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1218 microversion: 2.1 time: 0.190413 Dec 18 20:50:11.470205 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 536/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:11 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:11.641873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:11.642587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:11.663727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.665911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.667174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.669495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.910706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:11.911340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:11.924157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.925058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:11.925891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:11.927706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:12.233261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:12.258419 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8d1c34fc-79d1-4f4e-9ae7-93dfc2002415 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 0.621176 Dec 18 20:50:12.295924 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 538/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:11 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:12.430383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:12.444051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-162a79b0-5662-40b3-9823-8681f77d919a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1312 microversion: 2.1 time: 0.539640 Dec 18 20:50:12.457573 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 537/1075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:11 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1312 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:12.471343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bb4cb9ed-435f-42d3-becd-8e7e4d9e5af0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:12.475041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bb4cb9ed-435f-42d3-becd-8e7e4d9e5af0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:12.484841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2f5cc412-4278-40dc-9660-6ebd4d6ef613 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'create', calling method: .version_select at 0x7f714f5da310>, body: {"keypair": {"name": "tempest-keypair-1824634061"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:12.488939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb4cb9ed-435f-42d3-becd-8e7e4d9e5af0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:12.489776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb4cb9ed-435f-42d3-becd-8e7e4d9e5af0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:12.490901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb4cb9ed-435f-42d3-becd-8e7e4d9e5af0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:12.491550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb4cb9ed-435f-42d3-becd-8e7e4d9e5af0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:12.576036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-2f5cc412-4278-40dc-9660-6ebd4d6ef613 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:12.576735 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bb4cb9ed-435f-42d3-becd-8e7e4d9e5af0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action" status: 200 len: 40796 microversion: 2.1 time: 0.116900 Dec 18 20:50:12.577598 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 538/1076] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:12 2021] POST /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e/action => generated 40796 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:12.590489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:12.591250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:12.598588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-2f5cc412-4278-40dc-9660-6ebd4d6ef613 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for user ebd83848fe8d4e7284291660eb51da51 and project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:12.609310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:12.612559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:12.614638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:12.616374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:13.205541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:13.230542 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bb5949e9-2ad1-4de8-a681-eee5773db9a1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1316 microversion: 2.1 time: 0.650993 Dec 18 20:50:13.240903 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 539/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:12 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:13.245657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:13.246298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:13.280276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:13.281327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:13.287162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:13.290678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:13.455823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:13.469430 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f9e33e3-6d8b-4ad6-a3bb-09d1b777c4bc tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1270 microversion: 2.1 time: 0.226429 Dec 18 20:50:13.470439 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 540/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:13 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1270 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:13.492734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:13.493633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:13.503471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:13.504603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:13.505598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:13.506651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:13.546021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-2f5cc412-4278-40dc-9660-6ebd4d6ef613 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:13.555878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-2f5cc412-4278-40dc-9660-6ebd4d6ef613 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for user ebd83848fe8d4e7284291660eb51da51 and project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:13.630542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2f5cc412-4278-40dc-9660-6ebd4d6ef613 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.331516 Dec 18 20:50:13.631547 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 539/1079] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:50:12 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:13.647051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:13.647930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:13.667542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:13.668783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:13.670158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:13.675787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:14.201737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:14.227757 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af7cde85-1fbc-4a04-9b8a-83c127ea9710 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 200 len: 1709 microversion: 2.1 time: 0.738272 Dec 18 20:50:14.228627 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 541/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:13 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 1709 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:14.269832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:14.271660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:14.291202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:14.300152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:14.306935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:14.308798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:14.422391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:14.431191 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-77476b53-c9b4-4af7-8c09-e2c1ff29aefc tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 0.798369 Dec 18 20:50:14.441499 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 540/1081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:13 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:14.456098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:14.457697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:14.464715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:14.465589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:14.466731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:14.467495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:14.946319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:14.959320 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f9658cdf-9989-40f9-ba94-314cf17e028c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1333 microversion: 2.1 time: 0.703242 Dec 18 20:50:14.959929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 542/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:14 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1333 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:14.969351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:14.981845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:15.013999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:15.014669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:15.016739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:15.017421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:15.166136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:15.197056 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71b95bda-e781-4afb-a0e3-a5fe3a131d94 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1316 microversion: 2.1 time: 0.743927 Dec 18 20:50:15.199001 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 541/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:14 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:15.207284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:15.207922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:15.208812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:15.218669 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-17c0211e-91a3-44a8-8a62-1f8239148fcd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1276 microversion: 2.1 time: 0.256651 Dec 18 20:50:15.219407 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 543/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:14 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:15.220539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:15.221305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:15.223234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:15.223779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:15.268372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:50:15.460147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:15.460785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:15.473059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:15.475031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:15.481151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:15.488528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:15.518024 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0284028a-4432-4b90-a011-e1d86d3e67b2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 204 len: 0 microversion: 2.1 time: 0.317315 Dec 18 20:50:15.518818 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 542/1085] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:50:15 2021] DELETE /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:50:15.725878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-44011042", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "467279096", "adminPass": "***", "networks": [{"uuid": "b16f44c1-8015-4e89-85aa-20e9d5fd9f2e"}], "security_groups": [{"name": "tempest-securitygroup--1483741819"}], "key_name": "tempest-keypair-1493312864", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:16.132009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] validate_networks() for [('b16f44c1-8015-4e89-85aa-20e9d5fd9f2e', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:16.335680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:16.352409 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86627ee5-5209-4af8-9cf2-ffd209ff650f tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 0.896292 Dec 18 20:50:16.353725 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 544/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:15 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:16.359908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-88c8c09f-93a5-42d2-902f-98e5314c3ac2 req-ec5b13ce-bab1-4fae-a3fe-60e530440adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d2c622-4e87-45cc-aac2-313c30dd4c88", "name": "network-vif-plugged", "status": "completed", "tag": "3cb32a2c-a146-40ee-826d-31f36365ea91"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:16.367993 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:16.367993 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:16.389738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-88c8c09f-93a5-42d2-902f-98e5314c3ac2 req-ec5b13ce-bab1-4fae-a3fe-60e530440adb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:16.390977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-88c8c09f-93a5-42d2-902f-98e5314c3ac2 req-ec5b13ce-bab1-4fae-a3fe-60e530440adb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:16.433135 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-88c8c09f-93a5-42d2-902f-98e5314c3ac2 req-ec5b13ce-bab1-4fae-a3fe-60e530440adb service nova] Creating event network-vif-plugged:3cb32a2c-a146-40ee-826d-31f36365ea91 for instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 on nch1-master-1 Dec 18 20:50:16.444231 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-88c8c09f-93a5-42d2-902f-98e5314c3ac2 req-ec5b13ce-bab1-4fae-a3fe-60e530440adb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086558 Dec 18 20:50:16.445935 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 545/1087] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:16.458668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:16.460828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:16.477738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:16.479843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:16.487296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:16.488829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:17.887748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:17.888223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:17.888790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:17.889376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:17.889944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:17.902367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:17.918653 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed1500d7-a60c-46c1-b8f9-9a42e0e96da6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 1.468937 Dec 18 20:50:17.919263 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 546/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:16 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:17.921316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:17.921772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:17.922618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:17.923058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:17.951326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:17.961642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:17.991107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:17.991497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:17.992316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:17.992778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:18.036426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for project b48e95c75c9444f2a0d2cb6704727346. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:18.052641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Getting quotas for user c3e0c0d3dc8441968dafc98b902ab349 and project b48e95c75c9444f2a0d2cb6704727346. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:18.101050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:18.109974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:18.248890 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5b499458-d605-45fd-a0ea-272582b39e7b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.531760 Dec 18 20:50:18.255448 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 543/1089] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:15 2021] POST /compute/v2.1/servers => generated 402 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 20:50:18.260747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:18.267104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:18.278999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:18.280019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:18.281811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:18.283868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:19.242565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:19.291548 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cd435fc5-6955-4c07-88ec-82b49e5a01a4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1318 microversion: 2.1 time: 1.034465 Dec 18 20:50:19.302952 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 544/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:18 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1318 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:19.314750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:19.315376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:19.331113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:19.333421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:19.334728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:19.340508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:19.465591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:19.476174 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3302d7ff-c231-4f74-b697-396734afae13 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1316 microversion: 2.1 time: 1.547057 Dec 18 20:50:19.479555 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 547/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:17 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1316 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:19.484989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:19.491784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:19.508763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:19.509396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:19.510221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:19.513388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:19.912803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:19.922144 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-79c907c1-50c4-4483-8882-3566061884b5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1257 microversion: 2.1 time: 0.440773 Dec 18 20:50:19.926281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 548/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:19 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1257 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:19.936110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-fb032d3f-ae9c-49ab-b610-c4086b9fc019 req-2659007d-90e2-4a30-a345-d6dc5b25f381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930716df-900f-446a-8ca4-f1bc174e3345", "name": "network-vif-plugged", "status": "completed", "tag": "713b1105-c226-474e-8fd2-e067be484d6a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:19.946601 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:19.946601 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:19.961085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fb032d3f-ae9c-49ab-b610-c4086b9fc019 req-2659007d-90e2-4a30-a345-d6dc5b25f381 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:19.964195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fb032d3f-ae9c-49ab-b610-c4086b9fc019 req-2659007d-90e2-4a30-a345-d6dc5b25f381 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:20.008520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-fb032d3f-ae9c-49ab-b610-c4086b9fc019 req-2659007d-90e2-4a30-a345-d6dc5b25f381 service nova] Creating event network-vif-plugged:713b1105-c226-474e-8fd2-e067be484d6a for instance 930716df-900f-446a-8ca4-f1bc174e3345 on nch1-master-1 Dec 18 20:50:20.014384 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-fb032d3f-ae9c-49ab-b610-c4086b9fc019 req-2659007d-90e2-4a30-a345-d6dc5b25f381 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083107 Dec 18 20:50:20.019652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 549/1093] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:20.028138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:20.029276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:20.057051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:20.057769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:20.069760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:20.084874 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b51e27a-718e-4230-8600-2d6ea2dd01d0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1312 microversion: 2.1 time: 0.778559 Dec 18 20:50:20.086178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:20.090246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:20.093789 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 545/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:19 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1312 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:20.105703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3b83eef9-f53e-43c7-b73e-fa9811c688a1 req-da8a35a9-de6c-40c3-a5b7-d8d019e02d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "tag": "9b09cd1f-a315-422b-ad9b-2daf6a5aaea9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:20.107880 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:20.107880 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:20.143847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3b83eef9-f53e-43c7-b73e-fa9811c688a1 req-da8a35a9-de6c-40c3-a5b7-d8d019e02d9e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:20.144466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3b83eef9-f53e-43c7-b73e-fa9811c688a1 req-da8a35a9-de6c-40c3-a5b7-d8d019e02d9e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:20.175877 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3b83eef9-f53e-43c7-b73e-fa9811c688a1 req-da8a35a9-de6c-40c3-a5b7-d8d019e02d9e service nova] Creating event network-changed:9b09cd1f-a315-422b-ad9b-2daf6a5aaea9 for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:20.189481 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3b83eef9-f53e-43c7-b73e-fa9811c688a1 req-da8a35a9-de6c-40c3-a5b7-d8d019e02d9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091681 Dec 18 20:50:20.194635 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 546/1095] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:20.205186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1269275494", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5cbb2c71-d950-4efd-806f-e5446059ac55"}], "block_device_mapping_v2": [{"uuid": "9f5f7417-3abc-4462-988f-ef519750d753", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:20.373759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] validate_networks() for [('5cbb2c71-d950-4efd-806f-e5446059ac55', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:21.153837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:21.169051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e2209fbb-ac57-4505-90e5-b13dd4e6bb4b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 1.146590 Dec 18 20:50:21.170202 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 550/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:20 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:21.183818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:21.184884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:21.210998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:21.211502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:21.212345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:21.214966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:22.248180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:22.263266 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0410015c-ac87-485f-9418-e1dcc51836c1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1318 microversion: 2.1 time: 1.090906 Dec 18 20:50:22.264690 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 551/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:21 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1318 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:22.272991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:22.273732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:22.281108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:22.281570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:22.282438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:22.282896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:22.635367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:22.636581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:22.638045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:22.638656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:22.639170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:22.665741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:22.667239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:22.669211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:22.670492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:22.702356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:22.718848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Getting quotas for user 5aaf1ced6baf4e1d9c940cfe96b2c254 and project 0870e14bc2934bae9138d4818b260729. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:22.839856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:22.844476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f5f7417-3abc-4462-988f-ef519750d753',volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:23.047438 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f009b382-05af-4b1e-bf5f-800ceae8144d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.851467 Dec 18 20:50:23.053463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 547/1098] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 2858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:23.064576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:23.065193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:23.099775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:23.100239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:23.101625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:23.102074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:23.190553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:23.199438 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-367c8174-7a15-4493-8724-da6e2678f3fc tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1505 microversion: 2.1 time: 0.932725 Dec 18 20:50:23.200035 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 552/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:22 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1505 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:23.213389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:23.216376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:23.232172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:23.233051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:23.236065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:23.237399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:23.980871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:23.989935 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44fe17b0-ef72-40db-a4d4-5e24d05d4427 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1387 microversion: 2.1 time: 0.935017 Dec 18 20:50:23.994136 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 548/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:23 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1387 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:24.009164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:24.019098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-158424844", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fab4d786-81c4-48dc-b51f-790f7e93cb03"}], "block_device_mapping_v2": [{"uuid": "087215d3-1650-420d-a00a-220eba1b1657", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:24.025576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-832d92ec-492e-49f1-8bb7-d86e2c1ffafa tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1496 microversion: 2.1 time: 0.818553 Dec 18 20:50:24.027241 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 553/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:23 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1496 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:24.036555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d4769daa-c316-4cbf-bccb-5d3f93186149 req-66f03065-1d07-4564-8ef1-1c1b69fe8462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d9725-ba21-477e-9e70-c7e9c733e54e", "name": "network-vif-unplugged", "status": "completed", "tag": "ac8166be-db9c-48d7-aed1-022cd6d22a09"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:24.044587 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:24.044587 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:24.064358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d4769daa-c316-4cbf-bccb-5d3f93186149 req-66f03065-1d07-4564-8ef1-1c1b69fe8462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:24.067769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d4769daa-c316-4cbf-bccb-5d3f93186149 req-66f03065-1d07-4564-8ef1-1c1b69fe8462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:24.126701 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d4769daa-c316-4cbf-bccb-5d3f93186149 req-66f03065-1d07-4564-8ef1-1c1b69fe8462 service nova] Creating event network-vif-unplugged:ac8166be-db9c-48d7-aed1-022cd6d22a09 for instance bf9d9725-ba21-477e-9e70-c7e9c733e54e on nch2-master-1 Dec 18 20:50:24.155296 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d4769daa-c316-4cbf-bccb-5d3f93186149 req-66f03065-1d07-4564-8ef1-1c1b69fe8462 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117447 Dec 18 20:50:24.156535 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 554/1102] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:24.171450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:24.173946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:24.188847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:24.190624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:24.193418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:24.193962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:24.198894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] validate_networks() for [('fab4d786-81c4-48dc-b51f-790f7e93cb03', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:24.886485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:24.898637 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-667e8f46-3a42-4a85-809a-38c4063e1209 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.737965 Dec 18 20:50:24.899990 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 555/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:24 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:24.907097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1751341833", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b682fe11-354f-40ac-961b-a0ccac207599"}], "security_groups": [{"name": "tempest-securitygroup--1701177202"}], "key_name": "tempest-keypair-1824634061", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:25.500093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] validate_networks() for [('b682fe11-354f-40ac-961b-a0ccac207599', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:26.265667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:26.266657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:26.268216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:26.268632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:26.269045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:26.282132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.283670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.286398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.286894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.328288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:26.334895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Getting quotas for user 8042de28328d4b26b910f1be4b499879 and project a84b125f83d34481adc5617b5ca62e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:26.407954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:26.410237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='087215d3-1650-420d-a00a-220eba1b1657',volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:26.637697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f0c2e19-4858-46b5-983f-161c0fce57ad tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.642210 Dec 18 20:50:26.644369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:26.645125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:26.645613 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 549/1104] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 20:50:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 20:50:26.648711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:26.649274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:26.649974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:26.651276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1b397c75-cc6d-47e6-b2ae-5da0e4fab0ec req-72c2fa17-339d-46fa-a872-6479da534c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5edea04e-2c27-4be2-a3b4-1ec34f70c3ed", "tag": "d2ee6d32-7b4d-4339-825e-0c4db2f8ee5c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:26.653090 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:26.653090 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:26.661320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1b397c75-cc6d-47e6-b2ae-5da0e4fab0ec req-72c2fa17-339d-46fa-a872-6479da534c52 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.662016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1b397c75-cc6d-47e6-b2ae-5da0e4fab0ec req-72c2fa17-339d-46fa-a872-6479da534c52 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.683189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.684341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.686785 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1b397c75-cc6d-47e6-b2ae-5da0e4fab0ec req-72c2fa17-339d-46fa-a872-6479da534c52 service nova] Creating event network-changed:d2ee6d32-7b4d-4339-825e-0c4db2f8ee5c for instance 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed on nch1-master-1 Dec 18 20:50:26.688374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.689109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.700319 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1b397c75-cc6d-47e6-b2ae-5da0e4fab0ec req-72c2fa17-339d-46fa-a872-6479da534c52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052835 Dec 18 20:50:26.700503 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 550/1105] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:26.709845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-9d124cf3-63fc-4770-b12a-61c4d0c1b7f1 req-9120ae79-f600-4812-81c6-4939db69810d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cadd365-eceb-4a91-93b6-4514be9ac919", "tag": "54506b4b-7281-4b1a-9497-d7ae5def715f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:26.715916 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:26.715916 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:26.731402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9d124cf3-63fc-4770-b12a-61c4d0c1b7f1 req-9120ae79-f600-4812-81c6-4939db69810d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.733769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:26.736984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9d124cf3-63fc-4770-b12a-61c4d0c1b7f1 req-9120ae79-f600-4812-81c6-4939db69810d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.745151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for user ebd83848fe8d4e7284291660eb51da51 and project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:26.760807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9d124cf3-63fc-4770-b12a-61c4d0c1b7f1 req-9120ae79-f600-4812-81c6-4939db69810d service nova] Creating event network-changed:54506b4b-7281-4b1a-9497-d7ae5def715f for instance 6cadd365-eceb-4a91-93b6-4514be9ac919 on nch2-master-1 Dec 18 20:50:26.771097 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-9d124cf3-63fc-4770-b12a-61c4d0c1b7f1 req-9120ae79-f600-4812-81c6-4939db69810d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069058 Dec 18 20:50:26.774944 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 551/1106] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:26.776972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:26.781763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:26.784803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:26.785508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:26.800946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.801686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.803136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.805471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.882312 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-42150cae-360e-47ad-938f-ddc42a0a8b35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.980868 Dec 18 20:50:26.883143 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 556/1107] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:24 2021] POST /compute/v2.1/servers => generated 409 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:26.917180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:26.918015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:26.930490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.931237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.933148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:26.933789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:26.994641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:26.995830 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb9afdf4-7593-4c11-b804-a68d36f6d552 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345/os-instance-actions/req-33458494-555b-4eb7-b4a8-1ee8a71e6313" status: 200 len: 313 microversion: 2.1 time: 0.085014 Dec 18 20:50:27.006616 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 557/1108] 10.222.0.13 () {58 vars in 1418 bytes} [Sat Dec 18 20:50:26 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345/os-instance-actions/req-33458494-555b-4eb7-b4a8-1ee8a71e6313 => generated 313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:27.016247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:27.017187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:27.032425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.034537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.037086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.039436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.317001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:27.328187 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1f7c081-6a4a-4f1e-9ddd-1bdb64b73ead tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1199 microversion: 2.1 time: 0.550837 Dec 18 20:50:27.329844 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 552/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:26 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1199 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:27.335770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-898e9109-88c2-4718-9f59-e1d7ab573746 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:27.356754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.server_groups [None req-898e9109-88c2-4718-9f59-e1d7ab573746 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Querying cell cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) for 1 instances {{(pid=140732) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 18 20:50:27.359003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-898e9109-88c2-4718-9f59-e1d7ab573746 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.359871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-898e9109-88c2-4718-9f59-e1d7ab573746 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.434885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-898e9109-88c2-4718-9f59-e1d7ab573746 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/dab84d10-6689-462b-98bd-114ee80923ce" status: 200 len: 221 microversion: 2.1 time: 0.102605 Dec 18 20:50:27.436782 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 553/1110] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:50:27 2021] GET /compute/v2.1/os-server-groups/dab84d10-6689-462b-98bd-114ee80923ce => generated 221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:27.442057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:27.442906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:27.449794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.452719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.455738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.456195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.520326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:27.533266 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7f9cb346-35b0-4ebc-9758-b7560167455f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1318 microversion: 2.1 time: 0.527647 Dec 18 20:50:27.533867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 558/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:26 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:27.538595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:27.539415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:27.546158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.547037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.548010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.548621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.921706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:27.929456 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dcf8826b-7a8e-4a95-80fc-bd8651513b52 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1387 microversion: 2.1 time: 0.490865 Dec 18 20:50:27.930086 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 554/1112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:27 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1387 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:27.935011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:27.935868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:27.941976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.942474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.943248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:27.943689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:27.989384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:27.996731 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb456a2a-6b5f-411d-b347-f73bc6939fda tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.461861 Dec 18 20:50:27.997305 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 559/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:27 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:28.002107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:28.002692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:28.009160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.009693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.010515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.010954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.029391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:28.037679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:28.039339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:28.040857 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc5c51a2-c722-460e-925b-34bce093c34c tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1232 microversion: 2.25 time: 0.109811 Dec 18 20:50:28.041681 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 555/1114] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:27 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1232 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:28.051513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c7bd7f7-442f-4d02-a1af-1886877cda82 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:28.053084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c7bd7f7-442f-4d02-a1af-1886877cda82 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:28.058862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c7bd7f7-442f-4d02-a1af-1886877cda82 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.059311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c7bd7f7-442f-4d02-a1af-1886877cda82 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.060359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c7bd7f7-442f-4d02-a1af-1886877cda82 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.060791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c7bd7f7-442f-4d02-a1af-1886877cda82 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.102211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:28.119692 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd8a78be-5ed5-4b14-9a31-7d439fb08e07 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1235 microversion: 2.1 time: 0.121326 Dec 18 20:50:28.129654 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 560/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:27 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1235 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:28.135569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d6779a42-b7f9-4e77-ac29-3dc148d8f802 req-543ed026-596a-4d27-9ade-6c332bb64c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edea04e-2c27-4be2-a3b4-1ec34f70c3ed", "name": "network-vif-plugged", "status": "completed", "tag": "d2ee6d32-7b4d-4339-825e-0c4db2f8ee5c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:28.138139 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:28.138139 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:28.156300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d6779a42-b7f9-4e77-ac29-3dc148d8f802 req-543ed026-596a-4d27-9ade-6c332bb64c9c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.157395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d6779a42-b7f9-4e77-ac29-3dc148d8f802 req-543ed026-596a-4d27-9ade-6c332bb64c9c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.168705 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c7bd7f7-442f-4d02-a1af-1886877cda82 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "POST /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345/action" status: 202 len: 0 microversion: 2.1 time: 0.120274 Dec 18 20:50:28.174072 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 556/1116] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:28 2021] POST /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:50:28.179622 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d6779a42-b7f9-4e77-ac29-3dc148d8f802 req-543ed026-596a-4d27-9ade-6c332bb64c9c service nova] Creating event network-vif-plugged:d2ee6d32-7b4d-4339-825e-0c4db2f8ee5c for instance 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed on nch1-master-1 Dec 18 20:50:28.182302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:28.183137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:28.195775 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d6779a42-b7f9-4e77-ac29-3dc148d8f802 req-543ed026-596a-4d27-9ade-6c332bb64c9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064577 Dec 18 20:50:28.196683 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 561/1117] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:28.198427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.199177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.200281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.200956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.201798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:28.202659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:28.221542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.222063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.223031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.223524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.264069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:50:28.441998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4418055c-1583-407e-a315-eda5035aa4f0 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 204 len: 0 microversion: 2.1 time: 0.264437 Dec 18 20:50:28.442608 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 557/1118] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:50:28 2021] DELETE /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:50:28.456585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:28.457874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:28.472847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.477196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.479448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.481006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.690233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:28.698338 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-587d8b84-17ac-4fe0-b1a1-706eb8786d62 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1507 microversion: 2.1 time: 0.500176 Dec 18 20:50:28.704205 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 562/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:28 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:28.722774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:28.724969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:28.745823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.746497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:28.747634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:28.748228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:29.074815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:29.125031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-546519d9-c598-4939-8c47-430dc20aa0c5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1199 microversion: 2.1 time: 0.660442 Dec 18 20:50:29.132371 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 558/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:28 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1199 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:29.150754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:29.152038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:29.162477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:29.175012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:29.176154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:29.176748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:29.247268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:29.261766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b6c6df9-88b1-4bb0-9e41-2aba55fd161d tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1502 microversion: 2.1 time: 0.556122 Dec 18 20:50:29.273993 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 563/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:28 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:29.298694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3db244a5-8ab9-40f9-9465-cffaa73338d2 req-6cb3e535-a33a-48bc-a380-6529004b9b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "tag": "01e68d95-1643-42d9-8ad6-bf3e0318d01f"}, {"name": "network-changed", "server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "tag": "15f43c7a-5020-4142-bcf7-357f1cecac24"}, {"name": "network-changed", "server_uuid": "edeabf63-f66c-4719-9212-d3214bd03574", "tag": "0a593524-9707-4109-9577-e536b658044d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:29.305628 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:29.305628 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:29.325081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3db244a5-8ab9-40f9-9465-cffaa73338d2 req-6cb3e535-a33a-48bc-a380-6529004b9b10 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:29.327782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3db244a5-8ab9-40f9-9465-cffaa73338d2 req-6cb3e535-a33a-48bc-a380-6529004b9b10 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:29.354889 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3db244a5-8ab9-40f9-9465-cffaa73338d2 req-6cb3e535-a33a-48bc-a380-6529004b9b10 service nova] Creating event network-changed:01e68d95-1643-42d9-8ad6-bf3e0318d01f for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:29.362057 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3db244a5-8ab9-40f9-9465-cffaa73338d2 req-6cb3e535-a33a-48bc-a380-6529004b9b10 service nova] Creating event network-changed:15f43c7a-5020-4142-bcf7-357f1cecac24 for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:29.362842 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3db244a5-8ab9-40f9-9465-cffaa73338d2 req-6cb3e535-a33a-48bc-a380-6529004b9b10 service nova] Creating event network-changed:0a593524-9707-4109-9577-e536b658044d for instance edeabf63-f66c-4719-9212-d3214bd03574 on nch2-master-1 Dec 18 20:50:29.379554 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3db244a5-8ab9-40f9-9465-cffaa73338d2 req-6cb3e535-a33a-48bc-a380-6529004b9b10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.099707 Dec 18 20:50:29.381154 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 564/1122] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:29.393850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:29.394945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:29.409704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:29.414199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:29.415306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:29.415907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:29.959972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:29.973713 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc4ecc70-a7f6-44e6-9b82-f6daa20e84c9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1318 microversion: 2.1 time: 0.839963 Dec 18 20:50:29.974405 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 559/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:29 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1318 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:29.987477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4234a34e-9f1c-4c3b-9eb3-1777885487cc req-40734bf6-6d50-49fd-b03f-08a70c82a1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d9725-ba21-477e-9e70-c7e9c733e54e", "name": "network-vif-deleted", "tag": "ac8166be-db9c-48d7-aed1-022cd6d22a09"}, {"name": "network-changed", "server_uuid": "68fa4ba4-d935-4772-b54b-9d78b6d2ea3d", "tag": "70c1a24f-77c8-4810-9440-0a7498d6a257"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:29.991332 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:29.991332 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:30.006020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4234a34e-9f1c-4c3b-9eb3-1777885487cc req-40734bf6-6d50-49fd-b03f-08a70c82a1f7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:30.007981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4234a34e-9f1c-4c3b-9eb3-1777885487cc req-40734bf6-6d50-49fd-b03f-08a70c82a1f7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:30.041078 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4234a34e-9f1c-4c3b-9eb3-1777885487cc req-40734bf6-6d50-49fd-b03f-08a70c82a1f7 service nova] Creating event network-vif-deleted:ac8166be-db9c-48d7-aed1-022cd6d22a09 for instance bf9d9725-ba21-477e-9e70-c7e9c733e54e on nch2-master-1 Dec 18 20:50:30.041834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4234a34e-9f1c-4c3b-9eb3-1777885487cc req-40734bf6-6d50-49fd-b03f-08a70c82a1f7 service nova] Creating event network-changed:70c1a24f-77c8-4810-9440-0a7498d6a257 for instance 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d on nch2-master-1 Dec 18 20:50:30.056685 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4234a34e-9f1c-4c3b-9eb3-1777885487cc req-40734bf6-6d50-49fd-b03f-08a70c82a1f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.079417 Dec 18 20:50:30.059101 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 560/1124] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:30.075785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:30.076787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:30.091665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:30.092148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:30.093066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:30.102933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:30.235542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:30.246493 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2c519a6c-3cab-4040-bf9a-f383ad8e9f08 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1387 microversion: 2.1 time: 0.863848 Dec 18 20:50:30.250900 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 565/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:29 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1387 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:30.262960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:30.263599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:30.281742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:30.282192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:30.284004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:30.284473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:30.610508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:30.622128 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0601b5cf-ced7-41c8-aeea-c5659e642867 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.557832 Dec 18 20:50:30.622818 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 561/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:30 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:30.637584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:30.638456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:30.644703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:30.645380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:30.646403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:30.647008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.153110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:31.160915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5ecacfe-5f01-4b74-b16c-44d0f5585694 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1297 microversion: 2.1 time: 0.527067 Dec 18 20:50:31.170487 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 562/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:30 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1297 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:31.175359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:31.176169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:31.182551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.183215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.184164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.184752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.235172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:31.246582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:31.250150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:31.251940 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41782c76-f4b7-42a0-9009-740761dcf994 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1280 microversion: 2.25 time: 0.999775 Dec 18 20:50:31.253674 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 566/1128] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:30 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1280 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:31.258693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:31.259635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:31.270053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.272942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.273959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.274581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.863205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:31.870796 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1bb5bf5c-1342-46cd-b03f-55bba8bbf12b tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1505 microversion: 2.1 time: 0.698912 Dec 18 20:50:31.871364 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 563/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:31 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1505 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:31.877586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:31.878449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:31.885832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.904203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.904943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:31.906634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.909114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.936152 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-089844d4-ffe7-49c9-8889-dda972e31fd8 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1199 microversion: 2.1 time: 0.680282 Dec 18 20:50:31.938338 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 567/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:31 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1199 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:31.946437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:31.947741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:31.955551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.956182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.957128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.957820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.982744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:31.986061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:31.987261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lazy-loading 'fault' on Instance uuid 56d2c622-4e87-45cc-aac2-313c30dd4c88 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:50:32.116484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe3e4b89a9d489783a83b38a7a70c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0793f7505c664b34adc128f8bd38e5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:32.127914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b83ddb10-c89a-4f96-bafd-f84e74b6b729 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 200 len: 1302 microversion: 2.1 time: 0.255229 Dec 18 20:50:32.128793 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 564/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:31 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 1302 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:32.134615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:32.135918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:32.142537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.143385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.144201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.144640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.470590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:32.490484 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c154f9a0-22d2-4b41-8ebd-fe06e637e4d1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1467 microversion: 2.1 time: 0.549338 Dec 18 20:50:32.498412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 568/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:31 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1467 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:32.499327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6ac1ce4d-f0ec-4953-8023-61197e6aff27 req-82c42cc4-acd8-4431-84f9-02f4eac6eada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4d97c0-d046-4bf2-842f-bb1ab2c4c935", "tag": "4b0e7658-35c7-49ef-98fc-5ca3e983079d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:32.501306 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:32.501306 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:32.512832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6ac1ce4d-f0ec-4953-8023-61197e6aff27 req-82c42cc4-acd8-4431-84f9-02f4eac6eada service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.513701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6ac1ce4d-f0ec-4953-8023-61197e6aff27 req-82c42cc4-acd8-4431-84f9-02f4eac6eada service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.533452 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6ac1ce4d-f0ec-4953-8023-61197e6aff27 req-82c42cc4-acd8-4431-84f9-02f4eac6eada service nova] Creating event network-changed:4b0e7658-35c7-49ef-98fc-5ca3e983079d for instance da4d97c0-d046-4bf2-842f-bb1ab2c4c935 on nch1-master-1 Dec 18 20:50:32.539384 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6ac1ce4d-f0ec-4953-8023-61197e6aff27 req-82c42cc4-acd8-4431-84f9-02f4eac6eada service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044659 Dec 18 20:50:32.540251 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 569/1133] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:32.545510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:32.548714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:32.553730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.554422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.555424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.556028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.591747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:32.601388 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2f13fe2e-d18c-4f3d-bf29-74791f1369a5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1387 microversion: 2.1 time: 0.470206 Dec 18 20:50:32.601986 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 565/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:32 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1387 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:32.606898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ebcfb8d4-881a-432e-9114-e40ac2059f02 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '.version_select at 0x7f714f5f7160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:32.607650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ebcfb8d4-881a-432e-9114-e40ac2059f02 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:32.619198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebcfb8d4-881a-432e-9114-e40ac2059f02 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.621064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebcfb8d4-881a-432e-9114-e40ac2059f02 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.623102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebcfb8d4-881a-432e-9114-e40ac2059f02 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.624698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebcfb8d4-881a-432e-9114-e40ac2059f02 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.661863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ebcfb8d4-881a-432e-9114-e40ac2059f02 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.058517 Dec 18 20:50:32.662837 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 566/1135] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Dec 18 20:50:32 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345/os-instance-actions => generated 611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:32.673430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:32.674108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:32.680291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.680672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.681484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:32.682004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:32.992523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.004711 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f737f3a4-b857-4755-9b84-b3cbb0771ad9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.462521 Dec 18 20:50:33.005564 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 570/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:32 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:33.012113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.012894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:33.020470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.021157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.023160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.024282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.127579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.135187 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-04465c6d-9958-444b-8b80-89e8116ed297 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1365 microversion: 2.1 time: 0.471179 Dec 18 20:50:33.146085 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 567/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:32 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:33.150943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-650ad672-df37-458f-a603-c857c3ae0f67 req-4a98bf1e-49ea-4651-a598-04a23abdd54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cadd365-eceb-4a91-93b6-4514be9ac919", "name": "network-vif-plugged", "status": "completed", "tag": "54506b4b-7281-4b1a-9497-d7ae5def715f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:33.152976 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:33.152976 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:33.179261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-650ad672-df37-458f-a603-c857c3ae0f67 req-4a98bf1e-49ea-4651-a598-04a23abdd54f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.179678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-650ad672-df37-458f-a603-c857c3ae0f67 req-4a98bf1e-49ea-4651-a598-04a23abdd54f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.195265 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-650ad672-df37-458f-a603-c857c3ae0f67 req-4a98bf1e-49ea-4651-a598-04a23abdd54f service nova] Creating event network-vif-plugged:54506b4b-7281-4b1a-9497-d7ae5def715f for instance 6cadd365-eceb-4a91-93b6-4514be9ac919 on nch2-master-1 Dec 18 20:50:33.200310 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-650ad672-df37-458f-a603-c857c3ae0f67 req-4a98bf1e-49ea-4651-a598-04a23abdd54f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052937 Dec 18 20:50:33.201288 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 568/1138] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:33.206643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.208909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:33.215541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.216308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.217356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.218579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.477101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.485834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.487627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.488876 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2375108e-0993-46df-b8ea-25d777a15b36 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1280 microversion: 2.25 time: 0.482022 Dec 18 20:50:33.489445 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 571/1139] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:33 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1280 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:33.494844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.495529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:33.502502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.502964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.503761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.504374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.532561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:50:33.604423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.615209 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ebabaa9-6bea-42eb-89d2-646ce06522b5 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "DELETE /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 204 len: 0 microversion: 2.1 time: 0.124070 Dec 18 20:50:33.615976 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 572/1140] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:50:33 2021] DELETE /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:50:33.617010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d14b6c1-5ff2-4aa3-a2cd-3ad986944472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919" status: 200 len: 1318 microversion: 2.1 time: 0.414036 Dec 18 20:50:33.617743 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 569/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:33 2021] GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:33.622183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.623043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:33.628880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.629528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.630553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.630991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.633775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.634404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:33.641726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.642451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.643342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.643772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.658070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] HTTP exception thrown: Instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 could not be found. Dec 18 20:50:33.658913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Returning 404 to user: Instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:33.659735 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80105345-c022-429c-b9d2-97c7a3a43d22 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 404 len: 111 microversion: 2.1 time: 0.040912 Dec 18 20:50:33.660650 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 570/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:33 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:33.665248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.666129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:33.673201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.673883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.674690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.675125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.939006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.946385 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb4fa3cc-21ea-4869-8372-2ff192e41829 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1199 microversion: 2.1 time: 0.328501 Dec 18 20:50:33.949356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:33.953551 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 573/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:33 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1199 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:33.958418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.959029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:33.965048 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e4aebee6-e8ac-4b4e-9424-a781b49d1c99 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1387 microversion: 2.1 time: 0.303117 Dec 18 20:50:33.965256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.965646 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 571/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:33 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1387 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:33.965777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.966693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.967296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:33.975133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e5dfa81-922b-4579-b4b5-e173c2a4b901 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:33.988853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.server_groups [None req-0e5dfa81-922b-4579-b4b5-e173c2a4b901 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Querying cell cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) for 1 instances {{(pid=140732) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 18 20:50:33.989674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e5dfa81-922b-4579-b4b5-e173c2a4b901 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:33.990122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e5dfa81-922b-4579-b4b5-e173c2a4b901 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.001702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e5dfa81-922b-4579-b4b5-e173c2a4b901 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034445 Dec 18 20:50:34.002588 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 572/1145] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:50:33 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:34.012789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6be47ca0-585d-4e5e-af35-d73599574816 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:34.031077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.server_groups [None req-6be47ca0-585d-4e5e-af35-d73599574816 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Querying cell cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) for 1 instances {{(pid=140732) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 18 20:50:34.031931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6be47ca0-585d-4e5e-af35-d73599574816 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.032381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6be47ca0-585d-4e5e-af35-d73599574816 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.042090 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6be47ca0-585d-4e5e-af35-d73599574816 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/dab84d10-6689-462b-98bd-114ee80923ce" status: 200 len: 183 microversion: 2.1 time: 0.032747 Dec 18 20:50:34.042694 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 573/1146] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:50:34 2021] GET /compute/v2.1/os-server-groups/dab84d10-6689-462b-98bd-114ee80923ce => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:50:34.052525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:34.053140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:34.059339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.059829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.060879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.061844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.536792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:34.544806 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc4bc24e-be85-4e34-89e9-ea1dfedfb0c9 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1511 microversion: 2.1 time: 0.589688 Dec 18 20:50:34.545134 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 574/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:33 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:34.550552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:34.551047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:34.563546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.563999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.564806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.565245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.579604 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] HTTP exception thrown: Instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 could not be found. Dec 18 20:50:34.580372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Returning 404 to user: Instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:34.581395 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1f21de3-ff6d-4bb3-bf8e-fdc7a9488414 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 404 len: 111 microversion: 2.1 time: 0.034409 Dec 18 20:50:34.582129 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 575/1148] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:50:34 2021] DELETE /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:34.586904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:34.587514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:34.594556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.595007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.596209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.596820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.676451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:34.684100 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa498e64-0ff3-4dbf-bfb7-2b4f9715238e tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.635350 Dec 18 20:50:34.684717 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 574/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:34 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:34.690978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a2201177-df2b-4b68-b61b-24042d46272e req-6239d442-8a65-404c-ad94-92c8135066a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:34.692725 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:34.692725 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:34.700133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a2201177-df2b-4b68-b61b-24042d46272e req-6239d442-8a65-404c-ad94-92c8135066a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.700578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a2201177-df2b-4b68-b61b-24042d46272e req-6239d442-8a65-404c-ad94-92c8135066a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.715729 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a2201177-df2b-4b68-b61b-24042d46272e req-6239d442-8a65-404c-ad94-92c8135066a0 service nova] Creating event network-changed:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:50:34.723071 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a2201177-df2b-4b68-b61b-24042d46272e req-6239d442-8a65-404c-ad94-92c8135066a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036302 Dec 18 20:50:34.724176 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 575/1150] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:34.730649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:34.731493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:34.748431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.748939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.749747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.750189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.872694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:34.881950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc0395db-8652-4934-a80c-2d2212df3fdf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1365 microversion: 2.1 time: 0.298617 Dec 18 20:50:34.892652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 576/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:34 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:34.892652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-fc60f092-a1a0-4007-b8e7-b9c56aa57605 req-5ff519d5-0fa7-4e78-b3c0-77db76fb8163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d2c622-4e87-45cc-aac2-313c30dd4c88", "name": "network-vif-deleted", "tag": "3cb32a2c-a146-40ee-826d-31f36365ea91"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:34.892652 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:34.892652 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:34.900619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fc60f092-a1a0-4007-b8e7-b9c56aa57605 req-5ff519d5-0fa7-4e78-b3c0-77db76fb8163 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.901183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fc60f092-a1a0-4007-b8e7-b9c56aa57605 req-5ff519d5-0fa7-4e78-b3c0-77db76fb8163 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.914552 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-fc60f092-a1a0-4007-b8e7-b9c56aa57605 req-5ff519d5-0fa7-4e78-b3c0-77db76fb8163 service nova] Creating event network-vif-deleted:3cb32a2c-a146-40ee-826d-31f36365ea91 for instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 on nch1-master-1 Dec 18 20:50:34.920443 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-fc60f092-a1a0-4007-b8e7-b9c56aa57605 req-5ff519d5-0fa7-4e78-b3c0-77db76fb8163 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035821 Dec 18 20:50:34.921140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 577/1152] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:34.934183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:34.935303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] [instance: 56d2c622-4e87-45cc-aac2-313c30dd4c88] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:34.942724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.943259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.944130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.944744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.960408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] HTTP exception thrown: Instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 could not be found. Dec 18 20:50:34.961116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Returning 404 to user: Instance 56d2c622-4e87-45cc-aac2-313c30dd4c88 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:34.962068 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a349c24-8dee-4d85-a868-e10cdbb8d737 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88" status: 404 len: 111 microversion: 2.1 time: 0.039766 Dec 18 20:50:34.964501 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 578/1153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:34 2021] GET /compute/v2.1/servers/56d2c622-4e87-45cc-aac2-313c30dd4c88 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:34.970529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:34.971408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:34.979345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.979887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:34.980754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:34.981258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.003443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.013514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.015484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.016868 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e24f2d9c-d367-4d7d-9ce8-3292c3baca77 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1280 microversion: 2.25 time: 0.291119 Dec 18 20:50:35.017570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 576/1154] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:34 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:35.022180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:35.023122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:35.031815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.032503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.033346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.033794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.303935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.312023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22d06869-1004-4648-8809-56ee77c486f7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919" status: 200 len: 1467 microversion: 2.1 time: 0.345674 Dec 18 20:50:35.312664 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 579/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:34 2021] GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919 => generated 1467 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:35.317197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af6f1bac-29fe-4271-bfd8-51c59483fbf9 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:35.323123 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-af6f1bac-29fe-4271-bfd8-51c59483fbf9 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] HTTP exception thrown: Instance group 4a5d08bb-1b45-42e7-bc73-40558274ca56 could not be found. Dec 18 20:50:35.326059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af6f1bac-29fe-4271-bfd8-51c59483fbf9 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Returning 404 to user: Instance group 4a5d08bb-1b45-42e7-bc73-40558274ca56 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:35.326948 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af6f1bac-29fe-4271-bfd8-51c59483fbf9 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/4a5d08bb-1b45-42e7-bc73-40558274ca56" status: 404 len: 117 microversion: 2.1 time: 0.013159 Dec 18 20:50:35.327660 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 580/1156] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:50:35 2021] DELETE /compute/v2.1/os-server-groups/4a5d08bb-1b45-42e7-bc73-40558274ca56 => generated 117 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:35.333834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:35.334543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:35.340433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.340883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.341664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.342095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.352476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.364386 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8cc01d62-8783-4f97-bf00-48d51f237ccf tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1199 microversion: 2.1 time: 0.345618 Dec 18 20:50:35.365655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 577/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:35 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1199 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:35.370875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e0087580-8931-489d-b93f-2ad9b1258295 req-a55de984-8011-4735-9536-cabc7ee6fb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edeabf63-f66c-4719-9212-d3214bd03574", "name": "network-vif-plugged", "status": "completed", "tag": "0a593524-9707-4109-9577-e536b658044d"}, {"server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "name": "network-vif-plugged", "status": "completed", "tag": "15f43c7a-5020-4142-bcf7-357f1cecac24"}, {"server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "name": "network-vif-plugged", "status": "completed", "tag": "9b09cd1f-a315-422b-ad9b-2daf6a5aaea9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:35.373103 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:35.373103 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:35.381594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e0087580-8931-489d-b93f-2ad9b1258295 req-a55de984-8011-4735-9536-cabc7ee6fb0b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.382564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e0087580-8931-489d-b93f-2ad9b1258295 req-a55de984-8011-4735-9536-cabc7ee6fb0b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.399817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e0087580-8931-489d-b93f-2ad9b1258295 req-a55de984-8011-4735-9536-cabc7ee6fb0b service nova] Creating event network-vif-plugged:0a593524-9707-4109-9577-e536b658044d for instance edeabf63-f66c-4719-9212-d3214bd03574 on nch2-master-1 Dec 18 20:50:35.400866 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e0087580-8931-489d-b93f-2ad9b1258295 req-a55de984-8011-4735-9536-cabc7ee6fb0b service nova] Creating event network-vif-plugged:15f43c7a-5020-4142-bcf7-357f1cecac24 for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:35.401063 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e0087580-8931-489d-b93f-2ad9b1258295 req-a55de984-8011-4735-9536-cabc7ee6fb0b service nova] Creating event network-vif-plugged:9b09cd1f-a315-422b-ad9b-2daf6a5aaea9 for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:35.409803 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e0087580-8931-489d-b93f-2ad9b1258295 req-a55de984-8011-4735-9536-cabc7ee6fb0b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042741 Dec 18 20:50:35.410919 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 578/1158] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:35.415750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:35.420146 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:35.420146 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:35.422343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.423736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Searching by: {'reservation_id': 'r-u77kc7yo', 'deleted': False, 'project_id': '9ce640720b084b84a86f590d354dad25'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:50:35.430102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.430850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.431745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.432285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.537053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:50:35.614740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.621574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.622122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.760767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:35.769256 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d2b8f23-80ef-44c0-b32f-fd6181ecc8d5 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1387 microversion: 2.1 time: 0.440303 Dec 18 20:50:35.769913 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 581/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:35 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1387 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:35.774291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3f0ee91-429c-4f5a-8535-6673f698cfd8 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:35.789441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f3f0ee91-429c-4f5a-8535-6673f698cfd8 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] HTTP exception thrown: Instance group 0ae2b6aa-38c2-4a1f-baa9-3792c14d3ab0 could not be found. Dec 18 20:50:35.789955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3f0ee91-429c-4f5a-8535-6673f698cfd8 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Returning 404 to user: Instance group 0ae2b6aa-38c2-4a1f-baa9-3792c14d3ab0 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:35.790811 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3f0ee91-429c-4f5a-8535-6673f698cfd8 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/0ae2b6aa-38c2-4a1f-baa9-3792c14d3ab0" status: 404 len: 117 microversion: 2.1 time: 0.019886 Dec 18 20:50:35.791366 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 582/1160] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:50:35 2021] DELETE /compute/v2.1/os-server-groups/0ae2b6aa-38c2-4a1f-baa9-3792c14d3ab0 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:35.807935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:35.808550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:35.815942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.816536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:35.817550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:35.818003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.044384 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ded7da2-4b92-427f-898b-a175e51b59f8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-u77kc7yo" status: 200 len: 2927 microversion: 2.1 time: 0.632296 Dec 18 20:50:36.045668 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 579/1161] 10.222.0.13 () {58 vars in 1196 bytes} [Sat Dec 18 20:50:35 2021] GET /compute/v2.1/servers/detail?reservation_id=r-u77kc7yo => generated 2927 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:36.050536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.051578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:36.057628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.058094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.058913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.059385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.284931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:36.297204 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d90f3c48-d03b-4778-916a-2dbe8e8e73ae tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1511 microversion: 2.1 time: 0.504502 Dec 18 20:50:36.299544 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 583/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:35 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:36.304639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f9a4782f-bd9e-4b29-b568-7ff9b4b943a3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.311766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f9a4782f-bd9e-4b29-b568-7ff9b4b943a3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] HTTP exception thrown: Instance group 17abe55e-4fed-4673-b479-52503bdee27c could not be found. Dec 18 20:50:36.312560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f9a4782f-bd9e-4b29-b568-7ff9b4b943a3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Returning 404 to user: Instance group 17abe55e-4fed-4673-b479-52503bdee27c could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:36.314677 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f9a4782f-bd9e-4b29-b568-7ff9b4b943a3 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/17abe55e-4fed-4673-b479-52503bdee27c" status: 404 len: 117 microversion: 2.1 time: 0.013730 Dec 18 20:50:36.315855 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 584/1163] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:50:36 2021] DELETE /compute/v2.1/os-server-groups/17abe55e-4fed-4673-b479-52503bdee27c => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:36.322690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.323300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:36.332156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.333041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.333847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.334502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.449587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:36.457226 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-929a2f37-7c1d-4bfe-956a-04982d048dc9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.410500 Dec 18 20:50:36.457863 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 580/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:36 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:36.463518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.464154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:36.471871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.472325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.473150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.473625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.724683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:36.732294 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-058277a9-6aba-415d-a24f-f36229c7dac8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1365 microversion: 2.1 time: 0.414567 Dec 18 20:50:36.735193 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 585/1165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:36 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1365 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:36.741305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f011f96-c691-4213-8766-b621b4dc0b85 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.756898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.compute.server_groups [None req-1f011f96-c691-4213-8766-b621b4dc0b85 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Querying cell cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) for 2 instances {{(pid=140731) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 18 20:50:36.758013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f011f96-c691-4213-8766-b621b4dc0b85 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.758479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f011f96-c691-4213-8766-b621b4dc0b85 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.777780 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1f011f96-c691-4213-8766-b621b4dc0b85 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/0e39aefe-f4e1-48eb-8293-0ba96f3d68a1" status: 200 len: 271 microversion: 2.1 time: 0.040950 Dec 18 20:50:36.784242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 586/1166] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:50:36 2021] GET /compute/v2.1/os-server-groups/0e39aefe-f4e1-48eb-8293-0ba96f3d68a1 => generated 271 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:36.786709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:36.788960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c5e6433-4784-4282-84e0-7a6a52d39fd5 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.794756 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-5c5e6433-4784-4282-84e0-7a6a52d39fd5 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] HTTP exception thrown: Instance group f2328f19-dc02-462b-9bd1-8de50ced1187 could not be found. Dec 18 20:50:36.795184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:36.795577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c5e6433-4784-4282-84e0-7a6a52d39fd5 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Returning 404 to user: Instance group f2328f19-dc02-462b-9bd1-8de50ced1187 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:36.796924 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c5e6433-4784-4282-84e0-7a6a52d39fd5 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/f2328f19-dc02-462b-9bd1-8de50ced1187" status: 404 len: 117 microversion: 2.1 time: 0.011569 Dec 18 20:50:36.797463 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 587/1167] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:50:36 2021] DELETE /compute/v2.1/os-server-groups/f2328f19-dc02-462b-9bd1-8de50ced1187 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:36.797716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:36.799278 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-684d941a-aafe-4034-ae5e-d9388ee72874 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1280 microversion: 2.25 time: 0.340356 Dec 18 20:50:36.800463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 581/1168] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:36 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1280 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:36.804363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.805160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:36.805559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7e1119fb-9b19-47dd-ba86-309494504081 req-d6dbebd7-ad6b-4022-885f-213ecefda4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930716df-900f-446a-8ca4-f1bc174e3345", "name": "network-vif-deleted", "tag": "713b1105-c226-474e-8fd2-e067be484d6a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:36.807290 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:36.807290 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:36.811791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.812250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.813138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.813585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.815581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7e1119fb-9b19-47dd-ba86-309494504081 req-d6dbebd7-ad6b-4022-885f-213ecefda4ac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.816100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7e1119fb-9b19-47dd-ba86-309494504081 req-d6dbebd7-ad6b-4022-885f-213ecefda4ac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.826972 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7e1119fb-9b19-47dd-ba86-309494504081 req-d6dbebd7-ad6b-4022-885f-213ecefda4ac service nova] Creating event network-vif-deleted:713b1105-c226-474e-8fd2-e067be484d6a for instance 930716df-900f-446a-8ca4-f1bc174e3345 on nch1-master-1 Dec 18 20:50:36.832645 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7e1119fb-9b19-47dd-ba86-309494504081 req-d6dbebd7-ad6b-4022-885f-213ecefda4ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030727 Dec 18 20:50:36.833413 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 582/1169] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:36.838756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:36.839527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:36.846459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.846992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:36.847853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:36.848360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.015201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:37.022215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:37.028044 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86a3d9a1-a64f-47cd-9b95-e70b0402ae9d tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1199 microversion: 2.1 time: 0.229290 Dec 18 20:50:37.037476 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 588/1170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:36 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1199 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:37.037644 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc9cd3ba-db86-4816-bc61-7cb97de272b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1387 microversion: 2.1 time: 0.197294 Dec 18 20:50:37.037644 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 583/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:36 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1387 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:37.038058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcc43b41-772c-4e3c-9835-7a5e9a6c9036 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:37.042299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e054811-36d3-462b-ad60-8730ec12910f tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:37.042993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e054811-36d3-462b-ad60-8730ec12910f tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:37.049580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e054811-36d3-462b-ad60-8730ec12910f tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.050099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e054811-36d3-462b-ad60-8730ec12910f tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.050967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e054811-36d3-462b-ad60-8730ec12910f tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.051463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e054811-36d3-462b-ad60-8730ec12910f tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.069843 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcc43b41-772c-4e3c-9835-7a5e9a6c9036 tempest-ServerGroupTestJSON-289675994 tempest-ServerGroupTestJSON-289675994-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/dab84d10-6689-462b-98bd-114ee80923ce" status: 204 len: 0 microversion: 2.1 time: 0.035436 Dec 18 20:50:37.074031 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 584/1172] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:50:37 2021] DELETE /compute/v2.1/os-server-groups/dab84d10-6689-462b-98bd-114ee80923ce => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:50:37.207679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e054811-36d3-462b-ad60-8730ec12910f tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 200 len: 1618 microversion: 2.1 time: 0.176574 Dec 18 20:50:37.209295 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 589/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:37 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 1618 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:37.237353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cdfafa7a-5735-40f1-a56e-b4a9c84cfd34 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:37.238241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cdfafa7a-5735-40f1-a56e-b4a9c84cfd34 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:37.246431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdfafa7a-5735-40f1-a56e-b4a9c84cfd34 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.247622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdfafa7a-5735-40f1-a56e-b4a9c84cfd34 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.248641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdfafa7a-5735-40f1-a56e-b4a9c84cfd34 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.249292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdfafa7a-5735-40f1-a56e-b4a9c84cfd34 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.317269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:37.318063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:37.328130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.328911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.329941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.330606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.389015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.392445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.393628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lazy-loading 'fault' on Instance uuid 930716df-900f-446a-8ca4-f1bc174e3345 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:50:37.472152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1906a27b85764875af7fe46c07b32595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835793f458834c0387829e418f6e3b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:37.480460 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff1709e9-3c57-49e7-ba91-3fe7652b30b1 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 200 len: 1306 microversion: 2.1 time: 0.167493 Dec 18 20:50:37.491708 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 590/1174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:37 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 1306 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:37.499715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-34023bc7-3bcb-46dc-9bde-11e721385be3 req-8356a937-08ac-4b95-8e65-bb515d1d7fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "name": "network-vif-plugged", "status": "completed", "tag": "01e68d95-1643-42d9-8ad6-bf3e0318d01f"}, {"server_uuid": "68fa4ba4-d935-4772-b54b-9d78b6d2ea3d", "name": "network-vif-plugged", "status": "completed", "tag": "70c1a24f-77c8-4810-9440-0a7498d6a257"}, {"server_uuid": "da4d97c0-d046-4bf2-842f-bb1ab2c4c935", "name": "network-vif-plugged", "status": "completed", "tag": "4b0e7658-35c7-49ef-98fc-5ca3e983079d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:37.501892 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:37.501892 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:37.504960 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cdfafa7a-5735-40f1-a56e-b4a9c84cfd34 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919" status: 200 len: 1618 microversion: 2.1 time: 0.277774 Dec 18 20:50:37.521218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 585/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:37 2021] GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919 => generated 1618 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:37.526092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-34023bc7-3bcb-46dc-9bde-11e721385be3 req-8356a937-08ac-4b95-8e65-bb515d1d7fc8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.526572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-34023bc7-3bcb-46dc-9bde-11e721385be3 req-8356a937-08ac-4b95-8e65-bb515d1d7fc8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.533865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:37.535003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:37.543633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.544256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.545465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.546208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.549993 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-34023bc7-3bcb-46dc-9bde-11e721385be3 req-8356a937-08ac-4b95-8e65-bb515d1d7fc8 service nova] Creating event network-vif-plugged:01e68d95-1643-42d9-8ad6-bf3e0318d01f for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:37.550844 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-34023bc7-3bcb-46dc-9bde-11e721385be3 req-8356a937-08ac-4b95-8e65-bb515d1d7fc8 service nova] Creating event network-vif-plugged:70c1a24f-77c8-4810-9440-0a7498d6a257 for instance 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d on nch2-master-1 Dec 18 20:50:37.551391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-34023bc7-3bcb-46dc-9bde-11e721385be3 req-8356a937-08ac-4b95-8e65-bb515d1d7fc8 service nova] Creating event network-vif-plugged:4b0e7658-35c7-49ef-98fc-5ca3e983079d for instance da4d97c0-d046-4bf2-842f-bb1ab2c4c935 on nch1-master-1 Dec 18 20:50:37.565849 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-34023bc7-3bcb-46dc-9bde-11e721385be3 req-8356a937-08ac-4b95-8e65-bb515d1d7fc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072458 Dec 18 20:50:37.566733 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 591/1176] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:37 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:37.573850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-672339553", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b07c26ad-bdd3-495d-bf73-2844e2824e78"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:37.638609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:37.966594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:37.975863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-124e76fe-6cb1-41f9-9770-b9b0e929337f tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.455602 Dec 18 20:50:37.985572 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 586/1177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:37 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:37.986056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:37.986687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:37.992775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.993230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:37.994016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:37.994655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.220604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:38.221665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:38.222331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:38.222902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:38.223313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:38.233203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.233858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.234911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.235355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.252597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:38.253432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:38.262344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:38.270146 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d14e64e6-78c7-40b1-83c3-74d2c7da365f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1365 microversion: 2.1 time: 0.287591 Dec 18 20:50:38.270901 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 587/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:37 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:38.272385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:38.274891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:38.275610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:38.276230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:38.282475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.283216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.284207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.284795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.328788 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92a242f0-ff7b-4743-a071-8073974f0190 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760849 Dec 18 20:50:38.329851 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 592/1179] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:38.335090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:38.338360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:38.349302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.350066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.350924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.351341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.521424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:38.531214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:38.533019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:38.535031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1f31e6f9-d7aa-4dcd-ac39-887d42700c31 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1280 microversion: 2.25 time: 0.263072 Dec 18 20:50:38.535591 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 588/1180] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:38 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:38.540149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:38.541012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:38.547412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.548146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.549152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.549827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.566848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:38.575309 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9037644-9354-46af-bc5a-5003f853a791 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1199 microversion: 2.1 time: 0.244131 Dec 18 20:50:38.576088 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 593/1181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:38 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1199 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:38.581200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-049b6458-0e18-49ba-93be-acb0be6a0771 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:38.581812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-049b6458-0e18-49ba-93be-acb0be6a0771 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:38.659572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-049b6458-0e18-49ba-93be-acb0be6a0771 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:38.666410 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-049b6458-0e18-49ba-93be-acb0be6a0771 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1216 microversion: 2.1 time: 0.088527 Dec 18 20:50:38.676223 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 594/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:38 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:38.676223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:38.676223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] [instance: 930716df-900f-446a-8ca4-f1bc174e3345] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:38.679126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.679580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.680363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.680810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.702045 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] HTTP exception thrown: Instance 930716df-900f-446a-8ca4-f1bc174e3345 could not be found. Dec 18 20:50:38.702705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] Returning 404 to user: Instance 930716df-900f-446a-8ca4-f1bc174e3345 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:38.703506 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4b2486ee-74bd-494b-a2ef-76970abf88d8 tempest-InstanceActionsTestJSON-1683922892 tempest-InstanceActionsTestJSON-1683922892-project] 10.222.0.13 "GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345" status: 404 len: 111 microversion: 2.1 time: 0.035084 Dec 18 20:50:38.704063 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 595/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:38 2021] GET /compute/v2.1/servers/930716df-900f-446a-8ca4-f1bc174e3345 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:38.779808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:38.788098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-baa2ac4a-295f-4e67-aaf3-6ffa7f53bbc9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1587 microversion: 2.1 time: 0.251282 Dec 18 20:50:38.788723 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 589/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:38 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1587 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:38.805072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5866ef6-6fba-4f24-a64c-9bf72ce6b6af tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:38.805749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5866ef6-6fba-4f24-a64c-9bf72ce6b6af tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:38.812805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5866ef6-6fba-4f24-a64c-9bf72ce6b6af tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.813267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5866ef6-6fba-4f24-a64c-9bf72ce6b6af tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.814069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5866ef6-6fba-4f24-a64c-9bf72ce6b6af tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:38.814539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5866ef6-6fba-4f24-a64c-9bf72ce6b6af tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:38.899308 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5866ef6-6fba-4f24-a64c-9bf72ce6b6af tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098292 Dec 18 20:50:38.900081 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 596/1185] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:50:38 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:38.993160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:38.993877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:39.000162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.001421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.002440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.003133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.263605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:39.274872 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-53208802-1062-462a-89fe-ad031d1846fd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1354 microversion: 2.1 time: 0.285621 Dec 18 20:50:39.275840 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 590/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:38 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1354 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:39.293690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:39.294386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:39.304223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.304909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.305976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.306699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.556276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:39.557093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:39.567203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.568089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.569716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.570448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.592166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:39.608528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a8c93090-3e5d-4743-a2ec-87f7925bed1e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1365 microversion: 2.1 time: 0.319736 Dec 18 20:50:39.620321 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 597/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:39 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:39.628713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f1174aba-45f5-4403-8d1b-10b45dca89b0 req-40179305-a475-494b-8b40-ffc231d4434d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-plugged", "status": "completed", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:39.635563 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:39.635563 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:39.645666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f1174aba-45f5-4403-8d1b-10b45dca89b0 req-40179305-a475-494b-8b40-ffc231d4434d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.646517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f1174aba-45f5-4403-8d1b-10b45dca89b0 req-40179305-a475-494b-8b40-ffc231d4434d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.680886 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f1174aba-45f5-4403-8d1b-10b45dca89b0 req-40179305-a475-494b-8b40-ffc231d4434d service nova] Creating event network-vif-plugged:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:50:39.693263 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f1174aba-45f5-4403-8d1b-10b45dca89b0 req-40179305-a475-494b-8b40-ffc231d4434d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071204 Dec 18 20:50:39.699679 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 598/1188] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:39.709967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:39.710719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:39.739917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.740307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:39.741127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:39.741643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.320364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:40.338377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:40.340419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:40.341745 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-42decee7-4566-49f6-b232-102783b9faab tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1475 microversion: 2.25 time: 0.792446 Dec 18 20:50:40.342617 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 591/1189] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:39 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1475 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:50:40.359621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:40.360506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:40.366776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.367316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.368203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.368702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.475461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:40.484602 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67679cae-5890-4667-9f91-230986961285 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1274 microversion: 2.1 time: 0.129079 Dec 18 20:50:40.485384 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 592/1190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:40 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:40.497918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:40.498605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:40.505562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.506012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.506832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.507736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.520982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:40.535259 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0bbd8f20-7e29-45ab-afa2-e3c0fb837b25 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1382 microversion: 2.1 time: 0.831300 Dec 18 20:50:40.536720 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 599/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:39 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1382 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:40.542625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:40.543754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:40.552339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.553159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.554209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.554810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.932012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:40.941824 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4b6ebe56-08d6-4271-a0a1-b28a6722d761 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1804 microversion: 2.1 time: 0.455108 Dec 18 20:50:40.953798 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 593/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:40 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1804 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:40.958735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aedbd25a-37b6-4895-84ef-b178a0fc0bf6 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:40.959345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aedbd25a-37b6-4895-84ef-b178a0fc0bf6 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:40.965200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aedbd25a-37b6-4895-84ef-b178a0fc0bf6 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.965658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aedbd25a-37b6-4895-84ef-b178a0fc0bf6 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:40.966485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aedbd25a-37b6-4895-84ef-b178a0fc0bf6 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:40.966928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aedbd25a-37b6-4895-84ef-b178a0fc0bf6 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.098186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid da4d97c0-d046-4bf2-842f-bb1ab2c4c935 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:50:41.128599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6a4e656-b388-4c93-be07-e2e3ea841d8f tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1967 microversion: 2.25 time: 0.590558 Dec 18 20:50:41.130599 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 600/1193] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:40 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1967 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:41.135420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:41.136201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:41.144231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.144912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.145960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.146583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.361901 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aedbd25a-37b6-4895-84ef-b178a0fc0bf6 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1533 microversion: 2.1 time: 0.406707 Dec 18 20:50:41.366418 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 594/1194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:40 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1533 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:41.371105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e4f31e8-d449-4cea-ad65-314563ae81be tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:41.374372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e4f31e8-d449-4cea-ad65-314563ae81be tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:41.387105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e4f31e8-d449-4cea-ad65-314563ae81be tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.387553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e4f31e8-d449-4cea-ad65-314563ae81be tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.392396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e4f31e8-d449-4cea-ad65-314563ae81be tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.393450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e4f31e8-d449-4cea-ad65-314563ae81be tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.443611 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e4f31e8-d449-4cea-ad65-314563ae81be tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1/ips" status: 200 len: 218 microversion: 2.1 time: 0.075870 Dec 18 20:50:41.444249 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 595/1195] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 20:50:41 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1/ips => generated 218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:41.456924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a2753c7-56b4-44df-a4f9-1424dace7fff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:41.459387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a2753c7-56b4-44df-a4f9-1424dace7fff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:41.472492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a2753c7-56b4-44df-a4f9-1424dace7fff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.473905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a2753c7-56b4-44df-a4f9-1424dace7fff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.476506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a2753c7-56b4-44df-a4f9-1424dace7fff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.477471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a2753c7-56b4-44df-a4f9-1424dace7fff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.503949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:41.515522 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9a7c51cc-bb73-468d-a6c6-7481309e64eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1365 microversion: 2.1 time: 0.383501 Dec 18 20:50:41.520608 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 601/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:41 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:41.534359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e213a58d-e99d-458c-b98a-7373b02c6fe6 req-0be4b574-058f-4ecd-a9f2-e9f88b03e34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edeabf63-f66c-4719-9212-d3214bd03574", "tag": "0a593524-9707-4109-9577-e536b658044d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:41.540954 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:41.540954 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:41.553365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e213a58d-e99d-458c-b98a-7373b02c6fe6 req-0be4b574-058f-4ecd-a9f2-e9f88b03e34a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.554165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e213a58d-e99d-458c-b98a-7373b02c6fe6 req-0be4b574-058f-4ecd-a9f2-e9f88b03e34a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.569206 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a2753c7-56b4-44df-a4f9-1424dace7fff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 14 microversion: 2.1 time: 0.122908 Dec 18 20:50:41.570388 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 596/1197] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:41 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:41.575305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:41.576009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:41.582091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e213a58d-e99d-458c-b98a-7373b02c6fe6 req-0be4b574-058f-4ecd-a9f2-e9f88b03e34a service nova] Creating event network-changed:0a593524-9707-4109-9577-e536b658044d for instance edeabf63-f66c-4719-9212-d3214bd03574 on nch2-master-1 Dec 18 20:50:41.590052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e213a58d-e99d-458c-b98a-7373b02c6fe6 req-0be4b574-058f-4ecd-a9f2-e9f88b03e34a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066730 Dec 18 20:50:41.591480 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 602/1198] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:41.594218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.594723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.595608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.596053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.597691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76385dcc-9014-49f8-ab2c-43e61565357e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:41.598698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-76385dcc-9014-49f8-ab2c-43e61565357e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:41.620080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76385dcc-9014-49f8-ab2c-43e61565357e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.620835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76385dcc-9014-49f8-ab2c-43e61565357e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:41.622796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76385dcc-9014-49f8-ab2c-43e61565357e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:41.624118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76385dcc-9014-49f8-ab2c-43e61565357e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.131118 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76385dcc-9014-49f8-ab2c-43e61565357e tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1533 microversion: 2.1 time: 0.538030 Dec 18 20:50:42.145958 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 603/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:41 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1533 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:42.149465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:42.149980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:42.165626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.166289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.167415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.168013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.216269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:50:42.272139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid da4d97c0-d046-4bf2-842f-bb1ab2c4c935 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:50:42.307427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d27fc63c-8305-48f6-a902-43edf104e2a3 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1967 microversion: 2.25 time: 0.735747 Dec 18 20:50:42.320561 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 597/1200] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:41 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1967 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:42.325492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:42.326156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:42.350904 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b93d20e-55ff-4e9f-b340-818c91f05ff3 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 204 len: 0 microversion: 2.1 time: 0.211885 Dec 18 20:50:42.352422 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 604/1201] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:50:42 2021] DELETE /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:50:42.353113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.353731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.354854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.355701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.367044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca89b80b-6856-46ea-a704-676e075e68ba tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:42.368516 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:42.368516 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:42.374663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca89b80b-6856-46ea-a704-676e075e68ba tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.376910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca89b80b-6856-46ea-a704-676e075e68ba tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.379548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca89b80b-6856-46ea-a704-676e075e68ba tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.380009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca89b80b-6856-46ea-a704-676e075e68ba tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.454837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca89b80b-6856-46ea-a704-676e075e68ba tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.099815 Dec 18 20:50:42.455452 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 605/1202] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 20:50:42 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:42.466715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d349a3c-ff19-4367-a159-6612544423be tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:42.468136 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:42.468136 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:42.470143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d349a3c-ff19-4367-a159-6612544423be tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.470764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d349a3c-ff19-4367-a159-6612544423be tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.471684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d349a3c-ff19-4367-a159-6612544423be tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.472315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d349a3c-ff19-4367-a159-6612544423be tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.503396 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d349a3c-ff19-4367-a159-6612544423be tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044855 Dec 18 20:50:42.504239 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 606/1203] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Dec 18 20:50:42 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:42.521609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:42.523023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:42.534387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.535022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.535645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:42.536087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:42.938275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:42.969483 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-232d3eec-f1cf-4734-a7f3-ad6209f2dcdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1316 microversion: 2.1 time: 0.641398 Dec 18 20:50:42.972326 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 598/1204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:42 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1316 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:42.988043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:42.993318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:43.007439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:43.009017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:43.013271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:43.015044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:43.086978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:43.089459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lazy-loading 'flavor' on Instance uuid 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:50:43.098092 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e667f873-4950-46a3-8e42-ee324e049acc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1810 microversion: 2.1 time: 0.582814 Dec 18 20:50:43.099322 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 607/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:42 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1810 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:43.105158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:43.107106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:43.116933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:43.118758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:43.120051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:43.120725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:43.127683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Going to try to live migrate instance to nch1-master-1 {{(pid=140732) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:50:43.155462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'flavor' on Instance uuid da4d97c0-d046-4bf2-842f-bb1ab2c4c935 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:50:43.180541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Going to try to live migrate instance to nch2-master-1 {{(pid=140731) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 20:50:45.699790 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-454a85c8-7ea5-48e4-8df0-72d99cdd519c tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935/action" status: 202 len: 0 microversion: 2.25 time: 2.599131 Dec 18 20:50:45.705181 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 608/1206] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:50:43 2021] POST /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935/action => generated 0 bytes in 2605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:50:45.709932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:45.710833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:45.733780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:45.734554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:45.735556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:45.739167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:45.831628 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2a41261-7d39-4f49-91e9-21c2806ef437 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d/action" status: 202 len: 0 microversion: 2.1 time: 2.856345 Dec 18 20:50:45.832409 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 599/1207] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:42 2021] POST /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d/action => generated 0 bytes in 2859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:50:45.838103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4b16985d-9bf8-46c5-ba18-345e6b8b62c6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:45.839361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b16985d-9bf8-46c5-ba18-345e6b8b62c6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:45.856016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b16985d-9bf8-46c5-ba18-345e6b8b62c6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:45.860134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b16985d-9bf8-46c5-ba18-345e6b8b62c6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:45.865337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b16985d-9bf8-46c5-ba18-345e6b8b62c6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:45.866089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b16985d-9bf8-46c5-ba18-345e6b8b62c6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:45.928216 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4b16985d-9bf8-46c5-ba18-345e6b8b62c6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 14 microversion: 2.1 time: 0.092128 Dec 18 20:50:45.930535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 600/1208] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:45 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:46.105377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-254129863", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "919567ad-b643-45e0-8bd0-80e66f9ec1fc"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:46.162910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] validate_networks() for [('919567ad-b643-45e0-8bd0-80e66f9ec1fc', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:46.222867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:46.230598 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fc13735-a756-4424-aea9-d746dfe5eb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1552 microversion: 2.1 time: 0.524223 Dec 18 20:50:46.231185 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 609/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:45 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1552 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:46.239649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:46.241042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:46.250116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:46.250681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:46.251558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:46.252069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:46.796953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:46.804970 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe88c9c4-878a-4025-8cfb-abd7cadf6fcb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1316 microversion: 2.1 time: 0.572568 Dec 18 20:50:46.805550 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 610/1210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:46 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:46.810194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-868b7e17-147a-42d3-89a9-5f28aa161738 req-81ad528a-538d-4999-a6af-5a9fbaef771d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4e117a-1136-496e-a3b5-98c652ed0f78", "tag": "4984579f-71f2-49fb-bece-8c1cd12eaebd"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:46.813300 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:46.813300 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:46.820502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-868b7e17-147a-42d3-89a9-5f28aa161738 req-81ad528a-538d-4999-a6af-5a9fbaef771d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:46.820944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-868b7e17-147a-42d3-89a9-5f28aa161738 req-81ad528a-538d-4999-a6af-5a9fbaef771d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:46.840761 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-868b7e17-147a-42d3-89a9-5f28aa161738 req-81ad528a-538d-4999-a6af-5a9fbaef771d service nova] Creating event network-changed:4984579f-71f2-49fb-bece-8c1cd12eaebd for instance ce4e117a-1136-496e-a3b5-98c652ed0f78 on nch1-master-1 Dec 18 20:50:46.845866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-868b7e17-147a-42d3-89a9-5f28aa161738 req-81ad528a-538d-4999-a6af-5a9fbaef771d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039181 Dec 18 20:50:46.846486 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 611/1211] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:46.851796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:46.852524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:46.860161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:46.860598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:46.861387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:46.861822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:47.514285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:47.525095 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5989ba92-c148-4d29-b6bb-6e0c57074bcd tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1789 microversion: 2.1 time: 0.677303 Dec 18 20:50:47.536426 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 612/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:46 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1789 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:47.602997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2046507492", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b887375f-aca9-4b00-9b24-e802c9b9f2d0"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:47.673972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] validate_networks() for [('b887375f-aca9-4b00-9b24-e802c9b9f2d0', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:47.711135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:47.712318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:47.713020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:47.713533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:47.714047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:47.724779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:47.726444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:47.727283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:47.728512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:47.747956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Getting quotas for project bb6f0b624038403284d782c3c726279c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:47.754587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Getting quotas for user 2808986334b647068ea9777af124fe32 and project bb6f0b624038403284d782c3c726279c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:47.769001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:47.771472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:47.820383 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0268ca31-1f4b-449c-b502-1e690e409e43 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.887561 Dec 18 20:50:47.821441 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 601/1213] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:47.831293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:47.832074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:47.839894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:47.840345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:47.841223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:47.841680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:48.439797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:48.455914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:48.457806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:48.459214 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b450d90f-6aec-4fd4-9dca-816b93449272 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.636593 Dec 18 20:50:48.471731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 602/1214] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:47 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:48.477837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:48.479093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:48.489099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:48.489822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:48.490894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:48.492647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:48.863229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:48.881887 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-68b3375a-10c7-454f-a46b-447ce29bb2bd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.408719 Dec 18 20:50:48.891117 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 603/1215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:48 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:48.895912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-700b6cee-5d53-4895-9a7c-961e6eca4a67 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:48.896409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-700b6cee-5d53-4895-9a7c-961e6eca4a67 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:48.914539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-700b6cee-5d53-4895-9a7c-961e6eca4a67 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:48.916244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-700b6cee-5d53-4895-9a7c-961e6eca4a67 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:48.917244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-700b6cee-5d53-4895-9a7c-961e6eca4a67 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:48.917873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-700b6cee-5d53-4895-9a7c-961e6eca4a67 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:48.948960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:48.949447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:48.949985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:48.950490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:48.951841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:48.981090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:48.982101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:48.986119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:48.988409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.070521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Getting quotas for project 7f74319f4d954cea9418c30afd53b213. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:49.086077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Getting quotas for user 0184005bc5c34c038fd140564572807e and project 7f74319f4d954cea9418c30afd53b213. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:49.128713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:49.131796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:49.271483 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-700b6cee-5d53-4895-9a7c-961e6eca4a67 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.379206 Dec 18 20:50:49.272735 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 604/1216] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:50:48 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:49.277835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-79eacf9d-8aba-4d36-b884-64442496d39e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:49.279112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-79eacf9d-8aba-4d36-b884-64442496d39e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:49.299308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79eacf9d-8aba-4d36-b884-64442496d39e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.301818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79eacf9d-8aba-4d36-b884-64442496d39e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.303002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79eacf9d-8aba-4d36-b884-64442496d39e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.305234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79eacf9d-8aba-4d36-b884-64442496d39e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.308470 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-343b1bd3-6e32-453e-aea4-2c68430cf6d3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.769438 Dec 18 20:50:49.317827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 613/1217] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:49.330456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-dfae90a6-9388-4ff6-a752-98ca9f079cf2 req-f2a85e2b-9e39-4724-afbb-9f18885c726c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "name": "network-vif-unplugged", "status": "completed", "tag": "15f43c7a-5020-4142-bcf7-357f1cecac24"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:49.347868 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:49.347868 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:49.374414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-dfae90a6-9388-4ff6-a752-98ca9f079cf2 req-f2a85e2b-9e39-4724-afbb-9f18885c726c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.374955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-dfae90a6-9388-4ff6-a752-98ca9f079cf2 req-f2a85e2b-9e39-4724-afbb-9f18885c726c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.389052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-dfae90a6-9388-4ff6-a752-98ca9f079cf2 req-f2a85e2b-9e39-4724-afbb-9f18885c726c service nova] Creating event network-vif-unplugged:15f43c7a-5020-4142-bcf7-357f1cecac24 for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:49.413250 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-dfae90a6-9388-4ff6-a752-98ca9f079cf2 req-f2a85e2b-9e39-4724-afbb-9f18885c726c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086367 Dec 18 20:50:49.414342 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 614/1218] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:49.418970 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-79eacf9d-8aba-4d36-b884-64442496d39e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 14 microversion: 2.1 time: 0.144613 Dec 18 20:50:49.419386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:49.420563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:49.423428 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 605/1219] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:49 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:49.426582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:49.427417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:49.439994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.441263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.443281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.445107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.445777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.445905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.446926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.449652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.726082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:49.733944 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-feea4c96-7a50-44a9-b655-536f3729a52b tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1285 microversion: 2.1 time: 0.311522 Dec 18 20:50:49.746639 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 606/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:49 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:49.752534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:49.753367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:49.763411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.766829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.767885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.768862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.843237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.843886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.844501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lazy-loading 'fault' on Instance uuid bb5635b3-c81d-4517-9630-bfa0ee6598f1 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:50:49.889620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:49.899299 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-044c5289-c152-40f2-8e93-a917991359bb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1316 microversion: 2.1 time: 0.483708 Dec 18 20:50:49.899888 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 615/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:49 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:49.911233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2181a6e4-7a88-4717-82b8-75d7163c11a8 req-68ea012a-48d7-41a2-af2d-7a799fb239a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "name": "network-vif-deleted", "tag": "9b09cd1f-a315-422b-ad9b-2daf6a5aaea9"}, {"server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "name": "network-vif-deleted", "tag": "01e68d95-1643-42d9-8ad6-bf3e0318d01f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:49.912942 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:49.912942 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:49.934490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:49.937923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2181a6e4-7a88-4717-82b8-75d7163c11a8 req-68ea012a-48d7-41a2-af2d-7a799fb239a2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.938447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2181a6e4-7a88-4717-82b8-75d7163c11a8 req-68ea012a-48d7-41a2-af2d-7a799fb239a2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.944031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ef5edc7-b8c3-4268-a3d3-33a06abc9d78 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 200 len: 1302 microversion: 2.1 time: 0.195868 Dec 18 20:50:49.946026 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 607/1222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:49 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 1302 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:49.958527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-238687105", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b887375f-aca9-4b00-9b24-e802c9b9f2d0"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:49.959464 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2181a6e4-7a88-4717-82b8-75d7163c11a8 req-68ea012a-48d7-41a2-af2d-7a799fb239a2 service nova] Creating event network-vif-deleted:9b09cd1f-a315-422b-ad9b-2daf6a5aaea9 for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:49.960546 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2181a6e4-7a88-4717-82b8-75d7163c11a8 req-68ea012a-48d7-41a2-af2d-7a799fb239a2 service nova] Creating event network-vif-deleted:01e68d95-1643-42d9-8ad6-bf3e0318d01f for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:49.967089 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2181a6e4-7a88-4717-82b8-75d7163c11a8 req-68ea012a-48d7-41a2-af2d-7a799fb239a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059034 Dec 18 20:50:49.968464 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 616/1223] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:49 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:49.974709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:49.975767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:49.984139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.984852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:49.986573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:49.987311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.071018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] validate_networks() for [('b887375f-aca9-4b00-9b24-e802c9b9f2d0', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:50.331678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:50.339927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:50.341542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:50.343331 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-be87bcf1-dd9e-4caf-8cb0-66ddcd81198f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.373589 Dec 18 20:50:50.344180 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 617/1224] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:49 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:50.348528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:50.349633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:50.355986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.356660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.358294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.359223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.662296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:50.672655 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-78531ac2-d80c-4535-bf35-d73c2ba8f1d4 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.327286 Dec 18 20:50:50.673425 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 618/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:50 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:50.678124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-360a19be-45b4-46be-88ba-b44a95d10538 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:50.679443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-360a19be-45b4-46be-88ba-b44a95d10538 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:50.686590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-360a19be-45b4-46be-88ba-b44a95d10538 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.687127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-360a19be-45b4-46be-88ba-b44a95d10538 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.687973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-360a19be-45b4-46be-88ba-b44a95d10538 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.688414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-360a19be-45b4-46be-88ba-b44a95d10538 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.760060 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-360a19be-45b4-46be-88ba-b44a95d10538 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 14 microversion: 2.1 time: 0.085124 Dec 18 20:50:50.764028 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 619/1226] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:50 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:50.766534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aee6bfa6-6d55-4443-99c7-33e714a2a58d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:50.767521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aee6bfa6-6d55-4443-99c7-33e714a2a58d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:50.776551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee6bfa6-6d55-4443-99c7-33e714a2a58d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.777710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee6bfa6-6d55-4443-99c7-33e714a2a58d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.777831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee6bfa6-6d55-4443-99c7-33e714a2a58d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.778286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee6bfa6-6d55-4443-99c7-33e714a2a58d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.831583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:50.832257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:50.832933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:50.833542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:50.834159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:50.846864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.847692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.849117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.849622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.856574 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aee6bfa6-6d55-4443-99c7-33e714a2a58d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 14 microversion: 2.1 time: 0.094186 Dec 18 20:50:50.858039 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 620/1227] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:50 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:50.868959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Getting quotas for project 7f74319f4d954cea9418c30afd53b213. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:50.870410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:50.871090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:50.875988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Getting quotas for user 0184005bc5c34c038fd140564572807e and project 7f74319f4d954cea9418c30afd53b213. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:50.880140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.880592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.881394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.882330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:50.893098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:50.895889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:50.967522 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a2e5520-b522-431d-ade2-cdf45cb5784e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019636 Dec 18 20:50:50.968452 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 608/1228] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:50.973643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c3d701b3-5959-4dbd-b030-1ae7929f484e req-c498f224-3f42-4f04-9ec1-7b205dac916d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:50.975820 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:50.975820 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:50.985655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c3d701b3-5959-4dbd-b030-1ae7929f484e req-c498f224-3f42-4f04-9ec1-7b205dac916d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:50.986315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c3d701b3-5959-4dbd-b030-1ae7929f484e req-c498f224-3f42-4f04-9ec1-7b205dac916d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:51.018774 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c3d701b3-5959-4dbd-b030-1ae7929f484e req-c498f224-3f42-4f04-9ec1-7b205dac916d service nova] Creating event network-changed:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:50:51.029870 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c3d701b3-5959-4dbd-b030-1ae7929f484e req-c498f224-3f42-4f04-9ec1-7b205dac916d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059735 Dec 18 20:50:51.035696 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 609/1229] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:51.043048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:51.043735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:51.049917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:51.050681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:51.051684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:51.052383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:51.634127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:51.645281 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d8c69aa-eeab-4ae3-9c92-1a2fb174df21 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1327 microversion: 2.1 time: 0.782400 Dec 18 20:50:51.648366 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 621/1230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:50 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1327 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:51.650132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:51.654987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:51.656202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:51.663311 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-53ad48b8-c685-48fa-8093-fe3f319f528a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1316 microversion: 2.1 time: 0.625670 Dec 18 20:50:51.663885 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 610/1231] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:51 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:51.668242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:51.669122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:51.670942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:51.671744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:51.710906 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] HTTP exception thrown: Instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 could not be found. Dec 18 20:50:51.711655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Returning 404 to user: Instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:50:51.712892 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4cd23715-b493-4478-8fa3-4887e32cc68c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 404 len: 111 microversion: 2.1 time: 0.063253 Dec 18 20:50:51.714010 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 622/1232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:51 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:50:51.722317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2134422642", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "451", "networks": [{"uuid": "b887375f-aca9-4b00-9b24-e802c9b9f2d0"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:51.727879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:51.728791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:51.742283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:51.743190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:51.745024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:51.746684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:51.878110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] validate_networks() for [('b887375f-aca9-4b00-9b24-e802c9b9f2d0', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:52.791869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:52.806058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:52.808768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:52.810523 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe47f811-eb6f-4395-877d-74ff5c219465 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 1.093536 Dec 18 20:50:52.827252 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 623/1233] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:51 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:52.845996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c95f3866-dfc5-4105-8488-a3ef70c79a3f req-bad8d675-541e-466d-9058-b46cb2c53d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4e117a-1136-496e-a3b5-98c652ed0f78", "name": "network-vif-plugged", "status": "completed", "tag": "4984579f-71f2-49fb-bece-8c1cd12eaebd"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:52.848093 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:52.848093 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:52.872879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c95f3866-dfc5-4105-8488-a3ef70c79a3f req-bad8d675-541e-466d-9058-b46cb2c53d3b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:52.874197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c95f3866-dfc5-4105-8488-a3ef70c79a3f req-bad8d675-541e-466d-9058-b46cb2c53d3b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:52.900663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c95f3866-dfc5-4105-8488-a3ef70c79a3f req-bad8d675-541e-466d-9058-b46cb2c53d3b service nova] Creating event network-vif-plugged:4984579f-71f2-49fb-bece-8c1cd12eaebd for instance ce4e117a-1136-496e-a3b5-98c652ed0f78 on nch1-master-1 Dec 18 20:50:52.914765 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c95f3866-dfc5-4105-8488-a3ef70c79a3f req-bad8d675-541e-466d-9058-b46cb2c53d3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079751 Dec 18 20:50:52.916809 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 624/1234] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:52.930925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:52.934419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:52.970097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:52.972286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:52.974310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:52.977780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.736816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:53.744734 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a66512ec-c237-49b4-b372-989e0b27b578 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.821049 Dec 18 20:50:53.745327 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 625/1235] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:52 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:53.750634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4805a25f-24e3-4307-9861-a2e50ff2bc6b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:53.751610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4805a25f-24e3-4307-9861-a2e50ff2bc6b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:53.757603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4805a25f-24e3-4307-9861-a2e50ff2bc6b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.758061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4805a25f-24e3-4307-9861-a2e50ff2bc6b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.758890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4805a25f-24e3-4307-9861-a2e50ff2bc6b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.759331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4805a25f-24e3-4307-9861-a2e50ff2bc6b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.788249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:53.789507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:53.792369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:53.793156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:53.793673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:53.804730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.805486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.806609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.807228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.828921 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4805a25f-24e3-4307-9861-a2e50ff2bc6b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 16386 microversion: 2.1 time: 0.081799 Dec 18 20:50:53.830862 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 626/1236] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:53 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 16386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:53.843001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4022ac10-a272-4a5c-9f0e-8ce62ab2efb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:53.844917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4022ac10-a272-4a5c-9f0e-8ce62ab2efb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:53.854152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4022ac10-a272-4a5c-9f0e-8ce62ab2efb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.854984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4022ac10-a272-4a5c-9f0e-8ce62ab2efb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.856018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4022ac10-a272-4a5c-9f0e-8ce62ab2efb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.856623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4022ac10-a272-4a5c-9f0e-8ce62ab2efb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.864289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Getting quotas for project 7f74319f4d954cea9418c30afd53b213. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:53.882717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Getting quotas for user 0184005bc5c34c038fd140564572807e and project 7f74319f4d954cea9418c30afd53b213. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:53.921807 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4022ac10-a272-4a5c-9f0e-8ce62ab2efb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 14 microversion: 2.1 time: 0.089205 Dec 18 20:50:53.923060 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 627/1237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:53 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:53.929992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d5e90860-2bed-49d5-b818-8d0429fa9617 req-301008f0-a052-40c8-bd87-19123ac5f3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5635b3-c81d-4517-9630-bfa0ee6598f1", "name": "network-vif-deleted", "tag": "15f43c7a-5020-4142-bcf7-357f1cecac24"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:53.932727 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:53.932727 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:53.934569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:53.938810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:53.949499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d5e90860-2bed-49d5-b818-8d0429fa9617 req-301008f0-a052-40c8-bd87-19123ac5f3a7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.950147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d5e90860-2bed-49d5-b818-8d0429fa9617 req-301008f0-a052-40c8-bd87-19123ac5f3a7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.964886 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d5e90860-2bed-49d5-b818-8d0429fa9617 req-301008f0-a052-40c8-bd87-19123ac5f3a7 service nova] Creating event network-vif-deleted:15f43c7a-5020-4142-bcf7-357f1cecac24 for instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 on nch1-master-1 Dec 18 20:50:53.973023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d5e90860-2bed-49d5-b818-8d0429fa9617 req-301008f0-a052-40c8-bd87-19123ac5f3a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047856 Dec 18 20:50:53.974153 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 628/1238] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:53.981617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:53.983438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:53.991590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.992354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:53.994427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:53.995088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.009982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a9b59ac6-9e4d-4d47-b8f7-1b26f8286df3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.343172 Dec 18 20:50:54.011719 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 611/1239] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:54.018926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:54.023647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:54.043396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.046393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.049740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.050572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.520664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:54.532563 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1926734d-f2a2-4726-b246-1a39ecfd5371 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1327 microversion: 2.1 time: 0.556994 Dec 18 20:50:54.533664 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 629/1240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:53 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1327 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:54.547136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3995a9ef-c13c-4192-bdd5-a8d46537ebe2 req-53fb08ab-69ca-4a82-b0ac-1500e21758b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4d97c0-d046-4bf2-842f-bb1ab2c4c935", "name": "network-vif-unplugged", "status": "completed", "tag": "4b0e7658-35c7-49ef-98fc-5ca3e983079d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:54.548965 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:54.548965 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:54.564930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3995a9ef-c13c-4192-bdd5-a8d46537ebe2 req-53fb08ab-69ca-4a82-b0ac-1500e21758b0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.565381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3995a9ef-c13c-4192-bdd5-a8d46537ebe2 req-53fb08ab-69ca-4a82-b0ac-1500e21758b0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.591325 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3995a9ef-c13c-4192-bdd5-a8d46537ebe2 req-53fb08ab-69ca-4a82-b0ac-1500e21758b0 service nova] Creating event network-vif-unplugged:4b0e7658-35c7-49ef-98fc-5ca3e983079d for instance da4d97c0-d046-4bf2-842f-bb1ab2c4c935 on nch1-master-1 Dec 18 20:50:54.597784 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3995a9ef-c13c-4192-bdd5-a8d46537ebe2 req-53fb08ab-69ca-4a82-b0ac-1500e21758b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060328 Dec 18 20:50:54.598836 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 630/1241] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:54.604105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:54.604933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:54.612681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.613225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.614140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.614641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.679624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:54.694520 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19094b79-012a-4357-9a83-6333cc257e9a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1316 microversion: 2.1 time: 0.681554 Dec 18 20:50:54.695832 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 612/1242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:54 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1316 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:54.701057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:54.701923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:54.710179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.710927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.711802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.712440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.894006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:54.908233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e9072f94-9376-4807-b420-08fcd60358d0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1217 microversion: 2.1 time: 0.210759 Dec 18 20:50:54.912866 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 613/1243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:54 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:54.927368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:54.936720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:54.961880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.964674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:54.965861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:54.966402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.101846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:55.118494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:55.121719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:55.124062 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8e169178-eeb7-40ef-b8b3-94623203a5de tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.523840 Dec 18 20:50:55.138196 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 631/1244] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:54 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:55.144144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c275de99-11d6-41a3-8dbb-61e47161a474 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:55.145123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c275de99-11d6-41a3-8dbb-61e47161a474 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:55.159820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c275de99-11d6-41a3-8dbb-61e47161a474 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.160595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c275de99-11d6-41a3-8dbb-61e47161a474 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.163208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c275de99-11d6-41a3-8dbb-61e47161a474 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.163656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c275de99-11d6-41a3-8dbb-61e47161a474 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.244057 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c275de99-11d6-41a3-8dbb-61e47161a474 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 16386 microversion: 2.1 time: 0.103389 Dec 18 20:50:55.245550 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 632/1245] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:55 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 16386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:55.282059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d1f0bd23-2917-48af-9453-ee9aea237d8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:55.285467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d1f0bd23-2917-48af-9453-ee9aea237d8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:55.321214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1f0bd23-2917-48af-9453-ee9aea237d8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.323093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1f0bd23-2917-48af-9453-ee9aea237d8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.324029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1f0bd23-2917-48af-9453-ee9aea237d8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.324487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1f0bd23-2917-48af-9453-ee9aea237d8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.424683 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d1f0bd23-2917-48af-9453-ee9aea237d8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 14 microversion: 2.1 time: 0.174673 Dec 18 20:50:55.428669 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 633/1246] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:55 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:55.434347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:55.451686 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0a7c16b4-ce4f-4016-b05b-5ee994576d0b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.536523 Dec 18 20:50:55.453354 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 614/1247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:54 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:55.551874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:55.552535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:55.580196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.580736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.588702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.589572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.711917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:55.712913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:55.722526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.723270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:55.724264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:55.725141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:56.065063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:56.074286 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a062b089-43be-4ea9-87db-8ac3ae2e5995 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1327 microversion: 2.1 time: 0.528735 Dec 18 20:50:56.077989 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 634/1248] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:55 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1327 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:56.084151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:56.084934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:56.099129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:56.099585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:56.100377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:56.107946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:56.161115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:56.170090 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-db84e1f6-90c1-4802-b9a0-a7d11dafec1a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1466 microversion: 2.1 time: 0.461388 Dec 18 20:50:56.171310 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 615/1249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:55 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1466 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:56.191266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ba9465ed-a2a6-4709-886c-4e5b3a902bf8 req-f110d2a7-e741-40eb-805e-e52d1e9f94da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c923f8-581a-4223-b0d6-858f1ef3dabb", "tag": "f27987e3-7621-4ae3-852c-d3f86e49252c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:56.194038 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:56.194038 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:56.213232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ba9465ed-a2a6-4709-886c-4e5b3a902bf8 req-f110d2a7-e741-40eb-805e-e52d1e9f94da service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:56.214359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:56.214517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ba9465ed-a2a6-4709-886c-4e5b3a902bf8 req-f110d2a7-e741-40eb-805e-e52d1e9f94da service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:56.232907 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07bc7de1-58c4-4009-b46f-c69905080269 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1279 microversion: 2.1 time: 0.152227 Dec 18 20:50:56.235152 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 635/1250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:56 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:56.240145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:56.240880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:56.249370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:56.250524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:56.252300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:56.253238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:56.260668 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ba9465ed-a2a6-4709-886c-4e5b3a902bf8 req-f110d2a7-e741-40eb-805e-e52d1e9f94da service nova] Creating event network-changed:f27987e3-7621-4ae3-852c-d3f86e49252c for instance 57c923f8-581a-4223-b0d6-858f1ef3dabb on nch2-master-1 Dec 18 20:50:56.276832 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ba9465ed-a2a6-4709-886c-4e5b3a902bf8 req-f110d2a7-e741-40eb-805e-e52d1e9f94da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096492 Dec 18 20:50:56.278826 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 616/1251] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:56.315078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2027bcef-56db-4640-a6f3-e71a916123b7 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:56.315770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2027bcef-56db-4640-a6f3-e71a916123b7 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:56.338101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2027bcef-56db-4640-a6f3-e71a916123b7 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:56.338753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2027bcef-56db-4640-a6f3-e71a916123b7 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:56.340793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2027bcef-56db-4640-a6f3-e71a916123b7 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:56.341556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2027bcef-56db-4640-a6f3-e71a916123b7 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.204776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:57.213265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:57.215073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:57.217189 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8e8e71e5-1003-4a70-a2b5-fdbcb58783af tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.979996 Dec 18 20:50:57.219782 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 636/1252] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:56 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:57.228293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-754a5994-9263-41c2-909f-385b866d27a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:57.230994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-754a5994-9263-41c2-909f-385b866d27a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:57.238568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-754a5994-9263-41c2-909f-385b866d27a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.239951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-754a5994-9263-41c2-909f-385b866d27a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.241037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-754a5994-9263-41c2-909f-385b866d27a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.241512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2027bcef-56db-4640-a6f3-e71a916123b7 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1617 microversion: 2.1 time: 0.957989 Dec 18 20:50:57.241979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-754a5994-9263-41c2-909f-385b866d27a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.243064 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 617/1253] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:56 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1617 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:57.269046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82ebfa9e-2801-4191-9a64-5b106aa9035d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:57.270978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82ebfa9e-2801-4191-9a64-5b106aa9035d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:57.278778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82ebfa9e-2801-4191-9a64-5b106aa9035d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.280015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82ebfa9e-2801-4191-9a64-5b106aa9035d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.282137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82ebfa9e-2801-4191-9a64-5b106aa9035d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.282779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82ebfa9e-2801-4191-9a64-5b106aa9035d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.344839 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-754a5994-9263-41c2-909f-385b866d27a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 16386 microversion: 2.1 time: 0.123292 Dec 18 20:50:57.345179 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 637/1254] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:57 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 16386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:57.351943 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82ebfa9e-2801-4191-9a64-5b106aa9035d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 14 microversion: 2.1 time: 0.107443 Dec 18 20:50:57.352818 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 618/1255] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:57 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:50:57.359144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:57.360527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:57.369561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0ff93848-9849-44f4-9457-2191f9788be5 req-1ef8eeff-2b87-4b61-bc88-0dac07f3c63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fa4ba4-d935-4772-b54b-9d78b6d2ea3d", "name": "network-vif-unplugged", "status": "completed", "tag": "70c1a24f-77c8-4810-9440-0a7498d6a257"}, {"name": "network-changed", "server_uuid": "68fa4ba4-d935-4772-b54b-9d78b6d2ea3d", "tag": "70c1a24f-77c8-4810-9440-0a7498d6a257"}, {"name": "network-changed", "server_uuid": "da4d97c0-d046-4bf2-842f-bb1ab2c4c935", "tag": "4b0e7658-35c7-49ef-98fc-5ca3e983079d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:57.371421 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:57.371421 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:50:57.389756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.390237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.394834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.397325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.399260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0ff93848-9849-44f4-9457-2191f9788be5 req-1ef8eeff-2b87-4b61-bc88-0dac07f3c63f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.399717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0ff93848-9849-44f4-9457-2191f9788be5 req-1ef8eeff-2b87-4b61-bc88-0dac07f3c63f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.433588 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0ff93848-9849-44f4-9457-2191f9788be5 req-1ef8eeff-2b87-4b61-bc88-0dac07f3c63f service nova] Creating event network-vif-unplugged:70c1a24f-77c8-4810-9440-0a7498d6a257 for instance 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d on nch2-master-1 Dec 18 20:50:57.434623 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0ff93848-9849-44f4-9457-2191f9788be5 req-1ef8eeff-2b87-4b61-bc88-0dac07f3c63f service nova] Creating event network-changed:70c1a24f-77c8-4810-9440-0a7498d6a257 for instance 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d on nch2-master-1 Dec 18 20:50:57.435573 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0ff93848-9849-44f4-9457-2191f9788be5 req-1ef8eeff-2b87-4b61-bc88-0dac07f3c63f service nova] Creating event network-changed:4b0e7658-35c7-49ef-98fc-5ca3e983079d for instance da4d97c0-d046-4bf2-842f-bb1ab2c4c935 on nch1-master-1 Dec 18 20:50:57.451861 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0ff93848-9849-44f4-9457-2191f9788be5 req-1ef8eeff-2b87-4b61-bc88-0dac07f3c63f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.097179 Dec 18 20:50:57.467006 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 619/1256] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:57 2021] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:57.474141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:57.475240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:57.483334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.483786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:57.484594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:57.485177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:58.140126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:58.149532 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0ea75f6c-3c87-4a8d-a2fe-0fe2458bcee7 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.803143 Dec 18 20:50:58.150117 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 638/1257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:57 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:58.161413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:58.162291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:58.174726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:58.175255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:58.176131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:58.176667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:58.239064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:58.250733 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4435a3c0-8dcd-4439-82d6-8a697b2512fb tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1327 microversion: 2.1 time: 0.780404 Dec 18 20:50:58.252011 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 620/1258] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:57 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1327 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:58.260033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-419664107", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b07c26ad-bdd3-495d-bf73-2844e2824e78"]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:58.334856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:50:58.789404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:58.804758 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-63070d59-740d-4905-801c-a78746d1d708 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1321 microversion: 2.1 time: 0.653326 Dec 18 20:50:58.805363 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 639/1259] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:58 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1321 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:58.810642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:58.812849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:58.819279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:58.820031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:58.821031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:58.821631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.571578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:50:59.573308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:50:59.573847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:50:59.574279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:50:59.574722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:50:59.587848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.588320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.589716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.590520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.616077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:59.626992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:50:59.631299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:59.633576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:50:59.634523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:50:59.635817 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9acbb4c-20ea-436b-bf9a-bc404a195213 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.828600 Dec 18 20:50:59.647311 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 640/1260] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:50:58 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:50:59.653161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a1de59b4-1272-4f3b-a18e-2e691bdd4ed2 req-92cabcba-1fad-4814-955c-40e73d62f2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335d5aef-b6d5-402c-8431-28f42f02d8fc", "tag": "73fa6ad8-869b-4f9e-a560-517252ea691b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:59.655356 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:50:59.655356 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:50:59.660511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:50:59.663657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:50:59.682703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a1de59b4-1272-4f3b-a18e-2e691bdd4ed2 req-92cabcba-1fad-4814-955c-40e73d62f2dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.683369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a1de59b4-1272-4f3b-a18e-2e691bdd4ed2 req-92cabcba-1fad-4814-955c-40e73d62f2dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.703755 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a1de59b4-1272-4f3b-a18e-2e691bdd4ed2 req-92cabcba-1fad-4814-955c-40e73d62f2dd service nova] Creating event network-changed:73fa6ad8-869b-4f9e-a560-517252ea691b for instance 335d5aef-b6d5-402c-8431-28f42f02d8fc on nch1-master-1 Dec 18 20:50:59.714336 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a1de59b4-1272-4f3b-a18e-2e691bdd4ed2 req-92cabcba-1fad-4814-955c-40e73d62f2dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060779 Dec 18 20:50:59.717042 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 641/1261] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:50:59.727834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-63b78624-f2a9-4a56-b4a0-5ff19fa5ed0c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:59.735350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-63b78624-f2a9-4a56-b4a0-5ff19fa5ed0c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:59.745173 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-77abc3ad-eb8d-4fa5-8010-4f7ed241a472 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491464 Dec 18 20:50:59.746974 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 621/1262] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:50:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:50:59.754245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63b78624-f2a9-4a56-b4a0-5ff19fa5ed0c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.755238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63b78624-f2a9-4a56-b4a0-5ff19fa5ed0c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.755680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d5b16de6-1e41-4602-a4b5-3e637e780d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:50:59.756246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63b78624-f2a9-4a56-b4a0-5ff19fa5ed0c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.756917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63b78624-f2a9-4a56-b4a0-5ff19fa5ed0c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.758110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d5b16de6-1e41-4602-a4b5-3e637e780d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:59.770125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5b16de6-1e41-4602-a4b5-3e637e780d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.772220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5b16de6-1e41-4602-a4b5-3e637e780d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.773556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5b16de6-1e41-4602-a4b5-3e637e780d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.774011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5b16de6-1e41-4602-a4b5-3e637e780d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.823031 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-63b78624-f2a9-4a56-b4a0-5ff19fa5ed0c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 16386 microversion: 2.1 time: 0.103269 Dec 18 20:50:59.823781 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 642/1263] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:59 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 16386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:50:59.829199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:59.829890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:59.837086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.837620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.838447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.838929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.840462 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d5b16de6-1e41-4602-a4b5-3e637e780d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 8206 microversion: 2.1 time: 0.090822 Dec 18 20:50:59.841558 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 622/1264] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:50:59 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 8206 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:50:59.848116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:50:59.849080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:50:59.858866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.859328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:50:59.860136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:50:59.860571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.151660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:00.172372 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-020de7bf-1167-470c-94e1-aec521a89107 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.346955 Dec 18 20:51:00.183589 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 643/1265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:59 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:00.193761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7883a7c1-e0e6-4aad-a102-9725be87b219 req-b2becd95-335c-4a7e-bb07-191c9e19d1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffede440-64bd-4c72-bcaa-a602bc2fb9fc", "tag": "b3039056-1fc4-4019-883c-67786f806485"}, {"name": "network-changed", "server_uuid": "6acebe03-ef39-4717-abd1-ec9c4b52d21e", "tag": "8c68a13f-39f5-43c7-9efd-4920983792ab"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:00.199903 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:00.199903 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:00.207557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:00.219662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7883a7c1-e0e6-4aad-a102-9725be87b219 req-b2becd95-335c-4a7e-bb07-191c9e19d1cb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.220365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7883a7c1-e0e6-4aad-a102-9725be87b219 req-b2becd95-335c-4a7e-bb07-191c9e19d1cb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.224285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ef7aa6e-4dc8-4654-8f30-c328cdbca5d3 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1327 microversion: 2.1 time: 0.380803 Dec 18 20:51:00.226735 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 623/1266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:50:59 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1327 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:00.235621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7883a7c1-e0e6-4aad-a102-9725be87b219 req-b2becd95-335c-4a7e-bb07-191c9e19d1cb service nova] Creating event network-changed:b3039056-1fc4-4019-883c-67786f806485 for instance ffede440-64bd-4c72-bcaa-a602bc2fb9fc on nch1-master-1 Dec 18 20:51:00.235621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7883a7c1-e0e6-4aad-a102-9725be87b219 req-b2becd95-335c-4a7e-bb07-191c9e19d1cb service nova] Creating event network-changed:8c68a13f-39f5-43c7-9efd-4920983792ab for instance 6acebe03-ef39-4717-abd1-ec9c4b52d21e on nch2-master-1 Dec 18 20:51:00.240866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:00.241804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:00.253108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.253953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.255337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.256932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.261528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7883a7c1-e0e6-4aad-a102-9725be87b219 req-b2becd95-335c-4a7e-bb07-191c9e19d1cb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076223 Dec 18 20:51:00.262203 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 644/1267] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:00.288854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:00.289591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:00.320731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.320966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.321650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.332614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.408057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:00.415658 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c7d0fa6-c6b0-4c5d-bf03-a2361b4c5590 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1220 microversion: 2.1 time: 0.178437 Dec 18 20:51:00.426204 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 624/1268] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:00 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1220 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:00.654095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:00.654776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:00.666120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.666676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.667504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.667932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.700643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:00.719529 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7f1c5b5-4bef-4f9f-af1b-d276d17ed63b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1321 microversion: 2.1 time: 0.452790 Dec 18 20:51:00.725570 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 645/1269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:00 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:00.849851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b639b2a9-2963-47ae-a4a2-f4cf06a869d3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:00.852728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b639b2a9-2963-47ae-a4a2-f4cf06a869d3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:00.924693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b639b2a9-2963-47ae-a4a2-f4cf06a869d3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.925911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b639b2a9-2963-47ae-a4a2-f4cf06a869d3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:00.927718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b639b2a9-2963-47ae-a4a2-f4cf06a869d3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:00.928761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b639b2a9-2963-47ae-a4a2-f4cf06a869d3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.040350 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b639b2a9-2963-47ae-a4a2-f4cf06a869d3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.206264 Dec 18 20:51:01.045900 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 646/1270] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:00 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:01.049332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5cedc24f-e737-4294-9dc4-c8919d129eb5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:01.058591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5cedc24f-e737-4294-9dc4-c8919d129eb5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:01.103376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cedc24f-e737-4294-9dc4-c8919d129eb5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.103867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cedc24f-e737-4294-9dc4-c8919d129eb5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.106946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cedc24f-e737-4294-9dc4-c8919d129eb5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.110095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cedc24f-e737-4294-9dc4-c8919d129eb5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.161947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:01.175248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:01.177251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:01.182023 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c665bdd8-0dd5-4e8a-be2c-d92a1d089ae2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.531819 Dec 18 20:51:01.183840 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 625/1271] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:00 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:51:01.194698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6f2c7922-a318-419f-b1f2-4b06ca357d5e req-ba4485a1-413a-449b-baa4-97a8bbf6a69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c923f8-581a-4223-b0d6-858f1ef3dabb", "name": "network-vif-plugged", "status": "completed", "tag": "f27987e3-7621-4ae3-852c-d3f86e49252c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:01.202611 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:01.202611 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:01.212640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6f2c7922-a318-419f-b1f2-4b06ca357d5e req-ba4485a1-413a-449b-baa4-97a8bbf6a69e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.217901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6f2c7922-a318-419f-b1f2-4b06ca357d5e req-ba4485a1-413a-449b-baa4-97a8bbf6a69e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.253220 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5cedc24f-e737-4294-9dc4-c8919d129eb5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 16320 microversion: 2.1 time: 0.210448 Dec 18 20:51:01.253434 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6f2c7922-a318-419f-b1f2-4b06ca357d5e req-ba4485a1-413a-449b-baa4-97a8bbf6a69e service nova] Creating event network-vif-plugged:f27987e3-7621-4ae3-852c-d3f86e49252c for instance 57c923f8-581a-4223-b0d6-858f1ef3dabb on nch2-master-1 Dec 18 20:51:01.255249 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 647/1272] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:01 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 16320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:01.260446 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6f2c7922-a318-419f-b1f2-4b06ca357d5e req-ba4485a1-413a-449b-baa4-97a8bbf6a69e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074618 Dec 18 20:51:01.261325 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 626/1273] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:01.262110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:01.263745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:01.267082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:01.267789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:01.277459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.278023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.279566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.280262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.326277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.327138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.328228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.329223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.807575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:01.823357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:01.833639 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d788051-11bf-45d3-b7a3-2377fa0dd0ec tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.576792 Dec 18 20:51:01.834543 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 648/1274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:01 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:01.841263 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b32fca70-f8ae-4513-923a-113822e30757 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1327 microversion: 2.1 time: 0.578408 Dec 18 20:51:01.844166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 627/1275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:01 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1327 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:01.854430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:01.855435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:01.855563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:01.856235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:01.869440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.873809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.875469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.876105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.880828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.881716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.882855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:01.884346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:01.995855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:02.005106 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82f0e182-b1b4-4d6b-8aa4-e1f65d55858e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1274 microversion: 2.1 time: 0.167836 Dec 18 20:51:02.006371 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 649/1276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:01 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:02.057740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a2bb780-5b6b-42a7-962a-42c3bbbfce2c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:02.061133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a2bb780-5b6b-42a7-962a-42c3bbbfce2c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:02.089708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2bb780-5b6b-42a7-962a-42c3bbbfce2c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.093018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2bb780-5b6b-42a7-962a-42c3bbbfce2c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:02.094233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2bb780-5b6b-42a7-962a-42c3bbbfce2c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.095415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2bb780-5b6b-42a7-962a-42c3bbbfce2c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:02.159515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:02.170736 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbafb87e-1427-4c1c-b021-1ae2dda6c1a4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1321 microversion: 2.1 time: 0.324942 Dec 18 20:51:02.176538 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a2bb780-5b6b-42a7-962a-42c3bbbfce2c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.123718 Dec 18 20:51:02.179132 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 650/1277] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:02 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:02.186688 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 628/1278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:01 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:02.201856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:02.202854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:02.218352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.219055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:02.220044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.221427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:02.266285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f11b8588-e96c-4344-a436-a992c3df9171 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:02.267146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f11b8588-e96c-4344-a436-a992c3df9171 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:02.282513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f11b8588-e96c-4344-a436-a992c3df9171 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.283850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f11b8588-e96c-4344-a436-a992c3df9171 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:02.284942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f11b8588-e96c-4344-a436-a992c3df9171 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.285903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f11b8588-e96c-4344-a436-a992c3df9171 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:02.353014 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f11b8588-e96c-4344-a436-a992c3df9171 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 16320 microversion: 2.1 time: 0.090744 Dec 18 20:51:02.353718 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 629/1279] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:02 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 16320 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:02.447966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:02.460411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:02.463198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:02.465039 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f377286e-5573-4a0d-be98-597343bfe74d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.267678 Dec 18 20:51:02.484626 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 651/1280] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:02 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:51:02.741035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-129487370", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "31e19967-1c17-4096-8afb-e86fcf3cbcb3"}, {"uuid": "f880d138-a5d8-43c2-a2f8-b58d6577fea6"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:02.803466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] validate_networks() for [('31e19967-1c17-4096-8afb-e86fcf3cbcb3', None, None, None, None, None), ('f880d138-a5d8-43c2-a2f8-b58d6577fea6', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:51:02.852565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:02.856884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:02.865353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.866145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:02.867208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:02.867862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:03.380019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:03.394105 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8e7b17b6-f299-4780-8617-3e0edf34cfbb tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1392 microversion: 2.1 time: 0.545293 Dec 18 20:51:03.395615 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 652/1281] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:02 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1392 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:03.412858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:03.419285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:03.448281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:03.454045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:03.455197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:03.455914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:04.082120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:04.100871 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a6184c4-b46d-4c25-98d0-f8e055c422cd tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1527 microversion: 2.1 time: 0.703928 Dec 18 20:51:04.118688 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 653/1282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:03 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1527 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:04.133421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:04.136211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:04.161700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:04.162089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:04.163165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:04.163972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:04.877453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:04.885721 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca4b34d5-cb82-42f5-a599-8d164f4401d9 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1316 microversion: 2.1 time: 0.764349 Dec 18 20:51:04.886542 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 654/1283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:04 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:04.897682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:04.900253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:04.913116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:04.913929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:04.915092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:04.915819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.001736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:51:05.003056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:51:05.003858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:51:05.004462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:51:05.005311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:51:05.042077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.042597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.048161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.048874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.100920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Getting quotas for project 260f5423c9c44b499073e360e0e66264. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:51:05.107734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Getting quotas for user 8cf273e7f6d646c4a6c46bc7a197c6a3 and project 260f5423c9c44b499073e360e0e66264. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:51:05.156622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:51:05.159713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:51:05.232159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac4f9940-5072-44ad-81d8-a1756407d3f8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.494999 Dec 18 20:51:05.239062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 630/1284] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:51:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 2503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:51:05.252609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a5c9c45e-3b5f-4361-ac14-a46d1767cbab tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:05.255202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a5c9c45e-3b5f-4361-ac14-a46d1767cbab tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:05.269052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c9c45e-3b5f-4361-ac14-a46d1767cbab tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.269669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c9c45e-3b5f-4361-ac14-a46d1767cbab tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.270656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c9c45e-3b5f-4361-ac14-a46d1767cbab tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.273869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c9c45e-3b5f-4361-ac14-a46d1767cbab tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.343969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:05.354584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81fca560-4723-4731-98e4-9c83a4ed1b5d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1321 microversion: 2.1 time: 0.466481 Dec 18 20:51:05.359009 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a5c9c45e-3b5f-4361-ac14-a46d1767cbab tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.116452 Dec 18 20:51:05.361381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 655/1285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:04 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:05.366774 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 631/1286] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:05 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:05.372966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6c4e3382-134e-49dd-acc0-ada79a8a9872 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:05.374161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6c4e3382-134e-49dd-acc0-ada79a8a9872 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:05.375909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:05.376675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:05.382472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c4e3382-134e-49dd-acc0-ada79a8a9872 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.383479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c4e3382-134e-49dd-acc0-ada79a8a9872 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.384495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c4e3382-134e-49dd-acc0-ada79a8a9872 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.385143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c4e3382-134e-49dd-acc0-ada79a8a9872 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.393740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.394636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.395764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.396504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.465459 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6c4e3382-134e-49dd-acc0-ada79a8a9872 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 16320 microversion: 2.1 time: 0.100664 Dec 18 20:51:05.470362 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 656/1287] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:05 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 16320 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:05.479828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:05.495426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:05.515672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.516487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.517548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:05.518209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:05.984274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:05.999605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:06.001897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:06.004197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d567565-1a92-4eb9-994b-a56ca05c01f0 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1485 microversion: 2.25 time: 0.637143 Dec 18 20:51:06.005056 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 632/1288] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:05 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1485 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:06.006443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:06.010956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:06.011762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.018124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99c832a8-705c-4736-87bd-c7f09d440cb6 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1527 microversion: 2.1 time: 0.546113 Dec 18 20:51:06.021230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.021858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.022003 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 657/1289] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:05 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1527 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:06.026096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.026766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.039721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-bf0909a5-95b7-44ba-9def-c528ea1e5caf req-dfefd4a8-5e47-49d7-b310-453575169823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a40f995-3ddb-44b8-a4d1-51aac21ae695", "tag": "0b9441be-b2da-4416-9591-960ff551886a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:06.041338 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:06.041338 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:06.078224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bf0909a5-95b7-44ba-9def-c528ea1e5caf req-dfefd4a8-5e47-49d7-b310-453575169823 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.087275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bf0909a5-95b7-44ba-9def-c528ea1e5caf req-dfefd4a8-5e47-49d7-b310-453575169823 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.111589 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-bf0909a5-95b7-44ba-9def-c528ea1e5caf req-dfefd4a8-5e47-49d7-b310-453575169823 service nova] Creating event network-changed:0b9441be-b2da-4416-9591-960ff551886a for instance 5a40f995-3ddb-44b8-a4d1-51aac21ae695 on nch1-master-1 Dec 18 20:51:06.119180 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-bf0909a5-95b7-44ba-9def-c528ea1e5caf req-dfefd4a8-5e47-49d7-b310-453575169823 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091824 Dec 18 20:51:06.120048 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 658/1290] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:06.143819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:06.146413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.162196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.162644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.163463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.163903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.334481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:06.351138 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b451a122-0d04-49b8-a854-d33bd9db1946 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1208 microversion: 2.1 time: 0.216513 Dec 18 20:51:06.352723 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 659/1291] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:06 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1208 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:06.353891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:06.358882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:06.359704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.364840 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-374bda36-0e7a-4bc7-a9c3-70dc9086bb1c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1382 microversion: 2.1 time: 0.358117 Dec 18 20:51:06.366832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.367454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.368405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.369235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.378018 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 633/1292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:06 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1382 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:06.482782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:06.483461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.490347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.491021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.491873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.492246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.506891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] HTTP exception thrown: Instance 57c923f8-581a-4223-b0d6-858f1ef3dabb could not be found. Dec 18 20:51:06.507975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Returning 404 to user: Instance 57c923f8-581a-4223-b0d6-858f1ef3dabb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:06.508973 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28c26240-3166-4982-811c-0ee3f5debacf tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] 10.222.0.13 "DELETE /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 404 len: 111 microversion: 2.1 time: 0.129846 Dec 18 20:51:06.510019 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 634/1293] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:06 2021] DELETE /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:06.518293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-655645b4-7ec9-4475-9d67-3f50cb29b2fb req-e06e9fd8-af4a-42fd-9308-81ce3a46b447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffede440-64bd-4c72-bcaa-a602bc2fb9fc", "name": "network-vif-plugged", "status": "completed", "tag": "b3039056-1fc4-4019-883c-67786f806485"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:06.520067 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:06.520067 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:06.528128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-655645b4-7ec9-4475-9d67-3f50cb29b2fb req-e06e9fd8-af4a-42fd-9308-81ce3a46b447 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.529148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-655645b4-7ec9-4475-9d67-3f50cb29b2fb req-e06e9fd8-af4a-42fd-9308-81ce3a46b447 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.543494 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-655645b4-7ec9-4475-9d67-3f50cb29b2fb req-e06e9fd8-af4a-42fd-9308-81ce3a46b447 service nova] Creating event network-vif-plugged:b3039056-1fc4-4019-883c-67786f806485 for instance ffede440-64bd-4c72-bcaa-a602bc2fb9fc on nch1-master-1 Dec 18 20:51:06.548826 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-655645b4-7ec9-4475-9d67-3f50cb29b2fb req-e06e9fd8-af4a-42fd-9308-81ce3a46b447 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036323 Dec 18 20:51:06.549425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 635/1294] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:06.555207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f90eaab6-7646-455b-9b4f-831ed78a0a49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:06.556210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f90eaab6-7646-455b-9b4f-831ed78a0a49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.563390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f90eaab6-7646-455b-9b4f-831ed78a0a49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.564531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f90eaab6-7646-455b-9b4f-831ed78a0a49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.565541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f90eaab6-7646-455b-9b4f-831ed78a0a49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.565991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f90eaab6-7646-455b-9b4f-831ed78a0a49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.632496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:06.634568 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f90eaab6-7646-455b-9b4f-831ed78a0a49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.078218 Dec 18 20:51:06.640060 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 636/1295] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:06 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:06.644004 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-320862cc-3d6f-4b07-ae7d-acf9e155e3ee tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1316 microversion: 2.1 time: 0.289427 Dec 18 20:51:06.644596 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 660/1296] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:06 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:06.650462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:06.651297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.652138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-767727a2-7379-4cb8-a5d0-5c673a1db063 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '.version_select at 0x7f714fb30160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:06.654348 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:06.654348 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:06.656417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-767727a2-7379-4cb8-a5d0-5c673a1db063 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.657137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-767727a2-7379-4cb8-a5d0-5c673a1db063 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.663850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.664320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.665424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.666103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.671676 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-767727a2-7379-4cb8-a5d0-5c673a1db063 tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 3086 microversion: 2.1 time: 0.023542 Dec 18 20:51:06.672293 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 661/1297] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:51:06 2021] GET /compute/v2.1/os-migrations => generated 3086 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:06.676805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6945c5e5-edc1-41f8-b2b1-d012874cfe04 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:06.681144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6945c5e5-edc1-41f8-b2b1-d012874cfe04 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.722494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6945c5e5-edc1-41f8-b2b1-d012874cfe04 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.724462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6945c5e5-edc1-41f8-b2b1-d012874cfe04 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.731040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6945c5e5-edc1-41f8-b2b1-d012874cfe04 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.731719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6945c5e5-edc1-41f8-b2b1-d012874cfe04 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.850965 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6945c5e5-edc1-41f8-b2b1-d012874cfe04 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.176775 Dec 18 20:51:06.852827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 662/1298] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:06 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:06.861024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:06.862635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:06.879721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.882031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:06.883160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:06.887194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.139444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:07.148307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30eb6243-c798-4e88-a481-1412cfa2cb0b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1321 microversion: 2.1 time: 0.506917 Dec 18 20:51:07.159028 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 637/1299] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:06 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:07.163988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13b0cdaa-c320-4dd0-843f-65673241b95f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:07.164592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13b0cdaa-c320-4dd0-843f-65673241b95f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.178293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0cdaa-c320-4dd0-843f-65673241b95f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.178293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0cdaa-c320-4dd0-843f-65673241b95f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.179722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0cdaa-c320-4dd0-843f-65673241b95f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.180179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0cdaa-c320-4dd0-843f-65673241b95f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.374202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:07.389208 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3ade2ea8-3271-4528-ab82-72777630e44f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1527 microversion: 2.1 time: 0.534586 Dec 18 20:51:07.391401 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 663/1300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:06 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1527 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:07.400478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:07.401417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.410070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.411086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.411844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.412338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.512881 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13b0cdaa-c320-4dd0-843f-65673241b95f tempest-LiveMigrationTest-150705056 tempest-LiveMigrationTest-150705056-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1533 microversion: 2.1 time: 0.352655 Dec 18 20:51:07.514606 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 638/1301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:07 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1533 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:07.524531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:07.525963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.534656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.535272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.536377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.537010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.639281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:07.650736 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3217596d-8911-46f0-b477-8f2302a51792 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1270 microversion: 2.1 time: 0.134608 Dec 18 20:51:07.653228 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 639/1302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:07 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:07.659434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Action: 'update', calling method: >, body: {"server": {"name": "57c923f8-581a-4223-b0d6-858f1ef3dabb_new"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:07.660861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.671026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.671958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.673487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.675041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.721387 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] HTTP exception thrown: Instance 57c923f8-581a-4223-b0d6-858f1ef3dabb could not be found. Dec 18 20:51:07.723681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] Returning 404 to user: Instance 57c923f8-581a-4223-b0d6-858f1ef3dabb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:07.724819 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1bea0420-23e2-41d0-bc3d-76f332a6c624 tempest-ServersNegativeTestMultiTenantJSON-332308159 tempest-ServersNegativeTestMultiTenantJSON-332308159-project] 10.222.0.13 "PUT /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 404 len: 111 microversion: 2.1 time: 0.069712 Dec 18 20:51:07.730026 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 640/1303] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 20:51:07 2021] PUT /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:07.741227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:07.742056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.748891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.749625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.750974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.751666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.766319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:07.776353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:07.783891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:07.785791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:07.787187 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4013d6e-fee5-4fda-8788-730976329be8 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1475 microversion: 2.25 time: 0.394269 Dec 18 20:51:07.788029 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 664/1304] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:07 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1475 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:07.803946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c59f071c-9f49-4173-a2fe-dcf1a0539c19 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:07.805041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c59f071c-9f49-4173-a2fe-dcf1a0539c19 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.813731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59f071c-9f49-4173-a2fe-dcf1a0539c19 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.822601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59f071c-9f49-4173-a2fe-dcf1a0539c19 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.823697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59f071c-9f49-4173-a2fe-dcf1a0539c19 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.824803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59f071c-9f49-4173-a2fe-dcf1a0539c19 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.908181 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d736d1a8-fa11-4f2d-a79b-6e9ce8d1df35 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "DELETE /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 204 len: 0 microversion: 2.1 time: 0.176400 Dec 18 20:51:07.908928 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 641/1305] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:07 2021] DELETE /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:07.909811 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c59f071c-9f49-4173-a2fe-dcf1a0539c19 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.118830 Dec 18 20:51:07.913717 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 665/1306] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:07 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:07.918121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:07.921981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:07.923085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.931298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:07.936670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.937424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.938762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.939871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.959909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.964475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:07.967220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:07.969734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.017450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:08.167478 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2c44b82a-557d-40c8-9d38-d0115569906f tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "DELETE /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 204 len: 0 microversion: 2.1 time: 0.250120 Dec 18 20:51:08.167999 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 666/1307] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:07 2021] DELETE /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:08.173522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-109100e5-699a-4fdc-80e4-5b25f8d73a9b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '.version_select at 0x7f714fb2baf0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:08.174796 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:08.174796 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:08.176386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-109100e5-699a-4fdc-80e4-5b25f8d73a9b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.176839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-109100e5-699a-4fdc-80e4-5b25f8d73a9b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.191691 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-109100e5-699a-4fdc-80e4-5b25f8d73a9b tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 3620 microversion: 2.25 time: 0.022135 Dec 18 20:51:08.192496 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 667/1308] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Dec 18 20:51:08 2021] GET /compute/v2.1/os-migrations => generated 3620 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:08.197634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb1694d4-8a8a-4c1b-b844-d902c58441b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:08.198668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eb1694d4-8a8a-4c1b-b844-d902c58441b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:08.205210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb1694d4-8a8a-4c1b-b844-d902c58441b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.205665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb1694d4-8a8a-4c1b-b844-d902c58441b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.206496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb1694d4-8a8a-4c1b-b844-d902c58441b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.206938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb1694d4-8a8a-4c1b-b844-d902c58441b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.252212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb1694d4-8a8a-4c1b-b844-d902c58441b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.058077 Dec 18 20:51:08.256005 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 668/1309] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:08 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:08.258953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:08.259738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:08.274978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.275448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.276270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.276714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.296379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:08.307272 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-527d7f3b-0102-4d37-9d6b-bb8ca9e596b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1316 microversion: 2.1 time: 0.393674 Dec 18 20:51:08.310833 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 642/1310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:07 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:08.319973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:08.321887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:08.331840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.332297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.333098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.333530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.594832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:08.603627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c25e4a8-c945-4ee1-b08b-0da90ab7c574 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1388 microversion: 2.1 time: 0.348798 Dec 18 20:51:08.604272 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 669/1311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:08 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1388 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:08.610069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:08.610782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:08.617240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.617801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.618733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.619341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.639026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:08.653460 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35854102-1cae-4234-8fd7-7cc99f25411c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1321 microversion: 2.1 time: 0.341165 Dec 18 20:51:08.662711 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 643/1312] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:08 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:08.670396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:08.671394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:08.678391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.678844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.679765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.680212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:08.939828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:08.947381 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8de14931-c5f9-46eb-8ceb-3f7b261d4eb4 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1533 microversion: 2.1 time: 0.341517 Dec 18 20:51:08.948261 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 670/1313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:08 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1533 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:08.964548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a20d6e75-a21d-4d53-8728-93620f74aa87 req-af66129c-9841-45cf-b373-b2720d60bc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5aef-b6d5-402c-8431-28f42f02d8fc", "name": "network-vif-plugged", "status": "completed", "tag": "73fa6ad8-869b-4f9e-a560-517252ea691b"}, {"server_uuid": "6acebe03-ef39-4717-abd1-ec9c4b52d21e", "name": "network-vif-plugged", "status": "completed", "tag": "8c68a13f-39f5-43c7-9efd-4920983792ab"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:08.967662 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:08.967662 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:08.987968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] Lazy-loading 'services' on Instance uuid da4d97c0-d046-4bf2-842f-bb1ab2c4c935 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:51:08.991436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a20d6e75-a21d-4d53-8728-93620f74aa87 req-af66129c-9841-45cf-b373-b2720d60bc11 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:08.991890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a20d6e75-a21d-4d53-8728-93620f74aa87 req-af66129c-9841-45cf-b373-b2720d60bc11 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.013743 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f686f13-4bd0-4aa3-9355-b8d8ac227429 tempest-LiveAutoBlockMigrationV225Test-1140448609 tempest-LiveAutoBlockMigrationV225Test-1140448609-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1967 microversion: 2.25 time: 0.349461 Dec 18 20:51:09.014392 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 644/1314] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:08 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1967 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:09.017276 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a20d6e75-a21d-4d53-8728-93620f74aa87 req-af66129c-9841-45cf-b373-b2720d60bc11 service nova] Creating event network-vif-plugged:73fa6ad8-869b-4f9e-a560-517252ea691b for instance 335d5aef-b6d5-402c-8431-28f42f02d8fc on nch1-master-1 Dec 18 20:51:09.017968 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a20d6e75-a21d-4d53-8728-93620f74aa87 req-af66129c-9841-45cf-b373-b2720d60bc11 service nova] Creating event network-vif-plugged:8c68a13f-39f5-43c7-9efd-4920983792ab for instance 6acebe03-ef39-4717-abd1-ec9c4b52d21e on nch2-master-1 Dec 18 20:51:09.018909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:09.019499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:09.032018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a20d6e75-a21d-4d53-8728-93620f74aa87 req-af66129c-9841-45cf-b373-b2720d60bc11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081714 Dec 18 20:51:09.033202 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 671/1315] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:08 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:09.041245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.041699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.041960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db5fe6c3-0086-426b-982c-5f0c686f20cf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:09.042522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.043148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.043657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db5fe6c3-0086-426b-982c-5f0c686f20cf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:09.078980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db5fe6c3-0086-426b-982c-5f0c686f20cf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.079694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db5fe6c3-0086-426b-982c-5f0c686f20cf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.080892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db5fe6c3-0086-426b-982c-5f0c686f20cf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.082891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db5fe6c3-0086-426b-982c-5f0c686f20cf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.151677 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db5fe6c3-0086-426b-982c-5f0c686f20cf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.115705 Dec 18 20:51:09.152680 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 672/1316] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:09 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:09.165428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:09.166552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:09.175387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.176065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.177513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.178111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.219595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:09.352369 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26991c53-5fa1-4b07-a862-01831e168e6f tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 204 len: 0 microversion: 2.25 time: 0.195846 Dec 18 20:51:09.353483 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 673/1317] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:51:09 2021] DELETE /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:51:09.361090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e320ddc2-12c4-418e-97b7-c04adc951075 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:09.362804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e320ddc2-12c4-418e-97b7-c04adc951075 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:09.364752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:09.372954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e320ddc2-12c4-418e-97b7-c04adc951075 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.373665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e320ddc2-12c4-418e-97b7-c04adc951075 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.374109 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44c98a9a-a3b7-4e80-bcf1-830754d03744 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1312 microversion: 2.1 time: 0.358717 Dec 18 20:51:09.375381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e320ddc2-12c4-418e-97b7-c04adc951075 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.375866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e320ddc2-12c4-418e-97b7-c04adc951075 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.376612 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 645/1318] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:09 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1312 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:09.391972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:09.395098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:09.412514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.412949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.413756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.414782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.622582 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e320ddc2-12c4-418e-97b7-c04adc951075 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.267201 Dec 18 20:51:09.623729 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 674/1319] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:09 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:09.632040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:09.632767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:09.650418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.650887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:09.651715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:09.652253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.045184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:10.053609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:10.066763 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f0f95b0-5fcf-408b-a373-1632f3cc3bf5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1316 microversion: 2.1 time: 0.686357 Dec 18 20:51:10.067257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:10.067853 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 646/1320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:09 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:10.072470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:10.078063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:10.088113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:10.089355 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf5e37e4-cb02-49e5-82fa-ffdb3ae27154 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1481 microversion: 2.25 time: 0.464384 Dec 18 20:51:10.089933 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 675/1321] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:09 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1481 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:10.100012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:10.104575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.105097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.105666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:10.105940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.107164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.118537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.120806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.121666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.123024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.238614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:10.249012 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-db2948be-509d-4cc2-8b82-383891beb377 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 200 len: 1184 microversion: 2.1 time: 0.179952 Dec 18 20:51:10.249647 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 647/1322] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:10 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 1184 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:10.262606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7a829557-9194-4484-a74c-dbf6b10ab26f req-b588ad3c-5476-42f9-b132-5089b9d63e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fa4ba4-d935-4772-b54b-9d78b6d2ea3d", "name": "network-vif-deleted", "tag": "70c1a24f-77c8-4810-9440-0a7498d6a257"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:10.270201 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:10.270201 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:10.286419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7a829557-9194-4484-a74c-dbf6b10ab26f req-b588ad3c-5476-42f9-b132-5089b9d63e19 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.288580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7a829557-9194-4484-a74c-dbf6b10ab26f req-b588ad3c-5476-42f9-b132-5089b9d63e19 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.309052 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7a829557-9194-4484-a74c-dbf6b10ab26f req-b588ad3c-5476-42f9-b132-5089b9d63e19 service nova] Creating event network-vif-deleted:70c1a24f-77c8-4810-9440-0a7498d6a257 for instance 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d on nch1-master-1 Dec 18 20:51:10.321984 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7a829557-9194-4484-a74c-dbf6b10ab26f req-b588ad3c-5476-42f9-b132-5089b9d63e19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065416 Dec 18 20:51:10.322643 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 648/1323] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:10.332490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:10.333203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:10.358503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.359782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.362994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.363585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.586188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:10.601094 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-84720fd5-90b7-4088-8f16-707d2fef7adb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1321 microversion: 2.1 time: 0.508553 Dec 18 20:51:10.607616 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 676/1324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:10 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:10.612703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e8b0372-a864-49e1-85f1-13ba7b7055b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:10.613892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e8b0372-a864-49e1-85f1-13ba7b7055b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:10.621394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e8b0372-a864-49e1-85f1-13ba7b7055b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.622350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e8b0372-a864-49e1-85f1-13ba7b7055b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.623396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e8b0372-a864-49e1-85f1-13ba7b7055b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.624003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e8b0372-a864-49e1-85f1-13ba7b7055b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.680994 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e8b0372-a864-49e1-85f1-13ba7b7055b4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.071071 Dec 18 20:51:10.682168 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 677/1325] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:10 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:10.691006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:10.692308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:10.709093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.712731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.714816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.716498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.745617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2808986334b647068ea9777af124fe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6f0b624038403284d782c3c726279c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:10.754780 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b851f326-afb4-463e-9654-16f62b719475 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 200 len: 1533 microversion: 2.1 time: 0.426603 Dec 18 20:51:10.755637 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 649/1326] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:10 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 1533 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:10.760214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd49aafc-4633-4f6d-ac9c-4360b13d49eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:10.761391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bd49aafc-4633-4f6d-ac9c-4360b13d49eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:10.769004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd49aafc-4633-4f6d-ac9c-4360b13d49eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.769689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd49aafc-4633-4f6d-ac9c-4360b13d49eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.770870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd49aafc-4633-4f6d-ac9c-4360b13d49eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:10.771810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd49aafc-4633-4f6d-ac9c-4360b13d49eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:10.844239 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bd49aafc-4633-4f6d-ac9c-4360b13d49eb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.087057 Dec 18 20:51:10.849328 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 650/1327] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:10 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:11.085041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:11.085735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:11.094395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.094844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.095635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.096105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.129897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:11.137143 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-14559a01-df1e-4cf8-b1ca-a42756f275e6 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.451984 Dec 18 20:51:11.146768 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 678/1328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:10 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:11.151642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:11.152251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:11.159363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.159814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.160594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.161029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.735914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:11.746609 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-95c42e6e-5d22-40b6-9aee-006601a2d403 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1316 microversion: 2.1 time: 0.665489 Dec 18 20:51:11.748389 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 651/1329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:11 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1316 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:11.752989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:11.753588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:11.760696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.761164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.761951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.762424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.775412 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] HTTP exception thrown: Instance 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d could not be found. Dec 18 20:51:11.775998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Returning 404 to user: Instance 68fa4ba4-d935-4772-b54b-9d78b6d2ea3d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:11.776817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-138400d8-ab78-4026-b3ec-ca01a78521f5 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d" status: 404 len: 111 microversion: 2.1 time: 0.027514 Dec 18 20:51:11.777363 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 652/1330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:11 2021] GET /compute/v2.1/servers/68fa4ba4-d935-4772-b54b-9d78b6d2ea3d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:11.782972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:11.783571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:11.789567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.790016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.790834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.791808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.930603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:11.948076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:11.950211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:11.952078 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2697156d-97dc-4172-8874-15da5d134d2d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 200 len: 1481 microversion: 2.25 time: 0.804052 Dec 18 20:51:11.962585 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 679/1331] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:11 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 1481 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:11.967459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0d91f505-bb07-4a0f-8ffc-d27e6ab1f87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:11.968684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0d91f505-bb07-4a0f-8ffc-d27e6ab1f87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:11.977857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d91f505-bb07-4a0f-8ffc-d27e6ab1f87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.978629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d91f505-bb07-4a0f-8ffc-d27e6ab1f87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:11.979617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d91f505-bb07-4a0f-8ffc-d27e6ab1f87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:11.980251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d91f505-bb07-4a0f-8ffc-d27e6ab1f87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.040987 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0d91f505-bb07-4a0f-8ffc-d27e6ab1f87d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.079059 Dec 18 20:51:12.042330 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 680/1332] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:11 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:12.050187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:12.051083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] [instance: 57c923f8-581a-4223-b0d6-858f1ef3dabb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:12.060661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.061354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.062623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.063633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.083802 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] HTTP exception thrown: Instance 57c923f8-581a-4223-b0d6-858f1ef3dabb could not be found. Dec 18 20:51:12.084441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] Returning 404 to user: Instance 57c923f8-581a-4223-b0d6-858f1ef3dabb could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:12.085544 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-28545f80-9509-4ae7-97b8-08f8b6368ac8 tempest-ServersNegativeTestMultiTenantJSON-1057200871 tempest-ServersNegativeTestMultiTenantJSON-1057200871-project] 10.222.0.13 "GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb" status: 404 len: 111 microversion: 2.1 time: 0.041775 Dec 18 20:51:12.086590 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 681/1333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:12 2021] GET /compute/v2.1/servers/57c923f8-581a-4223-b0d6-858f1ef3dabb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:12.105720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-88cfc7e5-c3ce-4b8b-be0b-d84d245e7ec1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:12.107845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-88cfc7e5-c3ce-4b8b-be0b-d84d245e7ec1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:12.115215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88cfc7e5-c3ce-4b8b-be0b-d84d245e7ec1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.115925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88cfc7e5-c3ce-4b8b-be0b-d84d245e7ec1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.116636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:12.117268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88cfc7e5-c3ce-4b8b-be0b-d84d245e7ec1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.117894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88cfc7e5-c3ce-4b8b-be0b-d84d245e7ec1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.126942 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7db4664-20dc-42da-ae35-45fe65177a8a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1513 microversion: 2.1 time: 0.348113 Dec 18 20:51:12.139405 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 653/1334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:11 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1513 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:12.152381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cd0fb25d-c76a-4e1d-9a42-a2f22e314459 req-79ad0b70-fc59-4c33-9c88-2d3a24d688a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09b99ef-8148-405f-a61a-3cbebb685678", "tag": "e60078e1-0404-483c-be40-491d5a7ac210"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:12.155654 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:12.155654 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:12.174711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cd0fb25d-c76a-4e1d-9a42-a2f22e314459 req-79ad0b70-fc59-4c33-9c88-2d3a24d688a5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.180731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cd0fb25d-c76a-4e1d-9a42-a2f22e314459 req-79ad0b70-fc59-4c33-9c88-2d3a24d688a5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.187048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-88cfc7e5-c3ce-4b8b-be0b-d84d245e7ec1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.098455 Dec 18 20:51:12.189919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 682/1335] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:12 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:12.205314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:12.209889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:12.211716 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cd0fb25d-c76a-4e1d-9a42-a2f22e314459 req-79ad0b70-fc59-4c33-9c88-2d3a24d688a5 service nova] Creating event network-changed:e60078e1-0404-483c-be40-491d5a7ac210 for instance e09b99ef-8148-405f-a61a-3cbebb685678 on nch2-master-1 Dec 18 20:51:12.220520 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cd0fb25d-c76a-4e1d-9a42-a2f22e314459 req-79ad0b70-fc59-4c33-9c88-2d3a24d688a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079271 Dec 18 20:51:12.221792 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 654/1336] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:12.228954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.230865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:12.232451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.232982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:12.237051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.238194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.243510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.244244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.245316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.245918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.692056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:12.702851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8efca882-d2fa-4e7c-af47-95f556e0eba3 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1513 microversion: 2.1 time: 0.511228 Dec 18 20:51:12.703839 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 683/1337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:12 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1513 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:12.713656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-cd93afa0-ea60-4e98-9ebc-ffc7ee70d279 req-077f9518-9796-4d09-93f2-54f2f0bd49a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c923f8-581a-4223-b0d6-858f1ef3dabb", "name": "network-vif-deleted", "tag": "f27987e3-7621-4ae3-852c-d3f86e49252c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:12.717735 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:12.717735 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:12.728006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:12.728187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cd93afa0-ea60-4e98-9ebc-ffc7ee70d279 req-077f9518-9796-4d09-93f2-54f2f0bd49a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.728792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cd93afa0-ea60-4e98-9ebc-ffc7ee70d279 req-077f9518-9796-4d09-93f2-54f2f0bd49a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.739851 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c7a80d52-c16e-4ea9-bc2e-92d9dcdd288d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.516203 Dec 18 20:51:12.740610 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 655/1338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:12 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:12.740747 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-cd93afa0-ea60-4e98-9ebc-ffc7ee70d279 req-077f9518-9796-4d09-93f2-54f2f0bd49a0 service nova] Creating event network-vif-deleted:f27987e3-7621-4ae3-852c-d3f86e49252c for instance 57c923f8-581a-4223-b0d6-858f1ef3dabb on nch2-master-1 Dec 18 20:51:12.745471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:12.746749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:12.747842 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-cd93afa0-ea60-4e98-9ebc-ffc7ee70d279 req-077f9518-9796-4d09-93f2-54f2f0bd49a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041808 Dec 18 20:51:12.748484 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 684/1339] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:12.754054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.754751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.755716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.756885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.765386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:12.766296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:12.779365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.779827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:12.780727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:12.781437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.284354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:13.296275 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ffa4db78-f841-4d56-8858-957757199014 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 200 len: 1512 microversion: 2.1 time: 0.554791 Dec 18 20:51:13.307913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 656/1340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:12 2021] GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:13.307913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:13.307913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:13.320855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:13.327846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.329144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.330511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.330851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b7177d7-7525-46b2-9824-bacaf18b5e46 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1316 microversion: 2.1 time: 0.570088 Dec 18 20:51:13.331397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.338506 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 685/1341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:12 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:13.338506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:13.338995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: da4d97c0-d046-4bf2-842f-bb1ab2c4c935] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:13.350300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.351215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.352902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.353619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.371674 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] HTTP exception thrown: Instance da4d97c0-d046-4bf2-842f-bb1ab2c4c935 could not be found. Dec 18 20:51:13.373347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Returning 404 to user: Instance da4d97c0-d046-4bf2-842f-bb1ab2c4c935 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:13.374360 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1f20df0f-c5a9-486d-8eb5-06cdfbf55b1b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935" status: 404 len: 111 microversion: 2.25 time: 0.039483 Dec 18 20:51:13.375414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 686/1342] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:13 2021] GET /compute/v2.1/servers/da4d97c0-d046-4bf2-842f-bb1ab2c4c935 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:51:13.381033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0530ba26-2df5-414d-9797-e9e74549bb73 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:13.382189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0530ba26-2df5-414d-9797-e9e74549bb73 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:13.392388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0530ba26-2df5-414d-9797-e9e74549bb73 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.393079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0530ba26-2df5-414d-9797-e9e74549bb73 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.394468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0530ba26-2df5-414d-9797-e9e74549bb73 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.395058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0530ba26-2df5-414d-9797-e9e74549bb73 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.407419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:13.472070 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0530ba26-2df5-414d-9797-e9e74549bb73 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.094027 Dec 18 20:51:13.473439 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 687/1343] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:13 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:13.485310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a603490c-66ef-41d9-a5eb-8abb973891c0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:13.486867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a603490c-66ef-41d9-a5eb-8abb973891c0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:13.498061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a603490c-66ef-41d9-a5eb-8abb973891c0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.498892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a603490c-66ef-41d9-a5eb-8abb973891c0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.499960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a603490c-66ef-41d9-a5eb-8abb973891c0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.500716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a603490c-66ef-41d9-a5eb-8abb973891c0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.593221 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70a3f251-e24b-49d0-b9cd-8b4a652f9b75 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "DELETE /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 204 len: 0 microversion: 2.1 time: 0.291062 Dec 18 20:51:13.595143 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 657/1344] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:13 2021] DELETE /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:13.603480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:13.608116 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:13.608116 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:13.609322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:13.610664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:13.618154 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a603490c-66ef-41d9-a5eb-8abb973891c0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.142849 Dec 18 20:51:13.619624 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 688/1345] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:13 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:13.627520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-628b7ce3-4dcc-47e9-95d1-0e341bceea86 req-a7c1a1bd-3565-4927-be14-5515a3d49b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a40f995-3ddb-44b8-a4d1-51aac21ae695", "name": "network-vif-plugged", "status": "completed", "tag": "0b9441be-b2da-4416-9591-960ff551886a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:13.632244 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:13.632244 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:13.643799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.644250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.646827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-628b7ce3-4dcc-47e9-95d1-0e341bceea86 req-a7c1a1bd-3565-4927-be14-5515a3d49b76 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.647798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.648492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-628b7ce3-4dcc-47e9-95d1-0e341bceea86 req-a7c1a1bd-3565-4927-be14-5515a3d49b76 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.649568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.667505 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-628b7ce3-4dcc-47e9-95d1-0e341bceea86 req-a7c1a1bd-3565-4927-be14-5515a3d49b76 service nova] Creating event network-vif-plugged:0b9441be-b2da-4416-9591-960ff551886a for instance 5a40f995-3ddb-44b8-a4d1-51aac21ae695 on nch1-master-1 Dec 18 20:51:13.673713 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-628b7ce3-4dcc-47e9-95d1-0e341bceea86 req-a7c1a1bd-3565-4927-be14-5515a3d49b76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051764 Dec 18 20:51:13.679012 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 689/1346] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:13.686359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:13.687309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:13.695860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.696542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.697500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.698107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:13.785584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:13.915935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:13.936375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:13.937547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.236511 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2807ee67-8c27-4926-a853-7c261f980470 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.637723 Dec 18 20:51:14.253169 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 658/1347] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Dec 18 20:51:13 2021] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:14.258885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:14.259966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:14.268060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:14.272388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.272932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.276338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.276338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.279594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22b42c9c-3fe3-45e1-8197-944efb64ee4c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1501 microversion: 2.1 time: 0.598692 Dec 18 20:51:14.280219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 690/1348] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:13 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1501 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:14.286560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:14.302921 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:14.302921 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:14.306266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:14.311767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2046507492', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:14.317862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.324647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.326132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.326620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.494545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:14.635900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:14.647817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.648648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.709455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:14.726517 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18e62acb-d49d-4e9a-a067-35f57d493fbf tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.471527 Dec 18 20:51:14.727471 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 659/1349] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:14 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:14.733776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:14.734435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:14.749260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.750947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.753588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.755159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:14.947049 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0b58539-6084-4a88-85a2-59956f253d9b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2046507492" status: 200 len: 1516 microversion: 2.1 time: 0.663696 Dec 18 20:51:14.959086 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 691/1350] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:51:14 2021] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2046507492 => generated 1516 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:14.959086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c5cc0771-b79e-4e2c-a1d3-28ebc38a3c89 req-f28ee9c3-7d32-4681-821b-17eabfa961ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4d97c0-d046-4bf2-842f-bb1ab2c4c935", "name": "network-vif-deleted", "tag": "4b0e7658-35c7-49ef-98fc-5ca3e983079d"}, {"name": "network-changed", "server_uuid": "e09b99ef-8148-405f-a61a-3cbebb685678", "tag": "f6435f74-9322-42c0-8848-1a63b5470f96"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:14.959899 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:14.959899 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:14.989773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c5cc0771-b79e-4e2c-a1d3-28ebc38a3c89 req-f28ee9c3-7d32-4681-821b-17eabfa961ce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:14.990761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c5cc0771-b79e-4e2c-a1d3-28ebc38a3c89 req-f28ee9c3-7d32-4681-821b-17eabfa961ce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.084051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c5cc0771-b79e-4e2c-a1d3-28ebc38a3c89 req-f28ee9c3-7d32-4681-821b-17eabfa961ce service nova] Creating event network-vif-deleted:4b0e7658-35c7-49ef-98fc-5ca3e983079d for instance da4d97c0-d046-4bf2-842f-bb1ab2c4c935 on nch2-master-1 Dec 18 20:51:15.084887 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c5cc0771-b79e-4e2c-a1d3-28ebc38a3c89 req-f28ee9c3-7d32-4681-821b-17eabfa961ce service nova] Creating event network-changed:f6435f74-9322-42c0-8848-1a63b5470f96 for instance e09b99ef-8148-405f-a61a-3cbebb685678 on nch2-master-1 Dec 18 20:51:15.106894 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c5cc0771-b79e-4e2c-a1d3-28ebc38a3c89 req-f28ee9c3-7d32-4681-821b-17eabfa961ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.156088 Dec 18 20:51:15.109743 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 692/1351] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:14 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:15.121466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58c9a849-7d46-4c19-b772-184fb09e2e78 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:15.125611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:15.140261 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca4600a6-7f96-4474-b0b3-75460195a092 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1316 microversion: 2.1 time: 0.410694 Dec 18 20:51:15.141253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58c9a849-7d46-4c19-b772-184fb09e2e78 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:15.142143 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 660/1352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:14 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:15.153831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58c9a849-7d46-4c19-b772-184fb09e2e78 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.156516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58c9a849-7d46-4c19-b772-184fb09e2e78 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.157198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-293b70e5-98aa-43bb-a808-52b28d517d93 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:15.157408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58c9a849-7d46-4c19-b772-184fb09e2e78 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.159405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58c9a849-7d46-4c19-b772-184fb09e2e78 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.159861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-293b70e5-98aa-43bb-a808-52b28d517d93 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:15.170839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-293b70e5-98aa-43bb-a808-52b28d517d93 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.173246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-293b70e5-98aa-43bb-a808-52b28d517d93 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.175083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-293b70e5-98aa-43bb-a808-52b28d517d93 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.177603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-293b70e5-98aa-43bb-a808-52b28d517d93 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.232711 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58c9a849-7d46-4c19-b772-184fb09e2e78 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.120530 Dec 18 20:51:15.233672 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 693/1353] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:15 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:15.243283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:15.251180 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:15.251180 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:15.252304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:15.253264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:15.253664 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-293b70e5-98aa-43bb-a808-52b28d517d93 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.108002 Dec 18 20:51:15.255115 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 661/1354] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:15 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:15.265117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c382bae3-bcd0-46e9-8d17-8ec4a8a708ca req-153bea65-50cc-4dbb-9007-8eeeb66dae05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3c9fff-7539-4d85-9102-827366dbb6cd", "name": "network-vif-deleted", "tag": "12a3229b-b407-4f8f-9557-f1a6978d54bb"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:15.267493 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:15.267493 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:15.273769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.274697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.275726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.276331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.278737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c382bae3-bcd0-46e9-8d17-8ec4a8a708ca req-153bea65-50cc-4dbb-9007-8eeeb66dae05 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.279333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c382bae3-bcd0-46e9-8d17-8ec4a8a708ca req-153bea65-50cc-4dbb-9007-8eeeb66dae05 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.317022 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c382bae3-bcd0-46e9-8d17-8ec4a8a708ca req-153bea65-50cc-4dbb-9007-8eeeb66dae05 service nova] Creating event network-vif-deleted:12a3229b-b407-4f8f-9557-f1a6978d54bb for instance db3c9fff-7539-4d85-9102-827366dbb6cd on nch2-master-1 Dec 18 20:51:15.333491 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c382bae3-bcd0-46e9-8d17-8ec4a8a708ca req-153bea65-50cc-4dbb-9007-8eeeb66dae05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075891 Dec 18 20:51:15.335614 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 662/1355] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:15.345887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:15.350475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:15.359816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.362424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.363499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.364184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.390524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:15.402820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.403386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.408877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lazy-loading 'fault' on Instance uuid db3c9fff-7539-4d85-9102-827366dbb6cd {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:51:15.472364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:15.473931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:15.480245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.480702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.487280 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-501dd8e6-a766-46a0-9b04-8215cdb099db tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 200 len: 1301 microversion: 2.1 time: 0.149860 Dec 18 20:51:15.487875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 663/1356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:15 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 1301 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:15.700356 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb8459f0-1243-4625-bac2-3498b3381fb2 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4521 microversion: 2.1 time: 0.465671 Dec 18 20:51:15.715471 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 694/1357] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Dec 18 20:51:15 2021] GET /compute/v2.1/servers/detail?status=active => generated 4521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:15.721769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:15.729575 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:15.729575 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:15.731045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:15.746279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:15.747064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:15.749248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.servers [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Removing options 'limit' from query {{(pid=140732) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 18 20:51:15.750159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:15.758433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.758898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.759720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.760167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.765273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.765725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.766576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.767016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:15.908245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:15.914154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:15.914638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.120246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.128057 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8978cee3-f196-4591-ae5f-8899c1063e5c tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.385456 Dec 18 20:51:16.128802 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 695/1358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:15 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:16.142732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.143213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.150910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.151493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.152776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.153983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.180717 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9030dc72-7f43-4540-ba77-1b5f9d2016b6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.462765 Dec 18 20:51:16.181458 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 664/1359] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:51:15 2021] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:16.183741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:16.190057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.190893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.203588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.204305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.205257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.206523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.279434 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-acac5882-b58f-45b7-9f2f-c30bbddb50c3 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "DELETE /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 204 len: 0 microversion: 2.25 time: 0.138661 Dec 18 20:51:16.280627 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 696/1360] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:51:16 2021] DELETE /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:51:16.287563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.294450 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:16.294450 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:16.295927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.297058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:16.303552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.304078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.305067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.305581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.363842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.371369 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3343836f-b9f0-46c0-9949-0f2b5f10193c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1466 microversion: 2.1 time: 0.188031 Dec 18 20:51:16.372002 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 665/1361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1466 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:16.376409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1de1467c-8c6c-435c-938d-d6833e1160d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:16.377318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1de1467c-8c6c-435c-938d-d6833e1160d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.384207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1de1467c-8c6c-435c-938d-d6833e1160d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.384661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1de1467c-8c6c-435c-938d-d6833e1160d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.385457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1de1467c-8c6c-435c-938d-d6833e1160d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.385898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1de1467c-8c6c-435c-938d-d6833e1160d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.413360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:16.446994 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1de1467c-8c6c-435c-938d-d6833e1160d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 24570 microversion: 2.1 time: 0.073619 Dec 18 20:51:16.447710 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 666/1362] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:16 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:16.455038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f473d55a-a60a-4817-9c7a-fd951647f24f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:16.456319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f473d55a-a60a-4817-9c7a-fd951647f24f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.463429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f473d55a-a60a-4817-9c7a-fd951647f24f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.463884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f473d55a-a60a-4817-9c7a-fd951647f24f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.464864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f473d55a-a60a-4817-9c7a-fd951647f24f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.465433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f473d55a-a60a-4817-9c7a-fd951647f24f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.476624 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ab2eccd-1e02-478f-b582-79ab726a1efb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.193907 Dec 18 20:51:16.477225 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 697/1363] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:16.481448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.483242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.489321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.489829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.490624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.491062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.510185 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f473d55a-a60a-4817-9c7a-fd951647f24f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.060645 Dec 18 20:51:16.510998 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 667/1364] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:16 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:16.516984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4e1dcf07-1e3a-47b2-b954-743fb5ccc74c tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.517767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4e1dcf07-1e3a-47b2-b954-743fb5ccc74c tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.524747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1dcf07-1e3a-47b2-b954-743fb5ccc74c tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.525207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1dcf07-1e3a-47b2-b954-743fb5ccc74c tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.526000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1dcf07-1e3a-47b2-b954-743fb5ccc74c tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.526474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1dcf07-1e3a-47b2-b954-743fb5ccc74c tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.675524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.683461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.685860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.687216 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e00724a8-8539-4bff-bee7-cb25c6287662 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1563 microversion: 2.25 time: 0.209104 Dec 18 20:51:16.697940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 698/1365] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:16.703436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.707060 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:16.707060 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:16.708269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.708636 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4e1dcf07-1e3a-47b2-b954-743fb5ccc74c tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1617 microversion: 2.1 time: 0.195852 Dec 18 20:51:16.709292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.compute.servers [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Removing options 'limit' from query {{(pid=140731) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 18 20:51:16.715227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:16.720441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.720895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.721719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.722158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.722734 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 668/1366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1617 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:16.730217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.731354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: db3c9fff-7539-4d85-9102-827366dbb6cd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.744999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.745597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.746543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.747716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.757112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:16.764988 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] HTTP exception thrown: Instance db3c9fff-7539-4d85-9102-827366dbb6cd could not be found. Dec 18 20:51:16.765716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Returning 404 to user: Instance db3c9fff-7539-4d85-9102-827366dbb6cd could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:16.766843 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c36bf329-4657-49b6-94c5-04f02dcc0b7c tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd" status: 404 len: 111 microversion: 2.1 time: 0.040522 Dec 18 20:51:16.767942 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 669/1367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers/db3c9fff-7539-4d85-9102-827366dbb6cd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:16.775251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.776078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:16.782234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.783027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.784049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.784711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.814587 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b28a664a-7540-44e9-be39-0d605a5c17df tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.115428 Dec 18 20:51:16.815605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 699/1368] 10.222.0.13 () {58 vars in 1149 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:16.822874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:16.826314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.829448 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:16.829448 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:16.830607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.831276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:16.836692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.837155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.837995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.838463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.867535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:16.898610 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dc82cb5b-6eef-4a58-81bf-d291d9c77d67 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.075890 Dec 18 20:51:16.899198 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 700/1369] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:16.904012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-917181151", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b07c26ad-bdd3-495d-bf73-2844e2824e78"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:16.925580 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c7a74bea-a0aa-48ed-b7e9-15bbf7502294 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 204 len: 0 microversion: 2.1 time: 0.152778 Dec 18 20:51:16.927140 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 670/1370] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:16 2021] DELETE /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:51:16.938573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:16.942052 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:16.942052 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:16.945819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:16.945819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:16.962009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:51:16.967330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.968946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:16.970212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:16.971071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.063703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:17.128571 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0538dc22-0137-4c8d-ac0b-0ea42c3860c9 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.200382 Dec 18 20:51:17.129196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 671/1371] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:51:16 2021] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:17.133549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:17.134283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:17.140741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.141207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.142016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.142493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.233015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:51:17.234779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:51:17.235816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:51:17.236617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:51:17.237104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:51:17.247957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.248599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.249526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.250217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.280261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:51:17.287601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Getting quotas for user 231f078b4f4e4fdc9dcf0c6248f17551 and project 9ce640720b084b84a86f590d354dad25. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:51:17.305121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:51:17.309567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:51:17.318963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:17.329054 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-241e9a3a-5179-434b-a3c1-d4c0cf982885 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1485 microversion: 2.1 time: 0.197731 Dec 18 20:51:17.333389 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 672/1372] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:17 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1485 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:17.340056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:17.348153 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:17.348153 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:17.349386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:17.349889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.servers [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Removing options 'limit' from query {{(pid=140732) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 18 20:51:17.350816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:17.357605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.358273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.359301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.359751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.379207 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f0c3575-b156-4785-b619-bca4049ebe7a tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478904 Dec 18 20:51:17.379868 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 701/1373] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:51:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:51:17.384186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:17.384791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:17.394915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-afc4529e-d47d-4244-a00e-c8a26565b212 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.059303 Dec 18 20:51:17.396729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 673/1374] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Dec 18 20:51:17 2021] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:17.408393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.416360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.418512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.419573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.420466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82e546f9-fb07-47a3-b688-972edcd16a0c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:17.421101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82e546f9-fb07-47a3-b688-972edcd16a0c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:17.497232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82e546f9-fb07-47a3-b688-972edcd16a0c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:17.505112 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82e546f9-fb07-47a3-b688-972edcd16a0c tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1216 microversion: 2.1 time: 0.106493 Dec 18 20:51:17.505781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 674/1375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:17 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:17.511242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:17.516503 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:17.516503 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:17.519080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:17.519994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2046507492', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:17.525758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.526827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.527811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.529289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.660833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:17.777667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:17.788935 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d66d3811-f550-4196-8b43-22f4f2143b6b tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.407907 Dec 18 20:51:17.799431 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 702/1376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:17 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:17.805054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd26c53a-b37b-4fed-b866-dfcae2910e02 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:17.806196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd26c53a-b37b-4fed-b866-dfcae2910e02 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:17.813921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd26c53a-b37b-4fed-b866-dfcae2910e02 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.814717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd26c53a-b37b-4fed-b866-dfcae2910e02 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.816201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd26c53a-b37b-4fed-b866-dfcae2910e02 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.817049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd26c53a-b37b-4fed-b866-dfcae2910e02 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.830635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0414ffb8-5d5b-4f5a-bfc6-5724880c2cd5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2046507492" status: 200 len: 346 microversion: 2.1 time: 0.323383 Dec 18 20:51:17.831665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 675/1377] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 20:51:17 2021] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2046507492 => generated 346 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:17.845881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29c54cb1-e87d-4e12-a1b4-eeb4f31a00f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:17.847013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-29c54cb1-e87d-4e12-a1b4-eeb4f31a00f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:17.853656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c54cb1-e87d-4e12-a1b4-eeb4f31a00f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.854126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c54cb1-e87d-4e12-a1b4-eeb4f31a00f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.855132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c54cb1-e87d-4e12-a1b4-eeb4f31a00f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.855579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c54cb1-e87d-4e12-a1b4-eeb4f31a00f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.907505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29c54cb1-e87d-4e12-a1b4-eeb4f31a00f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.074256 Dec 18 20:51:17.908848 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 676/1378] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:17 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:17.914539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:17.915461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:17.922409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.923080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.924165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.924846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:17.931890 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd26c53a-b37b-4fed-b866-dfcae2910e02 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.131065 Dec 18 20:51:17.932561 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 703/1379] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:17 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:17.941169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c0257741-d7b3-44e3-b526-a31f1ee36314 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:17.964666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0257741-d7b3-44e3-b526-a31f1ee36314 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:17.967070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0257741-d7b3-44e3-b526-a31f1ee36314 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.041699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:18.052677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:18.057327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:18.061189 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b013142-3e9f-4793-9253-c51b78eb0f3d tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 200 len: 1347 microversion: 2.25 time: 0.150723 Dec 18 20:51:18.062209 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 677/1380] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:17 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 1347 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:18.068550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-abf54830-5d33-4f9c-9138-2cd7c507607c req-2ca43445-128d-4a4e-b580-74702fc5551e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919e413a-66ad-40fb-aad2-6d3392c35439", "name": "network-vif-deleted", "tag": "c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:18.070110 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:18.070110 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:18.081282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-abf54830-5d33-4f9c-9138-2cd7c507607c req-2ca43445-128d-4a4e-b580-74702fc5551e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.083561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-abf54830-5d33-4f9c-9138-2cd7c507607c req-2ca43445-128d-4a4e-b580-74702fc5551e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.091535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c0257741-d7b3-44e3-b526-a31f1ee36314 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Going to try to stop instance {{(pid=140731) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 20:51:18.106124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-abf54830-5d33-4f9c-9138-2cd7c507607c req-2ca43445-128d-4a4e-b580-74702fc5551e service nova] Creating event network-vif-deleted:c7ac2ad7-4aa4-4308-8ff9-3c9dc07d720a for instance 919e413a-66ad-40fb-aad2-6d3392c35439 on nch1-master-1 Dec 18 20:51:18.111508 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-abf54830-5d33-4f9c-9138-2cd7c507607c req-2ca43445-128d-4a4e-b580-74702fc5551e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047619 Dec 18 20:51:18.115825 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 678/1381] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:18.172010 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c0257741-d7b3-44e3-b526-a31f1ee36314 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "POST /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc/action" status: 202 len: 0 microversion: 2.1 time: 0.237865 Dec 18 20:51:18.174342 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 704/1382] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:17 2021] POST /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:51:18.183071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:18.184041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:18.192116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.192601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.193608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.194141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.350181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:18.351010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:18.359204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.363119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.364195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.364655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.495177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:18.503741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:18.507840 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-419abaa1-d1ec-49ea-bb4e-87497852b877 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 200 len: 1443 microversion: 2.1 time: 0.164909 Dec 18 20:51:18.511410 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 705/1383] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:18 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:18.517608 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ea02d20f-e6db-4b84-8d78-799fb3c95a06 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.339851 Dec 18 20:51:18.518194 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 679/1384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:18 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:18.536928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:18.544086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:18.548511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c9f1aecb-ccd7-44c9-9167-e23c495279a9 req-aa93790d-34c3-41d7-a473-401875ab09b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5985b52a-141c-483c-ab38-8b1e38a0278f", "name": "network-vif-deleted", "tag": "9426e501-39e7-4a02-84c3-cc79d30a84ff"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:18.550090 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:18.550090 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:18.557320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c9f1aecb-ccd7-44c9-9167-e23c495279a9 req-aa93790d-34c3-41d7-a473-401875ab09b4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.558032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c9f1aecb-ccd7-44c9-9167-e23c495279a9 req-aa93790d-34c3-41d7-a473-401875ab09b4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.570687 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c9f1aecb-ccd7-44c9-9167-e23c495279a9 req-aa93790d-34c3-41d7-a473-401875ab09b4 service nova] Creating event network-vif-deleted:9426e501-39e7-4a02-84c3-cc79d30a84ff for instance 5985b52a-141c-483c-ab38-8b1e38a0278f on nch2-master-1 Dec 18 20:51:18.571388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.572078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.574188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.576450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.577453 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c9f1aecb-ccd7-44c9-9167-e23c495279a9 req-aa93790d-34c3-41d7-a473-401875ab09b4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032496 Dec 18 20:51:18.578356 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 680/1385] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:51:18.674132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:18.682680 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67983516-2c7b-47b9-bb02-b11723e14b96 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1212 microversion: 2.1 time: 0.164129 Dec 18 20:51:18.685049 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 706/1386] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:18 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1212 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:18.807878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:18.808955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:18.815880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.816362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.817347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.817833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.919470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b69b6ef5-9d55-4cdd-b31e-72910d764a9d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:18.920471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b69b6ef5-9d55-4cdd-b31e-72910d764a9d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:18.931927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b69b6ef5-9d55-4cdd-b31e-72910d764a9d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.932754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b69b6ef5-9d55-4cdd-b31e-72910d764a9d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.934226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b69b6ef5-9d55-4cdd-b31e-72910d764a9d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.935319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b69b6ef5-9d55-4cdd-b31e-72910d764a9d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.969830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:18.980349 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-db7e4953-8d04-491b-8894-c1e6ab6d8db2 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.176896 Dec 18 20:51:18.981694 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 681/1387] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:18 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:18.986872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99424b3e-aa12-419e-83ee-4b38237fb5ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:18.988109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-99424b3e-aa12-419e-83ee-4b38237fb5ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:18.994351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99424b3e-aa12-419e-83ee-4b38237fb5ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.994813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99424b3e-aa12-419e-83ee-4b38237fb5ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.995615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99424b3e-aa12-419e-83ee-4b38237fb5ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:18.996062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99424b3e-aa12-419e-83ee-4b38237fb5ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:18.999334 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b69b6ef5-9d55-4cdd-b31e-72910d764a9d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.083566 Dec 18 20:51:19.000069 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 707/1388] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:18 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:19.049825 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99424b3e-aa12-419e-83ee-4b38237fb5ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.066683 Dec 18 20:51:19.050882 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 682/1389] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:18 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:19.080683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:19.081472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 919e413a-66ad-40fb-aad2-6d3392c35439] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:19.091518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.092107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.093012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.093572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.113485 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] HTTP exception thrown: Instance 919e413a-66ad-40fb-aad2-6d3392c35439 could not be found. Dec 18 20:51:19.114281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Returning 404 to user: Instance 919e413a-66ad-40fb-aad2-6d3392c35439 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:19.115241 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0318f41b-af87-484c-a2df-e01e4ff2663a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439" status: 404 len: 111 microversion: 2.25 time: 0.039026 Dec 18 20:51:19.116086 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 708/1390] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:19 2021] GET /compute/v2.1/servers/919e413a-66ad-40fb-aad2-6d3392c35439 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:51:19.124979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:19.125648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:19.132858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.133393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.134334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.134853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.166466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:19.289214 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f8735b2-5c7c-47ac-bf86-3e1efe26a17a tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 204 len: 0 microversion: 2.25 time: 0.168620 Dec 18 20:51:19.296172 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 683/1391] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:51:19 2021] DELETE /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 18 20:51:19.300163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:19.301095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:19.313577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.316126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.317102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.317663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.538053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:19.538807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:19.552730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.553184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.553996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.554467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.945218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:19.955851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:19.958497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:19.959853 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ddca86b1-dd2c-44f9-a827-3e8a576f49e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1549 microversion: 2.25 time: 0.664175 Dec 18 20:51:19.971448 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 709/1392] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:19 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1549 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:51:19.976151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:19.976774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5985b52a-141c-483c-ab38-8b1e38a0278f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:19.984127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.984845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.985829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:19.986350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:19.998817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:20.015587 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40b859b7-0e2c-4bae-ae4e-599b872b2350 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.481746 Dec 18 20:51:20.016201 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 684/1393] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:19 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:20.020813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:20.021409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:20.024858 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] HTTP exception thrown: Instance 5985b52a-141c-483c-ab38-8b1e38a0278f could not be found. Dec 18 20:51:20.025512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Returning 404 to user: Instance 5985b52a-141c-483c-ab38-8b1e38a0278f could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:20.026357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-79f19db8-c971-4242-ae9d-8cca2af28b94 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f" status: 404 len: 111 microversion: 2.1 time: 0.064121 Dec 18 20:51:20.026919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 710/1394] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:19 2021] GET /compute/v2.1/servers/5985b52a-141c-483c-ab38-8b1e38a0278f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:20.032741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:20.034089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:20.037556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.038414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.039495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.040141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.043938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.044406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.045605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.046061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.175626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:20.183467 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52ac5d76-8b94-4e68-b127-654445bd8776 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1274 microversion: 2.1 time: 0.165973 Dec 18 20:51:20.185913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 685/1395] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:20 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:20.192640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-edfa26d9-dd38-4baf-9a31-16d280f26c1b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:20.194010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-edfa26d9-dd38-4baf-9a31-16d280f26c1b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:20.201953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edfa26d9-dd38-4baf-9a31-16d280f26c1b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.202549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edfa26d9-dd38-4baf-9a31-16d280f26c1b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.203548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edfa26d9-dd38-4baf-9a31-16d280f26c1b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.204057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edfa26d9-dd38-4baf-9a31-16d280f26c1b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.260040 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-edfa26d9-dd38-4baf-9a31-16d280f26c1b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.071374 Dec 18 20:51:20.261044 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 686/1396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:20 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:20.272060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:20.272645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:20.281716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.282159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.283050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.283609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.317758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:20.333010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:20.350674 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-223d8258-766c-4e66-aa40-92b5094ac927 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.322602 Dec 18 20:51:20.351265 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 711/1397] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:20 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:20.355747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d9ab0c9e-c9a3-4982-9e82-05f40c5fb9a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:20.356771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d9ab0c9e-c9a3-4982-9e82-05f40c5fb9a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:20.370803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9ab0c9e-c9a3-4982-9e82-05f40c5fb9a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.372660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9ab0c9e-c9a3-4982-9e82-05f40c5fb9a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.374449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9ab0c9e-c9a3-4982-9e82-05f40c5fb9a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.375741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9ab0c9e-c9a3-4982-9e82-05f40c5fb9a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.431932 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d9ab0c9e-c9a3-4982-9e82-05f40c5fb9a3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.078812 Dec 18 20:51:20.437380 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 712/1398] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:20 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:20.460830 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c309642a-e077-426c-b598-56433cccd1cd tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 204 len: 0 microversion: 2.1 time: 0.198157 Dec 18 20:51:20.461578 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 687/1399] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:20 2021] DELETE /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:20.474067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:20.476072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:20.484799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.485481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.486302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.486901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.700787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:20.709634 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9f8f8aff-739b-4940-8f53-f3aad30ab416 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1499 microversion: 2.1 time: 0.241716 Dec 18 20:51:20.719594 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 713/1400] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:20 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1499 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:20.840547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-fd4a5a5d-2527-421f-b98c-55a0035ede7c req-26a6dd5e-675a-46ab-96fd-80fdf8b101f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1389e6-a05e-4f01-aa45-405bf57c622d", "name": "network-vif-deleted", "tag": "f4d2142c-df3c-4259-89f6-888e1edbf513"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:20.845232 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:20.845232 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:20.886944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fd4a5a5d-2527-421f-b98c-55a0035ede7c req-26a6dd5e-675a-46ab-96fd-80fdf8b101f5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.890583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fd4a5a5d-2527-421f-b98c-55a0035ede7c req-26a6dd5e-675a-46ab-96fd-80fdf8b101f5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.921493 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-fd4a5a5d-2527-421f-b98c-55a0035ede7c req-26a6dd5e-675a-46ab-96fd-80fdf8b101f5 service nova] Creating event network-vif-deleted:f4d2142c-df3c-4259-89f6-888e1edbf513 for instance 6b1389e6-a05e-4f01-aa45-405bf57c622d on nch1-master-1 Dec 18 20:51:20.927662 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-fd4a5a5d-2527-421f-b98c-55a0035ede7c req-26a6dd5e-675a-46ab-96fd-80fdf8b101f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098932 Dec 18 20:51:20.932457 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 688/1401] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:20.978866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:20.979487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:20.986205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.986694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:20.987559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:20.988015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.034066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:21.035043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:21.043596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.050788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.051930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.052624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.067751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.068211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.071509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lazy-loading 'fault' on Instance uuid 6b1389e6-a05e-4f01-aa45-405bf57c622d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:51:21.169971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:21.188464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:21.190562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:21.192066 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d4b9abac-82cf-4ace-b7e1-fee04847d0a2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 200 len: 1352 microversion: 2.25 time: 0.217303 Dec 18 20:51:21.192887 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 714/1402] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:20 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 1352 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:21.209206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:21.211938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:21.236791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.238318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.239761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.240720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.488518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:21.500990 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5fae7459-f876-47ce-9d60-d949189eed2c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.472124 Dec 18 20:51:21.512777 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 689/1403] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:21 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:21.531320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-26744bb5-536b-4172-8907-8b1e7bc43184 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:21.536155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-26744bb5-536b-4172-8907-8b1e7bc43184 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:21.558433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26744bb5-536b-4172-8907-8b1e7bc43184 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.560736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26744bb5-536b-4172-8907-8b1e7bc43184 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.561604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26744bb5-536b-4172-8907-8b1e7bc43184 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.562743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26744bb5-536b-4172-8907-8b1e7bc43184 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.577085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:21.585909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47d8cad0-f0cc-4d94-974e-8325032324e4 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1316 microversion: 2.1 time: 0.387228 Dec 18 20:51:21.596437 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 715/1404] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:21 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:21.601865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:21.602797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:21.611000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.611789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.613123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.613785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.662707 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-26744bb5-536b-4172-8907-8b1e7bc43184 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.147808 Dec 18 20:51:21.663755 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 690/1405] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:21 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:21.677000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-701e5ffd-4560-4a70-91c3-a100b3cfe020 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:21.678013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-701e5ffd-4560-4a70-91c3-a100b3cfe020 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:21.694027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-701e5ffd-4560-4a70-91c3-a100b3cfe020 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.700299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-701e5ffd-4560-4a70-91c3-a100b3cfe020 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.701337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-701e5ffd-4560-4a70-91c3-a100b3cfe020 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.701964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-701e5ffd-4560-4a70-91c3-a100b3cfe020 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.762529 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-701e5ffd-4560-4a70-91c3-a100b3cfe020 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.090974 Dec 18 20:51:21.763457 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 691/1406] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:21 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:21.773559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:21.781876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:21.792146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.792619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.793477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:21.794443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:21.895995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf1ced6baf4e1d9c940cfe96b2c254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0870e14bc2934bae9138d4818b260729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:21.908496 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-756572c7-f0b4-460f-84ad-7aa84a76c941 tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 200 len: 1457 microversion: 2.1 time: 0.141288 Dec 18 20:51:21.909008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 692/1407] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:21 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 1457 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:22.072901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:22.098833 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75e9706c-65a0-4a76-be84-c4ab5c0af765 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.498857 Dec 18 20:51:22.103340 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 716/1408] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:21 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:22.211271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:22.211880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 6b1389e6-a05e-4f01-aa45-405bf57c622d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:22.221799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.222243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.223574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.224025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.243145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] HTTP exception thrown: Instance 6b1389e6-a05e-4f01-aa45-405bf57c622d could not be found. Dec 18 20:51:22.244442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Returning 404 to user: Instance 6b1389e6-a05e-4f01-aa45-405bf57c622d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:22.245535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9492ef49-6c1c-4123-824e-bab00a1ab6e6 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d" status: 404 len: 111 microversion: 2.25 time: 0.038770 Dec 18 20:51:22.246606 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 693/1409] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:22 2021] GET /compute/v2.1/servers/6b1389e6-a05e-4f01-aa45-405bf57c622d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:51:22.260959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:22.265185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:22.276831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.279396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.280471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.281206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.292159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c84b502f-23b5-4b4a-ad68-95255e508411 req-68cae3c6-188b-450c-9290-31c92f3a5216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d26953e-4ddb-4f0b-85a1-3de0ae36401f", "tag": "1989df78-5575-43d1-8748-79a640639e11"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:22.294462 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:22.294462 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:22.310301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c84b502f-23b5-4b4a-ad68-95255e508411 req-68cae3c6-188b-450c-9290-31c92f3a5216 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.311938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c84b502f-23b5-4b4a-ad68-95255e508411 req-68cae3c6-188b-450c-9290-31c92f3a5216 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.350725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:22.361478 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c84b502f-23b5-4b4a-ad68-95255e508411 req-68cae3c6-188b-450c-9290-31c92f3a5216 service nova] Creating event network-changed:1989df78-5575-43d1-8748-79a640639e11 for instance 5d26953e-4ddb-4f0b-85a1-3de0ae36401f on nch2-master-1 Dec 18 20:51:22.384806 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c84b502f-23b5-4b4a-ad68-95255e508411 req-68cae3c6-188b-450c-9290-31c92f3a5216 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098611 Dec 18 20:51:22.389413 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 694/1410] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:51:22.520259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:22.521046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:22.529103 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-528cf448-4027-4661-be7a-f44f211dec07 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 204 len: 0 microversion: 2.25 time: 0.277538 Dec 18 20:51:22.530797 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 717/1411] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:51:22 2021] DELETE /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 18 20:51:22.534823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.535280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.536095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.536562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.542745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:22.543801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:22.554366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.555439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.556618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.557286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.910864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:22.922630 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ca0cb78-1196-4c2e-812b-46d5a052e774 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.406642 Dec 18 20:51:22.944514 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 695/1412] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:22 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:22.952886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:22.961526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:22.965574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:22.968409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:22.968820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:22.971713 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fad8a5a6-cb54-496f-8f73-3167108849c2 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1564 microversion: 2.25 time: 0.436760 Dec 18 20:51:22.982421 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 718/1413] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:22 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1564 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:51:22.982648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.982648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.983394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:22.987807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-27cdd538-48d0-4c18-98db-afb2d57a9672 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:22.988514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:22.993845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-27cdd538-48d0-4c18-98db-afb2d57a9672 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:23.010084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27cdd538-48d0-4c18-98db-afb2d57a9672 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.010511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27cdd538-48d0-4c18-98db-afb2d57a9672 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.011334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27cdd538-48d0-4c18-98db-afb2d57a9672 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.011784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27cdd538-48d0-4c18-98db-afb2d57a9672 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.076966 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-27cdd538-48d0-4c18-98db-afb2d57a9672 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 24494 microversion: 2.1 time: 0.098686 Dec 18 20:51:23.078720 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 719/1414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:22 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 24494 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:23.085263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-45b30711-d508-47d2-abd1-5280a63cff87 req-a6e86add-2c5e-455b-a5a7-b22c23a86904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b99ef-8148-405f-a61a-3cbebb685678", "name": "network-vif-plugged", "status": "completed", "tag": "e60078e1-0404-483c-be40-491d5a7ac210"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:23.086981 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:23.086981 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:23.099736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-45b30711-d508-47d2-abd1-5280a63cff87 req-a6e86add-2c5e-455b-a5a7-b22c23a86904 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.100608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-45b30711-d508-47d2-abd1-5280a63cff87 req-a6e86add-2c5e-455b-a5a7-b22c23a86904 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.120090 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-45b30711-d508-47d2-abd1-5280a63cff87 req-a6e86add-2c5e-455b-a5a7-b22c23a86904 service nova] Creating event network-vif-plugged:e60078e1-0404-483c-be40-491d5a7ac210 for instance e09b99ef-8148-405f-a61a-3cbebb685678 on nch2-master-1 Dec 18 20:51:23.128767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-45b30711-d508-47d2-abd1-5280a63cff87 req-a6e86add-2c5e-455b-a5a7-b22c23a86904 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047737 Dec 18 20:51:23.135741 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 720/1415] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:23.144847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a0516bf-1533-46b7-8d5c-25cd7439a96d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:23.145883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0a0516bf-1533-46b7-8d5c-25cd7439a96d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:23.155066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a0516bf-1533-46b7-8d5c-25cd7439a96d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.155602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a0516bf-1533-46b7-8d5c-25cd7439a96d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.157026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a0516bf-1533-46b7-8d5c-25cd7439a96d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.157589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a0516bf-1533-46b7-8d5c-25cd7439a96d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.232742 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a0516bf-1533-46b7-8d5c-25cd7439a96d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.095661 Dec 18 20:51:23.233818 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 721/1416] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:23 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:23.238906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:23.239662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] [instance: 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:23.247221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.247684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.248499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.248940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.267691 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] HTTP exception thrown: Instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f could not be found. Dec 18 20:51:23.268300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] Returning 404 to user: Instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:23.269150 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0528c689-bd0a-4930-899d-eaab6983f41b tempest-LiveMigrationTest-700829217 tempest-LiveMigrationTest-700829217-project] 10.222.0.13 "GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f" status: 404 len: 111 microversion: 2.1 time: 0.034216 Dec 18 20:51:23.269873 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 722/1417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:23 2021] GET /compute/v2.1/servers/5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:23.278444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6d923794-9d51-4a31-b772-eb22228704cc req-9c0b9e66-9968-43e4-b671-47ef865483bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f", "name": "network-vif-deleted", "tag": "4ca78321-f8c5-417a-8eae-41822d244cd0"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:23.280006 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:23.280006 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:23.288222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6d923794-9d51-4a31-b772-eb22228704cc req-9c0b9e66-9968-43e4-b671-47ef865483bb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.288541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6d923794-9d51-4a31-b772-eb22228704cc req-9c0b9e66-9968-43e4-b671-47ef865483bb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.303495 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6d923794-9d51-4a31-b772-eb22228704cc req-9c0b9e66-9968-43e4-b671-47ef865483bb service nova] Creating event network-vif-deleted:4ca78321-f8c5-417a-8eae-41822d244cd0 for instance 5d2f2e9e-da41-4537-8c8d-07cbe9ab3a7f on nch2-master-1 Dec 18 20:51:23.305493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:23.318539 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6d923794-9d51-4a31-b772-eb22228704cc req-9c0b9e66-9968-43e4-b671-47ef865483bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044230 Dec 18 20:51:23.319551 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 723/1418] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:23.324369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:23.324892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-500211f8-193e-41dc-82b2-45673957eb32 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1316 microversion: 2.1 time: 0.378077 Dec 18 20:51:23.325308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:23.327841 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 696/1419] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:22 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:23.332417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.332925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.333739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.334223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.704291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:23.724307 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72ad4d5e-4cbd-44e4-a722-52685843b944 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.403931 Dec 18 20:51:23.724891 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 724/1420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:23 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:23.941449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:23.942055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:23.949147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.950588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.951764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:23.952358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:23.994838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:23.995947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:24.004326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.005136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.006352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.007132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.044663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.045311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.046388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lazy-loading 'fault' on Instance uuid 9b8c445f-06db-4133-a919-8c79de5333f0 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:51:24.137003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:24.146629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:24.148202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8042de28328d4b26b910f1be4b499879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b125f83d34481adc5617b5ca62e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:24.149355 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6937fd46-29d0-496c-8505-432928b36e86 tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 200 len: 1352 microversion: 2.25 time: 0.158148 Dec 18 20:51:24.150055 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 725/1421] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:23 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 1352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:51:24.154730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-776b3301-a9da-46bf-9099-9534dddc2221 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:24.155844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-776b3301-a9da-46bf-9099-9534dddc2221 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:24.162431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-776b3301-a9da-46bf-9099-9534dddc2221 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.162767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-776b3301-a9da-46bf-9099-9534dddc2221 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.163565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-776b3301-a9da-46bf-9099-9534dddc2221 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.164008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-776b3301-a9da-46bf-9099-9534dddc2221 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.233699 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-776b3301-a9da-46bf-9099-9534dddc2221 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.082103 Dec 18 20:51:24.238026 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 726/1422] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:24 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:24.245432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e00bcee-28ec-46f5-a859-21a545c54cd4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:24.247016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e00bcee-28ec-46f5-a859-21a545c54cd4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:24.254202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e00bcee-28ec-46f5-a859-21a545c54cd4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.254697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e00bcee-28ec-46f5-a859-21a545c54cd4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.255502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e00bcee-28ec-46f5-a859-21a545c54cd4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.255941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e00bcee-28ec-46f5-a859-21a545c54cd4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.298932 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e00bcee-28ec-46f5-a859-21a545c54cd4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.057902 Dec 18 20:51:24.299739 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 727/1423] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:24 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:24.346370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:24.347313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:24.354525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.355303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.356893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.357483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.401898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:24.429071 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aac86091-565d-4472-aeea-492543fb4765 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.491824 Dec 18 20:51:24.433032 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 697/1424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:23 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:24.553056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:24.564428 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b19cff1-74e5-4b10-8a72-ba86362a2d07 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1316 microversion: 2.1 time: 0.224303 Dec 18 20:51:24.565344 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 728/1425] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:24 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:24.740891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:24.741494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:24.748931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.749375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:24.750316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:24.750610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.028692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:25.038163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b11e349d-be06-463f-96f5-302a0d02d4e4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.301112 Dec 18 20:51:25.039376 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 698/1426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:24 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:25.146162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c86331ba-902c-4a90-81c5-386310a77445 req-d5546028-a9e6-4e39-9ba4-ac58f5914427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b99ef-8148-405f-a61a-3cbebb685678", "name": "network-vif-plugged", "status": "completed", "tag": "f6435f74-9322-42c0-8848-1a63b5470f96"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:25.148390 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:25.148390 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:25.156360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c86331ba-902c-4a90-81c5-386310a77445 req-d5546028-a9e6-4e39-9ba4-ac58f5914427 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.156812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c86331ba-902c-4a90-81c5-386310a77445 req-d5546028-a9e6-4e39-9ba4-ac58f5914427 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.167610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:25.168245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] [instance: 9b8c445f-06db-4133-a919-8c79de5333f0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:25.177229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c86331ba-902c-4a90-81c5-386310a77445 req-d5546028-a9e6-4e39-9ba4-ac58f5914427 service nova] Creating event network-vif-plugged:f6435f74-9322-42c0-8848-1a63b5470f96 for instance e09b99ef-8148-405f-a61a-3cbebb685678 on nch2-master-1 Dec 18 20:51:25.178217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.178706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.179745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.180343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.183531 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c86331ba-902c-4a90-81c5-386310a77445 req-d5546028-a9e6-4e39-9ba4-ac58f5914427 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040203 Dec 18 20:51:25.184507 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 729/1427] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:25.202579 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] HTTP exception thrown: Instance 9b8c445f-06db-4133-a919-8c79de5333f0 could not be found. Dec 18 20:51:25.203382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] Returning 404 to user: Instance 9b8c445f-06db-4133-a919-8c79de5333f0 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:25.204364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a28581b-339e-4ba0-a004-3fb0dd78a12b tempest-LiveAutoBlockMigrationV225Test-1918466308 tempest-LiveAutoBlockMigrationV225Test-1918466308-project] 10.222.0.13 "GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0" status: 404 len: 111 microversion: 2.25 time: 0.040420 Dec 18 20:51:25.205101 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 699/1428] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:51:25 2021] GET /compute/v2.1/servers/9b8c445f-06db-4133-a919-8c79de5333f0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 20:51:25.248539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-166b2b9f-e983-4c72-ad03-97f6afb60898 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:25.249554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-166b2b9f-e983-4c72-ad03-97f6afb60898 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:25.257996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166b2b9f-e983-4c72-ad03-97f6afb60898 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.258594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166b2b9f-e983-4c72-ad03-97f6afb60898 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.259984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166b2b9f-e983-4c72-ad03-97f6afb60898 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.260935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166b2b9f-e983-4c72-ad03-97f6afb60898 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.311985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d4716535-d83e-4558-bff7-120fc303b243 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:25.313262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d4716535-d83e-4558-bff7-120fc303b243 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:25.325648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4716535-d83e-4558-bff7-120fc303b243 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.326143 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-166b2b9f-e983-4c72-ad03-97f6afb60898 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.083094 Dec 18 20:51:25.326772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4716535-d83e-4558-bff7-120fc303b243 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.330481 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 730/1429] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:25 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:25.331736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4716535-d83e-4558-bff7-120fc303b243 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.332315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4716535-d83e-4558-bff7-120fc303b243 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.384380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d4716535-d83e-4558-bff7-120fc303b243 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.075435 Dec 18 20:51:25.386772 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 700/1430] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:25 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:25.452486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:25.453923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:25.461775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.462810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.464025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.464638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.524374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e6db9638-e59a-4825-89e5-e8c845e3f180 req-542a44f2-476e-4330-8f04-eaaf625d5b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8c445f-06db-4133-a919-8c79de5333f0", "name": "network-vif-deleted", "tag": "35ef2a63-339b-4a47-a0b0-2edcd0dd0be1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:25.525870 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:25.525870 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:25.534075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e6db9638-e59a-4825-89e5-e8c845e3f180 req-542a44f2-476e-4330-8f04-eaaf625d5b33 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.534795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e6db9638-e59a-4825-89e5-e8c845e3f180 req-542a44f2-476e-4330-8f04-eaaf625d5b33 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.546618 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e6db9638-e59a-4825-89e5-e8c845e3f180 req-542a44f2-476e-4330-8f04-eaaf625d5b33 service nova] Creating event network-vif-deleted:35ef2a63-339b-4a47-a0b0-2edcd0dd0be1 for instance 9b8c445f-06db-4133-a919-8c79de5333f0 on nch1-master-1 Dec 18 20:51:25.552553 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e6db9638-e59a-4825-89e5-e8c845e3f180 req-542a44f2-476e-4330-8f04-eaaf625d5b33 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032759 Dec 18 20:51:25.553645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 701/1431] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:51:25.582799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:25.583586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:25.594639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.595095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.595971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:25.596528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:25.666117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:25.677101 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-275ebcbd-bf26-4b7e-9cd3-1c5f3ede170e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.230330 Dec 18 20:51:25.678003 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 731/1432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:25 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:25.788576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:25.799621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e404f82a-929b-4c33-8f10-d921fda51daf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1316 microversion: 2.1 time: 0.221551 Dec 18 20:51:25.800759 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 702/1433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:25 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:26.055504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:26.056459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:26.063554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.064334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.065350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.066005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.281121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:26.294184 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-654c4574-c06d-4de3-b8cb-d5ecc56603fc tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1333 microversion: 2.1 time: 0.242163 Dec 18 20:51:26.295500 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 732/1434] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:26 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1333 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:26.339103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a9a62097-9a5c-4ad9-879e-dbc0fe7febe4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:26.349876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a9a62097-9a5c-4ad9-879e-dbc0fe7febe4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:26.362881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a62097-9a5c-4ad9-879e-dbc0fe7febe4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.364469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a62097-9a5c-4ad9-879e-dbc0fe7febe4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.366939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a62097-9a5c-4ad9-879e-dbc0fe7febe4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.368757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a62097-9a5c-4ad9-879e-dbc0fe7febe4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.398697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d0a4c90-b7b4-4c65-b75b-113374e08c5d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:26.400701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d0a4c90-b7b4-4c65-b75b-113374e08c5d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:26.413576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0a4c90-b7b4-4c65-b75b-113374e08c5d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.413967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0a4c90-b7b4-4c65-b75b-113374e08c5d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.419333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0a4c90-b7b4-4c65-b75b-113374e08c5d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.420053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0a4c90-b7b4-4c65-b75b-113374e08c5d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.453407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a9a62097-9a5c-4ad9-879e-dbc0fe7febe4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.117503 Dec 18 20:51:26.454541 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 703/1435] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:26 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:26.506006 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d0a4c90-b7b4-4c65-b75b-113374e08c5d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.111480 Dec 18 20:51:26.511841 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 733/1436] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:26 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:26.696190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:26.696889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:26.719051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.719773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.720652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.721100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.823488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:26.824206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:26.832692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.833349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.834526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:26.835161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:26.959633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:26.971626 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03fd0129-aad1-48db-8bf5-cc8387c650da tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.279627 Dec 18 20:51:26.976366 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 704/1437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:26 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:27.070390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:27.091012 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9aedafea-1a74-465d-92d5-ec840f69feac tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1316 microversion: 2.1 time: 0.269726 Dec 18 20:51:27.093851 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 734/1438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:26 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:27.311656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:27.312451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:27.318646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.319315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.320107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.320541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.468255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86383224-f60e-473f-bcae-034048af74df tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:27.469184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86383224-f60e-473f-bcae-034048af74df tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:27.477074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86383224-f60e-473f-bcae-034048af74df tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.477772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86383224-f60e-473f-bcae-034048af74df tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.478776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86383224-f60e-473f-bcae-034048af74df tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.479450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86383224-f60e-473f-bcae-034048af74df tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.518804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:27.537343 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2f45f31-0679-4010-b096-5dddd0ec6cd4 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1669 microversion: 2.1 time: 0.230044 Dec 18 20:51:27.538459 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 705/1439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:27 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1669 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:27.547791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ebdca300-2c29-4eb9-a8ca-2cbfde262c34 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:27.549129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ebdca300-2c29-4eb9-a8ca-2cbfde262c34 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:27.552987 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86383224-f60e-473f-bcae-034048af74df tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.088566 Dec 18 20:51:27.553646 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 735/1440] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:27 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:27.557284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebdca300-2c29-4eb9-a8ca-2cbfde262c34 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.557749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebdca300-2c29-4eb9-a8ca-2cbfde262c34 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.558891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebdca300-2c29-4eb9-a8ca-2cbfde262c34 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.559499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebdca300-2c29-4eb9-a8ca-2cbfde262c34 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.564768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-17e12703-3407-49b1-8258-27ea74cac067 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:27.565360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-17e12703-3407-49b1-8258-27ea74cac067 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:27.583445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17e12703-3407-49b1-8258-27ea74cac067 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.583898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17e12703-3407-49b1-8258-27ea74cac067 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.584692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17e12703-3407-49b1-8258-27ea74cac067 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.589308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17e12703-3407-49b1-8258-27ea74cac067 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.617657 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ebdca300-2c29-4eb9-a8ca-2cbfde262c34 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.076938 Dec 18 20:51:27.617980 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-17e12703-3407-49b1-8258-27ea74cac067 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678/ips" status: 200 len: 180 microversion: 2.1 time: 0.062866 Dec 18 20:51:27.618344 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 706/1441] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:27 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:27.619422 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 736/1442] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 20:51:27 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678/ips => generated 180 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:27.630905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:27.632431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:27.640938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.642008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.643531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.644198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.693408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:27.825873 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e56018c-eaa8-460c-9a1c-e8809546042d tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 204 len: 0 microversion: 2.1 time: 0.200037 Dec 18 20:51:27.827916 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 737/1443] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:27 2021] DELETE /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:27.836926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:27.837617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:27.844114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.844562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.845341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:27.845773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:27.992148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:27.993247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:28.002630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.003603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.004885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.005443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.020659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:28.029163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecba5386-4494-4d8f-b197-2a8d49638e74 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1675 microversion: 2.1 time: 0.196671 Dec 18 20:51:28.029748 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 707/1444] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:27 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:28.108619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:28.109223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:28.116313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.117549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.119198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.119858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.175650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:28.186977 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9f56da9-4dd5-4972-a261-674a70e49432 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.199241 Dec 18 20:51:28.187821 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 738/1445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:27 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:28.280652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:28.288673 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-63d2d890-f0a9-4091-b1a8-99992e47b65d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1316 microversion: 2.1 time: 0.184184 Dec 18 20:51:28.289632 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 708/1446] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:28 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:28.520499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4c7dc196-de47-4792-9dad-71b5308258ca req-677b27ee-c99d-40c4-aa96-25ede3a296c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d26953e-4ddb-4f0b-85a1-3de0ae36401f", "name": "network-vif-plugged", "status": "completed", "tag": "1989df78-5575-43d1-8748-79a640639e11"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:28.521609 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:28.521609 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:28.530517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4c7dc196-de47-4792-9dad-71b5308258ca req-677b27ee-c99d-40c4-aa96-25ede3a296c4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.531238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4c7dc196-de47-4792-9dad-71b5308258ca req-677b27ee-c99d-40c4-aa96-25ede3a296c4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.546026 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4c7dc196-de47-4792-9dad-71b5308258ca req-677b27ee-c99d-40c4-aa96-25ede3a296c4 service nova] Creating event network-vif-plugged:1989df78-5575-43d1-8748-79a640639e11 for instance 5d26953e-4ddb-4f0b-85a1-3de0ae36401f on nch2-master-1 Dec 18 20:51:28.551592 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4c7dc196-de47-4792-9dad-71b5308258ca req-677b27ee-c99d-40c4-aa96-25ede3a296c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 Dec 18 20:51:28.553392 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 739/1447] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:28.567250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7330ef53-4c04-48a9-b29f-e9b18ceb816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:28.569106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7330ef53-4c04-48a9-b29f-e9b18ceb816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:28.577413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7330ef53-4c04-48a9-b29f-e9b18ceb816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.577989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7330ef53-4c04-48a9-b29f-e9b18ceb816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.579466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7330ef53-4c04-48a9-b29f-e9b18ceb816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.580123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7330ef53-4c04-48a9-b29f-e9b18ceb816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.631240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3a2a3236-874a-4549-a07a-09a050f89bf0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:28.632585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3a2a3236-874a-4549-a07a-09a050f89bf0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:28.636239 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7330ef53-4c04-48a9-b29f-e9b18ceb816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.074380 Dec 18 20:51:28.641631 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 709/1448] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:28 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:28.657885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a2a3236-874a-4549-a07a-09a050f89bf0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.660134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a2a3236-874a-4549-a07a-09a050f89bf0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.661066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a2a3236-874a-4549-a07a-09a050f89bf0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:28.662910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a2a3236-874a-4549-a07a-09a050f89bf0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:28.718761 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3a2a3236-874a-4549-a07a-09a050f89bf0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.091308 Dec 18 20:51:28.723597 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 740/1449] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:28 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:29.047494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:29.050533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:29.058245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.059487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.060750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.061359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.205693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:29.206547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:29.217576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.218292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.220179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.220813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.222953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:29.231832 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4b6f172-725f-4522-bc6c-3c71238dddd9 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1675 microversion: 2.1 time: 0.188786 Dec 18 20:51:29.241468 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 710/1450] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:29 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:29.307795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:29.308769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:29.317329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.318498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.319604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.320215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.416696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:29.427143 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaebd128-1637-40a3-a0d7-1f988148f364 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.226391 Dec 18 20:51:29.428002 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 741/1451] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:29 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:29.501746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:29.510120 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cebfbe72-14c2-45bc-8f6c-72c5743c9aa7 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1316 microversion: 2.1 time: 0.207626 Dec 18 20:51:29.510946 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 711/1452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:29 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:29.648968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe5be080-454f-41cc-ab1a-4610174f02ff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:29.649886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe5be080-454f-41cc-ab1a-4610174f02ff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:29.656958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5be080-454f-41cc-ab1a-4610174f02ff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.657660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5be080-454f-41cc-ab1a-4610174f02ff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.658490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5be080-454f-41cc-ab1a-4610174f02ff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.659112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5be080-454f-41cc-ab1a-4610174f02ff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.709681 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe5be080-454f-41cc-ab1a-4610174f02ff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.064209 Dec 18 20:51:29.715776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 742/1453] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:29 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:29.734668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d4f4b4a-e196-4803-94ea-b134743653ca tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:29.735898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d4f4b4a-e196-4803-94ea-b134743653ca tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:29.744755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b4a-e196-4803-94ea-b134743653ca tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.747161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b4a-e196-4803-94ea-b134743653ca tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.748551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b4a-e196-4803-94ea-b134743653ca tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:29.749382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4f4b4a-e196-4803-94ea-b134743653ca tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:29.804528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d4f4b4a-e196-4803-94ea-b134743653ca tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.074425 Dec 18 20:51:29.808975 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 743/1454] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:29 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:29.888230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b581ef8-ad1b-4aee-a9c9-85550900c021 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Action: 'update', calling method: .version_select at 0x7f714fbadb80>, body: {"quota_set": {"ram": "5120"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:29.891222 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:29.891222 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:30.229141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b581ef8-ad1b-4aee-a9c9-85550900c021 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.229953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b581ef8-ad1b-4aee-a9c9-85550900c021 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.231315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b581ef8-ad1b-4aee-a9c9-85550900c021 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.232567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b581ef8-ad1b-4aee-a9c9-85550900c021 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.253058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:30.254083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:30.263451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.264313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.265322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.266086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.308038 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b581ef8-ad1b-4aee-a9c9-85550900c021 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c" status: 200 len: 240 microversion: 2.36 time: 0.581390 Dec 18 20:51:30.310756 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 712/1455] 10.222.0.13 () {62 vars in 1302 bytes} [Sat Dec 18 20:51:29 2021] PUT /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c => generated 240 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:30.321009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a71319c3-cdb2-4f71-992d-a2a43fe04ee0 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Calling method '.version_select at 0x7f714ff873a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:30.509956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:30.517560 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56d8fc0f-b9d1-4ca2-8fb5-564eb7b7932a tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1675 microversion: 2.1 time: 0.271988 Dec 18 20:51:30.518725 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 744/1456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:30 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:30.524751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:30.526964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:30.536514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.537213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.538328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.539557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.685398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a71319c3-cdb2-4f71-992d-a2a43fe04ee0 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.685858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a71319c3-cdb2-4f71-992d-a2a43fe04ee0 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.689236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a71319c3-cdb2-4f71-992d-a2a43fe04ee0 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.689994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a71319c3-cdb2-4f71-992d-a2a43fe04ee0 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.737489 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a71319c3-cdb2-4f71-992d-a2a43fe04ee0 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c/detail" status: 200 len: 672 microversion: 2.36 time: 0.421010 Dec 18 20:51:30.747319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 713/1457] 10.222.0.13 () {60 vars in 1303 bytes} [Sat Dec 18 20:51:30 2021] GET /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c/detail => generated 672 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:30.757711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:30.759873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:30.767665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.769465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.772622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.773496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.895980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:30.904000 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0cf35fa7-4f27-4531-8b6a-27956ae00b1f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.383756 Dec 18 20:51:30.913979 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 745/1458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:30 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:30.920505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-751ed082-3b5e-421b-b457-ada3acb9a7f3 req-844aaaa7-56d9-4f33-bc13-a4191fb8887a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b99ef-8148-405f-a61a-3cbebb685678", "name": "network-vif-deleted", "tag": "f6435f74-9322-42c0-8848-1a63b5470f96"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:30.922262 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:30.922262 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:30.929712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-751ed082-3b5e-421b-b457-ada3acb9a7f3 req-844aaaa7-56d9-4f33-bc13-a4191fb8887a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.930168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-751ed082-3b5e-421b-b457-ada3acb9a7f3 req-844aaaa7-56d9-4f33-bc13-a4191fb8887a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.944969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-751ed082-3b5e-421b-b457-ada3acb9a7f3 req-844aaaa7-56d9-4f33-bc13-a4191fb8887a service nova] Creating event network-vif-deleted:f6435f74-9322-42c0-8848-1a63b5470f96 for instance e09b99ef-8148-405f-a61a-3cbebb685678 on nch2-master-1 Dec 18 20:51:30.950047 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-751ed082-3b5e-421b-b457-ada3acb9a7f3 req-844aaaa7-56d9-4f33-bc13-a4191fb8887a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034691 Dec 18 20:51:30.950894 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 746/1459] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:30.956376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aed39343-a7f1-40be-8988-be27d346b42a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:30.957575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aed39343-a7f1-40be-8988-be27d346b42a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:30.966356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aed39343-a7f1-40be-8988-be27d346b42a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.966984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aed39343-a7f1-40be-8988-be27d346b42a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:30.968541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aed39343-a7f1-40be-8988-be27d346b42a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:30.969146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aed39343-a7f1-40be-8988-be27d346b42a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.029690 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aed39343-a7f1-40be-8988-be27d346b42a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.077158 Dec 18 20:51:31.030730 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 747/1460] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:30 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:31.037095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59f22d59-d3f0-4e90-a649-5440844334aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:31.038303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-59f22d59-d3f0-4e90-a649-5440844334aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:31.045346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:31.046731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59f22d59-d3f0-4e90-a649-5440844334aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.047376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59f22d59-d3f0-4e90-a649-5440844334aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.048338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59f22d59-d3f0-4e90-a649-5440844334aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.049692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59f22d59-d3f0-4e90-a649-5440844334aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.055812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cdc44a78-9cf4-41a6-a05b-5edba1a67f15 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1466 microversion: 2.1 time: 0.310415 Dec 18 20:51:31.056457 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 714/1461] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:30 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1466 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:31.101080 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59f22d59-d3f0-4e90-a649-5440844334aa tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.068527 Dec 18 20:51:31.107146 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 748/1462] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:31 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:31.112108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-780b0880-e967-4d37-bb05-62c8764d7c52 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:31.112822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-780b0880-e967-4d37-bb05-62c8764d7c52 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:31.120731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780b0880-e967-4d37-bb05-62c8764d7c52 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.123031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780b0880-e967-4d37-bb05-62c8764d7c52 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.124035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780b0880-e967-4d37-bb05-62c8764d7c52 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.124484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780b0880-e967-4d37-bb05-62c8764d7c52 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.251365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2043801968", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:31.316218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:51:31.394317 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-780b0880-e967-4d37-bb05-62c8764d7c52 tempest-ServersOnMultiNodesTest-1117205473 tempest-ServersOnMultiNodesTest-1117205473-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1617 microversion: 2.1 time: 0.286094 Dec 18 20:51:31.396217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 749/1463] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:31 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1617 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:31.402765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Action: 'update', calling method: .version_select at 0x7f714fff2b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:31.405886 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:31.405886 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:31.625215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:51:31.625611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:51:31.626440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:51:31.626859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:51:31.627285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:51:31.628613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.629065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.630110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.630579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.637186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.637729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.638677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.639323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.657896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:51:31.663467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for user 09d32c08216a4035907c888a3c8cd70f and project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:51:31.665092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.665619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.666568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.667067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.677609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:51:31.680006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:51:31.729289 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88026e83-4abb-48b3-873a-efed8bd0d072 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671627 Dec 18 20:51:31.730562 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 715/1464] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:51:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:51:31.736183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:31.736889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:31.756016 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2af62556-5865-48bf-a4a0-dbc91149c956 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c?user_id=efcce724748d44089fd96d2e8f669512" status: 200 len: 240 microversion: 2.36 time: 0.357467 Dec 18 20:51:31.756981 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 750/1465] 10.222.0.13 () {62 vars in 1383 bytes} [Sat Dec 18 20:51:31 2021] PUT /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c?user_id=efcce724748d44089fd96d2e8f669512 => generated 240 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:31.757376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.759805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.760628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.761078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.762845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:31.763946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:31.772267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.773002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.774782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.779027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.807714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:31.826070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:31.826956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:31.827632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lazy-loading 'fault' on Instance uuid e09b99ef-8148-405f-a61a-3cbebb685678 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:51:31.905309 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4b532971-4466-4ffc-9f40-03737fe034fd tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 204 len: 0 microversion: 2.1 time: 0.172862 Dec 18 20:51:31.908912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf273e7f6d646c4a6c46bc7a197c6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260f5423c9c44b499073e360e0e66264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:31.909618 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 716/1466] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:31 2021] DELETE /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:31.914749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-474ed2c2-44d2-470f-a80d-11425a9a345f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:31.915719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-474ed2c2-44d2-470f-a80d-11425a9a345f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:31.923146 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a52e854-d7e8-44b7-be35-dbb551f92f71 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 200 len: 1302 microversion: 2.1 time: 0.164945 Dec 18 20:51:31.923730 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 751/1467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:31 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:31.936937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57594289-6ea1-4928-9b77-1b4850dbcf88 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Calling method '.version_select at 0x7f714fd82b80>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:32.019304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-474ed2c2-44d2-470f-a80d-11425a9a345f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:32.037234 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-474ed2c2-44d2-470f-a80d-11425a9a345f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1213 microversion: 2.1 time: 0.128338 Dec 18 20:51:32.037824 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 717/1468] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:31 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:32.054358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:32.056039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:32.072044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.072549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.073369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.073798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.076170 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57594289-6ea1-4928-9b77-1b4850dbcf88 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c?user_id=efcce724748d44089fd96d2e8f669512" status: 200 len: 282 microversion: 2.36 time: 0.148285 Dec 18 20:51:32.076786 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 752/1469] 10.222.0.13 () {60 vars in 1363 bytes} [Sat Dec 18 20:51:31 2021] GET /compute/v2.1/os-quota-sets/990335d293cf442680060ab40558015c?user_id=efcce724748d44089fd96d2e8f669512 => generated 282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:32.081300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:32.082123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:32.089352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.090643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.091670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.092363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.310856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:32.314819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:32.325767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6d56478d-36a9-4093-822a-3390d5cf0185 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.247753 Dec 18 20:51:32.326374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 753/1470] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:32 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:32.327245 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3b51300-fcb5-43b2-871a-6a207f2f211f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1472 microversion: 2.1 time: 0.288316 Dec 18 20:51:32.337146 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 718/1471] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:32 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1472 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:32.343582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fe4b7e0-a0c3-4f5b-b155-785e08fa4db5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:32.344974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8fe4b7e0-a0c3-4f5b-b155-785e08fa4db5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:32.345284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1eb1779b-9637-4743-826f-50588d79c43f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:32.346286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1eb1779b-9637-4743-826f-50588d79c43f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:32.352540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fe4b7e0-a0c3-4f5b-b155-785e08fa4db5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.353145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fe4b7e0-a0c3-4f5b-b155-785e08fa4db5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.354075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fe4b7e0-a0c3-4f5b-b155-785e08fa4db5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.355533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fe4b7e0-a0c3-4f5b-b155-785e08fa4db5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.360891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eb1779b-9637-4743-826f-50588d79c43f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.361349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eb1779b-9637-4743-826f-50588d79c43f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.363884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eb1779b-9637-4743-826f-50588d79c43f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.365265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eb1779b-9637-4743-826f-50588d79c43f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.428235 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1eb1779b-9637-4743-826f-50588d79c43f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.094240 Dec 18 20:51:32.430530 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fe4b7e0-a0c3-4f5b-b155-785e08fa4db5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.100749 Dec 18 20:51:32.431190 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 754/1472] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:32 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:32.434318 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 719/1473] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:32 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:32.943059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:32.944631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:32.955626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.956202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.957188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:32.957623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:32.977112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7db7c7ea-bcf1-4a95-9475-a288ea91c5c9 req-96c660e6-0ea0-4b8c-a25a-5b79ae69f437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09b99ef-8148-405f-a61a-3cbebb685678", "name": "network-vif-deleted", "tag": "e60078e1-0404-483c-be40-491d5a7ac210"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:32.979464 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:32.979464 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:32.985863 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] HTTP exception thrown: Instance e09b99ef-8148-405f-a61a-3cbebb685678 could not be found. Dec 18 20:51:32.989275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Returning 404 to user: Instance e09b99ef-8148-405f-a61a-3cbebb685678 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:32.990144 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab9e2f91-a768-4e13-a878-cf655dcc5c99 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 404 len: 111 microversion: 2.1 time: 0.053332 Dec 18 20:51:32.996643 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 755/1474] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:32 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:33.007151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7db7c7ea-bcf1-4a95-9475-a288ea91c5c9 req-96c660e6-0ea0-4b8c-a25a-5b79ae69f437 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.007598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7db7c7ea-bcf1-4a95-9475-a288ea91c5c9 req-96c660e6-0ea0-4b8c-a25a-5b79ae69f437 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.020242 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7db7c7ea-bcf1-4a95-9475-a288ea91c5c9 req-96c660e6-0ea0-4b8c-a25a-5b79ae69f437 service nova] Creating event network-vif-deleted:e60078e1-0404-483c-be40-491d5a7ac210 for instance e09b99ef-8148-405f-a61a-3cbebb685678 on nch2-master-1 Dec 18 20:51:33.025233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7db7c7ea-bcf1-4a95-9475-a288ea91c5c9 req-96c660e6-0ea0-4b8c-a25a-5b79ae69f437 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052107 Dec 18 20:51:33.030034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 720/1475] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:51:33.055652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:33.057405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:33.067594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.068524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.069641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.070951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.158158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:33.172958 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af12677b-bb8f-41ce-beca-2f03d8b7ccb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1273 microversion: 2.1 time: 0.120847 Dec 18 20:51:33.173761 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 756/1476] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:33 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:33.345007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:33.345411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:33.346383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:33.347208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:33.354687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.355528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.357004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.357663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.359650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.360165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.361067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.361478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.729303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:33.739765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:33.741481 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d0f7b2df-5168-43e6-926a-2849eb240bfa tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.401787 Dec 18 20:51:33.754944 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 721/1477] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:33 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:33.755281 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5142e03b-fac8-4a4d-a86f-6addfff15788 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1472 microversion: 2.1 time: 0.409596 Dec 18 20:51:33.761036 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 757/1478] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:33 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:33.767258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6b189fe-516f-40d1-9e72-cc192e8e32fb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:33.768393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6b189fe-516f-40d1-9e72-cc192e8e32fb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:33.776680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6b189fe-516f-40d1-9e72-cc192e8e32fb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.777398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6b189fe-516f-40d1-9e72-cc192e8e32fb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.778406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6b189fe-516f-40d1-9e72-cc192e8e32fb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.778772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3d4b7cd-220e-4173-8c4a-87b83bbb6b83 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:33.779179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6b189fe-516f-40d1-9e72-cc192e8e32fb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.784164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3d4b7cd-220e-4173-8c4a-87b83bbb6b83 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:33.803503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4b7cd-220e-4173-8c4a-87b83bbb6b83 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.803960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4b7cd-220e-4173-8c4a-87b83bbb6b83 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.804766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4b7cd-220e-4173-8c4a-87b83bbb6b83 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:33.805201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4b7cd-220e-4173-8c4a-87b83bbb6b83 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:33.840051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6b189fe-516f-40d1-9e72-cc192e8e32fb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.075788 Dec 18 20:51:33.841528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 758/1479] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:33 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:33.917396 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3d4b7cd-220e-4173-8c4a-87b83bbb6b83 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.151245 Dec 18 20:51:33.922020 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 722/1480] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:33 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:34.195263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:34.196740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:34.213274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:34.215998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:34.221331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:34.222042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:34.441478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:34.456393 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26dd5e92-c0d6-4d05-9906-a24b6a8183ef tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1271 microversion: 2.1 time: 0.267317 Dec 18 20:51:34.457272 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 759/1481] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:34 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:34.762958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:34.763665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:34.770748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:34.771714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:34.772871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:34.773330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:34.774327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:34.786112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:34.788161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:34.790092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:34.791961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:34.792443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:34.901310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:34.904221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:34.906476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lazy-loading 'fault' on Instance uuid 5d26953e-4ddb-4f0b-85a1-3de0ae36401f {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:51:35.016376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:35.029000 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a45d20a8-9cfa-48fd-aab2-3d0e2a8eb459 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 200 len: 1306 microversion: 2.1 time: 0.262420 Dec 18 20:51:35.030667 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 760/1482] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:34 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 1306 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:35.047823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c37f85d0-ba92-472e-9a5e-a79daa3ca71e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:35.050012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c37f85d0-ba92-472e-9a5e-a79daa3ca71e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:35.070367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c37f85d0-ba92-472e-9a5e-a79daa3ca71e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:35.071110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c37f85d0-ba92-472e-9a5e-a79daa3ca71e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:35.072410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c37f85d0-ba92-472e-9a5e-a79daa3ca71e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:35.074002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c37f85d0-ba92-472e-9a5e-a79daa3ca71e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:35.137490 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c37f85d0-ba92-472e-9a5e-a79daa3ca71e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.099635 Dec 18 20:51:35.138645 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 761/1483] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:35 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:35.146024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d86d78f8-3a35-43a9-9761-9b0e66e4afaf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:35.147155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d86d78f8-3a35-43a9-9761-9b0e66e4afaf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:35.160268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d86d78f8-3a35-43a9-9761-9b0e66e4afaf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:35.161328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d86d78f8-3a35-43a9-9761-9b0e66e4afaf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:35.162492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d86d78f8-3a35-43a9-9761-9b0e66e4afaf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:35.163149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d86d78f8-3a35-43a9-9761-9b0e66e4afaf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:35.267571 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d86d78f8-3a35-43a9-9761-9b0e66e4afaf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.126818 Dec 18 20:51:35.268292 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 762/1484] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:35 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:35.289112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f88cfb5c-ba3e-43ac-922a-2113053e34d6 req-fd79f577-32a7-4617-ae9e-63361ec6410c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d26953e-4ddb-4f0b-85a1-3de0ae36401f", "name": "network-vif-deleted", "tag": "1989df78-5575-43d1-8748-79a640639e11"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:35.292962 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:35.292962 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:35.315233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f88cfb5c-ba3e-43ac-922a-2113053e34d6 req-fd79f577-32a7-4617-ae9e-63361ec6410c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:35.315692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f88cfb5c-ba3e-43ac-922a-2113053e34d6 req-fd79f577-32a7-4617-ae9e-63361ec6410c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:35.362504 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f88cfb5c-ba3e-43ac-922a-2113053e34d6 req-fd79f577-32a7-4617-ae9e-63361ec6410c service nova] Creating event network-vif-deleted:1989df78-5575-43d1-8748-79a640639e11 for instance 5d26953e-4ddb-4f0b-85a1-3de0ae36401f on nch2-master-1 Dec 18 20:51:35.367729 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f88cfb5c-ba3e-43ac-922a-2113053e34d6 req-fd79f577-32a7-4617-ae9e-63361ec6410c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094636 Dec 18 20:51:35.377865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:35.378657 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 763/1485] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:35.388516 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2686bd2b-f066-4928-903d-1ae3eb4efb1d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.627990 Dec 18 20:51:35.391648 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 723/1486] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:34 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:35.477812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:35.479689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:35.492629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:35.493009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:35.493831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:35.498724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:35.827173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:35.836247 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4c4a718-00e0-418c-8e94-61f16fecd7ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1313 microversion: 2.1 time: 0.365117 Dec 18 20:51:35.840411 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 764/1487] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:35 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:36.048789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:36.051540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5d26953e-4ddb-4f0b-85a1-3de0ae36401f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:36.060732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.061701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.062858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.063573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.094403 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance 5d26953e-4ddb-4f0b-85a1-3de0ae36401f could not be found. Dec 18 20:51:36.095450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance 5d26953e-4ddb-4f0b-85a1-3de0ae36401f could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:36.100331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-43a2ed8d-642d-4b04-8dc0-1127de85da6e tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f" status: 404 len: 111 microversion: 2.1 time: 0.055959 Dec 18 20:51:36.101579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 724/1488] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:36 2021] GET /compute/v2.1/servers/5d26953e-4ddb-4f0b-85a1-3de0ae36401f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:36.110553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:36.111509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:36.139214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.140412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.142399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.145192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.149899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-356de9d1-1d7a-4d79-9a6b-3092774dc42d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:36.151095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-356de9d1-1d7a-4d79-9a6b-3092774dc42d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:36.161435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-356de9d1-1d7a-4d79-9a6b-3092774dc42d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.163953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-356de9d1-1d7a-4d79-9a6b-3092774dc42d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.164808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-356de9d1-1d7a-4d79-9a6b-3092774dc42d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.165264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-356de9d1-1d7a-4d79-9a6b-3092774dc42d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.224047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:36.257821 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-356de9d1-1d7a-4d79-9a6b-3092774dc42d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.111965 Dec 18 20:51:36.262942 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 725/1489] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:36 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:36.288559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56b99833-6bab-4bc7-8c06-7bc62b139d24 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:36.292125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56b99833-6bab-4bc7-8c06-7bc62b139d24 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:36.321196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56b99833-6bab-4bc7-8c06-7bc62b139d24 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.323726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56b99833-6bab-4bc7-8c06-7bc62b139d24 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.331783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56b99833-6bab-4bc7-8c06-7bc62b139d24 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.332247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56b99833-6bab-4bc7-8c06-7bc62b139d24 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.421922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56b99833-6bab-4bc7-8c06-7bc62b139d24 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.145394 Dec 18 20:51:36.423391 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 726/1490] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:36 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:36.426138 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6718252-f5d6-4abd-a55a-6fc5141150c2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 204 len: 0 microversion: 2.1 time: 0.320259 Dec 18 20:51:36.427190 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 765/1491] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:36 2021] DELETE /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:36.436057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:36.437061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:36.439650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:36.440446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:36.454151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.455593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.456939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.457422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.459103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.459446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:36.459574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:36.460722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.113481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:37.125320 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8069edc3-fbda-4732-ae62-2151f2e299a6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.700366 Dec 18 20:51:37.127886 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 727/1492] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:36 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:37.144949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8c05f761-1565-4de1-8dbc-3ef37e378a3b req-0fe88a67-276a-4647-b763-7f325d87b047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3", "tag": "209a1be9-0f3f-4756-8361-ca32f4b7d826"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:37.149072 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:37.149072 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:37.158963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:37.166964 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b261a84b-47c6-49cb-a0f0-9c3fc0f84c23 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1472 microversion: 2.1 time: 0.735475 Dec 18 20:51:37.171978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8c05f761-1565-4de1-8dbc-3ef37e378a3b req-0fe88a67-276a-4647-b763-7f325d87b047 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.172815 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 766/1493] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:36 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1472 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:37.177793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:37.178332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8c05f761-1565-4de1-8dbc-3ef37e378a3b req-0fe88a67-276a-4647-b763-7f325d87b047 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.178465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:37.199142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.199606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.200425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.200873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.205822 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8c05f761-1565-4de1-8dbc-3ef37e378a3b req-0fe88a67-276a-4647-b763-7f325d87b047 service nova] Creating event network-changed:209a1be9-0f3f-4756-8361-ca32f4b7d826 for instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 on nch1-master-1 Dec 18 20:51:37.222118 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8c05f761-1565-4de1-8dbc-3ef37e378a3b req-0fe88a67-276a-4647-b763-7f325d87b047 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092911 Dec 18 20:51:37.223427 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 728/1494] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:37.275909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5040ef0e-bd9c-4cb5-a415-e1f32ce4365d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:37.278160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5040ef0e-bd9c-4cb5-a415-e1f32ce4365d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:37.296943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5040ef0e-bd9c-4cb5-a415-e1f32ce4365d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.297416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5040ef0e-bd9c-4cb5-a415-e1f32ce4365d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.301715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5040ef0e-bd9c-4cb5-a415-e1f32ce4365d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.302212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5040ef0e-bd9c-4cb5-a415-e1f32ce4365d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.392057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5040ef0e-bd9c-4cb5-a415-e1f32ce4365d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.122855 Dec 18 20:51:37.393007 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 729/1495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:37 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:37.436197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7aaef7a0-a316-49ae-92f5-8245f5aaf668 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:37.447780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7aaef7a0-a316-49ae-92f5-8245f5aaf668 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:37.448456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:37.458722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66476037-c096-4211-94fe-4469ce9bb43c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1313 microversion: 2.1 time: 0.284262 Dec 18 20:51:37.459875 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 767/1496] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:37 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:37.468528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aaef7a0-a316-49ae-92f5-8245f5aaf668 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.469552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aaef7a0-a316-49ae-92f5-8245f5aaf668 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.470716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aaef7a0-a316-49ae-92f5-8245f5aaf668 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.471323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aaef7a0-a316-49ae-92f5-8245f5aaf668 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.483636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:37.484429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:37.490850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.491528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.492537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.493145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.510368 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] HTTP exception thrown: Instance e09b99ef-8148-405f-a61a-3cbebb685678 could not be found. Dec 18 20:51:37.510972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Returning 404 to user: Instance e09b99ef-8148-405f-a61a-3cbebb685678 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:37.511847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da1c147a-b1d0-4bb4-a8f8-34776bc0bda1 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 404 len: 111 microversion: 2.1 time: 0.032512 Dec 18 20:51:37.512482 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 768/1497] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:37 2021] DELETE /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:37.523257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:37.523874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: e09b99ef-8148-405f-a61a-3cbebb685678] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:37.532898 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7aaef7a0-a316-49ae-92f5-8245f5aaf668 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.101610 Dec 18 20:51:37.533422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.534143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.534789 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 730/1498] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:37 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:37.536167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.536611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.555013 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] HTTP exception thrown: Instance e09b99ef-8148-405f-a61a-3cbebb685678 could not be found. Dec 18 20:51:37.555887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Returning 404 to user: Instance e09b99ef-8148-405f-a61a-3cbebb685678 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:37.557042 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fb79306-1eac-4b4d-a2b1-f0ea78c845b8 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678" status: 404 len: 111 microversion: 2.1 time: 0.039588 Dec 18 20:51:37.558154 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 769/1499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:37 2021] GET /compute/v2.1/servers/e09b99ef-8148-405f-a61a-3cbebb685678 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:37.567620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:37.568224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:37.576306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.576839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.577749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.578289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.594820 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] HTTP exception thrown: Instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 could not be found. Dec 18 20:51:37.595508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Returning 404 to user: Instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:37.596596 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-949a606c-20ba-4886-b3bf-82e0a50230ae tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 404 len: 111 microversion: 2.1 time: 0.034233 Dec 18 20:51:37.597667 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 731/1500] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:37 2021] DELETE /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:51:37.606874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:37.607758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] [instance: bb5635b3-c81d-4517-9630-bfa0ee6598f1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:37.615329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.615799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.616606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:37.617194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:37.634602 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] HTTP exception thrown: Instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 could not be found. Dec 18 20:51:37.635213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] Returning 404 to user: Instance bb5635b3-c81d-4517-9630-bfa0ee6598f1 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:37.636338 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9023f32-3e71-4be4-98c4-ab40850e7919 tempest-ServersTestMultiNic-1194603688 tempest-ServersTestMultiNic-1194603688-project] 10.222.0.13 "GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1" status: 404 len: 111 microversion: 2.1 time: 0.034320 Dec 18 20:51:37.637901 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 770/1501] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:37 2021] GET /compute/v2.1/servers/bb5635b3-c81d-4517-9630-bfa0ee6598f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:38.145382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:38.146184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:38.160734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.163651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:38.166835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.167341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:38.189050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:38.189671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:38.207000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.207300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:38.208115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.208557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:38.508345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:38.520024 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-95a80ec2-3786-4f39-95d1-f4b3e2bb09fd tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.379867 Dec 18 20:51:38.523400 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 732/1502] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:38 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:38.774651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:38.785475 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-228e614b-b616-430d-8837-12efdc1ea08f tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 200 len: 1472 microversion: 2.1 time: 0.599980 Dec 18 20:51:38.786921 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 771/1503] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:38 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 1472 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:38.795603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4123f5c4-ce7f-47f7-a077-f287e2ff9870 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:38.798143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4123f5c4-ce7f-47f7-a077-f287e2ff9870 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:38.811493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4123f5c4-ce7f-47f7-a077-f287e2ff9870 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.812330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4123f5c4-ce7f-47f7-a077-f287e2ff9870 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:38.813479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4123f5c4-ce7f-47f7-a077-f287e2ff9870 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.814624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4123f5c4-ce7f-47f7-a077-f287e2ff9870 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:38.908349 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4123f5c4-ce7f-47f7-a077-f287e2ff9870 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.119426 Dec 18 20:51:38.914155 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 772/1504] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:38 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:38.926277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:38.927005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:38.927903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1553739261", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:38.939975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.942732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:38.943647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:38.946721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:39.029451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:51:39.870198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:39.883295 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7a8897d-68ef-40e8-958c-e48cfa3fb0ea tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1313 microversion: 2.1 time: 0.967160 Dec 18 20:51:39.894029 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 773/1505] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:38 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1313 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:39.899607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a7e9ff2-a547-418e-a6a8-077efd23bbc3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:39.904832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0a7e9ff2-a547-418e-a6a8-077efd23bbc3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:39.917310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a7e9ff2-a547-418e-a6a8-077efd23bbc3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:39.917803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a7e9ff2-a547-418e-a6a8-077efd23bbc3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:39.918661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a7e9ff2-a547-418e-a6a8-077efd23bbc3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:39.919093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a7e9ff2-a547-418e-a6a8-077efd23bbc3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:39.967346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:51:39.968507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:51:39.969395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:51:39.970474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:51:39.971238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:51:39.982106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:39.982838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:39.984606 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a7e9ff2-a547-418e-a6a8-077efd23bbc3 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.088375 Dec 18 20:51:39.984928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:39.985596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:39.992280 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 774/1506] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:39 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:39.998074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-efc5e761-077e-431b-8983-cd5f54141d43 req-dc7900cd-5987-4bde-b941-7536bafa3b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a40f995-3ddb-44b8-a4d1-51aac21ae695", "name": "network-vif-deleted", "tag": "0b9441be-b2da-4416-9591-960ff551886a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:39.999618 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:39.999618 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:40.013553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Getting quotas for project 09f464a0dbea408cb3f43c2c96bdaaac. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:51:40.019880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Getting quotas for user ca309394563d45ea9b911c14c5f7625f and project 09f464a0dbea408cb3f43c2c96bdaaac. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:51:40.020289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-efc5e761-077e-431b-8983-cd5f54141d43 req-dc7900cd-5987-4bde-b941-7536bafa3b6f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.022078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-efc5e761-077e-431b-8983-cd5f54141d43 req-dc7900cd-5987-4bde-b941-7536bafa3b6f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.041926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:51:40.045028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:51:40.045480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-efc5e761-077e-431b-8983-cd5f54141d43 req-dc7900cd-5987-4bde-b941-7536bafa3b6f service nova] Creating event network-vif-deleted:0b9441be-b2da-4416-9591-960ff551886a for instance 5a40f995-3ddb-44b8-a4d1-51aac21ae695 on nch1-master-1 Dec 18 20:51:40.052952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-efc5e761-077e-431b-8983-cd5f54141d43 req-dc7900cd-5987-4bde-b941-7536bafa3b6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059165 Dec 18 20:51:40.055356 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 775/1507] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:40.066514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:40.067567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:40.076638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.077339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.079214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.080467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.152341 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf5bb8f3-ea9e-4a45-b37d-d9cd82d57049 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.627653 Dec 18 20:51:40.153785 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 733/1508] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:51:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:51:40.183854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:40.184785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5a40f995-3ddb-44b8-a4d1-51aac21ae695] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:40.193943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.194433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.195376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.195663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.221245 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance 5a40f995-3ddb-44b8-a4d1-51aac21ae695 could not be found. Dec 18 20:51:40.221918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance 5a40f995-3ddb-44b8-a4d1-51aac21ae695 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:40.225694 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-558fe555-96a4-44f7-a7e7-8f007e99a3ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695" status: 404 len: 111 microversion: 2.1 time: 0.070878 Dec 18 20:51:40.227498 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 734/1509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:40 2021] GET /compute/v2.1/servers/5a40f995-3ddb-44b8-a4d1-51aac21ae695 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:40.237572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c7913367-3007-4432-809a-428d46b46aed tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:40.238579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c7913367-3007-4432-809a-428d46b46aed tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:40.247360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7913367-3007-4432-809a-428d46b46aed tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.247817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7913367-3007-4432-809a-428d46b46aed tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.248621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7913367-3007-4432-809a-428d46b46aed tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.249072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7913367-3007-4432-809a-428d46b46aed tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.321984 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c7913367-3007-4432-809a-428d46b46aed tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.092675 Dec 18 20:51:40.325980 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 735/1510] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:40 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:40.331502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:40.332699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:40.346367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.346816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.347618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.351035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.387308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:40.399827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:40.408728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-651af21c-96d1-487b-8a21-8f124e19fad6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.347668 Dec 18 20:51:40.412941 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 776/1511] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:40 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:40.421843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2077475624", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:40.496004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:51:40.591641 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0fc3a477-9a11-45a0-8b00-b56c3dc768c8 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 204 len: 0 microversion: 2.1 time: 0.266211 Dec 18 20:51:40.596123 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 736/1512] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:40 2021] DELETE /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:40.608684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:40.609410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:40.631966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.633298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:40.635711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:40.636833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.055876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:51:41.057124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:51:41.057796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:51:41.058466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:51:41.059120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:51:41.079757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:41.090570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.093440 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9808f4f2-1809-4f69-95e3-d9c0e07b6839 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1472 microversion: 2.1 time: 0.491457 Dec 18 20:51:41.094965 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 737/1513] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:40 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1472 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:41.097542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.099299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.099930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.116968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:41.119781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:41.136070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.142281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.143329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.144086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.167461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Getting quotas for project 09f464a0dbea408cb3f43c2c96bdaaac. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:51:41.180262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Getting quotas for user ca309394563d45ea9b911c14c5f7625f and project 09f464a0dbea408cb3f43c2c96bdaaac. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:51:41.218489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:51:41.224454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:51:41.300209 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1acb4e8-692e-4f68-be66-9c77a4287755 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885530 Dec 18 20:51:41.303518 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 777/1514] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:51:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:51:41.330970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1a25da7-36f9-484f-925d-6d21f9323c1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:41.333268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1a25da7-36f9-484f-925d-6d21f9323c1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:41.348978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1a25da7-36f9-484f-925d-6d21f9323c1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.349813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1a25da7-36f9-484f-925d-6d21f9323c1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.350918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1a25da7-36f9-484f-925d-6d21f9323c1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.352453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1a25da7-36f9-484f-925d-6d21f9323c1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.407215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1a25da7-36f9-484f-925d-6d21f9323c1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.101714 Dec 18 20:51:41.412583 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 778/1515] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:41 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:41.419279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-10e6f688-c13b-4f60-a3ee-cb243b3b117b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:41.420402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-10e6f688-c13b-4f60-a3ee-cb243b3b117b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:41.545202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-10e6f688-c13b-4f60-a3ee-cb243b3b117b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:41.560518 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-10e6f688-c13b-4f60-a3ee-cb243b3b117b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1214 microversion: 2.1 time: 0.145900 Dec 18 20:51:41.565155 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 779/1516] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:41 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:41.577431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3fdbf2f9-3849-4f8c-bf01-5dcee57cd3ef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:41.584839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:41.585010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3fdbf2f9-3849-4f8c-bf01-5dcee57cd3ef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:41.594528 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c4e7802c-9ac6-4417-8166-639ed23c3f52 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1313 microversion: 2.1 time: 0.497830 Dec 18 20:51:41.595112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 738/1517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:41 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:41.600543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fdbf2f9-3849-4f8c-bf01-5dcee57cd3ef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.601087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:41.601718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fdbf2f9-3849-4f8c-bf01-5dcee57cd3ef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.603274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:41.604020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fdbf2f9-3849-4f8c-bf01-5dcee57cd3ef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.604678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fdbf2f9-3849-4f8c-bf01-5dcee57cd3ef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.616482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.616932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.617733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.624211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.677222 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3fdbf2f9-3849-4f8c-bf01-5dcee57cd3ef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.109347 Dec 18 20:51:41.683127 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 780/1518] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:41 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:41.700070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ff9741bc-916e-4069-8bda-0f26a2d779bf req-987087ff-9d1a-4570-80f5-ed3ec837bef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3", "name": "network-vif-plugged", "status": "completed", "tag": "209a1be9-0f3f-4756-8361-ca32f4b7d826"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:41.701974 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:41.701974 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:41.719045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ff9741bc-916e-4069-8bda-0f26a2d779bf req-987087ff-9d1a-4570-80f5-ed3ec837bef1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:41.719795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ff9741bc-916e-4069-8bda-0f26a2d779bf req-987087ff-9d1a-4570-80f5-ed3ec837bef1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:41.783959 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ff9741bc-916e-4069-8bda-0f26a2d779bf req-987087ff-9d1a-4570-80f5-ed3ec837bef1 service nova] Creating event network-vif-plugged:209a1be9-0f3f-4756-8361-ca32f4b7d826 for instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 on nch1-master-1 Dec 18 20:51:41.789298 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ff9741bc-916e-4069-8bda-0f26a2d779bf req-987087ff-9d1a-4570-80f5-ed3ec837bef1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096669 Dec 18 20:51:41.791049 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 781/1519] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:51:42.010736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:42.046142 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f102fd0b-01f8-4362-b6f3-c1c82b59f110 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.448421 Dec 18 20:51:42.065945 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 739/1520] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:41 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:42.117401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:42.118286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:42.131968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.132910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:42.134558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.135692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:42.420531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e0afa66-20fd-4606-95e6-c5dc587d1853 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:42.421759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2e0afa66-20fd-4606-95e6-c5dc587d1853 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:42.434075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e0afa66-20fd-4606-95e6-c5dc587d1853 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.434932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e0afa66-20fd-4606-95e6-c5dc587d1853 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:42.435805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e0afa66-20fd-4606-95e6-c5dc587d1853 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.436314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e0afa66-20fd-4606-95e6-c5dc587d1853 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:42.482429 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2e0afa66-20fd-4606-95e6-c5dc587d1853 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.066328 Dec 18 20:51:42.484085 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 740/1521] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:42 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:42.574024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:42.581336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:42.581933 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b5ce53a-91e8-4fe8-8e93-b7d122f8b61d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1472 microversion: 2.1 time: 0.473319 Dec 18 20:51:42.582480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:42.588712 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 782/1522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:42 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1472 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:42.598643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.599213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:42.600125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.601359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:42.611449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:42.613076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:42.620193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.621503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:42.622628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:42.623334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.220388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:43.228279 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da462ace-489f-4e13-95ee-948c09c96026 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1266 microversion: 2.1 time: 0.650834 Dec 18 20:51:43.237949 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 741/1523] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:42 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1266 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:43.237949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-536d2b1c-9eaf-4910-9c1d-c216137a97d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:43.237949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-536d2b1c-9eaf-4910-9c1d-c216137a97d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:43.242677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-536d2b1c-9eaf-4910-9c1d-c216137a97d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.243464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-536d2b1c-9eaf-4910-9c1d-c216137a97d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.244653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-536d2b1c-9eaf-4910-9c1d-c216137a97d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.245336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-536d2b1c-9eaf-4910-9c1d-c216137a97d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.314347 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-536d2b1c-9eaf-4910-9c1d-c216137a97d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.083630 Dec 18 20:51:43.315709 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 742/1524] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:43 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:43.321946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:43.340294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:43.341438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:43.346361 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4119ed82-346e-4af9-92c0-9b2cd5415dec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1313 microversion: 2.1 time: 0.738632 Dec 18 20:51:43.348222 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 783/1525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:42 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:43.356885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.357646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.358801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.361155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.496777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2339e1e3-48ca-4109-ab09-b61e22e22299 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:43.498593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2339e1e3-48ca-4109-ab09-b61e22e22299 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:43.506576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2339e1e3-48ca-4109-ab09-b61e22e22299 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.507309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2339e1e3-48ca-4109-ab09-b61e22e22299 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.508485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2339e1e3-48ca-4109-ab09-b61e22e22299 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.509435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2339e1e3-48ca-4109-ab09-b61e22e22299 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.564702 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2339e1e3-48ca-4109-ab09-b61e22e22299 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.073056 Dec 18 20:51:43.565360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 784/1526] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:43 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:43.602774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:43.603569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:43.616300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.617670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.618724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.619263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.800662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:43.819961 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b849ddde-afc3-484d-bf98-36030f96e574 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.502777 Dec 18 20:51:43.823745 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 743/1527] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:43 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:43.937381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-40628fb5-923c-48e5-86cb-12dd7e851413 req-beeaf11c-20e9-4966-aabd-0fd26890a239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4e117a-1136-496e-a3b5-98c652ed0f78", "name": "network-vif-deleted", "tag": "4984579f-71f2-49fb-bece-8c1cd12eaebd"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:43.943641 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:43.943641 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:43.953566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-40628fb5-923c-48e5-86cb-12dd7e851413 req-beeaf11c-20e9-4966-aabd-0fd26890a239 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:43.954576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-40628fb5-923c-48e5-86cb-12dd7e851413 req-beeaf11c-20e9-4966-aabd-0fd26890a239 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:43.972316 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-40628fb5-923c-48e5-86cb-12dd7e851413 req-beeaf11c-20e9-4966-aabd-0fd26890a239 service nova] Creating event network-vif-deleted:4984579f-71f2-49fb-bece-8c1cd12eaebd for instance ce4e117a-1136-496e-a3b5-98c652ed0f78 on nch1-master-1 Dec 18 20:51:43.979862 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-40628fb5-923c-48e5-86cb-12dd7e851413 req-beeaf11c-20e9-4966-aabd-0fd26890a239 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077673 Dec 18 20:51:43.981825 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 744/1528] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:44.033859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:44.044319 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ffa9fa3e-6e8d-4695-9f74-b0adb45f15fb tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 200 len: 1472 microversion: 2.1 time: 0.449524 Dec 18 20:51:44.052444 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 785/1529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:43 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 1472 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:44.248606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:44.250536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:44.258449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.259410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.261071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.262774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.329110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba7a740a-1c51-4599-b946-73bde4d18c5f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:44.337634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba7a740a-1c51-4599-b946-73bde4d18c5f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:44.388273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7a740a-1c51-4599-b946-73bde4d18c5f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.390051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7a740a-1c51-4599-b946-73bde4d18c5f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.392423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7a740a-1c51-4599-b946-73bde4d18c5f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.394314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7a740a-1c51-4599-b946-73bde4d18c5f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.457168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:44.470978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96e960ec-a561-4f9d-99d8-d733fdbbc7c1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1272 microversion: 2.1 time: 0.228718 Dec 18 20:51:44.474912 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 745/1530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:44 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:44.487366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:44.488580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:44.499236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.500326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.501543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.502504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.521169 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba7a740a-1c51-4599-b946-73bde4d18c5f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.191864 Dec 18 20:51:44.523102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 786/1531] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:44 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:44.580566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ec0b3843-3a3a-41ef-9290-343186e42e49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:44.582184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ec0b3843-3a3a-41ef-9290-343186e42e49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:44.596028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0b3843-3a3a-41ef-9290-343186e42e49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.596886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0b3843-3a3a-41ef-9290-343186e42e49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.600116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0b3843-3a3a-41ef-9290-343186e42e49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.600850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0b3843-3a3a-41ef-9290-343186e42e49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.656790 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ec0b3843-3a3a-41ef-9290-343186e42e49 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.082694 Dec 18 20:51:44.659268 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 787/1532] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:44 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:44.841115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:44.842416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:44.867562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.869076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:44.872118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:44.875496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.283999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:45.297853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c5bdd12-5b4e-497d-b02e-47876d80360d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1462 microversion: 2.1 time: 0.821803 Dec 18 20:51:45.299149 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 746/1533] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:44 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1462 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:45.305811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:45.306739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: ce4e117a-1136-496e-a3b5-98c652ed0f78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:45.315641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.317007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.318220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.319315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.341391 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance ce4e117a-1136-496e-a3b5-98c652ed0f78 could not be found. Dec 18 20:51:45.343193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance ce4e117a-1136-496e-a3b5-98c652ed0f78 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:45.344068 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09fbdb75-b2e2-4f3f-b6ab-ee2db3fd38cf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78" status: 404 len: 111 microversion: 2.1 time: 0.043725 Dec 18 20:51:45.344964 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 747/1534] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:45 2021] GET /compute/v2.1/servers/ce4e117a-1136-496e-a3b5-98c652ed0f78 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:45.416823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:45.425333 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5119ddd4-3fdf-4a52-86c4-5600b259761f tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.588410 Dec 18 20:51:45.426072 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 788/1535] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:44 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:45.431866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:45.432605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:45.445476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.446222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.448254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.449471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.484884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:45.626686 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53a38fcf-3abc-4f54-911d-c178e9d6a661 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919" status: 204 len: 0 microversion: 2.1 time: 0.198791 Dec 18 20:51:45.634354 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 789/1536] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:45 2021] DELETE /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:45.641233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:45.642074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:45.648638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.649386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.650412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.651105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.801694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1aaf289-33bf-4e6d-a9dc-27edd8269d79 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:45.803512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1aaf289-33bf-4e6d-a9dc-27edd8269d79 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:45.819953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1aaf289-33bf-4e6d-a9dc-27edd8269d79 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.821588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1aaf289-33bf-4e6d-a9dc-27edd8269d79 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:45.823110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1aaf289-33bf-4e6d-a9dc-27edd8269d79 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:45.825979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1aaf289-33bf-4e6d-a9dc-27edd8269d79 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.278570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:46.289414 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4bdadad1-a25b-44f2-97d9-28f628962b01 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1314 microversion: 2.1 time: 0.653055 Dec 18 20:51:46.290226 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 790/1537] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:45 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:46.295821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d708dd75-97c6-4c2b-8784-2eedff0d4e42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:46.296878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d708dd75-97c6-4c2b-8784-2eedff0d4e42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:46.303650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d708dd75-97c6-4c2b-8784-2eedff0d4e42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.304303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d708dd75-97c6-4c2b-8784-2eedff0d4e42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.305442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d708dd75-97c6-4c2b-8784-2eedff0d4e42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.305930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d708dd75-97c6-4c2b-8784-2eedff0d4e42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.353532 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d708dd75-97c6-4c2b-8784-2eedff0d4e42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.062132 Dec 18 20:51:46.356258 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 791/1538] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:46 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:46.364186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:46.365654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:46.376534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.377260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.378246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.379559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.414460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:46.574974 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c811998-86bb-43e8-b196-b271fdc73912 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 204 len: 0 microversion: 2.1 time: 0.216956 Dec 18 20:51:46.577377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 792/1539] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:46 2021] DELETE /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:46.595592 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d1aaf289-33bf-4e6d-a9dc-27edd8269d79 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1613 microversion: 2.1 time: 1.249562 Dec 18 20:51:46.601810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cf7f8f8-7b62-43cd-b474-96be89be70e7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:46.604555 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 748/1540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:45 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1613 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:46.610808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cf7f8f8-7b62-43cd-b474-96be89be70e7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:46.621269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1510e403-161e-43b8-a014-bdd048a2cf39 req-41ca2495-5d04-4c5e-bc63-928d86d390b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b8477c-e0d4-4c92-ab00-6ff2899911da", "tag": "4b35e620-8957-42f7-a38a-5c515e281514"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:46.628138 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:46.628138 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:46.632032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf7f8f8-7b62-43cd-b474-96be89be70e7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.632504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf7f8f8-7b62-43cd-b474-96be89be70e7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.633360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf7f8f8-7b62-43cd-b474-96be89be70e7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.633746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf7f8f8-7b62-43cd-b474-96be89be70e7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.646622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1510e403-161e-43b8-a014-bdd048a2cf39 req-41ca2495-5d04-4c5e-bc63-928d86d390b1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.648123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1510e403-161e-43b8-a014-bdd048a2cf39 req-41ca2495-5d04-4c5e-bc63-928d86d390b1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.666399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1510e403-161e-43b8-a014-bdd048a2cf39 req-41ca2495-5d04-4c5e-bc63-928d86d390b1 service nova] Creating event network-changed:4b35e620-8957-42f7-a38a-5c515e281514 for instance 15b8477c-e0d4-4c92-ab00-6ff2899911da on nch2-master-1 Dec 18 20:51:46.678108 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1510e403-161e-43b8-a014-bdd048a2cf39 req-41ca2495-5d04-4c5e-bc63-928d86d390b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071877 Dec 18 20:51:46.680095 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 749/1541] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:46.691271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:46.693388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:46.700748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.701402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.703194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.703931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.731662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cf7f8f8-7b62-43cd-b474-96be89be70e7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.152387 Dec 18 20:51:46.737256 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 793/1542] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:46 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:46.747314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:46.749614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:46.759730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.761554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:46.763072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:46.763743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.059419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:47.078807 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e148ff5-2e89-4005-b1e9-508f369b47b3 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919" status: 200 len: 1473 microversion: 2.1 time: 0.336543 Dec 18 20:51:47.079402 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 794/1543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:46 2021] GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919 => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:47.084038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:47.084612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:47.103891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.104347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.105379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.105979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.158981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f2372afe520416386d5e961633ba6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc853b43346c4b80a888930d782d7bbc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:47.159901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] flavor_id is None. Assuming migration. {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 18 20:51:47.160535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 20:51:47.210504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:47.232912 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82a8fa29-63ac-47f3-a680-7b388fdc24dc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.551183 Dec 18 20:51:47.234009 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 750/1544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:46 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:47.244136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7d819b48-2bf9-42c3-ad77-c81ab94b6e85 req-7e9f8c50-fab9-4f2e-ad08-af1eb578fa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d00b730-00ba-4bc7-be51-6de9d571a1b2", "tag": "659424cb-2544-4eb1-afc7-8c764a75b399"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:47.246506 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:47.246506 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:47.260958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7d819b48-2bf9-42c3-ad77-c81ab94b6e85 req-7e9f8c50-fab9-4f2e-ad08-af1eb578fa17 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.265056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7d819b48-2bf9-42c3-ad77-c81ab94b6e85 req-7e9f8c50-fab9-4f2e-ad08-af1eb578fa17 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.284496 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7d819b48-2bf9-42c3-ad77-c81ab94b6e85 req-7e9f8c50-fab9-4f2e-ad08-af1eb578fa17 service nova] Creating event network-changed:659424cb-2544-4eb1-afc7-8c764a75b399 for instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 on nch2-master-1 Dec 18 20:51:47.301257 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7d819b48-2bf9-42c3-ad77-c81ab94b6e85 req-7e9f8c50-fab9-4f2e-ad08-af1eb578fa17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062377 Dec 18 20:51:47.302774 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 751/1545] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:47.321112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:47.322405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:47.329752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.330438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.331397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.332026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.679842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:47.696086 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b673b89c-d18a-4292-8eeb-f622f3ad8e20 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1314 microversion: 2.1 time: 0.389584 Dec 18 20:51:47.707632 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 752/1546] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:47 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:47.722589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b78fb945-db98-4e97-8982-b0b4046c4dba tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:47.725586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b78fb945-db98-4e97-8982-b0b4046c4dba tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:47.746131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fb945-db98-4e97-8982-b0b4046c4dba tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.746612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fb945-db98-4e97-8982-b0b4046c4dba tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.747423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fb945-db98-4e97-8982-b0b4046c4dba tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.747871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fb945-db98-4e97-8982-b0b4046c4dba tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.820345 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf7e4869-a0aa-4ae1-bd7b-702a2d661aed tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3/action" status: 202 len: 0 microversion: 2.1 time: 0.739486 Dec 18 20:51:47.825783 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 795/1547] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:47 2021] POST /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:51:47.832449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-035f315d-762c-4ace-acb7-06fc15a4f7ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:47.833551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-035f315d-762c-4ace-acb7-06fc15a4f7ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:47.842766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-035f315d-762c-4ace-acb7-06fc15a4f7ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.843304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-035f315d-762c-4ace-acb7-06fc15a4f7ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.844350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-035f315d-762c-4ace-acb7-06fc15a4f7ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.845647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-035f315d-762c-4ace-acb7-06fc15a4f7ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.876163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b78fb945-db98-4e97-8982-b0b4046c4dba tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.166741 Dec 18 20:51:47.881725 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 753/1548] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:47 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:47.889966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:47.890728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:47.903942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.904975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:47.907579 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-035f315d-762c-4ace-acb7-06fc15a4f7ea tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.075933 Dec 18 20:51:47.907728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:47.907832 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 796/1549] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:47 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:47.907947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:48.096940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:48.099729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:48.108878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:48.109685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:48.110738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:48.111388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:48.500253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:48.508107 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b16fea5a-05fe-498a-9420-a688db471ef4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1471 microversion: 2.1 time: 0.624804 Dec 18 20:51:48.515030 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 754/1550] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:47 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1471 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:48.519977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:48.523638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:48.540850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:48.541577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:48.543177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:48.543839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:48.996853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:49.009732 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0dc0fc7-f037-4fe8-9846-b5f7ede2d084 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919" status: 200 len: 1473 microversion: 2.1 time: 0.915699 Dec 18 20:51:49.022627 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 797/1551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:48 2021] GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919 => generated 1473 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:49.301021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d6712d99-ce3a-4016-8ae9-9f9952317e75 req-a8bbd6b2-6507-47b9-972d-857c78405a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edea04e-2c27-4be2-a3b4-1ec34f70c3ed", "name": "network-vif-deleted", "tag": "d2ee6d32-7b4d-4339-825e-0c4db2f8ee5c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:49.303315 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:49.303315 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:49.330925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d6712d99-ce3a-4016-8ae9-9f9952317e75 req-a8bbd6b2-6507-47b9-972d-857c78405a0a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.331636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d6712d99-ce3a-4016-8ae9-9f9952317e75 req-a8bbd6b2-6507-47b9-972d-857c78405a0a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.347186 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d6712d99-ce3a-4016-8ae9-9f9952317e75 req-a8bbd6b2-6507-47b9-972d-857c78405a0a service nova] Creating event network-vif-deleted:d2ee6d32-7b4d-4339-825e-0c4db2f8ee5c for instance 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed on nch1-master-1 Dec 18 20:51:49.354868 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d6712d99-ce3a-4016-8ae9-9f9952317e75 req-a8bbd6b2-6507-47b9-972d-857c78405a0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328910 Dec 18 20:51:49.355802 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 798/1552] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:49.363374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:49.364484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:49.373652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.387555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.391831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.392713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.439655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:49.457426 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abee749d-8d70-499c-a2be-4dfe00fc29af tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1523 microversion: 2.1 time: 0.939124 Dec 18 20:51:49.460217 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 755/1553] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:48 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1523 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:49.472489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5d3da6cc-a254-4c9e-9ce4-0cb1e4b3ac36 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:49.476272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5d3da6cc-a254-4c9e-9ce4-0cb1e4b3ac36 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:49.494060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3da6cc-a254-4c9e-9ce4-0cb1e4b3ac36 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.496797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3da6cc-a254-4c9e-9ce4-0cb1e4b3ac36 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.503758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3da6cc-a254-4c9e-9ce4-0cb1e4b3ac36 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.505632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3da6cc-a254-4c9e-9ce4-0cb1e4b3ac36 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.579676 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5d3da6cc-a254-4c9e-9ce4-0cb1e4b3ac36 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.116088 Dec 18 20:51:49.580585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 756/1554] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:49 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:49.587535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-79a9f5cb-2481-48e7-8d11-e4626f7ad4a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:49.591990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-79a9f5cb-2481-48e7-8d11-e4626f7ad4a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:49.610194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79a9f5cb-2481-48e7-8d11-e4626f7ad4a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.611231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79a9f5cb-2481-48e7-8d11-e4626f7ad4a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.614155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79a9f5cb-2481-48e7-8d11-e4626f7ad4a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.615175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79a9f5cb-2481-48e7-8d11-e4626f7ad4a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.733499 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-79a9f5cb-2481-48e7-8d11-e4626f7ad4a2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.151371 Dec 18 20:51:49.742781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 757/1555] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:49 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:49.756276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a57ce8b4-bd16-48b0-a9b3-d5f0f3b23c32 req-16794dc5-f0cf-4189-918e-9b8417ed8c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cadd365-eceb-4a91-93b6-4514be9ac919", "name": "network-vif-deleted", "tag": "54506b4b-7281-4b1a-9497-d7ae5def715f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:49.757898 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:49.757898 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:49.776235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a57ce8b4-bd16-48b0-a9b3-d5f0f3b23c32 req-16794dc5-f0cf-4189-918e-9b8417ed8c87 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.776845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a57ce8b4-bd16-48b0-a9b3-d5f0f3b23c32 req-16794dc5-f0cf-4189-918e-9b8417ed8c87 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.804500 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a57ce8b4-bd16-48b0-a9b3-d5f0f3b23c32 req-16794dc5-f0cf-4189-918e-9b8417ed8c87 service nova] Creating event network-vif-deleted:54506b4b-7281-4b1a-9497-d7ae5def715f for instance 6cadd365-eceb-4a91-93b6-4514be9ac919 on nch2-master-1 Dec 18 20:51:49.819225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:49.829888 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a57ce8b4-bd16-48b0-a9b3-d5f0f3b23c32 req-16794dc5-f0cf-4189-918e-9b8417ed8c87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078237 Dec 18 20:51:49.832182 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5380b4b8-3808-40c2-bfb1-e0bf53315c16 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1314 microversion: 2.1 time: 0.474956 Dec 18 20:51:49.832888 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 799/1556] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:49 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:49.836267 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 758/1557] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:49.843626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:49.845216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:49.862823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.863437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:49.864387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:49.864934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.030344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.032166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 6cadd365-eceb-4a91-93b6-4514be9ac919] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.038817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.039623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.040749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.041407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.063424 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance 6cadd365-eceb-4a91-93b6-4514be9ac919 could not be found. Dec 18 20:51:50.064357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance 6cadd365-eceb-4a91-93b6-4514be9ac919 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:50.065418 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa2f364c-9283-472a-9e4d-8bae2d84c548 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919" status: 404 len: 111 microversion: 2.1 time: 0.040503 Dec 18 20:51:50.066601 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 759/1558] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:50 2021] GET /compute/v2.1/servers/6cadd365-eceb-4a91-93b6-4514be9ac919 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:51:50.074834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.075833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.085597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.086684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.096641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.099780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.119046 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed could not be found. Dec 18 20:51:50.120004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance 5edea04e-2c27-4be2-a3b4-1ec34f70c3ed could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:50.121249 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2e08416c-b09f-41b8-a435-abafb3b7f129 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed" status: 404 len: 111 microversion: 2.1 time: 0.051024 Dec 18 20:51:50.122374 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 760/1559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:50 2021] GET /compute/v2.1/servers/5edea04e-2c27-4be2-a3b4-1ec34f70c3ed => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:50.131435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:50.132019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2710f05-8dc0-403f-b7cc-5362afa6eacf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.140689 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-965ede00-ad95-4a17-bafd-b4e130ceee3d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1471 microversion: 2.1 time: 0.306624 Dec 18 20:51:50.142845 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 800/1560] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:49 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:50.163998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2710f05-8dc0-403f-b7cc-5362afa6eacf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/0e39aefe-f4e1-48eb-8293-0ba96f3d68a1" status: 204 len: 0 microversion: 2.1 time: 0.037087 Dec 18 20:51:50.164713 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 761/1561] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:51:50 2021] DELETE /compute/v2.1/os-server-groups/0e39aefe-f4e1-48eb-8293-0ba96f3d68a1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:50.176803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.178446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.188819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.189495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.191012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.191960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.226376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:50.336656 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-405b8069-a48f-45f7-81ac-cb6b0819279d tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452" status: 204 len: 0 microversion: 2.1 time: 0.166895 Dec 18 20:51:50.337257 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 801/1562] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:50 2021] DELETE /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:50.345767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.346303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.354764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.355346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.356443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.356992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.387404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:50.477696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.478386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.488523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.488976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.495797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.496454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.509558 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75db637b-5f6b-468d-9d94-6f19629e454b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 204 len: 0 microversion: 2.1 time: 0.167651 Dec 18 20:51:50.511909 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 762/1563] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:50 2021] DELETE /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:50.524036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.527479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.541092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.541771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.545739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.546709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.785109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:50.794233 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-77981c2b-7bdd-49f2-b286-cc36e411bbdc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1500 microversion: 2.1 time: 0.320906 Dec 18 20:51:50.799610 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 802/1564] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:50 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1500 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:50.809772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9c3f234-ca5f-4c20-be39-c5102316d482 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:50.815464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9c3f234-ca5f-4c20-be39-c5102316d482 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.826058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c3f234-ca5f-4c20-be39-c5102316d482 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.826547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c3f234-ca5f-4c20-be39-c5102316d482 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.831547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c3f234-ca5f-4c20-be39-c5102316d482 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.832016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c3f234-ca5f-4c20-be39-c5102316d482 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.886001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:50.899390 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6f22003-2295-47ba-9fe0-4fffc3199cdf tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452" status: 200 len: 1474 microversion: 2.1 time: 0.382492 Dec 18 20:51:50.900437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 763/1565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:50 2021] GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452 => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:50.905644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a62c6e12-4520-4b4c-b36c-5c015cd4e7c2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:50.907001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a62c6e12-4520-4b4c-b36c-5c015cd4e7c2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:50.914508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a62c6e12-4520-4b4c-b36c-5c015cd4e7c2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.914926 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9c3f234-ca5f-4c20-be39-c5102316d482 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.113785 Dec 18 20:51:50.919450 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 803/1566] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:50 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:50.919651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a62c6e12-4520-4b4c-b36c-5c015cd4e7c2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.919651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a62c6e12-4520-4b4c-b36c-5c015cd4e7c2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.919651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a62c6e12-4520-4b4c-b36c-5c015cd4e7c2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.921588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.937037 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:50.937037 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:50.938331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:50.939399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:50.947116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.954512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.955791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:50.956326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:50.973976 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a62c6e12-4520-4b4c-b36c-5c015cd4e7c2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.072018 Dec 18 20:51:50.976079 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 764/1567] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:50 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:50.986274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:50.989218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:50.992525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:51.007179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.007893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.009465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.010463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.026973 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01571909-a073-4302-9d50-13b18643b36b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.109347 Dec 18 20:51:51.030371 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 804/1568] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Dec 18 20:51:50 2021] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:51.039785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0092586d-cd0a-43bf-92ca-e619b6ecc396 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:51.047305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0092586d-cd0a-43bf-92ca-e619b6ecc396 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.048147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0092586d-cd0a-43bf-92ca-e619b6ecc396 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.074562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0092586d-cd0a-43bf-92ca-e619b6ecc396 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Going to try to start instance {{(pid=140731) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 20:51:51.157748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0092586d-cd0a-43bf-92ca-e619b6ecc396 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "POST /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc/action" status: 202 len: 0 microversion: 2.1 time: 0.121926 Dec 18 20:51:51.159191 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 805/1569] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:51 2021] POST /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:51:51.170613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:51.173135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:51.194088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.194767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.195676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.196210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.474570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:51.491178 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b566fdc0-bb38-4034-8180-732348900ffe tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1314 microversion: 2.1 time: 0.515058 Dec 18 20:51:51.502838 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 765/1570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:50 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:51.507882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:51.508609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:51.515362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.516901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.518643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.519323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.529490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:51.539549 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1475adcf-f8f7-41f7-a05a-02abb1fa9208 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1471 microversion: 2.1 time: 0.378343 Dec 18 20:51:51.540454 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 806/1571] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:51 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:51.682936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:51.696365 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21390e9e-de6d-483d-87a5-a2cf02dfe5b7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1509 microversion: 2.1 time: 0.192060 Dec 18 20:51:51.697415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 766/1572] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:51 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:51.918500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:51.919119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:51.927511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f869ed98-6add-482a-8884-548df91eade2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:51.928060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.928514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.929087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f869ed98-6add-482a-8884-548df91eade2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:51.929308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.929745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.937193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f869ed98-6add-482a-8884-548df91eade2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.941977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f869ed98-6add-482a-8884-548df91eade2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:51.944260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f869ed98-6add-482a-8884-548df91eade2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:51.946155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f869ed98-6add-482a-8884-548df91eade2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:52.013476 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f869ed98-6add-482a-8884-548df91eade2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.090628 Dec 18 20:51:52.015712 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 767/1573] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:51 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:51:52.021335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2eebfd93-99a5-488f-9d40-e0c8491b064c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:52.022693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2eebfd93-99a5-488f-9d40-e0c8491b064c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:52.030361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eebfd93-99a5-488f-9d40-e0c8491b064c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:52.031047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eebfd93-99a5-488f-9d40-e0c8491b064c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:52.038235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eebfd93-99a5-488f-9d40-e0c8491b064c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:52.038717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eebfd93-99a5-488f-9d40-e0c8491b064c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:52.083422 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2eebfd93-99a5-488f-9d40-e0c8491b064c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.065865 Dec 18 20:51:52.084282 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 768/1574] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:52 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:52.509872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:52.511164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:52.547240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:52.550807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:52.552849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:52.553495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:52.635656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:52.651118 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd10acff-a98b-4b10-9cbb-82aebc2c3f5b tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452" status: 200 len: 1474 microversion: 2.1 time: 0.733334 Dec 18 20:51:52.652862 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 807/1575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:51 2021] GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452 => generated 1474 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:52.664448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:52.665499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:52.685024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:52.685891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:52.687513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:52.688619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.076467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:53.092391 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d7805a7-af82-401c-8747-62f48b9e3a84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1314 microversion: 2.1 time: 0.585896 Dec 18 20:51:53.096010 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 769/1576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:52 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:53.105920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:53.107899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:53.121283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.121739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.124631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.127018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.247665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:53.255855 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7055700d-d70e-4820-b2a8-7e052a88fd8c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1471 microversion: 2.1 time: 0.601800 Dec 18 20:51:53.271227 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 808/1577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:52 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1471 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:53.282287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7f50f6e5-98d0-4cd4-b330-32d2db105572 req-fe595967-b617-4ed5-b7a2-9643efb8dbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8477c-e0d4-4c92-ab00-6ff2899911da", "name": "network-vif-plugged", "status": "completed", "tag": "4b35e620-8957-42f7-a38a-5c515e281514"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:53.284256 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:53.284256 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:53.296745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7f50f6e5-98d0-4cd4-b330-32d2db105572 req-fe595967-b617-4ed5-b7a2-9643efb8dbd2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.302285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7f50f6e5-98d0-4cd4-b330-32d2db105572 req-fe595967-b617-4ed5-b7a2-9643efb8dbd2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.333124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7f50f6e5-98d0-4cd4-b330-32d2db105572 req-fe595967-b617-4ed5-b7a2-9643efb8dbd2 service nova] Creating event network-vif-plugged:4b35e620-8957-42f7-a38a-5c515e281514 for instance 15b8477c-e0d4-4c92-ab00-6ff2899911da on nch2-master-1 Dec 18 20:51:53.343984 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7f50f6e5-98d0-4cd4-b330-32d2db105572 req-fe595967-b617-4ed5-b7a2-9643efb8dbd2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071277 Dec 18 20:51:53.345200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 809/1578] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:53.350706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54402fa6-08a4-47eb-b4f7-d82c948c6b7d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:53.362814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54402fa6-08a4-47eb-b4f7-d82c948c6b7d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:53.376617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54402fa6-08a4-47eb-b4f7-d82c948c6b7d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.377080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54402fa6-08a4-47eb-b4f7-d82c948c6b7d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.377882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54402fa6-08a4-47eb-b4f7-d82c948c6b7d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.378356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54402fa6-08a4-47eb-b4f7-d82c948c6b7d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.450146 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54402fa6-08a4-47eb-b4f7-d82c948c6b7d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.103366 Dec 18 20:51:53.451242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 810/1579] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:53 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:53.456872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d38f438-596d-4df0-bae4-a9d21902f508 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:53.458645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d38f438-596d-4df0-bae4-a9d21902f508 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:53.476555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d38f438-596d-4df0-bae4-a9d21902f508 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.477013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d38f438-596d-4df0-bae4-a9d21902f508 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.477842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d38f438-596d-4df0-bae4-a9d21902f508 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.478774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d38f438-596d-4df0-bae4-a9d21902f508 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.549090 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d38f438-596d-4df0-bae4-a9d21902f508 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.089661 Dec 18 20:51:53.552151 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 811/1580] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:53 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:53.670175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:53.671514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:53.687761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.688257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.690634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:53.691091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:53.994294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:54.005796 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a683f85-5976-44af-b3c6-12e7a32d5e7a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1509 microversion: 2.1 time: 0.908282 Dec 18 20:51:54.019452 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 770/1581] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:53 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1509 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:54.112253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:54.112875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:54.125035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.133327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.134914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.135382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.324791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:54.336962 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13cc8f20-11d0-441f-80e0-3944103db495 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452" status: 200 len: 1474 microversion: 2.1 time: 0.671599 Dec 18 20:51:54.339428 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 812/1582] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:53 2021] GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452 => generated 1474 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:54.342869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:54.343467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:54.366134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.366721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.367555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.368001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.680949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:54.695188 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1b56174-67ee-45af-b39c-c7c2971b916a tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1314 microversion: 2.1 time: 0.586016 Dec 18 20:51:54.699504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 771/1583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:54 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:54.719818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-027d412b-f9c9-4749-988e-8b9416153896 req-94078e8d-1ec5-41af-9941-e50dbd3d2f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facfd9bf-d901-4385-a082-8a8c8b44f452", "name": "network-vif-deleted", "tag": "9dec9e11-2f64-410a-9138-c76a28139138"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:54.727464 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:54.727464 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:54.747987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-027d412b-f9c9-4749-988e-8b9416153896 req-94078e8d-1ec5-41af-9941-e50dbd3d2f5f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.749817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-027d412b-f9c9-4749-988e-8b9416153896 req-94078e8d-1ec5-41af-9941-e50dbd3d2f5f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.776400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:54.787183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-027d412b-f9c9-4749-988e-8b9416153896 req-94078e8d-1ec5-41af-9941-e50dbd3d2f5f service nova] Creating event network-vif-deleted:9dec9e11-2f64-410a-9138-c76a28139138 for instance facfd9bf-d901-4385-a082-8a8c8b44f452 on nch2-master-1 Dec 18 20:51:54.799426 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-490523b4-233b-4527-9e04-63e75ccdb188 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.445815 Dec 18 20:51:54.802555 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 813/1584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:54 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:54.815913 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-027d412b-f9c9-4749-988e-8b9416153896 req-94078e8d-1ec5-41af-9941-e50dbd3d2f5f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096924 Dec 18 20:51:54.818063 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 772/1585] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:54.819589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-673c1ac4-3002-46c5-89fb-0e46f5d82f41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:54.820556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-673c1ac4-3002-46c5-89fb-0e46f5d82f41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:54.829645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9faf6b48-a831-4ac9-82b4-09bac88a64f4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:54.831049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9faf6b48-a831-4ac9-82b4-09bac88a64f4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:54.838458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-673c1ac4-3002-46c5-89fb-0e46f5d82f41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.838980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-673c1ac4-3002-46c5-89fb-0e46f5d82f41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.842984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-673c1ac4-3002-46c5-89fb-0e46f5d82f41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.843668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-673c1ac4-3002-46c5-89fb-0e46f5d82f41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.850751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9faf6b48-a831-4ac9-82b4-09bac88a64f4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.851506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9faf6b48-a831-4ac9-82b4-09bac88a64f4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.852699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9faf6b48-a831-4ac9-82b4-09bac88a64f4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:54.853370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9faf6b48-a831-4ac9-82b4-09bac88a64f4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:54.917706 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-673c1ac4-3002-46c5-89fb-0e46f5d82f41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.113794 Dec 18 20:51:54.918869 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 814/1586] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:54 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:54.927617 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9faf6b48-a831-4ac9-82b4-09bac88a64f4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.105577 Dec 18 20:51:54.928802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 773/1587] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:54 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:55.025526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.026239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:55.039079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.039531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.040362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.040811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.367920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.369245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: facfd9bf-d901-4385-a082-8a8c8b44f452] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:55.391906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.393254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.394573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.395532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.435716 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance facfd9bf-d901-4385-a082-8a8c8b44f452 could not be found. Dec 18 20:51:55.436517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance facfd9bf-d901-4385-a082-8a8c8b44f452 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:55.438062 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4847ea7e-bc37-4c00-9622-9ffffafa5c47 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452" status: 404 len: 111 microversion: 2.1 time: 0.079743 Dec 18 20:51:55.439704 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 774/1588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:55 2021] GET /compute/v2.1/servers/facfd9bf-d901-4385-a082-8a8c8b44f452 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:55.447968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-297ff410-5ee0-4cff-b1a9-e91df3a1e7a1 req-aa87a400-a73d-4752-ad45-a0645fc3bc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facfd9bf-d901-4385-a082-8a8c8b44f452", "name": "network-vif-unplugged", "status": "completed", "tag": "9dec9e11-2f64-410a-9138-c76a28139138"}, {"server_uuid": "1d00b730-00ba-4bc7-be51-6de9d571a1b2", "name": "network-vif-plugged", "status": "completed", "tag": "659424cb-2544-4eb1-afc7-8c764a75b399"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:55.450588 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:55.450588 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:55.468323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-297ff410-5ee0-4cff-b1a9-e91df3a1e7a1 req-aa87a400-a73d-4752-ad45-a0645fc3bc34 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.468783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-297ff410-5ee0-4cff-b1a9-e91df3a1e7a1 req-aa87a400-a73d-4752-ad45-a0645fc3bc34 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.484011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:55.494401 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-297ff410-5ee0-4cff-b1a9-e91df3a1e7a1 req-aa87a400-a73d-4752-ad45-a0645fc3bc34 service nova] Creating event network-vif-unplugged:9dec9e11-2f64-410a-9138-c76a28139138 for instance facfd9bf-d901-4385-a082-8a8c8b44f452 on nch2-master-1 Dec 18 20:51:55.495535 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-89c28e36-ba5e-4d9b-8649-567436564560 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1513 microversion: 2.1 time: 0.472352 Dec 18 20:51:55.496889 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-297ff410-5ee0-4cff-b1a9-e91df3a1e7a1 req-aa87a400-a73d-4752-ad45-a0645fc3bc34 service nova] Creating event network-vif-plugged:659424cb-2544-4eb1-afc7-8c764a75b399 for instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 on nch2-master-1 Dec 18 20:51:55.498400 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 815/1589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:55 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1513 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:55.507027 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-297ff410-5ee0-4cff-b1a9-e91df3a1e7a1 req-aa87a400-a73d-4752-ad45-a0645fc3bc34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.065365 Dec 18 20:51:55.508916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.510694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: bc0b61b0-8c22-420f-9c24-f948a8967c70] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:55.518465 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 775/1590] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:55 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:55.525526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.531241 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:55.531241 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:55.534043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:55.535056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.servers [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Removing options 'limit' from query {{(pid=140732) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 18 20:51:55.535823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:55.537766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.538223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.540426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.540873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.544246 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec84e25a-e7e8-4840-b445-3e372b458c55 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.023632 Dec 18 20:51:55.545016 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 776/1591] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Dec 18 20:51:55 2021] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:51:55.548362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.550845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.551844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.561879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.565319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:55.565500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.584736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.585467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.586664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.587266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.591408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance bc0b61b0-8c22-420f-9c24-f948a8967c70 could not be found. Dec 18 20:51:55.592314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance bc0b61b0-8c22-420f-9c24-f948a8967c70 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:55.593326 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43a1dece-a0ab-4554-b0ab-eeefc95b2617 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70" status: 404 len: 111 microversion: 2.1 time: 0.092474 Dec 18 20:51:55.594419 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 816/1592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:55 2021] GET /compute/v2.1/servers/bc0b61b0-8c22-420f-9c24-f948a8967c70 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:55.613975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b4947c0-15d8-4c45-aae7-dae275ac28ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.655411 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4b4947c0-15d8-4c45-aae7-dae275ac28ae tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/240cf658-8624-46e5-9566-26dfa7b69a27" status: 204 len: 0 microversion: 2.1 time: 0.051024 Dec 18 20:51:55.656283 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 817/1593] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 20:51:55 2021] DELETE /compute/v2.1/os-server-groups/240cf658-8624-46e5-9566-26dfa7b69a27 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:55.666190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.667551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:55.675475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.675929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.676973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.677422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.705134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:51:55.797987 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d79f46f4-c756-4fef-91af-a25f9b5644d2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 204 len: 0 microversion: 2.1 time: 0.135201 Dec 18 20:51:55.799057 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 818/1594] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:51:55 2021] DELETE /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:55.810759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.812035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:55.833195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.833970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.836474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:55.837761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:55.972749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:55.981166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d79574bd-63e7-4d00-bf03-6e2069509a05 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1513 microversion: 2.1 time: 0.425167 Dec 18 20:51:55.982348 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 777/1595] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:55 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:55.989884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:55.993237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:56.001742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.002598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.003663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.004116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.184342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:56.194763 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ea9f9891-1fad-4c26-9b42-253d3f524f08 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1464 microversion: 2.1 time: 0.393868 Dec 18 20:51:56.195881 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 819/1596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:55 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:56.200586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:56.201197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:56.211202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.211679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.212550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.213309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.310635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:56.318306 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fb8f212a-ab66-49da-b721-1011e6a3a2b5 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1471 microversion: 2.1 time: 0.334558 Dec 18 20:51:56.319997 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 778/1597] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:55 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1471 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:56.325622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8135cd8c-624c-4f6e-a344-5fdcc015ba85 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:56.326612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8135cd8c-624c-4f6e-a344-5fdcc015ba85 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:56.332738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8135cd8c-624c-4f6e-a344-5fdcc015ba85 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.333193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8135cd8c-624c-4f6e-a344-5fdcc015ba85 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.333981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8135cd8c-624c-4f6e-a344-5fdcc015ba85 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.334650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8135cd8c-624c-4f6e-a344-5fdcc015ba85 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.385050 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8135cd8c-624c-4f6e-a344-5fdcc015ba85 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.063318 Dec 18 20:51:56.386427 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 779/1598] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:56 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:56.392010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5b9ea59b-7091-4c6a-9662-c3edf710f8d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:56.393101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5b9ea59b-7091-4c6a-9662-c3edf710f8d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:56.400444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b9ea59b-7091-4c6a-9662-c3edf710f8d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.401722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b9ea59b-7091-4c6a-9662-c3edf710f8d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.402580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b9ea59b-7091-4c6a-9662-c3edf710f8d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.403107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b9ea59b-7091-4c6a-9662-c3edf710f8d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.446187 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5b9ea59b-7091-4c6a-9662-c3edf710f8d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.058230 Dec 18 20:51:56.448904 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 780/1599] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:56 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:56.453388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:56.454207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:56.461341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.461834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.462955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.463471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.466181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:56.474753 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0f486dc-6eaa-4137-9bd2-64492b225250 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.277570 Dec 18 20:51:56.484233 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 820/1600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:56 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:56.488873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:56.489480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:56.497063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.497625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.498444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.498888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.799993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:56.808096 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-acc675f3-ca61-4680-82dd-1d78b95c42d4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 200 len: 1512 microversion: 2.1 time: 0.359102 Dec 18 20:51:56.808875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 781/1601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:56 2021] GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:56.823932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:56.830493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:56.831209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:56.833156 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce1fbfcf-ad4c-4df1-a23c-7da77920992b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1314 microversion: 2.1 time: 0.347827 Dec 18 20:51:56.833903 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 821/1602] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:56 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:56.837985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.838841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.839851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.840306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.851423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-5bb2dffc-7646-4fa0-8afc-ed51073074c1 req-52a2f33e-b2b3-4c56-999f-0d117ebca76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0b61b0-8c22-420f-9c24-f948a8967c70", "name": "network-vif-deleted", "tag": "a52b9904-6215-4656-8796-8cca7fdd5a67"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:56.853015 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:56.853015 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:56.861678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5bb2dffc-7646-4fa0-8afc-ed51073074c1 req-52a2f33e-b2b3-4c56-999f-0d117ebca76a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:56.862126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5bb2dffc-7646-4fa0-8afc-ed51073074c1 req-52a2f33e-b2b3-4c56-999f-0d117ebca76a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:56.874755 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-5bb2dffc-7646-4fa0-8afc-ed51073074c1 req-52a2f33e-b2b3-4c56-999f-0d117ebca76a service nova] Creating event network-vif-deleted:a52b9904-6215-4656-8796-8cca7fdd5a67 for instance bc0b61b0-8c22-420f-9c24-f948a8967c70 on nch2-master-1 Dec 18 20:51:56.880195 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-5bb2dffc-7646-4fa0-8afc-ed51073074c1 req-52a2f33e-b2b3-4c56-999f-0d117ebca76a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 Dec 18 20:51:56.881201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 822/1603] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:51:57.337672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:57.338581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:57.346357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.347083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.348099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.348624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.502890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:57.511755 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5cb3183c-db04-4396-95ed-ca78780b9ccb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1513 microversion: 2.1 time: 0.685400 Dec 18 20:51:57.512438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 782/1604] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:56 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1513 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:57.517125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ee0eda8-b7ad-4d8c-bcf0-e4dc38d3b141 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:57.518245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ee0eda8-b7ad-4d8c-bcf0-e4dc38d3b141 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:57.524611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee0eda8-b7ad-4d8c-bcf0-e4dc38d3b141 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.525063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee0eda8-b7ad-4d8c-bcf0-e4dc38d3b141 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.525847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee0eda8-b7ad-4d8c-bcf0-e4dc38d3b141 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.526854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee0eda8-b7ad-4d8c-bcf0-e4dc38d3b141 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.566052 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ee0eda8-b7ad-4d8c-bcf0-e4dc38d3b141 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.052077 Dec 18 20:51:57.570152 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 783/1605] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:57 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:57.572255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82f66340-47d0-4dbc-a405-3775ab066c2b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:57.573738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82f66340-47d0-4dbc-a405-3775ab066c2b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:57.581408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f66340-47d0-4dbc-a405-3775ab066c2b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.581975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f66340-47d0-4dbc-a405-3775ab066c2b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.582619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f66340-47d0-4dbc-a405-3775ab066c2b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.583063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f66340-47d0-4dbc-a405-3775ab066c2b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.625518 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82f66340-47d0-4dbc-a405-3775ab066c2b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.056961 Dec 18 20:51:57.626432 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 784/1606] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:57 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:57.631679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:57.632386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:57.639828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.640311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.641141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:57.641671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:57.743785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231f078b4f4e4fdc9dcf0c6248f17551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce640720b084b84a86f590d354dad25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:57.756128 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67bca36a-7262-4133-a8c8-6a5eccb050f1 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 200 len: 1471 microversion: 2.1 time: 0.422848 Dec 18 20:51:57.767140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 823/1607] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:57 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:57.772831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:57.777135 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:57.777135 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:51:57.778227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:57.778962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:51:58.008744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.010471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.012754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.013999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:58.014786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.025561 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2ffe699-609a-419f-8dcd-cfac2da15dbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.398038 Dec 18 20:51:58.026376 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 785/1608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:57 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:58.031926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:58.032533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:58.050729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.051188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.051998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.052443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.212189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:51:58.280382 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a760ed0-cd52-4642-9466-8750af01f828 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.511914 Dec 18 20:51:58.282833 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 824/1609] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Dec 18 20:51:57 2021] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:58.304403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:58.306614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:58.315687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.316304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.316744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:58.317863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.318573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.324617 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d8beb3f-827c-4856-9b52-bbc2ab595a2e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1464 microversion: 2.1 time: 0.297241 Dec 18 20:51:58.338333 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 786/1610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:58 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1464 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:58.576952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-197fd074-eb84-4dd6-8f83-035161e83fc7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:58.578782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-197fd074-eb84-4dd6-8f83-035161e83fc7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:58.584111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:58.589901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-197fd074-eb84-4dd6-8f83-035161e83fc7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.594993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-197fd074-eb84-4dd6-8f83-035161e83fc7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.596449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-197fd074-eb84-4dd6-8f83-035161e83fc7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.599959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-197fd074-eb84-4dd6-8f83-035161e83fc7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.603049 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e725e343-521e-49fb-adc5-db70860118e5 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1513 microversion: 2.1 time: 0.311506 Dec 18 20:51:58.608379 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 825/1611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:58 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:51:58.613325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1635469272", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1d00b730-00ba-4bc7-be51-6de9d571a1b2"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:58.670379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:51:58.700854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-197fd074-eb84-4dd6-8f83-035161e83fc7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.127109 Dec 18 20:51:58.701638 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 787/1612] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:58 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:58.706815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:58.707698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:58.721151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.722022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:58.723015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:58.723602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.101297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:59.111156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef0c4e90-1809-403b-9fc5-8c18150300d6 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 200 len: 1512 microversion: 2.1 time: 0.408102 Dec 18 20:51:59.116676 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 788/1613] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:58 2021] GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:59.140690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1041fef4-4934-404d-be44-afe9455b5254 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:59.146787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1041fef4-4934-404d-be44-afe9455b5254 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:59.153634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1041fef4-4934-404d-be44-afe9455b5254 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.155657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1041fef4-4934-404d-be44-afe9455b5254 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.156760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1041fef4-4934-404d-be44-afe9455b5254 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.157432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1041fef4-4934-404d-be44-afe9455b5254 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.252077 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1041fef4-4934-404d-be44-afe9455b5254 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.119259 Dec 18 20:51:59.259059 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 789/1614] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:59 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:51:59.268192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:59.269184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] [instance: b07c26ad-bdd3-495d-bf73-2844e2824e78] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:59.272294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:51:59.272750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:51:59.274397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:51:59.274877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:51:59.276024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:51:59.279143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.279945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.280976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.281658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.288787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.289478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.295209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.295869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.313651 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] HTTP exception thrown: Instance b07c26ad-bdd3-495d-bf73-2844e2824e78 could not be found. Dec 18 20:51:59.316966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] Returning 404 to user: Instance b07c26ad-bdd3-495d-bf73-2844e2824e78 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:51:59.318114 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-975878ca-7c88-4d63-a94a-2a589ebe23b2 tempest-ServersOnMultiNodesTest-410683735 tempest-ServersOnMultiNodesTest-410683735-project] 10.222.0.13 "GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78" status: 404 len: 111 microversion: 2.1 time: 0.057491 Dec 18 20:51:59.321636 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 790/1615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:59 2021] GET /compute/v2.1/servers/b07c26ad-bdd3-495d-bf73-2844e2824e78 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:51:59.331785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6c058921-6a82-4aa1-ba00-d76d26bef3c2 req-a1f8eb98-bf71-4ffd-afb7-6f034157097d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07c26ad-bdd3-495d-bf73-2844e2824e78", "name": "network-vif-deleted", "tag": "05ea3e02-3bf7-43f5-91c1-02487451a24d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:59.334284 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:59.334284 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:51:59.352095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6c058921-6a82-4aa1-ba00-d76d26bef3c2 req-a1f8eb98-bf71-4ffd-afb7-6f034157097d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.352801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6c058921-6a82-4aa1-ba00-d76d26bef3c2 req-a1f8eb98-bf71-4ffd-afb7-6f034157097d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.374065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Getting quotas for project 09f464a0dbea408cb3f43c2c96bdaaac. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:51:59.381228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6c058921-6a82-4aa1-ba00-d76d26bef3c2 req-a1f8eb98-bf71-4ffd-afb7-6f034157097d service nova] Creating event network-vif-deleted:05ea3e02-3bf7-43f5-91c1-02487451a24d for instance b07c26ad-bdd3-495d-bf73-2844e2824e78 on nch2-master-1 Dec 18 20:51:59.392236 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6c058921-6a82-4aa1-ba00-d76d26bef3c2 req-a1f8eb98-bf71-4ffd-afb7-6f034157097d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069048 Dec 18 20:51:59.392947 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 791/1616] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:51:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:51:59.393596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Getting quotas for user ca309394563d45ea9b911c14c5f7625f and project 09f464a0dbea408cb3f43c2c96bdaaac. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:51:59.410726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:59.411736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:59.419469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.422229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:51:59.422879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.423903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.424506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.426536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:51:59.533373 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54e71047-a231-448c-81d5-1dadf5676a31 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922454 Dec 18 20:51:59.536473 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 826/1617] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:51:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:51:59.547926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:59.548919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:59.561646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.563160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.585507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.586385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.784727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:59.792331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0de87a1-b17a-4055-af7b-d57c487489e6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.396424 Dec 18 20:51:59.793007 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 792/1618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:59 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:59.812707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3aa5401-8de6-4317-a996-f8e8b7d63ff1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:51:59.813370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c3aa5401-8de6-4317-a996-f8e8b7d63ff1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:59.944502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c3aa5401-8de6-4317-a996-f8e8b7d63ff1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:59.953897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3aa5401-8de6-4317-a996-f8e8b7d63ff1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1214 microversion: 2.1 time: 0.159973 Dec 18 20:51:59.954768 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 793/1619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:59 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:51:59.971987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9f1cf99-3a65-45fb-bb20-37dc3a3a1821 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:51:59.973326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9f1cf99-3a65-45fb-bb20-37dc3a3a1821 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:51:59.984342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:51:59.989746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1cf99-3a65-45fb-bb20-37dc3a3a1821 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.991355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1cf99-3a65-45fb-bb20-37dc3a3a1821 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:51:59.998793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1cf99-3a65-45fb-bb20-37dc3a3a1821 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:51:59.999614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1cf99-3a65-45fb-bb20-37dc3a3a1821 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.000588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4749e2ea-9398-4cf4-8e08-20f641beae37 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1513 microversion: 2.1 time: 0.460900 Dec 18 20:52:00.004213 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 827/1620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:51:59 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:00.024391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:00.037820 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:00.037820 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:00.042995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:00.043816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:00.059096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.059814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.060818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.061257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.078350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9f1cf99-3a65-45fb-bb20-37dc3a3a1821 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.121767 Dec 18 20:52:00.079159 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 794/1621] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:51:59 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:00.125170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:00.178419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:00.189704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.190836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.280658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5066495e-a1b9-4945-afe8-7eeb362a7ae8 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:00.285886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5066495e-a1b9-4945-afe8-7eeb362a7ae8 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:00.336955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5066495e-a1b9-4945-afe8-7eeb362a7ae8 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.337318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5066495e-a1b9-4945-afe8-7eeb362a7ae8 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.338363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5066495e-a1b9-4945-afe8-7eeb362a7ae8 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.339601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5066495e-a1b9-4945-afe8-7eeb362a7ae8 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.412758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5066495e-a1b9-4945-afe8-7eeb362a7ae8 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.144957 Dec 18 20:52:00.417366 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 795/1622] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:00 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:52:00.545289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75b77e8e-abfc-4760-988e-957214913825 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 4521 microversion: 2.1 time: 0.528996 Dec 18 20:52:00.546223 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 828/1623] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:52:00 2021] GET /compute/v2.1/servers/detail => generated 4521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:00.566066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:00.570006 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:00.570006 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:00.573715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:00.575868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:00.702233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.702983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.704452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.705087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.813428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:00.814375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:00.829240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.829871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.831065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:00.831666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:00.933920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:01.069430 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-34077f43-2993-479f-862e-5c64037241b8 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1011 microversion: 2.1 time: 0.507777 Dec 18 20:52:01.071481 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 796/1624] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:52:00 2021] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1011 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:01.082643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:01.083869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:01.111328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.112135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.115187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.116233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.423429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:01.451493 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49608a63-0135-44c4-ac09-ff3ebdbdacaf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1284 microversion: 2.1 time: 0.378604 Dec 18 20:52:01.465638 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 797/1625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:01 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1284 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:01.490114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:01.494317 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:01.494317 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:01.496919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:01.497954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:01.506934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.507729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.510230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.511749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.560851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:01.570851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a51eb5cb-f494-481a-a1b5-081f9485db48 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.764579 Dec 18 20:52:01.571451 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 829/1626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:00 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:01.598518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21b3ed08-b54b-46b2-9579-04b12feab5f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:01.599528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-21b3ed08-b54b-46b2-9579-04b12feab5f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:01.614289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b3ed08-b54b-46b2-9579-04b12feab5f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.614665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b3ed08-b54b-46b2-9579-04b12feab5f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.615481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b3ed08-b54b-46b2-9579-04b12feab5f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.615924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b3ed08-b54b-46b2-9579-04b12feab5f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.678231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:01.694019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21b3ed08-b54b-46b2-9579-04b12feab5f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.110382 Dec 18 20:52:01.699013 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 830/1627] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:01 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:01.716574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0fd4346a-e9fa-428c-9011-0dfda7f95864 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:01.717614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0fd4346a-e9fa-428c-9011-0dfda7f95864 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:01.745455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fd4346a-e9fa-428c-9011-0dfda7f95864 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.746107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fd4346a-e9fa-428c-9011-0dfda7f95864 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.747137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fd4346a-e9fa-428c-9011-0dfda7f95864 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.750116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fd4346a-e9fa-428c-9011-0dfda7f95864 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.813127 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0fd4346a-e9fa-428c-9011-0dfda7f95864 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.116329 Dec 18 20:52:01.813973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 831/1628] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:01 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:01.821701 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e65fe4bb-205d-41be-8ad1-2c2f1e570157 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.354236 Dec 18 20:52:01.825017 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 798/1629] 10.222.0.13 () {58 vars in 1211 bytes} [Sat Dec 18 20:52:01 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:01.834171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:01.848453 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:01.848453 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:01.849660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:01.850468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:01.868966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.869421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:01.870829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:01.871270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.050979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:02.140914 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ab44ea8-7d82-458c-beb6-ee30b777564a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.310879 Dec 18 20:52:02.148848 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 832/1630] 10.222.0.13 () {58 vars in 1195 bytes} [Sat Dec 18 20:52:01 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:02.153218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:02.156873 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:02.156873 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:02.157936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:02.158640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'name': '2046507492', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:02.177352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.178051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.179069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.179668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.355726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:02.438889 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bb7f3cd-c086-45a0-9fb7-fc1f73f9f1f7 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?name=2046507492" status: 200 len: 346 microversion: 2.1 time: 0.289338 Dec 18 20:52:02.439822 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 799/1631] 10.222.0.13 () {58 vars in 1155 bytes} [Sat Dec 18 20:52:02 2021] GET /compute/v2.1/servers?name=2046507492 => generated 346 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:02.455859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:02.463059 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:02.463059 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:02.466813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:02.468057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:02.470812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:02.471444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:02.476513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.477542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.478623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.479840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.481018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.481481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.482318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.482773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.610016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:02.681125 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22be4334-f82a-4ea7-aa8b-4dcbe1d8fbd0 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.234363 Dec 18 20:52:02.681818 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 833/1632] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Dec 18 20:52:02 2021] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:02.687117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:02.688152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:02.699223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.699823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.700765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.701337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.949061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:02.958424 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0c4d0929-ca00-4c0f-ac06-a82906b4702e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1272 microversion: 2.1 time: 0.491276 Dec 18 20:52:02.959091 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 800/1633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:02 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1272 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:02.972627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:02.976230 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:02.976230 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:02.977420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:02.978076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-204650749', 'deleted': False, 'project_id': '7f74319f4d954cea9418c30afd53b213'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:02.984470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.984918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:02.985725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:02.986154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.081350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:03.188915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1eaf627b-0415-4bd6-8e00-d0bf3d51bd28 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-204650749" status: 200 len: 346 microversion: 2.1 time: 0.228325 Dec 18 20:52:03.190377 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 801/1634] 10.222.0.13 () {58 vars in 1227 bytes} [Sat Dec 18 20:52:02 2021] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-204650749 => generated 346 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:03.204454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-68cdfd24-4058-4fad-aaa2-52ec26b00fc4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:03.205711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-68cdfd24-4058-4fad-aaa2-52ec26b00fc4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:03.212346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68cdfd24-4058-4fad-aaa2-52ec26b00fc4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.213077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68cdfd24-4058-4fad-aaa2-52ec26b00fc4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.214143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68cdfd24-4058-4fad-aaa2-52ec26b00fc4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.214917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68cdfd24-4058-4fad-aaa2-52ec26b00fc4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.263042 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-68cdfd24-4058-4fad-aaa2-52ec26b00fc4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.070853 Dec 18 20:52:03.268794 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 802/1635] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:03 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:03.274951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec68422f-41cd-428c-838b-8f03ac88ea62 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:03.276162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec68422f-41cd-428c-838b-8f03ac88ea62 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:03.284662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec68422f-41cd-428c-838b-8f03ac88ea62 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.285261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec68422f-41cd-428c-838b-8f03ac88ea62 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.286178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec68422f-41cd-428c-838b-8f03ac88ea62 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.286778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec68422f-41cd-428c-838b-8f03ac88ea62 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.333843 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec68422f-41cd-428c-838b-8f03ac88ea62 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.063404 Dec 18 20:52:03.334811 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 803/1636] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:03 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:03.341647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:03.341918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:03.342670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:03.350841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.351399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.352582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.353661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.360928 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53028da8-066b-4e4d-97c3-32be29e3d6c4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.677936 Dec 18 20:52:03.362143 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 834/1637] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:02 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:03.383973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:52:03.513141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6865b12-521c-4da6-848a-93e63b90db15 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 204 len: 0 microversion: 2.1 time: 0.176088 Dec 18 20:52:03.514571 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 804/1638] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:52:03 2021] DELETE /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:03.523152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:03.523762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:03.530498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.530949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.531753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:03.532369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:03.978788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:03.980688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:03.988967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:04.003206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.004605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.006190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.008170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.012102 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e13d11a-2aa5-4170-ba5c-a3e89b70310b tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1519 microversion: 2.1 time: 0.492650 Dec 18 20:52:04.016570 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 835/1639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:03 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1519 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:04.277621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f17c6473-9dce-444c-8ad0-ba66eec6a6a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:04.279348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f17c6473-9dce-444c-8ad0-ba66eec6a6a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:04.288337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f17c6473-9dce-444c-8ad0-ba66eec6a6a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.289038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f17c6473-9dce-444c-8ad0-ba66eec6a6a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.289846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f17c6473-9dce-444c-8ad0-ba66eec6a6a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.290476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f17c6473-9dce-444c-8ad0-ba66eec6a6a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.352917 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f17c6473-9dce-444c-8ad0-ba66eec6a6a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.079885 Dec 18 20:52:04.354242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 836/1640] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:04 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:04.363505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-83ca34ba-af5f-4599-af55-0edcdab967cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:04.364729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-83ca34ba-af5f-4599-af55-0edcdab967cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:04.373649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ca34ba-af5f-4599-af55-0edcdab967cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.374412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ca34ba-af5f-4599-af55-0edcdab967cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.375379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ca34ba-af5f-4599-af55-0edcdab967cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.376594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83ca34ba-af5f-4599-af55-0edcdab967cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.432961 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-83ca34ba-af5f-4599-af55-0edcdab967cb tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.075222 Dec 18 20:52:04.434300 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 837/1641] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:04 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:04.445015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:04.446962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:04.462974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.466519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.467419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:04.469502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:04.592365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:04.604871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05eef043-abe4-4eb4-834a-1e4beec4be23 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.630203 Dec 18 20:52:04.605485 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 805/1642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:03 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:04.854891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:04.865114 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4677f3cf-6010-4195-8e0b-5bf329e23bbf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.429278 Dec 18 20:52:04.877122 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 838/1643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:04 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:05.032684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:05.033592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:05.057215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.059804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.062405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.063043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.366166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a466346-d793-4226-a81b-45fa7b5c37b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:05.367147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1a466346-d793-4226-a81b-45fa7b5c37b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:05.381792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a466346-d793-4226-a81b-45fa7b5c37b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.382294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a466346-d793-4226-a81b-45fa7b5c37b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.390112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a466346-d793-4226-a81b-45fa7b5c37b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.390595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a466346-d793-4226-a81b-45fa7b5c37b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.491267 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a466346-d793-4226-a81b-45fa7b5c37b6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.130466 Dec 18 20:52:05.493640 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 839/1644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:05 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:52:05.503708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-948b5706-5f7f-44a5-904a-c734f8206c71 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:05.509931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-948b5706-5f7f-44a5-904a-c734f8206c71 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:05.532375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-948b5706-5f7f-44a5-904a-c734f8206c71 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.533076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-948b5706-5f7f-44a5-904a-c734f8206c71 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.534138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-948b5706-5f7f-44a5-904a-c734f8206c71 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.534767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-948b5706-5f7f-44a5-904a-c734f8206c71 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.611036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-948b5706-5f7f-44a5-904a-c734f8206c71 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.114054 Dec 18 20:52:05.612838 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 840/1645] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:05 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:05.623714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:05.625123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:05.639549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.640205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.641162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.644140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.851651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:05.886207 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c51cb8f3-5981-47de-94c9-687239fdf57a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1519 microversion: 2.1 time: 0.838296 Dec 18 20:52:05.886926 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 806/1646] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:05 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1519 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:05.898160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:05.902071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:05.912632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.913385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:05.914372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:05.914820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:06.731205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:06.740075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd8caf42-0997-4303-9e58-be31983b4a00 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 1.122785 Dec 18 20:52:06.743201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 841/1647] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:05 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:06.755419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b422123-aa5e-4d17-ba1d-b4887a32cfbb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:06.759345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b422123-aa5e-4d17-ba1d-b4887a32cfbb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:06.781829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b422123-aa5e-4d17-ba1d-b4887a32cfbb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:06.783088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b422123-aa5e-4d17-ba1d-b4887a32cfbb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:06.783708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b422123-aa5e-4d17-ba1d-b4887a32cfbb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:06.784445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b422123-aa5e-4d17-ba1d-b4887a32cfbb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:06.853343 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b422123-aa5e-4d17-ba1d-b4887a32cfbb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.106931 Dec 18 20:52:06.854360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 842/1648] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:06 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:06.859773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c0def0f-64af-428a-b33b-b45d6cfbe363 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:06.863578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5c0def0f-64af-428a-b33b-b45d6cfbe363 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:06.884013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c0def0f-64af-428a-b33b-b45d6cfbe363 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:06.884473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c0def0f-64af-428a-b33b-b45d6cfbe363 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:06.885883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c0def0f-64af-428a-b33b-b45d6cfbe363 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:06.886403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c0def0f-64af-428a-b33b-b45d6cfbe363 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:06.963821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:06.979285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a72b67e-4d61-47e6-94fa-48d05f5f949f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 1.089236 Dec 18 20:52:06.996268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c0def0f-64af-428a-b33b-b45d6cfbe363 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.138112 Dec 18 20:52:06.997416 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 807/1649] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:05 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:06.998549 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 843/1650] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:06 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:07.006813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:07.012069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:07.023632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:07.024382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:07.025204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:07.025643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:07.688943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-123f49d1-ca03-4214-af90-a70d014e65b0 req-f4fa65e1-bdb4-4490-be0f-4d15f77c0e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f5fb37-07c8-4714-8eb3-fad1fa1f51d6", "tag": "82e2dc4f-305b-4f3d-be2d-709ad9dc49f0"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:07.693995 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:07.693995 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:07.726872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-123f49d1-ca03-4214-af90-a70d014e65b0 req-f4fa65e1-bdb4-4490-be0f-4d15f77c0e1e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:07.727798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-123f49d1-ca03-4214-af90-a70d014e65b0 req-f4fa65e1-bdb4-4490-be0f-4d15f77c0e1e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:07.775653 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-123f49d1-ca03-4214-af90-a70d014e65b0 req-f4fa65e1-bdb4-4490-be0f-4d15f77c0e1e service nova] Creating event network-changed:82e2dc4f-305b-4f3d-be2d-709ad9dc49f0 for instance 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 on nch2-master-1 Dec 18 20:52:07.790204 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-123f49d1-ca03-4214-af90-a70d014e65b0 req-f4fa65e1-bdb4-4490-be0f-4d15f77c0e1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323133 Dec 18 20:52:07.794127 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 844/1651] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:07.805125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:07.808762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:07.840720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:07.841664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:07.843463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:07.844118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:07.913870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:07.927002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2787c686-b008-4a5d-b8e8-1dbbc9556f11 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 200 len: 1519 microversion: 2.1 time: 0.923431 Dec 18 20:52:07.928210 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 808/1652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:06 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 1519 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:07.941658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97c120f5-71de-40ab-8e0c-723ee81c4cdc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:07.942780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97c120f5-71de-40ab-8e0c-723ee81c4cdc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:07.953089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c120f5-71de-40ab-8e0c-723ee81c4cdc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:07.953549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c120f5-71de-40ab-8e0c-723ee81c4cdc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:07.954640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c120f5-71de-40ab-8e0c-723ee81c4cdc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:07.955097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c120f5-71de-40ab-8e0c-723ee81c4cdc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:08.060939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97c120f5-71de-40ab-8e0c-723ee81c4cdc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.128857 Dec 18 20:52:08.068525 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 809/1653] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:07 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:08.089991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:08.092648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:08.111082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:08.126818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:08.129743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:08.132378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:08.659696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:08.671556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac3053aa-f54b-4eae-a6ee-cbeedd9857e1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.875534 Dec 18 20:52:08.672154 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 845/1654] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:07 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:08.676732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-42af91fa-34d6-4138-9cac-dd5ecd1ddb1b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:08.677665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-42af91fa-34d6-4138-9cac-dd5ecd1ddb1b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:08.694443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42af91fa-34d6-4138-9cac-dd5ecd1ddb1b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:08.694909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42af91fa-34d6-4138-9cac-dd5ecd1ddb1b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:08.695731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42af91fa-34d6-4138-9cac-dd5ecd1ddb1b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:08.696174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42af91fa-34d6-4138-9cac-dd5ecd1ddb1b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:08.698681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:08.708752 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-20c1acc8-0490-4a98-a526-5c2b8aa86435 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.636145 Dec 18 20:52:08.709326 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 810/1655] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:08 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:08.783798 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-42af91fa-34d6-4138-9cac-dd5ecd1ddb1b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.110248 Dec 18 20:52:08.786813 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 846/1656] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:08 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:08.949487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:08.951006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 6acebe03-ef39-4717-abd1-ec9c4b52d21e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:08.968576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:08.969588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:08.971324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:08.972054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.034990 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] HTTP exception thrown: Instance 6acebe03-ef39-4717-abd1-ec9c4b52d21e could not be found. Dec 18 20:52:09.036522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Returning 404 to user: Instance 6acebe03-ef39-4717-abd1-ec9c4b52d21e could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:52:09.037626 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72d1e4bc-41da-43c9-a4e9-fa958fbb6800 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e" status: 404 len: 111 microversion: 2.1 time: 0.096115 Dec 18 20:52:09.044848 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 811/1657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:08 2021] GET /compute/v2.1/servers/6acebe03-ef39-4717-abd1-ec9c4b52d21e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:09.047845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:09.048443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:09.056384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.057633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.058646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.059244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.073858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e53a2d2-fd61-467d-92f3-7c3f85e64800 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:09.074837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e53a2d2-fd61-467d-92f3-7c3f85e64800 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:09.089081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e53a2d2-fd61-467d-92f3-7c3f85e64800 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.089591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e53a2d2-fd61-467d-92f3-7c3f85e64800 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.090460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e53a2d2-fd61-467d-92f3-7c3f85e64800 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.091828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:52:09.094314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e53a2d2-fd61-467d-92f3-7c3f85e64800 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.194034 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e53a2d2-fd61-467d-92f3-7c3f85e64800 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.125263 Dec 18 20:52:09.202487 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 812/1658] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:09 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:09.281946 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e66e1c2a-2820-41ce-82c1-e0a47b6c064d tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 204 len: 0 microversion: 2.1 time: 0.237454 Dec 18 20:52:09.284499 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 847/1659] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:52:09 2021] DELETE /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:52:09.294977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:09.295677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:09.305099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.305632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.308983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.309907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.685335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:09.693381 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57f259b2-57b9-4f6f-a14f-12266485756a tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 200 len: 1518 microversion: 2.1 time: 0.404319 Dec 18 20:52:09.693692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:09.699207 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 813/1660] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:09 2021] GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 1518 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:09.703508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:09.712894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.719218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.720012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.720566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.724534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:09.725160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:09.737908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.738587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:09.739589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:09.740036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:10.127427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:10.136583 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3003ae4a-e379-424e-95d6-472734dda395 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.415607 Dec 18 20:52:10.138163 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 814/1661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:09 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:10.152254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:10.171089 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-620fb25a-fd6e-4bbf-a180-1a5cc18a7527 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.482269 Dec 18 20:52:10.177796 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 848/1662] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:09 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:10.182702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e22f4cd5-7e25-49f4-8424-e0f92cebbef0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:10.183818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e22f4cd5-7e25-49f4-8424-e0f92cebbef0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:10.190579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e22f4cd5-7e25-49f4-8424-e0f92cebbef0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:10.191217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e22f4cd5-7e25-49f4-8424-e0f92cebbef0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:10.192178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e22f4cd5-7e25-49f4-8424-e0f92cebbef0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:10.192806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e22f4cd5-7e25-49f4-8424-e0f92cebbef0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:10.223982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-319709975", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "f1d70eca-02f4-4675-afda-361ba3071aaf"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:10.268753 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e22f4cd5-7e25-49f4-8424-e0f92cebbef0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.088701 Dec 18 20:52:10.274190 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 849/1663] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:10 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:10.281057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-045e960e-1e04-4d8d-8a9b-781179589c7e req-a16ede36-56eb-4841-9932-ddced4c2433f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acebe03-ef39-4717-abd1-ec9c4b52d21e", "name": "network-vif-deleted", "tag": "8c68a13f-39f5-43c7-9efd-4920983792ab"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:10.282755 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:10.282755 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:10.293544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-045e960e-1e04-4d8d-8a9b-781179589c7e req-a16ede36-56eb-4841-9932-ddced4c2433f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:10.294329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-045e960e-1e04-4d8d-8a9b-781179589c7e req-a16ede36-56eb-4841-9932-ddced4c2433f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:10.302124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] validate_networks() for [('f1d70eca-02f4-4675-afda-361ba3071aaf', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:52:10.312366 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-045e960e-1e04-4d8d-8a9b-781179589c7e req-a16ede36-56eb-4841-9932-ddced4c2433f service nova] Creating event network-vif-deleted:8c68a13f-39f5-43c7-9efd-4920983792ab for instance 6acebe03-ef39-4717-abd1-ec9c4b52d21e on nch2-master-1 Dec 18 20:52:10.319215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-045e960e-1e04-4d8d-8a9b-781179589c7e req-a16ede36-56eb-4841-9932-ddced4c2433f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043246 Dec 18 20:52:10.319895 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 850/1664] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:10.329719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9fd969b7-c9e6-411e-a4d5-3d1bcf755d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:10.331217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9fd969b7-c9e6-411e-a4d5-3d1bcf755d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:10.340272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fd969b7-c9e6-411e-a4d5-3d1bcf755d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:10.341325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fd969b7-c9e6-411e-a4d5-3d1bcf755d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:10.342334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fd969b7-c9e6-411e-a4d5-3d1bcf755d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:10.342936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fd969b7-c9e6-411e-a4d5-3d1bcf755d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:10.398139 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9fd969b7-c9e6-411e-a4d5-3d1bcf755d05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.077024 Dec 18 20:52:10.398899 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 851/1665] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:10 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:10.727576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:10.730697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:10.745679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:10.746950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:10.748439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:10.748900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.110054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:52:11.110997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:52:11.111640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:52:11.112212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:52:11.112812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:52:11.131369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.132793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.134043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.136546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.175793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Getting quotas for project 47e94e03944844ccb90b9a5818d00856. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:52:11.188005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Getting quotas for user 24ceebd647214518a032847eadef041f and project 47e94e03944844ccb90b9a5818d00856. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:52:11.196209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:11.209549 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-38b91c8b-c76f-4852-8106-ec1aa57e6a5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 200 len: 1518 microversion: 2.1 time: 0.499737 Dec 18 20:52:11.223651 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 852/1666] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:10 2021] GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 1518 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:11.233193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:11.235470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:11.253260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:52:11.258825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.261914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.263125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.264837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.265513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:52:11.381156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-133c4cd1-a76c-493e-84a4-8db95c8e1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241507 Dec 18 20:52:11.384242 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 815/1667] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:52:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:52:11.395610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:11.396695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:11.410779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.411500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.412862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.413675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.732389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:11.753934 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6688955-1307-4779-b5e1-099216733741 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.528975 Dec 18 20:52:11.766919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 853/1668] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:11 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:11.805222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-96ca0891-89e8-4d18-8a8b-854712474e7d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:11.818493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-96ca0891-89e8-4d18-8a8b-854712474e7d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:11.854873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96ca0891-89e8-4d18-8a8b-854712474e7d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.855943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96ca0891-89e8-4d18-8a8b-854712474e7d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.858436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96ca0891-89e8-4d18-8a8b-854712474e7d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:11.862278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96ca0891-89e8-4d18-8a8b-854712474e7d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:11.880292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:11.891039 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1df5dad-91e8-45c2-bd52-583d51fea115 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.505357 Dec 18 20:52:11.891620 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 816/1669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:11 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:11.910219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b2cadd4-d0aa-4cb9-9a60-a3014ae73544 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:11.915048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b2cadd4-d0aa-4cb9-9a60-a3014ae73544 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:11.981499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-96ca0891-89e8-4d18-8a8b-854712474e7d tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.212895 Dec 18 20:52:11.983876 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 854/1670] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:11 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:11.997930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ea65683-9909-45e2-b878-0ff110fd8e1f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:11.999437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ea65683-9909-45e2-b878-0ff110fd8e1f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:12.007489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ea65683-9909-45e2-b878-0ff110fd8e1f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.008362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ea65683-9909-45e2-b878-0ff110fd8e1f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.009452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ea65683-9909-45e2-b878-0ff110fd8e1f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.010842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ea65683-9909-45e2-b878-0ff110fd8e1f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.038566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b2cadd4-d0aa-4cb9-9a60-a3014ae73544 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:12.045640 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b2cadd4-d0aa-4cb9-9a60-a3014ae73544 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1231 microversion: 2.1 time: 0.139210 Dec 18 20:52:12.046233 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 817/1671] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:11 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1231 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:12.065582 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ea65683-9909-45e2-b878-0ff110fd8e1f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.076883 Dec 18 20:52:12.066951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d62d7391-d936-43e4-9afc-72b1808a7f29 req-098ea332-afac-4b6d-9a63-4363a75c55e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffede440-64bd-4c72-bcaa-a602bc2fb9fc", "name": "network-vif-deleted", "tag": "b3039056-1fc4-4019-883c-67786f806485"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:12.070381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 855/1672] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:11 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:12.082242 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:12.082242 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:12.100552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d62d7391-d936-43e4-9afc-72b1808a7f29 req-098ea332-afac-4b6d-9a63-4363a75c55e4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.101279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d62d7391-d936-43e4-9afc-72b1808a7f29 req-098ea332-afac-4b6d-9a63-4363a75c55e4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.113992 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d62d7391-d936-43e4-9afc-72b1808a7f29 req-098ea332-afac-4b6d-9a63-4363a75c55e4 service nova] Creating event network-vif-deleted:b3039056-1fc4-4019-883c-67786f806485 for instance ffede440-64bd-4c72-bcaa-a602bc2fb9fc on nch1-master-1 Dec 18 20:52:12.123956 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d62d7391-d936-43e4-9afc-72b1808a7f29 req-098ea332-afac-4b6d-9a63-4363a75c55e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060188 Dec 18 20:52:12.131082 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 818/1673] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:12.230870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:12.232483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:12.245020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.245482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.246321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.246775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.367608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.368093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.368553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lazy-loading 'fault' on Instance uuid ffede440-64bd-4c72-bcaa-a602bc2fb9fc {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:52:12.460019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:12.482343 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6319454-577e-499a-805d-1a4f2fcbedeb tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 200 len: 1310 microversion: 2.1 time: 0.258686 Dec 18 20:52:12.484020 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 856/1674] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:12 2021] GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 1310 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:12.794627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:12.796172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:12.806510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.807884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.809204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.810267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.909305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:12.910360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:12.936613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.937448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:12.938422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:12.939072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.116220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:13.130368 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d2e4e25-4f8e-47b6-8296-e574cd74946e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.360565 Dec 18 20:52:13.135939 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 819/1675] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:12 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:13.146822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44589681-c7db-49d0-baf7-ddccd27b6d67 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:13.147980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44589681-c7db-49d0-baf7-ddccd27b6d67 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:13.169739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44589681-c7db-49d0-baf7-ddccd27b6d67 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.170712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44589681-c7db-49d0-baf7-ddccd27b6d67 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.171804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44589681-c7db-49d0-baf7-ddccd27b6d67 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.172404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44589681-c7db-49d0-baf7-ddccd27b6d67 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.195282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:13.207020 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-84df4014-8b79-49bf-95d3-f6e6f9d59faf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.302647 Dec 18 20:52:13.217702 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 857/1676] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:12 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:13.223385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:13.224318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:13.237847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.238701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.241489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.242433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.251560 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44589681-c7db-49d0-baf7-ddccd27b6d67 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.113861 Dec 18 20:52:13.252915 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 820/1677] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:13 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:13.265713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bbc90947-d980-41dd-8b6d-d0421b61ac0e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:13.267520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bbc90947-d980-41dd-8b6d-d0421b61ac0e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:13.283537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbc90947-d980-41dd-8b6d-d0421b61ac0e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.283992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbc90947-d980-41dd-8b6d-d0421b61ac0e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.285447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbc90947-d980-41dd-8b6d-d0421b61ac0e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.285889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbc90947-d980-41dd-8b6d-d0421b61ac0e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.379944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:13.391686 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca169a53-afa3-40f7-9c7e-3f77e074e2da tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1283 microversion: 2.1 time: 0.172349 Dec 18 20:52:13.392618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 858/1678] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:13 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:13.419080 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bbc90947-d980-41dd-8b6d-d0421b61ac0e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.164409 Dec 18 20:52:13.425203 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 821/1679] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:13 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:13.508665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:13.509700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: ffede440-64bd-4c72-bcaa-a602bc2fb9fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:13.526012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.530793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.531969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.532661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.553230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] HTTP exception thrown: Instance ffede440-64bd-4c72-bcaa-a602bc2fb9fc could not be found. Dec 18 20:52:13.554200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Returning 404 to user: Instance ffede440-64bd-4c72-bcaa-a602bc2fb9fc could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:52:13.555331 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb89550a-4567-4257-94b3-aeec57ed5949 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc" status: 404 len: 111 microversion: 2.1 time: 0.059000 Dec 18 20:52:13.559793 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 859/1680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:13 2021] GET /compute/v2.1/servers/ffede440-64bd-4c72-bcaa-a602bc2fb9fc => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:13.574904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:13.576875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:13.592566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.596891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.598044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.598378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.663832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:52:13.837953 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1055ee99-23b0-4de4-bef5-dbe67701af77 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "DELETE /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 204 len: 0 microversion: 2.1 time: 0.276684 Dec 18 20:52:13.846336 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 822/1681] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:52:13 2021] DELETE /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:13.848145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:13.848755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:13.856565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.857022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:13.857829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:13.858284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.011753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:14.019984 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1a3343c-258e-45f0-9826-b0e83004647c tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1519 microversion: 2.1 time: 0.176658 Dec 18 20:52:14.020923 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 860/1682] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:13 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:14.149245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:14.149933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:14.160473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.160928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.161747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.162179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.226938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:14.227574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:14.236247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.236731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.238141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.239262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.480149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:14.488386 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-92ab9564-e074-4d20-aca9-7ce3bb7190c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1476 microversion: 2.1 time: 0.343195 Dec 18 20:52:14.493505 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 823/1683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:14 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1476 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:14.514609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fafd901b-8e4f-4cd0-b773-a48be6907c03 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:14.515525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fafd901b-8e4f-4cd0-b773-a48be6907c03 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:14.560093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fafd901b-8e4f-4cd0-b773-a48be6907c03 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.562232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fafd901b-8e4f-4cd0-b773-a48be6907c03 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.563099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fafd901b-8e4f-4cd0-b773-a48be6907c03 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.572996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fafd901b-8e4f-4cd0-b773-a48be6907c03 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.710065 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fafd901b-8e4f-4cd0-b773-a48be6907c03 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.201797 Dec 18 20:52:14.711287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 824/1684] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:14 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:14.720063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:14.733728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a3669f6-9e27-484b-9a6a-9c581c5ac862 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.513055 Dec 18 20:52:14.734472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:14.735139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:14.735846 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 861/1685] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:14 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:14.740943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40eeeb24-b745-4ffb-979a-56e39978f6a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:14.742237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40eeeb24-b745-4ffb-979a-56e39978f6a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:14.750836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40eeeb24-b745-4ffb-979a-56e39978f6a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.751330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.751957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40eeeb24-b745-4ffb-979a-56e39978f6a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.752978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40eeeb24-b745-4ffb-979a-56e39978f6a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.753638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40eeeb24-b745-4ffb-979a-56e39978f6a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.754018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.763482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:14.763988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:14.825401 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40eeeb24-b745-4ffb-979a-56e39978f6a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.088019 Dec 18 20:52:14.830087 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 862/1686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:14 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:15.039443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:15.041431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:15.053366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:15.062637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:15.063675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:15.065590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:15.066143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:15.067153 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac9476df-8f33-4361-8e6f-5db2aa142654 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.354166 Dec 18 20:52:15.068732 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 825/1687] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:14 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:15.511531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:15.512524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:15.520233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:15.521600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:15.522617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:15.523222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:15.707893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:15.725141 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9a1db295-8c8b-4cb6-83ca-d032d6702b5e tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1519 microversion: 2.1 time: 0.690477 Dec 18 20:52:15.725719 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 863/1688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:15 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1519 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:15.872306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3aa81704-edcf-4397-841c-08c4981d28d3 req-68714466-9d88-41b0-9129-12b5398d32a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f5fb37-07c8-4714-8eb3-fad1fa1f51d6", "name": "network-vif-plugged", "status": "completed", "tag": "82e2dc4f-305b-4f3d-be2d-709ad9dc49f0"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:15.874349 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:15.874349 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:15.891707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3aa81704-edcf-4397-841c-08c4981d28d3 req-68714466-9d88-41b0-9129-12b5398d32a1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:15.904308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3aa81704-edcf-4397-841c-08c4981d28d3 req-68714466-9d88-41b0-9129-12b5398d32a1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:15.949627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3aa81704-edcf-4397-841c-08c4981d28d3 req-68714466-9d88-41b0-9129-12b5398d32a1 service nova] Creating event network-vif-plugged:82e2dc4f-305b-4f3d-be2d-709ad9dc49f0 for instance 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 on nch2-master-1 Dec 18 20:52:15.964111 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3aa81704-edcf-4397-841c-08c4981d28d3 req-68714466-9d88-41b0-9129-12b5398d32a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235171 Dec 18 20:52:15.968771 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 864/1689] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:15.983259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4682a2b6-2fbd-4cd8-87dd-e89e52200bff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:15.989243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4682a2b6-2fbd-4cd8-87dd-e89e52200bff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:16.022378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4682a2b6-2fbd-4cd8-87dd-e89e52200bff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.024186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4682a2b6-2fbd-4cd8-87dd-e89e52200bff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.026927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4682a2b6-2fbd-4cd8-87dd-e89e52200bff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.032100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4682a2b6-2fbd-4cd8-87dd-e89e52200bff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.137120 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4682a2b6-2fbd-4cd8-87dd-e89e52200bff tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.165933 Dec 18 20:52:16.145643 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 865/1690] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:15 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:16.161238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:16.162433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:16.177595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.178051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.187361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.187821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.319191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:16.335086 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c275b0f5-dfad-4efc-b216-a2a2160827ce tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1475 microversion: 2.1 time: 0.827877 Dec 18 20:52:16.335887 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 826/1691] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:15 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1475 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:16.343501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ab307bd-f57c-4a4d-850e-2fe1982007f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:16.350089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ab307bd-f57c-4a4d-850e-2fe1982007f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:16.367957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab307bd-f57c-4a4d-850e-2fe1982007f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.368410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab307bd-f57c-4a4d-850e-2fe1982007f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.374211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab307bd-f57c-4a4d-850e-2fe1982007f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.374786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab307bd-f57c-4a4d-850e-2fe1982007f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.468853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ab307bd-f57c-4a4d-850e-2fe1982007f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.131510 Dec 18 20:52:16.471603 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 827/1692] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:16 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:16.491067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:16.493147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:16.532280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.533415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.542518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.544291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.725590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:16.745689 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ad2c530-d554-4b65-8f31-50b17156c49e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.595552 Dec 18 20:52:16.746688 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 866/1693] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:16 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:16.757013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:16.759008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:16.769784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.771170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.772221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.773670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:16.950610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:16.959017 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d6f6513-4cb1-4ad8-af89-b25636ef670b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.485644 Dec 18 20:52:16.963860 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 828/1694] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:16 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:16.973764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-777b6b5e-7551-4d31-8ad8-12e668087838 req-8f74accd-17d8-4732-93bb-acbee5675d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce12ca16-56f4-459d-bc88-98eab54424b7", "tag": "cbe017f3-1a9e-4b8f-b078-a8a69597377e"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:16.975584 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:16.975584 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:16.995279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-777b6b5e-7551-4d31-8ad8-12e668087838 req-8f74accd-17d8-4732-93bb-acbee5675d9c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:16.996170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-777b6b5e-7551-4d31-8ad8-12e668087838 req-8f74accd-17d8-4732-93bb-acbee5675d9c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.020526 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-777b6b5e-7551-4d31-8ad8-12e668087838 req-8f74accd-17d8-4732-93bb-acbee5675d9c service nova] Creating event network-changed:cbe017f3-1a9e-4b8f-b078-a8a69597377e for instance ce12ca16-56f4-459d-bc88-98eab54424b7 on nch1-master-1 Dec 18 20:52:17.033440 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-777b6b5e-7551-4d31-8ad8-12e668087838 req-8f74accd-17d8-4732-93bb-acbee5675d9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068129 Dec 18 20:52:17.034486 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 829/1695] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:17.089441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184005bc5c34c038fd140564572807e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f74319f4d954cea9418c30afd53b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:17.101689 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20283d68-9b8a-4390-a124-feff4b16cfd4 tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 200 len: 1519 microversion: 2.1 time: 0.348401 Dec 18 20:52:17.102531 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 867/1696] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:16 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 1519 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:17.153521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d5893123-1cab-4d16-8f1c-9a45f3dc2e72 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:17.156029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d5893123-1cab-4d16-8f1c-9a45f3dc2e72 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:17.185542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5893123-1cab-4d16-8f1c-9a45f3dc2e72 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.186582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5893123-1cab-4d16-8f1c-9a45f3dc2e72 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.188561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5893123-1cab-4d16-8f1c-9a45f3dc2e72 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.190177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5893123-1cab-4d16-8f1c-9a45f3dc2e72 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.318619 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d5893123-1cab-4d16-8f1c-9a45f3dc2e72 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.170620 Dec 18 20:52:17.325370 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 830/1697] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:17 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:17.354198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:17.357628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:17.379640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5bedae23-940b-48bf-8409-fb7037f5849b req-c030a3cf-db2d-483c-986b-2ba48d102c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3", "name": "network-vif-unplugged", "status": "completed", "tag": "209a1be9-0f3f-4756-8361-ca32f4b7d826"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:17.381948 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:17.381948 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:17.385283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.398170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.398544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5bedae23-940b-48bf-8409-fb7037f5849b req-c030a3cf-db2d-483c-986b-2ba48d102c61 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.398992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5bedae23-940b-48bf-8409-fb7037f5849b req-c030a3cf-db2d-483c-986b-2ba48d102c61 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.400135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.401925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.425878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5bedae23-940b-48bf-8409-fb7037f5849b req-c030a3cf-db2d-483c-986b-2ba48d102c61 service nova] Creating event network-vif-unplugged:209a1be9-0f3f-4756-8361-ca32f4b7d826 for instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 on nch2-master-1 Dec 18 20:52:17.458184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-5bedae23-940b-48bf-8409-fb7037f5849b req-c030a3cf-db2d-483c-986b-2ba48d102c61 service nova] Instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:52:17.495255 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5bedae23-940b-48bf-8409-fb7037f5849b req-c030a3cf-db2d-483c-986b-2ba48d102c61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118812 Dec 18 20:52:17.496571 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 831/1698] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:17.502793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba466b34-6f96-441c-8592-ad1ac8b53d8f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:17.505098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba466b34-6f96-441c-8592-ad1ac8b53d8f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:17.517135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba466b34-6f96-441c-8592-ad1ac8b53d8f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.518618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba466b34-6f96-441c-8592-ad1ac8b53d8f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.520156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba466b34-6f96-441c-8592-ad1ac8b53d8f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.520964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba466b34-6f96-441c-8592-ad1ac8b53d8f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.586710 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba466b34-6f96-441c-8592-ad1ac8b53d8f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.088337 Dec 18 20:52:17.590802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 832/1699] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:17 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:17.768067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:17.769426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:17.780956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.781961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:17.785272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:17.786764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.220639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:18.232835 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-999d1a4a-470d-49c6-bd34-87c679a6cccf tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1475 microversion: 2.1 time: 0.883560 Dec 18 20:52:18.234030 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 868/1700] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:17 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1475 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:18.248921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:18.249755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:18.257285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.258056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.259168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.265490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.417113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:18.451591 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f022ead7-f099-4a8f-aeaa-3bfe8823e401 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1314 microversion: 2.1 time: 0.691164 Dec 18 20:52:18.452225 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 833/1701] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:17 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:18.465271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:18.466165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] [instance: 335d5aef-b6d5-402c-8431-28f42f02d8fc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:18.481778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.482914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.486660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.487324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.519305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] HTTP exception thrown: Instance 335d5aef-b6d5-402c-8431-28f42f02d8fc could not be found. Dec 18 20:52:18.530142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] Returning 404 to user: Instance 335d5aef-b6d5-402c-8431-28f42f02d8fc could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:52:18.531398 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9362ffc2-9475-492b-82d3-8f5f1a595ffc tempest-ListServerFiltersTestJSON-1507499997 tempest-ListServerFiltersTestJSON-1507499997-project] 10.222.0.13 "GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc" status: 404 len: 111 microversion: 2.1 time: 0.077389 Dec 18 20:52:18.534097 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 834/1702] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:18 2021] GET /compute/v2.1/servers/335d5aef-b6d5-402c-8431-28f42f02d8fc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:18.545814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bce187f3-4fbf-420d-9811-98d20a85357b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:18.552506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bce187f3-4fbf-420d-9811-98d20a85357b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:18.565895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce187f3-4fbf-420d-9811-98d20a85357b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.566458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce187f3-4fbf-420d-9811-98d20a85357b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.567304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce187f3-4fbf-420d-9811-98d20a85357b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.567744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce187f3-4fbf-420d-9811-98d20a85357b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.646481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:18.655412 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-608bbf71-8565-4320-b1bc-fc98c33ea64a tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.419959 Dec 18 20:52:18.656014 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 869/1703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:18 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:18.661431 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bce187f3-4fbf-420d-9811-98d20a85357b tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.125782 Dec 18 20:52:18.665718 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 835/1704] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:18 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:18.677543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dcb444c9-b02e-4f5a-b6fd-4c427db71f7a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:18.678579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dcb444c9-b02e-4f5a-b6fd-4c427db71f7a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:18.696537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb444c9-b02e-4f5a-b6fd-4c427db71f7a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.700229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb444c9-b02e-4f5a-b6fd-4c427db71f7a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.711016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb444c9-b02e-4f5a-b6fd-4c427db71f7a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:18.717581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb444c9-b02e-4f5a-b6fd-4c427db71f7a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:18.788627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dcb444c9-b02e-4f5a-b6fd-4c427db71f7a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.114786 Dec 18 20:52:18.793697 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 870/1705] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:18 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:19.061358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a7475fbc-ae4a-4825-aea1-c4a0bd3d2b08 req-2b0a73a4-d59b-4aa0-ab99-590c8626309a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5aef-b6d5-402c-8431-28f42f02d8fc", "name": "network-vif-deleted", "tag": "73fa6ad8-869b-4f9e-a560-517252ea691b"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:19.063450 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:19.063450 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:19.077670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a7475fbc-ae4a-4825-aea1-c4a0bd3d2b08 req-2b0a73a4-d59b-4aa0-ab99-590c8626309a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.078534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a7475fbc-ae4a-4825-aea1-c4a0bd3d2b08 req-2b0a73a4-d59b-4aa0-ab99-590c8626309a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.098621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a7475fbc-ae4a-4825-aea1-c4a0bd3d2b08 req-2b0a73a4-d59b-4aa0-ab99-590c8626309a service nova] Creating event network-vif-deleted:73fa6ad8-869b-4f9e-a560-517252ea691b for instance 335d5aef-b6d5-402c-8431-28f42f02d8fc on nch1-master-1 Dec 18 20:52:19.124729 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a7475fbc-ae4a-4825-aea1-c4a0bd3d2b08 req-2b0a73a4-d59b-4aa0-ab99-590c8626309a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068460 Dec 18 20:52:19.125760 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 836/1706] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:19.251537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:19.252235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:19.259420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.259885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.260886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.261328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.475715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:19.476468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:19.485605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.486477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.487690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.488449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.654559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:19.664544 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e3a348ce-830e-48ec-b6c8-423140114772 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1475 microversion: 2.1 time: 0.416705 Dec 18 20:52:19.675294 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 871/1707] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:19 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1475 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:19.681177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-511a8424-1208-4868-8a66-313fc8b48812 req-ef908e3b-cce4-4c90-b3bf-da71f8ffdb8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3", "tag": "209a1be9-0f3f-4756-8361-ca32f4b7d826"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:19.683271 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:19.683271 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:19.692188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-511a8424-1208-4868-8a66-313fc8b48812 req-ef908e3b-cce4-4c90-b3bf-da71f8ffdb8a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.692949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-511a8424-1208-4868-8a66-313fc8b48812 req-ef908e3b-cce4-4c90-b3bf-da71f8ffdb8a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.705561 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-511a8424-1208-4868-8a66-313fc8b48812 req-ef908e3b-cce4-4c90-b3bf-da71f8ffdb8a service nova] Creating event network-changed:209a1be9-0f3f-4756-8361-ca32f4b7d826 for instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 on nch2-master-1 Dec 18 20:52:19.721609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-511a8424-1208-4868-8a66-313fc8b48812 req-ef908e3b-cce4-4c90-b3bf-da71f8ffdb8a service nova] Instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:52:19.743743 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-511a8424-1208-4868-8a66-313fc8b48812 req-ef908e3b-cce4-4c90-b3bf-da71f8ffdb8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066867 Dec 18 20:52:19.745365 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 872/1708] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:19.750758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:19.751836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:19.759953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.760626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.761642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.762280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.821454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:19.835547 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-14584705-fb92-4413-9f8e-f155e1e32bdb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1464 microversion: 2.1 time: 0.366010 Dec 18 20:52:19.846948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 837/1709] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:19 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1464 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:19.867593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-555e70b3-e0a8-4de9-adca-c79655d1967c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:19.868897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-555e70b3-e0a8-4de9-adca-c79655d1967c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:19.875804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-555e70b3-e0a8-4de9-adca-c79655d1967c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.876486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-555e70b3-e0a8-4de9-adca-c79655d1967c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.877454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-555e70b3-e0a8-4de9-adca-c79655d1967c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.878154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-555e70b3-e0a8-4de9-adca-c79655d1967c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.943158 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-555e70b3-e0a8-4de9-adca-c79655d1967c tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.094221 Dec 18 20:52:19.945212 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 838/1710] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:19 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:19.957659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-996348d0-bc78-416b-8d5f-b2aa88b45d75 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:19.961329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-996348d0-bc78-416b-8d5f-b2aa88b45d75 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:19.980938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-996348d0-bc78-416b-8d5f-b2aa88b45d75 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.981731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-996348d0-bc78-416b-8d5f-b2aa88b45d75 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:19.982963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-996348d0-bc78-416b-8d5f-b2aa88b45d75 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:19.984034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-996348d0-bc78-416b-8d5f-b2aa88b45d75 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:20.077565 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-996348d0-bc78-416b-8d5f-b2aa88b45d75 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.130661 Dec 18 20:52:20.078723 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 839/1711] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:19 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:20.179939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:20.191153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5debb23-edc2-47eb-a392-c7b1919ca787 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.443209 Dec 18 20:52:20.193271 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 873/1712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:19 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:20.474493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6e9c3be-94cc-4531-bf6a-9c95a4a6b498 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:20.479886 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:20.479886 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:20.489620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c6e9c3be-94cc-4531-bf6a-9c95a4a6b498 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Searching by: {'deleted': False, 'project_id': 'c48df72b525b42219b13f6145223684e'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:20.518925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3be-94cc-4531-bf6a-9c95a4a6b498 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:20.519385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3be-94cc-4531-bf6a-9c95a4a6b498 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:20.520208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3be-94cc-4531-bf6a-9c95a4a6b498 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:20.520641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3be-94cc-4531-bf6a-9c95a4a6b498 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:20.620832 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c6e9c3be-94cc-4531-bf6a-9c95a4a6b498 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.540238 Dec 18 20:52:20.622843 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 840/1713] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:52:20 2021] GET /compute/v2.1/servers/detail => generated 15 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:52:20.643063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:20.649579 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:20.649579 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:20.652361 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:20.652361 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:20.654630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Searching by: {'deleted': False} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:20.665293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:20.667912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:20.669251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:20.669997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:20.685812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:20.687515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:20.703418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:20.706883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:20.710859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:20.711373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:20.930073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:21.136510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:21.139567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:21.765900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:21.776526 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fc5a7a8-7b41-471c-9d19-1aa15c819c49 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1473 microversion: 2.1 time: 1.095086 Dec 18 20:52:21.777120 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 841/1714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:20 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1473 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:21.788181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3d4007a-f432-4bbf-9439-39e5a67d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:21.792582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3d4007a-f432-4bbf-9439-39e5a67d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:21.808589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4007a-f432-4bbf-9439-39e5a67d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:21.809019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4007a-f432-4bbf-9439-39e5a67d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:21.810142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4007a-f432-4bbf-9439-39e5a67d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:21.810565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3d4007a-f432-4bbf-9439-39e5a67d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:21.970317 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3d4007a-f432-4bbf-9439-39e5a67d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.187694 Dec 18 20:52:21.975313 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 842/1715] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:21 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:21.981037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-23015144-0baa-4f6f-b296-c0ce21bec207 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:21.986675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-23015144-0baa-4f6f-b296-c0ce21bec207 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:22.001053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23015144-0baa-4f6f-b296-c0ce21bec207 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.002786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23015144-0baa-4f6f-b296-c0ce21bec207 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.005084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23015144-0baa-4f6f-b296-c0ce21bec207 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.007842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23015144-0baa-4f6f-b296-c0ce21bec207 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.082339 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06861b8c-3c54-424a-b9df-527b2a960edc tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11573 microversion: 2.1 time: 1.443870 Dec 18 20:52:22.083130 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 874/1716] 10.222.0.13 () {58 vars in 1170 bytes} [Sat Dec 18 20:52:20 2021] GET /compute/v2.1/servers/detail?all_tenants= => generated 11573 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:52:22.090392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:22.091132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:22.100893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.101767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.103014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.104550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.107247 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-23015144-0baa-4f6f-b296-c0ce21bec207 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.130159 Dec 18 20:52:22.107984 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 843/1717] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:21 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:22.137741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-192e6175-e9e6-42f3-85e7-ce38a613fb07 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:22.141740 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:22.141740 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:22.144541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-192e6175-e9e6-42f3-85e7-ce38a613fb07 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Searching by: {'deleted': False, 'project_id': 'c48df72b525b42219b13f6145223684e'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:22.153234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-192e6175-e9e6-42f3-85e7-ce38a613fb07 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.154630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-192e6175-e9e6-42f3-85e7-ce38a613fb07 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.156138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-192e6175-e9e6-42f3-85e7-ce38a613fb07 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.156706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-192e6175-e9e6-42f3-85e7-ce38a613fb07 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.211375 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-192e6175-e9e6-42f3-85e7-ce38a613fb07 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?tenant_id=09f464a0dbea408cb3f43c2c96bdaaac" status: 200 len: 15 microversion: 2.1 time: 0.075294 Dec 18 20:52:22.212172 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 844/1718] 10.222.0.13 () {58 vars in 1230 bytes} [Sat Dec 18 20:52:22 2021] GET /compute/v2.1/servers/detail?tenant_id=09f464a0dbea408cb3f43c2c96bdaaac => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:52:22.231338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:22.238863 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:22.238863 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:22.246284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Searching by: {'tenant_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'deleted': False} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:22.260975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.265367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.267034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.271659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.358041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:22.369015 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-de9a4c94-f205-4e35-9123-8c5f39a230f0 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.284048 Dec 18 20:52:22.371176 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 875/1719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:22 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:22.404180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:22.612187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.612590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.796707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:22.797317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:22.804316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.804761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:22.810518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:22.811261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.092175 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5e9a3e7a-84c2-4e07-b76a-b44f6a533b6d tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=09f464a0dbea408cb3f43c2c96bdaaac" status: 200 len: 4828 microversion: 2.1 time: 0.868742 Dec 18 20:52:23.093240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 845/1720] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 20:52:22 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=09f464a0dbea408cb3f43c2c96bdaaac => generated 4828 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:23.097731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-171911de-4ad0-407b-af14-e39a494f23d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:23.099355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-171911de-4ad0-407b-af14-e39a494f23d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:23.112303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-171911de-4ad0-407b-af14-e39a494f23d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.118634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-171911de-4ad0-407b-af14-e39a494f23d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.120200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-171911de-4ad0-407b-af14-e39a494f23d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.120547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-171911de-4ad0-407b-af14-e39a494f23d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.170677 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-171911de-4ad0-407b-af14-e39a494f23d0 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.074913 Dec 18 20:52:23.172738 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 846/1721] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:23 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:23.182734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-309c1d20-2446-4bcd-801c-05ec72fcfcb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:23.183836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-309c1d20-2446-4bcd-801c-05ec72fcfcb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:23.203893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c1d20-2446-4bcd-801c-05ec72fcfcb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.204346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c1d20-2446-4bcd-801c-05ec72fcfcb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.205157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c1d20-2446-4bcd-801c-05ec72fcfcb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.205608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c1d20-2446-4bcd-801c-05ec72fcfcb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.275397 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-309c1d20-2446-4bcd-801c-05ec72fcfcb7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.100015 Dec 18 20:52:23.280420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:23.292460 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 847/1722] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:23 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:23.294856 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-69112103-2bd3-429c-bedb-7b408064e77a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1470 microversion: 2.1 time: 0.502107 Dec 18 20:52:23.296727 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 876/1723] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:22 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1470 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:23.301708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f47bd0a9-de0b-453e-9bed-62ac9b4ad4e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:23.305118 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:23.305118 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:23.307799 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:23.307799 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:23.323523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf60215e-cad3-4c11-8e63-b629152efcd3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:23.324280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf60215e-cad3-4c11-8e63-b629152efcd3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:23.329678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f47bd0a9-de0b-453e-9bed-62ac9b4ad4e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Searching by: {'tenant_id': 'c48df72b525b42219b13f6145223684e', 'deleted': False} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:23.335399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf60215e-cad3-4c11-8e63-b629152efcd3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.338652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf60215e-cad3-4c11-8e63-b629152efcd3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.339448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf60215e-cad3-4c11-8e63-b629152efcd3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.339894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf60215e-cad3-4c11-8e63-b629152efcd3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.345526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47bd0a9-de0b-453e-9bed-62ac9b4ad4e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.345980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47bd0a9-de0b-453e-9bed-62ac9b4ad4e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.348362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47bd0a9-de0b-453e-9bed-62ac9b4ad4e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.348809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47bd0a9-de0b-453e-9bed-62ac9b4ad4e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.384225 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f47bd0a9-de0b-453e-9bed-62ac9b4ad4e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c48df72b525b42219b13f6145223684e" status: 200 len: 15 microversion: 2.1 time: 0.089083 Dec 18 20:52:23.385632 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 848/1724] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 20:52:23 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c48df72b525b42219b13f6145223684e => generated 15 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:52:23.393676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:23.394943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:23.410483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.411216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.412660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.412660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.472132 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf60215e-cad3-4c11-8e63-b629152efcd3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3/action" status: 204 len: 0 microversion: 2.1 time: 0.162492 Dec 18 20:52:23.472929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 877/1725] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:23 2021] POST /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3/action => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:23.501965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ec1c8634-6901-47df-9c89-2f141429adc4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:23.513747 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:23.513747 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:23.522556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ec1c8634-6901-47df-9c89-2f141429adc4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.044147 Dec 18 20:52:23.523369 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 878/1726] 10.222.0.13 () {58 vars in 1188 bytes} [Sat Dec 18 20:52:23 2021] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:52:23.541063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:23.544125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:23.563763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.565931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.566843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.568911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.719651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:23.733357 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ae88aaf-24e4-47c3-be97-88e8275dfc85 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.346081 Dec 18 20:52:23.735412 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 849/1727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:23 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:23.755106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-73a65f31-bdc6-498c-8279-fafb8c8429e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:23.756766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-73a65f31-bdc6-498c-8279-fafb8c8429e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:23.764854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a65f31-bdc6-498c-8279-fafb8c8429e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.765699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a65f31-bdc6-498c-8279-fafb8c8429e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.766808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a65f31-bdc6-498c-8279-fafb8c8429e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.767634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a65f31-bdc6-498c-8279-fafb8c8429e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.874697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-73a65f31-bdc6-498c-8279-fafb8c8429e7 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action" status: 202 len: 0 microversion: 2.1 time: 0.137814 Dec 18 20:52:23.878529 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 850/1728] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:23 2021] POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:52:23.883977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:23.892129 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:23.892129 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:23.893798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:23.894893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:23.903366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.903366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:23.903809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:23.905368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:24.019168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:24.030230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e55fbf6-ed8c-407c-aaeb-6c18a9c3126b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1470 microversion: 2.1 time: 0.503289 Dec 18 20:52:24.031453 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 879/1729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:23 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1470 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:24.085037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:24.173612 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-434a8816-5a77-4df3-87a3-0818aa341edf tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.293849 Dec 18 20:52:24.175217 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 851/1730] 10.222.0.13 () {58 vars in 1149 bytes} [Sat Dec 18 20:52:23 2021] GET /compute/v2.1/servers?status=error => generated 339 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:52:24.185995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c658ec98-6d5a-461b-a0a0-c59c68d38b77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:24.187165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c658ec98-6d5a-461b-a0a0-c59c68d38b77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:24.197395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c658ec98-6d5a-461b-a0a0-c59c68d38b77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:24.200510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c658ec98-6d5a-461b-a0a0-c59c68d38b77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:24.203028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c658ec98-6d5a-461b-a0a0-c59c68d38b77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:24.204009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7bac057b-75e5-4b4d-a00f-c7c8f9365ce2 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:24.204790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c658ec98-6d5a-461b-a0a0-c59c68d38b77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:24.206517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7bac057b-75e5-4b4d-a00f-c7c8f9365ce2 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:24.217821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bac057b-75e5-4b4d-a00f-c7c8f9365ce2 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:24.218489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bac057b-75e5-4b4d-a00f-c7c8f9365ce2 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:24.219485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bac057b-75e5-4b4d-a00f-c7c8f9365ce2 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:24.220109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bac057b-75e5-4b4d-a00f-c7c8f9365ce2 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:24.283679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c658ec98-6d5a-461b-a0a0-c59c68d38b77 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.103188 Dec 18 20:52:24.284942 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 880/1731] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:24 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:52:24.624872 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7bac057b-75e5-4b4d-a00f-c7c8f9365ce2 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action" status: 202 len: 0 microversion: 2.1 time: 0.431988 Dec 18 20:52:24.625887 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 852/1732] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:24 2021] POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:52:24.631047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-602e9519-c361-49a6-a1d8-6820c17220b3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:24.632078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-602e9519-c361-49a6-a1d8-6820c17220b3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:24.649776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1029726018", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "7fe37750-b06f-419d-82fb-61fd7d848a35"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:24.656577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602e9519-c361-49a6-a1d8-6820c17220b3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:24.657209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602e9519-c361-49a6-a1d8-6820c17220b3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:24.658450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602e9519-c361-49a6-a1d8-6820c17220b3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:24.658926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602e9519-c361-49a6-a1d8-6820c17220b3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:24.744710 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-602e9519-c361-49a6-a1d8-6820c17220b3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.114690 Dec 18 20:52:24.746786 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 853/1733] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:24 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:24.761774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d05cb6b3-da27-4f17-91cf-ca5b5e05b4a2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'create', calling method: .version_select at 0x7f714ee91310>, body: {"keypair": {"name": "tempest-keypair-1201310450"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:24.784443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] validate_networks() for [('7fe37750-b06f-419d-82fb-61fd7d848a35', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:52:24.794156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d05cb6b3-da27-4f17-91cf-ca5b5e05b4a2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Getting quotas for project 405bfbeb7b7d47c48b706aa32c6702bf. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:52:24.855683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d05cb6b3-da27-4f17-91cf-ca5b5e05b4a2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Getting quotas for user 9073865992504246b9d1699da089c86f and project 405bfbeb7b7d47c48b706aa32c6702bf. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:52:25.128465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d05cb6b3-da27-4f17-91cf-ca5b5e05b4a2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Getting quotas for project 405bfbeb7b7d47c48b706aa32c6702bf. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:52:25.134743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d05cb6b3-da27-4f17-91cf-ca5b5e05b4a2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Getting quotas for user 9073865992504246b9d1699da089c86f and project 405bfbeb7b7d47c48b706aa32c6702bf. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:52:25.162293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d05cb6b3-da27-4f17-91cf-ca5b5e05b4a2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.32 time: 0.409140 Dec 18 20:52:25.168304 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 854/1734] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Dec 18 20:52:24 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 421 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 20:52:25.178298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e707c15f-5cc0-4dd0-a3c5-ad5955485785 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:25.178298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e707c15f-5cc0-4dd0-a3c5-ad5955485785 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:25.183603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e707c15f-5cc0-4dd0-a3c5-ad5955485785 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:25.184042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e707c15f-5cc0-4dd0-a3c5-ad5955485785 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:25.185123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e707c15f-5cc0-4dd0-a3c5-ad5955485785 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:25.185564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e707c15f-5cc0-4dd0-a3c5-ad5955485785 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:25.519509 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e707c15f-5cc0-4dd0-a3c5-ad5955485785 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1615 microversion: 2.1 time: 0.349847 Dec 18 20:52:25.540085 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 855/1735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:25 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1615 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:25.560509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:25.565797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:25.583934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:25.584793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:25.591503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:25.592226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:25.850184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:52:25.850753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:52:25.851403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:52:25.851960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:52:25.852467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:52:25.863939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:25.864683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:25.867231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:25.868043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:25.888399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Getting quotas for project 1a0744714bbf4779a774d5d0d8fc18d7. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:52:25.901978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Getting quotas for user 05a9edc0cd6b4eaababe6d74aa697bc5 and project 1a0744714bbf4779a774d5d0d8fc18d7. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:52:25.933576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Going to run 2 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:52:25.937143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 98fdfb4c-b91a-4b47-bc5c-21b3edeb251d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:52:25.963422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:25.974828 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7114b5c2-17fe-4207-9f49-6603ae3f65bd tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.432421 Dec 18 20:52:25.983716 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 856/1736] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:25 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:25.995883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1276dcc9-7325-4e65-958c-13458c93414a req-aff9b146-2ead-483e-be2a-bc450fca40e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce12ca16-56f4-459d-bc88-98eab54424b7", "name": "network-vif-plugged", "status": "completed", "tag": "cbe017f3-1a9e-4b8f-b078-a8a69597377e"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:25.997419 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:25.997419 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:26.005602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1276dcc9-7325-4e65-958c-13458c93414a req-aff9b146-2ead-483e-be2a-bc450fca40e8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.006108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1276dcc9-7325-4e65-958c-13458c93414a req-aff9b146-2ead-483e-be2a-bc450fca40e8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.022560 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1276dcc9-7325-4e65-958c-13458c93414a req-aff9b146-2ead-483e-be2a-bc450fca40e8 service nova] Creating event network-vif-plugged:cbe017f3-1a9e-4b8f-b078-a8a69597377e for instance ce12ca16-56f4-459d-bc88-98eab54424b7 on nch1-master-1 Dec 18 20:52:26.031515 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1276dcc9-7325-4e65-958c-13458c93414a req-aff9b146-2ead-483e-be2a-bc450fca40e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046538 Dec 18 20:52:26.032773 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 857/1737] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:26.039600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=98fdfb4c-b91a-4b47-bc5c-21b3edeb251d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:52:26.041554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:26.042849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:26.053264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.053947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.055008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.055457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.157998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-415e32d3-4d2e-4574-8484-c9430e38b079 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.869363 Dec 18 20:52:26.161450 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 881/1738] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:52:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:52:26.171291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b41cc64-c2b3-42b4-a0e6-9397057d1161 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:26.173653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b41cc64-c2b3-42b4-a0e6-9397057d1161 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:26.203849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b41cc64-c2b3-42b4-a0e6-9397057d1161 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.210102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b41cc64-c2b3-42b4-a0e6-9397057d1161 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.211221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b41cc64-c2b3-42b4-a0e6-9397057d1161 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.211915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b41cc64-c2b3-42b4-a0e6-9397057d1161 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.285268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b41cc64-c2b3-42b4-a0e6-9397057d1161 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.122192 Dec 18 20:52:26.292605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 882/1739] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:26 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:26.319249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48668ea0-a24e-4043-9bd2-892633886da4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:26.320000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48668ea0-a24e-4043-9bd2-892633886da4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:26.330383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:26.343592 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2603660a-b24b-4646-b114-42c22b300c22 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1470 microversion: 2.1 time: 0.305187 Dec 18 20:52:26.344934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 858/1740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:26 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1470 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:26.348922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48668ea0-a24e-4043-9bd2-892633886da4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.349875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48668ea0-a24e-4043-9bd2-892633886da4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.352398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48668ea0-a24e-4043-9bd2-892633886da4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.352898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48668ea0-a24e-4043-9bd2-892633886da4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.356506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c076fe17-1f34-4fe4-823d-809fe010d9f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:26.360642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c076fe17-1f34-4fe4-823d-809fe010d9f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:26.375436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c076fe17-1f34-4fe4-823d-809fe010d9f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.377516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c076fe17-1f34-4fe4-823d-809fe010d9f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.380397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c076fe17-1f34-4fe4-823d-809fe010d9f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.381034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c076fe17-1f34-4fe4-823d-809fe010d9f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.473526 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c076fe17-1f34-4fe4-823d-809fe010d9f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.125664 Dec 18 20:52:26.474706 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 859/1741] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:26 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:26.491351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:26.514366 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:26.514366 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:26.517529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:26.518460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Searching by: {'deleted': False, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:26.579821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.580361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.581275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.586531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.618948 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48668ea0-a24e-4043-9bd2-892633886da4 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1615 microversion: 2.1 time: 0.324934 Dec 18 20:52:26.622718 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 883/1742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:26 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1615 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:26.649658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:26.678971 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:26.678971 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:26.680258 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0c044d42-c57c-497c-9997-7fdc3a9d86b4 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.203529 Dec 18 20:52:26.680867 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 860/1743] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:52:26 2021] GET /compute/v2.1/servers => generated 677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:26.692611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba5769d1-bf75-4f44-9cb5-25e8620ef456 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:26.693389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba5769d1-bf75-4f44-9cb5-25e8620ef456 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:26.705726 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:26.705726 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:26.707129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:26.788511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.791926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.801516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:26.801990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:26.826092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ba5769d1-bf75-4f44-9cb5-25e8620ef456 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:26.834053 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba5769d1-bf75-4f44-9cb5-25e8620ef456 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356" status: 200 len: 1220 microversion: 2.1 time: 0.145179 Dec 18 20:52:26.838294 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 861/1744] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:26 2021] GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356 => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:26.972525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:27.000438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:27.003345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:27.030510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.031016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.040633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.041851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.541648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:27.552757 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa76e05c-418c-4777-8e31-bf207c3295ce tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1331 microversion: 2.1 time: 0.563243 Dec 18 20:52:27.556068 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 862/1745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:26 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1331 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:52:27.582633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65a282c1-e820-46b6-9e9c-c49c23c00bcf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:27.587041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65a282c1-e820-46b6-9e9c-c49c23c00bcf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:27.605786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65a282c1-e820-46b6-9e9c-c49c23c00bcf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.607184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65a282c1-e820-46b6-9e9c-c49c23c00bcf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.608900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65a282c1-e820-46b6-9e9c-c49c23c00bcf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.610539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65a282c1-e820-46b6-9e9c-c49c23c00bcf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.621778 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad258fa7-3283-4a22-a86c-9a1175136471 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1653 microversion: 2.1 time: 0.986354 Dec 18 20:52:27.628798 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 884/1746] 10.222.0.13 () {58 vars in 1189 bytes} [Sat Dec 18 20:52:26 2021] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1653 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:27.633967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:27.635521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:27.643241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.644615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.645846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.646617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.715361 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65a282c1-e820-46b6-9e9c-c49c23c00bcf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 32650 microversion: 2.1 time: 0.153525 Dec 18 20:52:27.715361 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 863/1747] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:27 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 32650 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:27.724725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2a437e9a-eb57-4a51-86b3-7a60e3028c41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:27.728630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2a437e9a-eb57-4a51-86b3-7a60e3028c41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:27.746918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a437e9a-eb57-4a51-86b3-7a60e3028c41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.747459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a437e9a-eb57-4a51-86b3-7a60e3028c41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.748953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a437e9a-eb57-4a51-86b3-7a60e3028c41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.749407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a437e9a-eb57-4a51-86b3-7a60e3028c41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.798205 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2a437e9a-eb57-4a51-86b3-7a60e3028c41 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.082003 Dec 18 20:52:27.802238 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 864/1748] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:27 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:27.813414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50b90248-76b4-41d1-b294-c20d481e8b51 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:27.821269 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:27.821269 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:27.826724 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:27.826724 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:27.830417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50b90248-76b4-41d1-b294-c20d481e8b51 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:27.844032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b90248-76b4-41d1-b294-c20d481e8b51 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.849444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b90248-76b4-41d1-b294-c20d481e8b51 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.849444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b90248-76b4-41d1-b294-c20d481e8b51 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:27.849713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b90248-76b4-41d1-b294-c20d481e8b51 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:27.982075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:27.998719 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8c3b974f-c78f-4b19-a4bb-95aacd6e9f26 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1462 microversion: 2.1 time: 0.368466 Dec 18 20:52:27.999989 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 885/1749] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:27 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1462 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:28.006778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:28.007642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:28.015767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.016762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.017771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.019213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.053307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50b90248-76b4-41d1-b294-c20d481e8b51 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.252133 Dec 18 20:52:28.054275 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 865/1750] 10.222.0.13 () {58 vars in 1195 bytes} [Sat Dec 18 20:52:27 2021] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:52:28.070084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80555650-ef81-43e5-8b1f-8e37a781ae58 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:28.075208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80555650-ef81-43e5-8b1f-8e37a781ae58 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:28.082711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80555650-ef81-43e5-8b1f-8e37a781ae58 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.083397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80555650-ef81-43e5-8b1f-8e37a781ae58 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.084402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80555650-ef81-43e5-8b1f-8e37a781ae58 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.085611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80555650-ef81-43e5-8b1f-8e37a781ae58 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.148987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:28.158414 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca2f5567-5c27-4a7d-8a59-aba60caa407d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356" status: 200 len: 1216 microversion: 2.1 time: 0.156922 Dec 18 20:52:28.159652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 886/1751] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:28 2021] GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:28.170848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b9d278a9-591d-4ed2-b803-888c1b4a6517 req-dbfe07a1-d532-4cd2-96f8-eac7c81722eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3", "name": "network-vif-plugged", "status": "completed", "tag": "209a1be9-0f3f-4756-8361-ca32f4b7d826"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:28.173192 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:28.173192 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:28.185543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b9d278a9-591d-4ed2-b803-888c1b4a6517 req-dbfe07a1-d532-4cd2-96f8-eac7c81722eb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.187228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b9d278a9-591d-4ed2-b803-888c1b4a6517 req-dbfe07a1-d532-4cd2-96f8-eac7c81722eb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.201165 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b9d278a9-591d-4ed2-b803-888c1b4a6517 req-dbfe07a1-d532-4cd2-96f8-eac7c81722eb service nova] Creating event network-vif-plugged:209a1be9-0f3f-4756-8361-ca32f4b7d826 for instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 on nch2-master-1 Dec 18 20:52:28.206837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b9d278a9-591d-4ed2-b803-888c1b4a6517 req-dbfe07a1-d532-4cd2-96f8-eac7c81722eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045535 Dec 18 20:52:28.207732 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 887/1752] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:28.214707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a4de0cd-9761-4d6e-87f2-b50bfb01d792 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:28.215941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a4de0cd-9761-4d6e-87f2-b50bfb01d792 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:28.224736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a4de0cd-9761-4d6e-87f2-b50bfb01d792 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.225670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a4de0cd-9761-4d6e-87f2-b50bfb01d792 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.226815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a4de0cd-9761-4d6e-87f2-b50bfb01d792 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.227477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a4de0cd-9761-4d6e-87f2-b50bfb01d792 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.281270 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80555650-ef81-43e5-8b1f-8e37a781ae58 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1613 microversion: 2.1 time: 0.219609 Dec 18 20:52:28.282781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 866/1753] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:28 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1613 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:28.303179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93ceefeb-ef1a-4e12-8b35-0e79d9ab2c05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '.version_select at 0x7f714ee918b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:28.305946 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:28.305946 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:28.308926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93ceefeb-ef1a-4e12-8b35-0e79d9ab2c05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.309865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93ceefeb-ef1a-4e12-8b35-0e79d9ab2c05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.338363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-93ceefeb-ef1a-4e12-8b35-0e79d9ab2c05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.040074 Dec 18 20:52:28.339358 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 867/1754] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:52:28 2021] GET /compute/v2.1/os-migrations => generated 409 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:52:28.389360 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a4de0cd-9761-4d6e-87f2-b50bfb01d792 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action" status: 202 len: 0 microversion: 2.1 time: 0.180080 Dec 18 20:52:28.390596 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 888/1755] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:28 2021] POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:52:28.398670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:28.400700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:28.407066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.407529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.408335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.408785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.520882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:52:28.522119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:52:28.522857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:52:28.523514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:52:28.524180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:52:28.554059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1415447183", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:28.656943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:52:28.657584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:28.670524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.673769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.675407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.675877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.762307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d095e4ee-12bd-4106-bcdb-af2ec995df84 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action" status: 202 len: 1068 microversion: 2.1 time: 0.365947 Dec 18 20:52:28.774688 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 868/1756] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:28 2021] POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action => generated 1068 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Dec 18 20:52:28.780669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:28.787069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:28.810486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.811000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:28.815224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:28.816033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.241888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:29.250228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab91791a-26d7-422a-abe3-33bb4a97ceb1 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1536 microversion: 2.1 time: 0.480827 Dec 18 20:52:29.262665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 869/1757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:28 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1536 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:29.275004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57d635bc-2143-4fc8-b741-800f4f3a3fdf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:29.276774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57d635bc-2143-4fc8-b741-800f4f3a3fdf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:29.293106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57d635bc-2143-4fc8-b741-800f4f3a3fdf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.293854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57d635bc-2143-4fc8-b741-800f4f3a3fdf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.294888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57d635bc-2143-4fc8-b741-800f4f3a3fdf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.295483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57d635bc-2143-4fc8-b741-800f4f3a3fdf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.380698 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57d635bc-2143-4fc8-b741-800f4f3a3fdf tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action" status: 200 len: 40770 microversion: 2.1 time: 0.116687 Dec 18 20:52:29.387097 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 870/1758] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:29 2021] POST /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574/action => generated 40770 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:29.392626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:29.407288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:29.414279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.414976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.416526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.417130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.595751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:52:29.596649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:52:29.597429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:52:29.598022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:52:29.598814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:52:29.611169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.612116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.613311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.613977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.639484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:52:29.645859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for user 09d32c08216a4035907c888a3c8cd70f and project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:52:29.663442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:52:29.666420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:52:29.729890 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06638e33-6373-4d51-924f-667e306dddbd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178587 Dec 18 20:52:29.730662 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 889/1759] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:52:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 20:52:29.736672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2885d610-1976-4261-8408-7e8dc335eda1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:29.738095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2885d610-1976-4261-8408-7e8dc335eda1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:29.748482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2885d610-1976-4261-8408-7e8dc335eda1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.749310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2885d610-1976-4261-8408-7e8dc335eda1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.750922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2885d610-1976-4261-8408-7e8dc335eda1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.751688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2885d610-1976-4261-8408-7e8dc335eda1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.803536 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2885d610-1976-4261-8408-7e8dc335eda1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 32579 microversion: 2.1 time: 0.071130 Dec 18 20:52:29.804530 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 890/1760] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:29 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 32579 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:29.810853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2078130631", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b3cf1807-07e5-4f23-a394-25e4d942b008"}, {"port": "f8de1dac-5fbd-4626-8379-c9547acc28fb", "tag": "port-1"}, {"port": "04c02923-efaf-4b7a-9421-6c1c3df3d6eb", "tag": "port-2"}, {"uuid": "86999e20-7286-4a34-ab79-356dd5f0f5ea", "tag": "net-1"}, {"uuid": "86999e20-7286-4a34-ab79-356dd5f0f5ea"}, {"uuid": "5b74eeda-4ba0-4971-b20a-e138901b128c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5b74eeda-4ba0-4971-b20a-e138901b128c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ac480cea-f87c-451e-96df-24febe018123", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "26094cb4-a4fa-43a4-86c4-5a3342be6fa8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "61701d83-e055-4683-9550-0ed663125a4c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--135724728"}], "key_name": "tempest-keypair-1201310450", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:29.858502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:29.874363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3cd3a94-4402-47b5-9ce6-dc26470bfc2c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1472 microversion: 2.1 time: 0.481296 Dec 18 20:52:29.876394 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 871/1761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:29 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:29.900763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:29.901557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:29.908952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.909609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:29.910756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:29.911711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:30.027811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:30.042293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6859376b-134d-446e-803a-fdc61c94df51 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356" status: 200 len: 1278 microversion: 2.1 time: 0.164908 Dec 18 20:52:30.043111 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 872/1762] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:29 2021] GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:30.048416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c607bd9a-adfb-4058-a409-ff10fff001f7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'create', calling method: .version_select at 0x7f714f585c10>, body: {"pool": "c1abfdfc-0c98-4a48-868b-8cd075b12438"} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:30.188149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] validate_networks() for [('b3cf1807-07e5-4f23-a394-25e4d942b008', None, None, None, None, None), (None, None, 'f8de1dac-5fbd-4626-8379-c9547acc28fb', None, None, None), (None, None, '04c02923-efaf-4b7a-9421-6c1c3df3d6eb', None, None, None), ('86999e20-7286-4a34-ab79-356dd5f0f5ea', None, None, None, None, None), ('86999e20-7286-4a34-ab79-356dd5f0f5ea', None, None, None, None, None), ('5b74eeda-4ba0-4971-b20a-e138901b128c', '10.2.2.100', None, None, None, None), ('5b74eeda-4ba0-4971-b20a-e138901b128c', '10.2.2.200', None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:52:35.396756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c607bd9a-adfb-4058-a409-ff10fff001f7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.352228 Dec 18 20:52:35.398301 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 873/1763] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:52:30 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:35.414907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:35.415532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:35.430655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:35.432977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:35.433817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:35.434316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:35.824192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:35.835620 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1de3b4c-fa5f-47b4-ba1d-dc80837a3b28 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1706 microversion: 2.1 time: 0.435971 Dec 18 20:52:35.851377 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 874/1764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:35 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1706 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:35.864264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:35.865947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:35.873137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:35.873739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:35.874776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:35.875279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.129693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:36.137721 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-593294bc-45b7-4ecb-9d4d-b83e91aaf06f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1313 microversion: 2.1 time: 0.285391 Dec 18 20:52:36.138335 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 875/1765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:35 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:36.143937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-063f00b1-56f1-4a3e-b174-5d55a5e5f130 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:36.145121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-063f00b1-56f1-4a3e-b174-5d55a5e5f130 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:36.152071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063f00b1-56f1-4a3e-b174-5d55a5e5f130 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.152530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063f00b1-56f1-4a3e-b174-5d55a5e5f130 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.153335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063f00b1-56f1-4a3e-b174-5d55a5e5f130 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.154079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063f00b1-56f1-4a3e-b174-5d55a5e5f130 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.207818 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-063f00b1-56f1-4a3e-b174-5d55a5e5f130 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 40717 microversion: 2.1 time: 0.067901 Dec 18 20:52:36.208866 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 876/1766] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:36 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 40717 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:52:36.214611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:36.215382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:36.222755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.223235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.224074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.224508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.314098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:52:36.314550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:52:36.315036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:52:36.315448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:52:36.315873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:52:36.325113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.325572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.326447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.326896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.344071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Getting quotas for project 405bfbeb7b7d47c48b706aa32c6702bf. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:52:36.349158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Getting quotas for user 9073865992504246b9d1699da089c86f and project 405bfbeb7b7d47c48b706aa32c6702bf. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:52:36.497499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:52:36.499085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ac480cea-f87c-451e-96df-24febe018123',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='26094cb4-a4fa-43a4-86c4-5a3342be6fa8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61701d83-e055-4683-9550-0ed663125a4c',volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:52:36.536470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:36.543918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78e7cdd1-d71d-4aab-b755-42cef8f9d5ee tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1472 microversion: 2.1 time: 0.333673 Dec 18 20:52:36.544508 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 877/1767] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:36 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:36.549143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:36.550295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:36.557952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.558859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.560209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.560983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.746651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:36.763315 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca7c914c-3939-4990-b9fe-b0b9f6d01fed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356" status: 200 len: 1320 microversion: 2.1 time: 0.217504 Dec 18 20:52:36.764283 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 878/1768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:36 2021] GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:36.773182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-2fd1b741-b88b-4a23-9b0e-2979b1a8a613 req-1831a412-2ec7-498c-b380-e1be68f7415d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfebec43-3354-4223-9f86-adc3ef6fb19d", "tag": "b09fe15f-0b97-40bf-b218-e64ff9933df9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:36.773182 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:36.773182 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:36.781828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2fd1b741-b88b-4a23-9b0e-2979b1a8a613 req-1831a412-2ec7-498c-b380-e1be68f7415d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.782312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2fd1b741-b88b-4a23-9b0e-2979b1a8a613 req-1831a412-2ec7-498c-b380-e1be68f7415d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.797142 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-2fd1b741-b88b-4a23-9b0e-2979b1a8a613 req-1831a412-2ec7-498c-b380-e1be68f7415d service nova] Creating event network-changed:b09fe15f-0b97-40bf-b218-e64ff9933df9 for instance cfebec43-3354-4223-9f86-adc3ef6fb19d on nch1-master-1 Dec 18 20:52:36.805001 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-2fd1b741-b88b-4a23-9b0e-2979b1a8a613 req-1831a412-2ec7-498c-b380-e1be68f7415d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038456 Dec 18 20:52:36.806974 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 879/1769] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:36.814109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b403f193-5b61-4231-ac21-665e1d98cafa req-99918e9c-c408-4143-89fc-4ac055342908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704a41a1-bd03-4b9c-8164-b39c33c23356", "tag": "2ecbcce4-d67b-4875-bcc2-e9294017cbcb"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:36.816104 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:36.816104 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:36.826346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b403f193-5b61-4231-ac21-665e1d98cafa req-99918e9c-c408-4143-89fc-4ac055342908 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.827090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b403f193-5b61-4231-ac21-665e1d98cafa req-99918e9c-c408-4143-89fc-4ac055342908 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.843897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b403f193-5b61-4231-ac21-665e1d98cafa req-99918e9c-c408-4143-89fc-4ac055342908 service nova] Creating event network-changed:2ecbcce4-d67b-4875-bcc2-e9294017cbcb for instance 704a41a1-bd03-4b9c-8164-b39c33c23356 on nch2-master-1 Dec 18 20:52:36.849775 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b403f193-5b61-4231-ac21-665e1d98cafa req-99918e9c-c408-4143-89fc-4ac055342908 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041258 Dec 18 20:52:36.855417 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 880/1770] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:36.876151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.193"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:36.878691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:36.887744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.888535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.889644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.890560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.921624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Acquired lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:52:36.938056 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-954b2cf4-298a-4200-93a4-5d89bdbfd151 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.131846 Dec 18 20:52:36.939342 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 891/1771] 10.222.0.13 () {62 vars in 1188 bytes} [Sat Dec 18 20:52:29 2021] POST /compute/v2.1/servers => generated 405 bytes in 7134 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 20:52:36.944351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:36.945197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:36.953466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.954177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:36.955167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:36.955774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:37.746891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:37.755400 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82873f75-cced-4783-a73f-76d074ebc4d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.814783 Dec 18 20:52:37.755997 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 892/1772] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:36 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:37.761952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:37.762722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:37.771865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:37.773540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:37.774703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:37.775888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:37.810070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:52:37.940651 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-102619f9-a659-4ffc-81f2-5a80712e6b1e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "DELETE /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 204 len: 0 microversion: 2.1 time: 0.182450 Dec 18 20:52:37.941253 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 893/1773] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:52:37 2021] DELETE /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:37.946672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:37.947925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:37.956587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:37.957047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:37.958049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:37.959107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:38.136841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:38.146395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:38.148221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:38.149854 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5140899-cbe7-43a3-8b07-922ca6880c9e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1576 microversion: 2.32 time: 0.207177 Dec 18 20:52:38.151230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 894/1774] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:52:37 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:52:38.156460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:38.157336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:38.163486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:38.164318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:38.165431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:38.166657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:38.774069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:38.787263 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-89b18340-7be2-44b4-a8fc-88b0baa4952e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1313 microversion: 2.1 time: 0.634674 Dec 18 20:52:38.787925 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 895/1775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:38 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:38.802240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:38.802856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:38.822604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:38.823120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:38.823926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:38.834930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:39.625921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:39.633868 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dacda2a2-d2ec-4415-beac-7c005e9b3ba0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1472 microversion: 2.1 time: 0.835636 Dec 18 20:52:39.647475 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 896/1776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:38 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1472 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:39.652609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-961b39b7-577d-4d5d-9530-7aaf40f75950 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-450930837"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:39.653973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-961b39b7-577d-4d5d-9530-7aaf40f75950 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:39.661604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-961b39b7-577d-4d5d-9530-7aaf40f75950 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:39.662062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-961b39b7-577d-4d5d-9530-7aaf40f75950 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:39.674864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-961b39b7-577d-4d5d-9530-7aaf40f75950 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:39.675634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-961b39b7-577d-4d5d-9530-7aaf40f75950 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:40.121728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-961b39b7-577d-4d5d-9530-7aaf40f75950 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.472301 Dec 18 20:52:40.127152 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 897/1777] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:39 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Dec 18 20:52:40.134696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:40.135805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:40.144345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:40.145598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:40.146926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:40.147673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:40.749915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:40.764692 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-038f3f51-5676-4092-ab37-73cb1128dc9b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356" status: 200 len: 1320 microversion: 2.1 time: 0.635894 Dec 18 20:52:40.765934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 898/1778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:40 2021] GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356 => generated 1320 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:40.776786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:40.777859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:40.790277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:40.790784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:40.791598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:40.792048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:41.200474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Building network info cache for instance {{(pid=140732) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:52:41.363619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:41.371901 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b541f54-dede-434f-8e10-3a69445e13b6 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1712 microversion: 2.1 time: 0.604722 Dec 18 20:52:41.372487 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 899/1779] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:40 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1712 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:41.385744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-25bfb6c0-392d-4d2a-9423-8be4d5cbeb77 req-a90bb769-b5f9-490b-84d1-8b539d305d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fdfb4c-b91a-4b47-bc5c-21b3edeb251d", "tag": "64d3133c-2391-4792-9bd6-ac1e947e1ef2"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:41.387673 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:41.387673 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:41.406916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-25bfb6c0-392d-4d2a-9423-8be4d5cbeb77 req-a90bb769-b5f9-490b-84d1-8b539d305d02 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:41.407456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-25bfb6c0-392d-4d2a-9423-8be4d5cbeb77 req-a90bb769-b5f9-490b-84d1-8b539d305d02 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:41.435798 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-25bfb6c0-392d-4d2a-9423-8be4d5cbeb77 req-a90bb769-b5f9-490b-84d1-8b539d305d02 service nova] Creating event network-changed:64d3133c-2391-4792-9bd6-ac1e947e1ef2 for instance 98fdfb4c-b91a-4b47-bc5c-21b3edeb251d on nch2-master-1 Dec 18 20:52:41.441429 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-25bfb6c0-392d-4d2a-9423-8be4d5cbeb77 req-a90bb769-b5f9-490b-84d1-8b539d305d02 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063653 Dec 18 20:52:41.442503 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 900/1780] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:41.467596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-49f453df-500b-45dd-8c4f-b5a7d41f5562 req-61af715c-bfd4-481b-9c51-116429a2cbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704a41a1-bd03-4b9c-8164-b39c33c23356", "name": "network-vif-plugged", "status": "completed", "tag": "2ecbcce4-d67b-4875-bcc2-e9294017cbcb"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:41.470312 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:41.470312 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:41.483237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-49f453df-500b-45dd-8c4f-b5a7d41f5562 req-61af715c-bfd4-481b-9c51-116429a2cbd7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:41.483996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-49f453df-500b-45dd-8c4f-b5a7d41f5562 req-61af715c-bfd4-481b-9c51-116429a2cbd7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:41.500963 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-49f453df-500b-45dd-8c4f-b5a7d41f5562 req-61af715c-bfd4-481b-9c51-116429a2cbd7 service nova] Creating event network-vif-plugged:2ecbcce4-d67b-4875-bcc2-e9294017cbcb for instance 704a41a1-bd03-4b9c-8164-b39c33c23356 on nch2-master-1 Dec 18 20:52:41.507730 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-49f453df-500b-45dd-8c4f-b5a7d41f5562 req-61af715c-bfd4-481b-9c51-116429a2cbd7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062797 Dec 18 20:52:41.508863 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 901/1781] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:41.515541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:41.535418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:41.544574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:41.545273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:41.546472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:41.547096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:42.592479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:42.606416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:42.608428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:42.609876 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44d9cc72-e544-4825-8865-8cde3b409727 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1753 microversion: 2.32 time: 1.099100 Dec 18 20:52:42.611006 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 902/1782] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:52:41 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1753 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:52:42.615563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:42.616445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:42.625284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:42.626078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:42.627143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:42.627795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.072736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:43.080998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4108b90b-19b2-46ea-90b4-e65aed4ce7fa tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1313 microversion: 2.1 time: 0.468719 Dec 18 20:52:43.081583 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 903/1783] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:42 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:43.085892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:43.102746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:43.109152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.109622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.110485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.110935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.533251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Updating instance_info_cache with network_info: [{"id": "cbe017f3-1a9e-4b8f-b078-a8a69597377e", "address": "fa:16:3e:8d:e6:3a", "network": {"id": "f1d70eca-02f4-4675-afda-361ba3071aaf", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1421722987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47e94e03944844ccb90b9a5818d00856", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcbe017f3-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140732) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:52:43.553447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Releasing lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:52:43.554970 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1508b9af-78c5-4125-a724-37df3c10fe32 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action" status: 202 len: 0 microversion: 2.1 time: 6.697470 Dec 18 20:52:43.558158 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 881/1784] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:36 2021] POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action => generated 0 bytes in 6700 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 20:52:43.572540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:43.574883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:43.582121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:43.588818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.590060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.591387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.592920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.603132 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed51df74-0d33-4caf-b351-3f3f4d54f40e tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1472 microversion: 2.1 time: 0.520416 Dec 18 20:52:43.603871 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 904/1785] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:43 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:43.622540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:43.625217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:43.645656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.646229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.647184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.647988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.789095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e0c0d3dc8441968dafc98b902ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48e95c75c9444f2a0d2cb6704727346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:43.798937 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93026251-cd41-48f8-b359-0e8eaf243ca9 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 200 len: 1644 microversion: 2.1 time: 0.194157 Dec 18 20:52:43.810688 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 905/1786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:43 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 1644 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:43.824297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-545b2672-fad2-459d-9c1b-2ffb499f4ced req-e3290da0-4228-4fcf-ae7e-6c1ed8698701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce12ca16-56f4-459d-bc88-98eab54424b7", "tag": "cbe017f3-1a9e-4b8f-b078-a8a69597377e"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:43.828424 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:43.828424 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:43.854655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-545b2672-fad2-459d-9c1b-2ffb499f4ced req-e3290da0-4228-4fcf-ae7e-6c1ed8698701 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.857977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-545b2672-fad2-459d-9c1b-2ffb499f4ced req-e3290da0-4228-4fcf-ae7e-6c1ed8698701 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:43.887949 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-545b2672-fad2-459d-9c1b-2ffb499f4ced req-e3290da0-4228-4fcf-ae7e-6c1ed8698701 service nova] Creating event network-changed:cbe017f3-1a9e-4b8f-b078-a8a69597377e for instance ce12ca16-56f4-459d-bc88-98eab54424b7 on nch1-master-1 Dec 18 20:52:43.919071 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-545b2672-fad2-459d-9c1b-2ffb499f4ced req-e3290da0-4228-4fcf-ae7e-6c1ed8698701 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100258 Dec 18 20:52:43.920210 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 906/1787] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:43.929700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-124fc799-3182-4651-a47b-4c2a11e7bcea req-811afbd2-e24d-4892-947a-7109ff3f016b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfebec43-3354-4223-9f86-adc3ef6fb19d", "name": "network-vif-plugged", "status": "completed", "tag": "b09fe15f-0b97-40bf-b218-e64ff9933df9"}, {"server_uuid": "98fdfb4c-b91a-4b47-bc5c-21b3edeb251d", "name": "network-vif-plugged", "status": "completed", "tag": "64d3133c-2391-4792-9bd6-ac1e947e1ef2"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:43.941246 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:43.941246 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:43.967259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-124fc799-3182-4651-a47b-4c2a11e7bcea req-811afbd2-e24d-4892-947a-7109ff3f016b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:43.968893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-124fc799-3182-4651-a47b-4c2a11e7bcea req-811afbd2-e24d-4892-947a-7109ff3f016b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:44.002020 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-124fc799-3182-4651-a47b-4c2a11e7bcea req-811afbd2-e24d-4892-947a-7109ff3f016b service nova] Creating event network-vif-plugged:b09fe15f-0b97-40bf-b218-e64ff9933df9 for instance cfebec43-3354-4223-9f86-adc3ef6fb19d on nch1-master-1 Dec 18 20:52:44.004385 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-124fc799-3182-4651-a47b-4c2a11e7bcea req-811afbd2-e24d-4892-947a-7109ff3f016b service nova] Creating event network-vif-plugged:64d3133c-2391-4792-9bd6-ac1e947e1ef2 for instance 98fdfb4c-b91a-4b47-bc5c-21b3edeb251d on nch2-master-1 Dec 18 20:52:44.027997 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-124fc799-3182-4651-a47b-4c2a11e7bcea req-811afbd2-e24d-4892-947a-7109ff3f016b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104510 Dec 18 20:52:44.029973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 907/1788] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:43 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:44.042989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba0c62d8-e7af-4f10-8024-7786d237fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'create', calling method: .version_select at 0x7f715c440550>, body: {"pool": "c1abfdfc-0c98-4a48-868b-8cd075b12438"} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:44.108806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:44.116834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-735d819c-fecc-4294-a506-ba34958a5700 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356" status: 200 len: 1509 microversion: 2.1 time: 0.556138 Dec 18 20:52:44.132364 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 882/1789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:43 2021] GET /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356 => generated 1509 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:44.143540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:44.144159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:44.168171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:44.168871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:44.172762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:44.173408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:45.018700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:45.042934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:45.048030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:45.051430 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d7e1904-cbe8-4a3d-85d2-a082aff8eadb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1833 microversion: 2.32 time: 0.917706 Dec 18 20:52:45.053796 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 883/1790] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:52:44 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1833 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:52:45.064798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:45.066444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:45.073105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:45.073858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:45.074942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:45.075651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:46.508739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:46.517232 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f20c6080-9766-42d1-a7d5-c3c208e8356f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1313 microversion: 2.1 time: 1.462514 Dec 18 20:52:46.523063 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 884/1791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:45 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1313 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:46.528912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:46.533753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 98fdfb4c-b91a-4b47-bc5c-21b3edeb251d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:46.548976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:46.551627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:46.555730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:46.558671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:47.255354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:47.265274 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96fe973b-dfbb-4b74-aca0-0ba81b0307e8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/98fdfb4c-b91a-4b47-bc5c-21b3edeb251d" status: 200 len: 1508 microversion: 2.1 time: 0.740680 Dec 18 20:52:47.277444 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 885/1792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:46 2021] GET /compute/v2.1/servers/98fdfb4c-b91a-4b47-bc5c-21b3edeb251d => generated 1508 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:47.283399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:47.284281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:47.299429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:47.300508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:47.301815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:47.302891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:47.860484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:47.874862 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-766ac0cb-f6df-489a-945e-8e88c6371eaa tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1478 microversion: 2.1 time: 0.595693 Dec 18 20:52:47.877210 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 886/1793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:47 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1478 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:47.902006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:47.906143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:47.915029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:47.917396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:47.918866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:47.919590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:47.943459 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] HTTP exception thrown: Instance edeabf63-f66c-4719-9212-d3214bd03574 could not be found. Dec 18 20:52:47.944414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Returning 404 to user: Instance edeabf63-f66c-4719-9212-d3214bd03574 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:52:47.945468 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0582fe8c-7cf5-4f28-8842-a6dd3e91055f tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 404 len: 111 microversion: 2.1 time: 0.065732 Dec 18 20:52:47.948155 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 887/1794] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:47 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:47.953728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-395ebc61-95d4-4a92-9f40-0aa106edd19c req-e37d949b-f720-40f1-900e-605eeaec8a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "bf2508ae-cc73-498d-b496-3c1f2e87f0f4"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:47.955774 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:47.955774 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:47.969225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-395ebc61-95d4-4a92-9f40-0aa106edd19c req-e37d949b-f720-40f1-900e-605eeaec8a8c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:47.970442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-395ebc61-95d4-4a92-9f40-0aa106edd19c req-e37d949b-f720-40f1-900e-605eeaec8a8c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:47.994327 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-395ebc61-95d4-4a92-9f40-0aa106edd19c req-e37d949b-f720-40f1-900e-605eeaec8a8c service nova] Creating event network-changed:bf2508ae-cc73-498d-b496-3c1f2e87f0f4 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:52:47.999697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-395ebc61-95d4-4a92-9f40-0aa106edd19c req-e37d949b-f720-40f1-900e-605eeaec8a8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049922 Dec 18 20:52:48.000568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 888/1795] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:48.006287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:48.012948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:48.020094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:48.033557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:48.034479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:48.034932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:48.602179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:48.613709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:48.615622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:48.618921 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-017ca41c-e08d-44f6-8590-2ff712ea85bd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.616751 Dec 18 20:52:48.622002 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 889/1796] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:52:48 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:52:48.629631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-71c915bb-117f-44ce-9604-748993cd800f req-29eb9b42-dd9d-48d6-8355-8407f7610c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-plugged", "status": "completed", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:48.645607 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:48.645607 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:48.660054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-71c915bb-117f-44ce-9604-748993cd800f req-29eb9b42-dd9d-48d6-8355-8407f7610c6a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:48.660984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-71c915bb-117f-44ce-9604-748993cd800f req-29eb9b42-dd9d-48d6-8355-8407f7610c6a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:48.695479 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-71c915bb-117f-44ce-9604-748993cd800f req-29eb9b42-dd9d-48d6-8355-8407f7610c6a service nova] Creating event network-vif-plugged:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:52:48.705323 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-71c915bb-117f-44ce-9604-748993cd800f req-29eb9b42-dd9d-48d6-8355-8407f7610c6a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081912 Dec 18 20:52:48.708686 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 890/1797] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:48.730557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f61e49aa-be73-4cc2-b54c-d59cf1da381e req-cbf93fec-0404-4448-af3f-b7cba4891059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edeabf63-f66c-4719-9212-d3214bd03574", "name": "network-vif-deleted", "tag": "0a593524-9707-4109-9577-e536b658044d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:48.732159 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:48.732159 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:48.747859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f61e49aa-be73-4cc2-b54c-d59cf1da381e req-cbf93fec-0404-4448-af3f-b7cba4891059 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:48.751606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f61e49aa-be73-4cc2-b54c-d59cf1da381e req-cbf93fec-0404-4448-af3f-b7cba4891059 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:48.772375 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f61e49aa-be73-4cc2-b54c-d59cf1da381e req-cbf93fec-0404-4448-af3f-b7cba4891059 service nova] Creating event network-vif-deleted:0a593524-9707-4109-9577-e536b658044d for instance edeabf63-f66c-4719-9212-d3214bd03574 on nch2-master-1 Dec 18 20:52:48.793117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f61e49aa-be73-4cc2-b54c-d59cf1da381e req-cbf93fec-0404-4448-af3f-b7cba4891059 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081909 Dec 18 20:52:48.795322 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 891/1798] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:48.802055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:48.806547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 98fdfb4c-b91a-4b47-bc5c-21b3edeb251d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:48.820230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:48.823413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:48.827246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:48.827953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:48.894107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 98fdfb4c-b91a-4b47-bc5c-21b3edeb251d] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:52:49.109140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9a672073-ae36-4a60-beda-7d60741d91de tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "DELETE /compute/v2.1/servers/98fdfb4c-b91a-4b47-bc5c-21b3edeb251d" status: 204 len: 0 microversion: 2.1 time: 0.311996 Dec 18 20:52:49.113807 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 892/1799] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:52:48 2021] DELETE /compute/v2.1/servers/98fdfb4c-b91a-4b47-bc5c-21b3edeb251d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:49.119936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:49.120779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:49.130660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.130984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.132376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.133356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.169795 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba0c62d8-e7af-4f10-8024-7786d237fcd2 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.136116 Dec 18 20:52:49.170577 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 908/1800] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:52:44 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:49.180524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:49.182265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:49.196546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.205614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.208072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.210610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.250704 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] HTTP exception thrown: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. Dec 18 20:52:49.251560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Returning 404 to user: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:52:49.252585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-10f2faa3-accc-4c97-bee1-0bb71653d9e1 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 404 len: 111 microversion: 2.1 time: 0.081096 Dec 18 20:52:49.253810 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 909/1801] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:52:49 2021] DELETE /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:49.258758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:49.259628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:49.267881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.268834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.270535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.271147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.632106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:49.644591 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31257428-0b8b-4b5c-be53-6b97faa14a19 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1462 microversion: 2.1 time: 0.527102 Dec 18 20:52:49.645245 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 893/1802] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:49 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1462 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:49.662208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:49.663124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:49.678938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.679660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.685942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.686804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.750091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 704a41a1-bd03-4b9c-8164-b39c33c23356] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:52:49.792592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:49.801299 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-baacb849-36fa-4533-8446-f763e5ab0b8c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1478 microversion: 2.1 time: 0.546214 Dec 18 20:52:49.822424 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 910/1803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:49 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1478 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:49.836256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.145"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:49.837781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:49.851289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.853913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.856054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.856807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.918193 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9b8d0f9-233c-4084-9d05-db11d1b191cf tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "DELETE /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356" status: 204 len: 0 microversion: 2.1 time: 0.271658 Dec 18 20:52:49.920888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Acquired lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:52:49.921390 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 894/1804] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:52:49 2021] DELETE /compute/v2.1/servers/704a41a1-bd03-4b9c-8164-b39c33c23356 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:49.934181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:49.938360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:49.948397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.949201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.950119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.950675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.968005 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] HTTP exception thrown: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. Dec 18 20:52:49.968514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Returning 404 to user: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:52:49.969355 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c00aa046-5503-4bd2-84e8-0190dfaf9fe2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 404 len: 111 microversion: 2.1 time: 0.045920 Dec 18 20:52:49.971150 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 895/1805] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:49 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:49.975831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:49.976435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:49.984016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.984566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:49.985462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:49.985968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:50.672390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:50.688777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:50.692612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:50.696471 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-afb62cc2-2667-43e4-8081-737d259a5bdf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.723220 Dec 18 20:52:50.698535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 896/1806] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:52:49 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:52:50.713514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:50.721726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:50.739407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:50.740341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:50.741365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:50.741979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:50.986207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:51.025410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Old instance type m1.heat2, new instance type m1.heat {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 20:52:51.042596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:52:51.045628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:52:51.047150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:52:51.057675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:52:51.060785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:52:51.165142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.3.145 (f6bc1808-de65-4217-98d4-d7680f0bf190) with port cbe017f3-1a9e-4b8f-b078-a8a69597377e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network c1abfdfc-0c98-4a48-868b-8cd075b12438.", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:52:51.166500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Releasing lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:52:51.166909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] HTTP exception thrown: Cannot associate floating IP 172.35.3.145 (f6bc1808-de65-4217-98d4-d7680f0bf190) with port cbe017f3-1a9e-4b8f-b078-a8a69597377e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network c1abfdfc-0c98-4a48-868b-8cd075b12438. Dec 18 20:52:51.166909 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-61d3b2fd-de54-49b9-a4a8-2201b741fe86'] Dec 18 20:52:51.167519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Returning 400 to user: Cannot associate floating IP 172.35.3.145 (f6bc1808-de65-4217-98d4-d7680f0bf190) with port cbe017f3-1a9e-4b8f-b078-a8a69597377e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network c1abfdfc-0c98-4a48-868b-8cd075b12438. Dec 18 20:52:51.167519 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-61d3b2fd-de54-49b9-a4a8-2201b741fe86'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:52:51.168366 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76455e98-f4ec-4fb7-aca9-bc879e94e6b7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action" status: 400 len: 382 microversion: 2.1 time: 1.344553 Dec 18 20:52:51.168935 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 911/1807] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:49 2021] POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action => generated 382 bytes in 1346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:52:51.179302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4d26435-681c-47ee-860a-913097435819 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '.version_select at 0x7f714ff80160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:51.219562 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4d26435-681c-47ee-860a-913097435819 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493312864" status: 202 len: 0 microversion: 2.1 time: 0.049382 Dec 18 20:52:51.220087 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 912/1808] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 20:52:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493312864 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:52:51.226380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1050268116", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "7fe37750-b06f-419d-82fb-61fd7d848a35"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:51.313801 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05474b1e-ec96-48f3-939e-e3e1dcbe19f7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d/action" status: 202 len: 0 microversion: 2.1 time: 0.613822 Dec 18 20:52:51.323126 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 897/1809] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:50 2021] POST /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:52:51.344546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f5651212-dc0c-4fad-ae7a-5ff7753296ed req-cdc0d5df-3a32-440a-bdeb-0e9c75bf8afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "f8de1dac-5fbd-4626-8379-c9547acc28fb"}, {"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "04c02923-efaf-4b7a-9421-6c1c3df3d6eb"}, {"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "5740d94d-10b4-4d4f-b84a-14e2647f72c7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:51.353346 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:51.353346 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:51.359697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] validate_networks() for [('7fe37750-b06f-419d-82fb-61fd7d848a35', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:52:51.384886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f5651212-dc0c-4fad-ae7a-5ff7753296ed req-cdc0d5df-3a32-440a-bdeb-0e9c75bf8afb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:51.390088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f5651212-dc0c-4fad-ae7a-5ff7753296ed req-cdc0d5df-3a32-440a-bdeb-0e9c75bf8afb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:51.439458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f5651212-dc0c-4fad-ae7a-5ff7753296ed req-cdc0d5df-3a32-440a-bdeb-0e9c75bf8afb service nova] Creating event network-changed:f8de1dac-5fbd-4626-8379-c9547acc28fb for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:52:51.446010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f5651212-dc0c-4fad-ae7a-5ff7753296ed req-cdc0d5df-3a32-440a-bdeb-0e9c75bf8afb service nova] Creating event network-changed:04c02923-efaf-4b7a-9421-6c1c3df3d6eb for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:52:51.450302 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f5651212-dc0c-4fad-ae7a-5ff7753296ed req-cdc0d5df-3a32-440a-bdeb-0e9c75bf8afb service nova] Creating event network-changed:5740d94d-10b4-4d4f-b84a-14e2647f72c7 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:52:51.476730 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f5651212-dc0c-4fad-ae7a-5ff7753296ed req-cdc0d5df-3a32-440a-bdeb-0e9c75bf8afb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.149801 Dec 18 20:52:51.495978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 898/1810] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:51 2021] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:51.529371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b1895deb-4fb9-4f1f-9135-fbca1f31a0ba req-d76876df-87c2-4dd5-a71f-ccadf4fb76fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d00b730-00ba-4bc7-be51-6de9d571a1b2", "name": "network-vif-unplugged", "status": "completed", "tag": "659424cb-2544-4eb1-afc7-8c764a75b399"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:51.533628 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:51.533628 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:51.549880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b1895deb-4fb9-4f1f-9135-fbca1f31a0ba req-d76876df-87c2-4dd5-a71f-ccadf4fb76fa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:51.554159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b1895deb-4fb9-4f1f-9135-fbca1f31a0ba req-d76876df-87c2-4dd5-a71f-ccadf4fb76fa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:51.581933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b1895deb-4fb9-4f1f-9135-fbca1f31a0ba req-d76876df-87c2-4dd5-a71f-ccadf4fb76fa service nova] Creating event network-vif-unplugged:659424cb-2544-4eb1-afc7-8c764a75b399 for instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 on nch2-master-1 Dec 18 20:52:51.593530 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b1895deb-4fb9-4f1f-9135-fbca1f31a0ba req-d76876df-87c2-4dd5-a71f-ccadf4fb76fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095977 Dec 18 20:52:51.595847 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 899/1811] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:51 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:51.608489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:51.610822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:51.625368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:51.625918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:51.630008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:51.630008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:53.594135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:53.609071 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecb4e11f-6487-4211-ad58-8e555b585dc4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1478 microversion: 2.1 time: 2.002855 Dec 18 20:52:53.610422 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 900/1812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:51 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1478 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:53.616982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-23872e37-08de-4ff7-b9c7-bbcc651a780e tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '.version_select at 0x7f714ef2f3a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:55.209346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:52:55.209873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:52:55.210244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:52:55.210893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:52:55.211496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:52:55.237538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:55.238292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:55.248886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:55.249564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:55.284497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Getting quotas for project 1a0744714bbf4779a774d5d0d8fc18d7. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:52:55.302023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Getting quotas for user 05a9edc0cd6b4eaababe6d74aa697bc5 and project 1a0744714bbf4779a774d5d0d8fc18d7. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:52:55.331454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Going to run 2 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:52:55.334308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:52:55.413975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=f23d751a-dbda-4976-a75f-1b418b3c1ef4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:52:55.539213 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb2b3b59-c50c-49ec-88d6-21c76ce1f480 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.317837 Dec 18 20:52:55.542745 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 913/1813] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:52:51 2021] POST /compute/v2.1/servers => generated 32 bytes in 4322 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Dec 18 20:52:55.553701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:55.556411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:55.569614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:55.571486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:55.573034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:55.574909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:57.171155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:57.184226 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bacb2194-40f9-4636-9ea5-5bbf98c73e97 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1471 microversion: 2.1 time: 1.639735 Dec 18 20:52:57.187693 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 914/1814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:55 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1471 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:57.203770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:57.209210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:57.229793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:57.230593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:57.235555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:57.236159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.077779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:58.091347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:58.096832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:58.101104 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b32b00bb-76a6-4c46-857c-477d7d75ec56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.912196 Dec 18 20:52:58.105030 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 915/1815] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:52:57 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:52:58.114873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c5f654d9-a652-405a-b787-d88160141fa6 req-c3c080d2-281f-46af-994b-6d483ee77ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "ccb5043d-02af-492d-8f2d-78752159fb84"}, {"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "f1cdb751-5072-47e3-96f0-96e30fe3bc2f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:58.116595 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:58.116595 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:58.134700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c5f654d9-a652-405a-b787-d88160141fa6 req-c3c080d2-281f-46af-994b-6d483ee77ccb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:58.135159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c5f654d9-a652-405a-b787-d88160141fa6 req-c3c080d2-281f-46af-994b-6d483ee77ccb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.167265 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c5f654d9-a652-405a-b787-d88160141fa6 req-c3c080d2-281f-46af-994b-6d483ee77ccb service nova] Creating event network-changed:ccb5043d-02af-492d-8f2d-78752159fb84 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:52:58.168058 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c5f654d9-a652-405a-b787-d88160141fa6 req-c3c080d2-281f-46af-994b-6d483ee77ccb service nova] Creating event network-changed:f1cdb751-5072-47e3-96f0-96e30fe3bc2f for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:52:58.184414 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c5f654d9-a652-405a-b787-d88160141fa6 req-c3c080d2-281f-46af-994b-6d483ee77ccb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077942 Dec 18 20:52:58.186005 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 916/1816] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:58 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:58.191394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ed9e13aa-ed9a-4839-9351-24e1a8a1dff5 req-e87b1fa6-dc9a-4e24-a863-9f35a29c47f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d00b730-00ba-4bc7-be51-6de9d571a1b2", "name": "network-vif-plugged", "status": "completed", "tag": "659424cb-2544-4eb1-afc7-8c764a75b399"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:58.198568 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:58.198568 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:58.216794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ed9e13aa-ed9a-4839-9351-24e1a8a1dff5 req-e87b1fa6-dc9a-4e24-a863-9f35a29c47f8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:58.223758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ed9e13aa-ed9a-4839-9351-24e1a8a1dff5 req-e87b1fa6-dc9a-4e24-a863-9f35a29c47f8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.244556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ed9e13aa-ed9a-4839-9351-24e1a8a1dff5 req-e87b1fa6-dc9a-4e24-a863-9f35a29c47f8 service nova] Creating event network-vif-plugged:659424cb-2544-4eb1-afc7-8c764a75b399 for instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 on nch2-master-1 Dec 18 20:52:58.254230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ed9e13aa-ed9a-4839-9351-24e1a8a1dff5 req-e87b1fa6-dc9a-4e24-a863-9f35a29c47f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066555 Dec 18 20:52:58.255242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 917/1817] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:58.270782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:58.271904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:58.284359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:58.285652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.286850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:58.287732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.841201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:58.849885 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1eb113ce-0074-4650-b579-e7f2afe9b74b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1478 microversion: 2.1 time: 0.591680 Dec 18 20:52:58.856733 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 918/1818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:58 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1478 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:58.863181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:58.882070 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:58.882070 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:58.887487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:58.888591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Searching by: {'deleted': False, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:52:58.904547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:58.905442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.907755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:58.912939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.931951 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-23872e37-08de-4ff7-b9c7-bbcc651a780e tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/f6bc1808-de65-4217-98d4-d7680f0bf190" status: 202 len: 0 microversion: 2.1 time: 5.319469 Dec 18 20:52:58.932838 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 901/1819] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:52:53 2021] DELETE /compute/v2.1/os-floating-ips/f6bc1808-de65-4217-98d4-d7680f0bf190 => generated 0 bytes in 5322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:52:58.943576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8099014b-5a2c-4dff-962e-de3f1e1468ec req-adf7d736-f4a2-4696-a46c-186f1b99d36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fdfb4c-b91a-4b47-bc5c-21b3edeb251d", "name": "network-vif-deleted", "tag": "64d3133c-2391-4792-9bd6-ac1e947e1ef2"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:58.952309 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:58.952309 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:52:58.981215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8099014b-5a2c-4dff-962e-de3f1e1468ec req-adf7d736-f4a2-4696-a46c-186f1b99d36a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:58.981670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8099014b-5a2c-4dff-962e-de3f1e1468ec req-adf7d736-f4a2-4696-a46c-186f1b99d36a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:58.991810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:52:59.000788 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8099014b-5a2c-4dff-962e-de3f1e1468ec req-adf7d736-f4a2-4696-a46c-186f1b99d36a service nova] Creating event network-vif-deleted:64d3133c-2391-4792-9bd6-ac1e947e1ef2 for instance 98fdfb4c-b91a-4b47-bc5c-21b3edeb251d on nch2-master-1 Dec 18 20:52:59.007037 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8099014b-5a2c-4dff-962e-de3f1e1468ec req-adf7d736-f4a2-4696-a46c-186f1b99d36a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072607 Dec 18 20:52:59.007909 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 902/1820] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:52:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:59.013126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:59.014046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:59.021878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.022583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.023538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.023984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.074060 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87ad87d4-0b0b-4efe-9a56-9768bb56b018 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.215261 Dec 18 20:52:59.074692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 919/1821] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:52:58 2021] GET /compute/v2.1/servers => generated 673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:52:59.083243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5bbbfaf-091f-4831-92dc-dcce387b64b6 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:59.084265 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:52:59.084265 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:52:59.107207 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5bbbfaf-091f-4831-92dc-dcce387b64b6 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1297665195" status: 202 len: 0 microversion: 2.1 time: 0.031376 Dec 18 20:52:59.108531 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 920/1822] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 20:52:59 2021] DELETE /compute/v2.1/flavors/1297665195 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:52:59.115752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.193"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:52:59.355712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:59.366456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.366456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.366456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.366456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.535596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:59.555319 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d5d10b09-a964-4c09-881f-617c30f2840e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.545881 Dec 18 20:52:59.558818 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 903/1823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:59 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:59.573051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:59.575946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:59.601894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.606686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.612089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.622529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.723031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:52:59.735259 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e499d7b4-c7a3-44c1-961e-d741d824415d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1276 microversion: 2.1 time: 0.173118 Dec 18 20:52:59.735259 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 904/1824] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:52:59 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:59.745257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9ea45d7-6e93-421d-8538-3521d5303a99 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:59.779949 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9ea45d7-6e93-421d-8538-3521d5303a99 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.043815 Dec 18 20:52:59.789166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 905/1825] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:52:59 2021] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:52:59.794135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:52:59.794792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:52:59.807400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.810970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.814674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:52:59.815389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:52:59.984845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Acquired lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:53:00.416468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:00.442687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:00.445046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:00.447718 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6db5f5f6-1759-4699-80f8-d170a7176776 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.656301 Dec 18 20:53:00.450470 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 906/1826] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:52:59 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:00.456702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9870b766-261d-47bb-a9fa-39db34f0dec4 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:00.457849 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:00.457849 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:00.499592 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9870b766-261d-47bb-a9fa-39db34f0dec4 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/467279096" status: 202 len: 0 microversion: 2.1 time: 0.046809 Dec 18 20:53:00.504338 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 907/1827] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:53:00 2021] DELETE /compute/v2.1/flavors/467279096 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:00.510742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:00.511991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:00.528236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:00.529509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:00.531127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:00.531571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:01.427170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:01.435819 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e5c496f-85ae-4480-99fd-143e37aea576 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1464 microversion: 2.1 time: 0.929936 Dec 18 20:53:01.436399 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 908/1828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:00 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1464 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:01.450103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cc7a2c2f-14a8-4de2-b7f8-bca186207418 req-d94f3a00-d9d5-4586-a47b-7c10105cbead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704a41a1-bd03-4b9c-8164-b39c33c23356", "name": "network-vif-unplugged", "status": "completed", "tag": "2ecbcce4-d67b-4875-bcc2-e9294017cbcb"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:01.459750 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:01.459750 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:01.468505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cc7a2c2f-14a8-4de2-b7f8-bca186207418 req-d94f3a00-d9d5-4586-a47b-7c10105cbead service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:01.475397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cc7a2c2f-14a8-4de2-b7f8-bca186207418 req-d94f3a00-d9d5-4586-a47b-7c10105cbead service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:01.510652 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cc7a2c2f-14a8-4de2-b7f8-bca186207418 req-d94f3a00-d9d5-4586-a47b-7c10105cbead service nova] Creating event network-vif-unplugged:2ecbcce4-d67b-4875-bcc2-e9294017cbcb for instance 704a41a1-bd03-4b9c-8164-b39c33c23356 on nch2-master-1 Dec 18 20:53:01.517745 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cc7a2c2f-14a8-4de2-b7f8-bca186207418 req-d94f3a00-d9d5-4586-a47b-7c10105cbead service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079247 Dec 18 20:53:01.518740 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 909/1829] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:01.536481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-def4c322-fa12-428a-bbe3-a9c51ecf50af req-d14acf99-bf27-49ce-b3b5-bb0a7ef9e8cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "e339efff-5759-4aa7-8925-f9e71e302622"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:01.539037 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:01.539037 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:01.551026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-def4c322-fa12-428a-bbe3-a9c51ecf50af req-d14acf99-bf27-49ce-b3b5-bb0a7ef9e8cd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:01.551736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-def4c322-fa12-428a-bbe3-a9c51ecf50af req-d14acf99-bf27-49ce-b3b5-bb0a7ef9e8cd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:01.567502 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-def4c322-fa12-428a-bbe3-a9c51ecf50af req-d14acf99-bf27-49ce-b3b5-bb0a7ef9e8cd service nova] Creating event network-changed:e339efff-5759-4aa7-8925-f9e71e302622 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:01.577492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-def4c322-fa12-428a-bbe3-a9c51ecf50af req-d14acf99-bf27-49ce-b3b5-bb0a7ef9e8cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047188 Dec 18 20:53:01.579663 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 910/1830] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:01.584728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88e3dacb-ed98-4ed7-83b9-f7d86e60c688 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:01.614783 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88e3dacb-ed98-4ed7-83b9-f7d86e60c688 tempest-ServersWithSpecificFlavorTestJSON-947851361 tempest-ServersWithSpecificFlavorTestJSON-947851361-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033224 Dec 18 20:53:01.629153 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 911/1831] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:53:01 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:01.637040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:01.638017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:01.654908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:01.657454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:01.659924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:01.662152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:02.257021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:02.270579 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-290a34e6-0b74-4af1-a806-0e963357b331 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.637446 Dec 18 20:53:02.272087 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 912/1832] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:01 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:02.300062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:02.300791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:02.318747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:02.319536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:02.320595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:02.322479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:02.381992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Building network info cache for instance {{(pid=140731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 20:53:03.020600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:03.029725 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9c9c2f2-2bd0-4b32-beb4-a350cc5edfe9 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1318 microversion: 2.1 time: 0.753408 Dec 18 20:53:03.036723 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 913/1833] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:02 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:03.056854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-19036515-dba1-459f-b3ff-266c83fac835 req-a49231ea-6fe6-470d-b3e4-84fd1b367528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704a41a1-bd03-4b9c-8164-b39c33c23356", "name": "network-vif-deleted", "tag": "2ecbcce4-d67b-4875-bcc2-e9294017cbcb"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:03.062240 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:03.062240 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:03.081347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-19036515-dba1-459f-b3ff-266c83fac835 req-a49231ea-6fe6-470d-b3e4-84fd1b367528 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:03.081804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-19036515-dba1-459f-b3ff-266c83fac835 req-a49231ea-6fe6-470d-b3e4-84fd1b367528 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:03.116513 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-19036515-dba1-459f-b3ff-266c83fac835 req-a49231ea-6fe6-470d-b3e4-84fd1b367528 service nova] Creating event network-vif-deleted:2ecbcce4-d67b-4875-bcc2-e9294017cbcb for instance 704a41a1-bd03-4b9c-8164-b39c33c23356 on nch2-master-1 Dec 18 20:53:03.132500 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-19036515-dba1-459f-b3ff-266c83fac835 req-a49231ea-6fe6-470d-b3e4-84fd1b367528 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084225 Dec 18 20:53:03.133437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 914/1834] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:03.141031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:03.144652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:03.162239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:03.164563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:03.165550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:03.166045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:03.694955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:03.708804 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c92b15a-4ca0-475b-bfe4-0e60338e457f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1464 microversion: 2.1 time: 0.573545 Dec 18 20:53:03.719594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 915/1835] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:03 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1464 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:03.741775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:03.742948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:03.763462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:03.764188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:03.765189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:03.765879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.364922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:04.395255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:04.398293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:04.399728 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b75f6de1-ad29-4d75-ad1b-dfa915510673 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.676345 Dec 18 20:53:04.400793 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 916/1836] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:03 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:04.407326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:04.408640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:04.417306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.418059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.419730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.421856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.447557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] HTTP exception thrown: Instance edeabf63-f66c-4719-9212-d3214bd03574 could not be found. Dec 18 20:53:04.449225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Returning 404 to user: Instance edeabf63-f66c-4719-9212-d3214bd03574 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:04.451216 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81cba424-9ebc-4cf4-a298-f097c98bf8e2 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "DELETE /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 404 len: 111 microversion: 2.1 time: 0.048724 Dec 18 20:53:04.452218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 917/1837] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:04 2021] DELETE /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:04.472919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:04.474077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:04.487754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.488458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.489129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Updating instance_info_cache with network_info: [{"id": "cbe017f3-1a9e-4b8f-b078-a8a69597377e", "address": "fa:16:3e:8d:e6:3a", "network": {"id": "f1d70eca-02f4-4675-afda-361ba3071aaf", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1421722987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47e94e03944844ccb90b9a5818d00856", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcbe017f3-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:53:04.490198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.490832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.508922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Releasing lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:53:04.510687 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0159878-9988-400a-90cf-04149dd4c31f tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action" status: 202 len: 0 microversion: 2.1 time: 5.400291 Dec 18 20:53:04.511692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 921/1838] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:52:59 2021] POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action => generated 0 bytes in 5402 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 20:53:04.516484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e537e50b-83e2-422c-8568-4ec8ec9f1ce2 req-a2bf88ad-92eb-47e7-aa37-8129d6ea142f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23d751a-dbda-4976-a75f-1b418b3c1ef4", "tag": "49e4deb1-4b6d-4313-9ef1-0f5905853b16"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:04.517994 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:04.517994 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:04.535349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e537e50b-83e2-422c-8568-4ec8ec9f1ce2 req-a2bf88ad-92eb-47e7-aa37-8129d6ea142f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.536084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e537e50b-83e2-422c-8568-4ec8ec9f1ce2 req-a2bf88ad-92eb-47e7-aa37-8129d6ea142f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.559969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e537e50b-83e2-422c-8568-4ec8ec9f1ce2 req-a2bf88ad-92eb-47e7-aa37-8129d6ea142f service nova] Creating event network-changed:49e4deb1-4b6d-4313-9ef1-0f5905853b16 for instance f23d751a-dbda-4976-a75f-1b418b3c1ef4 on nch1-master-1 Dec 18 20:53:04.581726 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e537e50b-83e2-422c-8568-4ec8ec9f1ce2 req-a2bf88ad-92eb-47e7-aa37-8129d6ea142f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068706 Dec 18 20:53:04.582552 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 922/1839] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:04.591271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:04.593566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:04.611138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.613190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.615450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.616253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.809737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:53:04.810172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:53:04.810948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:53:04.811393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:53:04.811781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:53:04.883723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:04.906395 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fd4fdf84-1199-4e39-8aef-2b3dbfbc2525 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.450471 Dec 18 20:53:04.907468 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 918/1840] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:04 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:04.923020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:04.939574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:04.940423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:04.947620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.949350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.956368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.959545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.989928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.991060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:04.996225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:04.997127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:05.093699 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0080e88-eda7-44c3-b705-a41485dfe8ce tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action" status: 202 len: 1068 microversion: 2.1 time: 0.507815 Dec 18 20:53:05.095922 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 923/1841] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:04 2021] POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action => generated 1068 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 18 20:53:05.418798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:05.441275 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d8cd142-02e8-45fe-9c6b-f17fe41a635b tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1318 microversion: 2.1 time: 0.515577 Dec 18 20:53:05.442120 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 919/1842] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:04 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:05.447444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a78326a-6486-497f-a551-f44d681b1087 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '.version_select at 0x7f714ef60e50>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:05.515512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:05.518693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: edeabf63-f66c-4719-9212-d3214bd03574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:05.537738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:05.538789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:05.541314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:05.542099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:05.573071 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] HTTP exception thrown: Instance edeabf63-f66c-4719-9212-d3214bd03574 could not be found. Dec 18 20:53:05.573989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Returning 404 to user: Instance edeabf63-f66c-4719-9212-d3214bd03574 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:05.575094 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d712dac-f338-4cb7-a9b9-24ac3d029118 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574" status: 404 len: 111 microversion: 2.1 time: 0.477959 Dec 18 20:53:05.577784 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 924/1843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:05 2021] GET /compute/v2.1/servers/edeabf63-f66c-4719-9212-d3214bd03574 => generated 111 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:05.588657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:05.590680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:05.615175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:05.615833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:05.616808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:05.618902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:06.481655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:06.492274 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-15ff30da-f576-41b3-84e9-6d5003c6a806 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.912025 Dec 18 20:53:06.494459 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 925/1844] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:05 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:06.501508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7877d1ba-82d5-4ba8-8ad2-f0e377610c6d req-6453527e-841b-4fe2-b8e9-1a51505cab1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce12ca16-56f4-459d-bc88-98eab54424b7", "tag": "cbe017f3-1a9e-4b8f-b078-a8a69597377e"}, {"name": "network-changed", "server_uuid": "85e89dcf-25e5-4937-a138-a00b38f607bd", "tag": "c5c1b4ce-768a-40ac-84a0-0e5dff3d7f03"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:06.505215 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:06.505215 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:06.523784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7877d1ba-82d5-4ba8-8ad2-f0e377610c6d req-6453527e-841b-4fe2-b8e9-1a51505cab1d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:06.524309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7877d1ba-82d5-4ba8-8ad2-f0e377610c6d req-6453527e-841b-4fe2-b8e9-1a51505cab1d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:06.555204 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7877d1ba-82d5-4ba8-8ad2-f0e377610c6d req-6453527e-841b-4fe2-b8e9-1a51505cab1d service nova] Creating event network-changed:cbe017f3-1a9e-4b8f-b078-a8a69597377e for instance ce12ca16-56f4-459d-bc88-98eab54424b7 on nch1-master-1 Dec 18 20:53:06.556909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7877d1ba-82d5-4ba8-8ad2-f0e377610c6d req-6453527e-841b-4fe2-b8e9-1a51505cab1d service nova] Creating event network-changed:c5c1b4ce-768a-40ac-84a0-0e5dff3d7f03 for instance 85e89dcf-25e5-4937-a138-a00b38f607bd on nch2-master-1 Dec 18 20:53:06.572594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7877d1ba-82d5-4ba8-8ad2-f0e377610c6d req-6453527e-841b-4fe2-b8e9-1a51505cab1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074715 Dec 18 20:53:06.575866 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 926/1845] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:06.588088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:06.599313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:06.613531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:06.614665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:06.616042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:06.617765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.159851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:07.192877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:07.196046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:07.198513 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d95e5037-2bfd-4095-9278-d50cbbae9666 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.617963 Dec 18 20:53:07.199332 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 927/1846] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:06 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:07.215594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:07.216110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:07.227586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.228082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.230144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.234700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.251135 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] HTTP exception thrown: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. Dec 18 20:53:07.252000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Returning 404 to user: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:07.253052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5859d0cc-543d-4905-a85d-5f980d55016e tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 404 len: 111 microversion: 2.1 time: 0.052622 Dec 18 20:53:07.254597 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 928/1847] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:07 2021] DELETE /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:07.260784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:07.261402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:07.268385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.269231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.270216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.270871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.654536 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6a78326a-6486-497f-a551-f44d681b1087 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/7c382847-752a-4795-9d1a-9177a9dd09e8" status: 202 len: 0 microversion: 2.1 time: 2.211002 Dec 18 20:53:07.662327 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 920/1848] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:53:05 2021] DELETE /compute/v2.1/os-floating-ips/7c382847-752a-4795-9d1a-9177a9dd09e8 => generated 0 bytes in 2219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:07.667156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:07.667945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:07.674985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.675665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.676639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.677331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.750420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:07.760993 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9719a590-de05-4763-a12a-0e0a3154433f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.504358 Dec 18 20:53:07.761859 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 929/1849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:07 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:07.767629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:07.769187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] [instance: bf9d9725-ba21-477e-9e70-c7e9c733e54e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:07.775757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.778851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.779938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.780139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.803235 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] HTTP exception thrown: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. Dec 18 20:53:07.804691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] Returning 404 to user: Instance bf9d9725-ba21-477e-9e70-c7e9c733e54e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:07.808110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32cb76e6-ac7a-4a40-bdf6-79f719319ec7 tempest-ServersWithSpecificFlavorTestJSON-1520230706 tempest-ServersWithSpecificFlavorTestJSON-1520230706-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e" status: 404 len: 111 microversion: 2.1 time: 0.044411 Dec 18 20:53:07.813020 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 930/1850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:07 2021] GET /compute/v2.1/servers/bf9d9725-ba21-477e-9e70-c7e9c733e54e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:07.818460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:07.819337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:07.827194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.827973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:07.829022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:07.829689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.140374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:08.151510 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b684ab22-8f2a-42ef-905e-37be051a7db3 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1318 microversion: 2.1 time: 0.487691 Dec 18 20:53:08.152365 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 921/1851] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:07 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:08.157863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:08.158709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:08.166635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.167308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.168261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.168856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.219204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:08.229586 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-166c1454-2f1c-4833-9f4f-d5219ef9965b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.415127 Dec 18 20:53:08.230178 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 931/1852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:07 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:08.246685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3e0ab02-c99d-4f97-bb18-7e79b3da7154 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:08.248815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3e0ab02-c99d-4f97-bb18-7e79b3da7154 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:08.249644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3e0ab02-c99d-4f97-bb18-7e79b3da7154 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action" status: 400 len: 142 microversion: 2.1 time: 0.007001 Dec 18 20:53:08.250391 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 932/1853] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:08 2021] POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:53:08.255316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:08.256142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:08.268607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.270779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.278418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.279529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.491548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:08.502724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05c5189f-3adb-4166-bb78-c3515fc280e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.348921 Dec 18 20:53:08.503888 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 922/1854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:08 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:08.523647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5b6b1031-516c-4588-b3cc-d2d2ee1b16c7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1298049402"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:08.526241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5b6b1031-516c-4588-b3cc-d2d2ee1b16c7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:08.532865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b6b1031-516c-4588-b3cc-d2d2ee1b16c7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.533648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b6b1031-516c-4588-b3cc-d2d2ee1b16c7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.534733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b6b1031-516c-4588-b3cc-d2d2ee1b16c7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.535413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b6b1031-516c-4588-b3cc-d2d2ee1b16c7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.582399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:08.593683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:08.595531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:08.596898 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-96f2ef4b-b65e-41d1-bcf7-5478ea2e05e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.345444 Dec 18 20:53:08.608853 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 933/1855] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:08 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:08.613866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:08.615932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:08.622442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.623102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.624083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.624725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.656530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Acquired lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 20:53:08.824561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Releasing lock "refresh_cache-ce12ca16-56f4-459d-bc88-98eab54424b7" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 20:53:08.825281 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] HTTP exception thrown: floating IP not found Dec 18 20:53:08.825997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Returning 404 to user: floating IP not found {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:08.827041 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc872499-9972-4246-b93c-b7b3e2c3fe82 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action" status: 404 len: 67 microversion: 2.1 time: 0.216954 Dec 18 20:53:08.827809 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 934/1856] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:08 2021] POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action => generated 67 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:08.832539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:08.833957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:08.841176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.841912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.842867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:08.843442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:08.933570 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5b6b1031-516c-4588-b3cc-d2d2ee1b16c7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.426514 Dec 18 20:53:08.938414 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 923/1857] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:08 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Dec 18 20:53:08.964968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-705c134e-bfa8-4269-8b02-3daf88d10af7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:09.102492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-705c134e-bfa8-4269-8b02-3daf88d10af7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Dec 18 20:53:09.104093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-705c134e-bfa8-4269-8b02-3daf88d10af7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:09.106613 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-705c134e-bfa8-4269-8b02-3daf88d10af7 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action" status: 404 len: 88 microversion: 2.1 time: 0.169549 Dec 18 20:53:09.110811 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 924/1858] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:08 2021] POST /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7/action => generated 88 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:09.141566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:09.145058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:09.154641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:09.155364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.156169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.157170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.157777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.174353 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-05295b94-7376-4a10-9bcb-9596de73194c tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.341831 Dec 18 20:53:09.184773 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 935/1859] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:08 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:09.194363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:53:09.201844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:09.204366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:09.222348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.226813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.228122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.228803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.343005 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0055a26f-de2b-4fad-b7d0-0b4b7e43c3eb tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 204 len: 0 microversion: 2.1 time: 0.220015 Dec 18 20:53:09.344720 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 925/1860] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:09 2021] DELETE /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:53:09.354838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:09.357754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:09.368036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.372190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.372190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.373137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.517843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:09.526583 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-974cd81c-e754-4432-b2b5-738996300097 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1318 microversion: 2.1 time: 0.340242 Dec 18 20:53:09.538903 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 936/1861] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:09 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:09.538903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-cf392b7e-eb16-49ec-aa10-e14a7ee214b5 req-903d4f56-1149-4e91-b273-6ef79bbc1bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e89dcf-25e5-4937-a138-a00b38f607bd", "name": "network-vif-plugged", "status": "completed", "tag": "c5c1b4ce-768a-40ac-84a0-0e5dff3d7f03"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:09.538903 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:09.538903 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:09.557583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cf392b7e-eb16-49ec-aa10-e14a7ee214b5 req-903d4f56-1149-4e91-b273-6ef79bbc1bff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.557766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cf392b7e-eb16-49ec-aa10-e14a7ee214b5 req-903d4f56-1149-4e91-b273-6ef79bbc1bff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.587290 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-cf392b7e-eb16-49ec-aa10-e14a7ee214b5 req-903d4f56-1149-4e91-b273-6ef79bbc1bff service nova] Creating event network-vif-plugged:c5c1b4ce-768a-40ac-84a0-0e5dff3d7f03 for instance 85e89dcf-25e5-4937-a138-a00b38f607bd on nch2-master-1 Dec 18 20:53:09.598855 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-cf392b7e-eb16-49ec-aa10-e14a7ee214b5 req-903d4f56-1149-4e91-b273-6ef79bbc1bff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067377 Dec 18 20:53:09.601228 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 937/1862] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:09.613262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:09.615245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:09.623545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.627276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.633146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.633951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.650834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:09.666092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5dad2554-4fae-47b0-89be-402c3c47c653 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1542 microversion: 2.1 time: 0.316185 Dec 18 20:53:09.675757 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 926/1863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:09 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1542 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:09.677202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:09.677832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:09.692963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.693693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.694536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:09.694984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:09.978572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:09.993650 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46adbc30-f8ca-42a4-af6a-1c9ba4924656 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.390730 Dec 18 20:53:10.005556 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 938/1864] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:09 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:10.059600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:10.072590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:10.074458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:10.075862 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3e069a3a-c825-409b-b41e-7f9d48b776c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.407783 Dec 18 20:53:10.077116 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 927/1865] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:09 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:10.192634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:10.193294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:10.206856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:10.207671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:10.208758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:10.209286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:10.416954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:10.433541 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b11d46f-0f97-4184-ace5-fe510712d2b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.239231 Dec 18 20:53:10.437102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 939/1866] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:10 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:10.545374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:10.546192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:10.560003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:10.560899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:10.562091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:10.562714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:10.689830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:10.691064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:10.710294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:10.711194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:10.712719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:10.713396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:10.776050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:10.787015 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d6f80c7-7b27-4620-964b-c99f8600a007 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1318 microversion: 2.1 time: 0.244866 Dec 18 20:53:10.788192 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 928/1867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:10 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:10.974937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:10.995255 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51874133-ed0c-4214-b7c6-629afcc97330 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1542 microversion: 2.1 time: 0.310946 Dec 18 20:53:11.001795 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 940/1868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:10 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1542 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:11.011282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:11.027782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:11.038856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:11.039311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:11.040636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:11.043938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:11.095284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:11.095916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:11.105849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:11.107480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:11.108332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:11.109791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:11.761204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:11.775452 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6afd7fa9-f606-4ca7-967d-545df07398b6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.767239 Dec 18 20:53:11.776456 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 929/1869] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:11 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:11.799332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:11.801719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:11.819332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:11.822772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:11.823702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:11.824249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:12.206989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:12.216500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:12.229437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:12.230839 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-69202706-8891-4f28-80d2-e88f0b6f0988 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 1.139302 Dec 18 20:53:12.231439 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 941/1870] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:11 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 20:53:12.247581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-def58d06-95f9-48e8-b1f9-d21c73c888b5 req-13b5ab53-7ed5-4668-89e8-4f803628fd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:12.249652 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:12.249652 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:12.257436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-def58d06-95f9-48e8-b1f9-d21c73c888b5 req-13b5ab53-7ed5-4668-89e8-4f803628fd29 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:12.258155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-def58d06-95f9-48e8-b1f9-d21c73c888b5 req-13b5ab53-7ed5-4668-89e8-4f803628fd29 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:12.272091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-def58d06-95f9-48e8-b1f9-d21c73c888b5 req-13b5ab53-7ed5-4668-89e8-4f803628fd29 service nova] Creating event network-vif-unplugged:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:53:12.277626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-def58d06-95f9-48e8-b1f9-d21c73c888b5 req-13b5ab53-7ed5-4668-89e8-4f803628fd29 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034399 Dec 18 20:53:12.278535 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 942/1871] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:12.284586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:12.285921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:12.293352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:12.294043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:12.295999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:12.297371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:12.644218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:12.654025 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f327065-0708-4e56-afa3-7deba49ac371 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.876332 Dec 18 20:53:12.661164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 930/1872] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:11 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:12.692782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:12.693416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:12.717982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:12.718895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:12.719264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:12.719707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:13.300099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:13.325786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cfce14d1-5e47-4764-beac-e6a8d2a09fa1 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1506 microversion: 2.1 time: 1.045451 Dec 18 20:53:13.327705 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 943/1873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:12 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1506 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:13.364683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:13.371149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:13.386938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:13.388538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:13.389547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:13.390515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:13.632901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ceebd647214518a032847eadef041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e94e03944844ccb90b9a5818d00856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:13.662205 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5193687-1a6b-4872-94c4-695ab28f7e4b tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 200 len: 1542 microversion: 2.1 time: 0.999901 Dec 18 20:53:13.665896 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 931/1874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:12 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 1542 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:13.682892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:13.688579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:13.695119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:13.695890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:13.696972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:13.698225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.329336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:14.337508 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2fe87ce7-1227-414e-b8dd-684befee88a6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 1.007223 Dec 18 20:53:14.342522 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 944/1875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:13 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:14.357108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:14.358470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:14.379709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:14.380232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.381103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:14.384740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.408746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:14.418607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:14.428948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:14.433206 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-703ba688-fbe4-4cab-bbec-f1cfa38f8b3e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.762398 Dec 18 20:53:14.434421 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 932/1876] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:13 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:14.439384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:14.451207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:14.462612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:14.463633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.467992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:14.469004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.675659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:14.698231 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a5f301a-b291-4975-8069-336eb55a06ed tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4" status: 200 len: 1318 microversion: 2.1 time: 0.354115 Dec 18 20:53:14.700264 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 945/1877] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:14 2021] GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:14.723721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e996d5b5-d101-4d9b-9f5c-bc704857422c req-d227c4a2-e240-4537-a309-c76fb165dc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce12ca16-56f4-459d-bc88-98eab54424b7", "name": "network-vif-deleted", "tag": "cbe017f3-1a9e-4b8f-b078-a8a69597377e"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:14.725499 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:14.725499 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:14.753967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e996d5b5-d101-4d9b-9f5c-bc704857422c req-d227c4a2-e240-4537-a309-c76fb165dc89 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:14.757502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e996d5b5-d101-4d9b-9f5c-bc704857422c req-d227c4a2-e240-4537-a309-c76fb165dc89 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.814739 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e996d5b5-d101-4d9b-9f5c-bc704857422c req-d227c4a2-e240-4537-a309-c76fb165dc89 service nova] Creating event network-vif-deleted:cbe017f3-1a9e-4b8f-b078-a8a69597377e for instance ce12ca16-56f4-459d-bc88-98eab54424b7 on nch1-master-1 Dec 18 20:53:14.823243 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e996d5b5-d101-4d9b-9f5c-bc704857422c req-d227c4a2-e240-4537-a309-c76fb165dc89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118384 Dec 18 20:53:14.825495 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 946/1878] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:14.836288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:14.838402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] [instance: ce12ca16-56f4-459d-bc88-98eab54424b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:14.869835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:14.872599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.875938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:14.881636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:14.919174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:14.919733 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] HTTP exception thrown: Instance ce12ca16-56f4-459d-bc88-98eab54424b7 could not be found. Dec 18 20:53:14.920038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] Returning 404 to user: Instance ce12ca16-56f4-459d-bc88-98eab54424b7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:14.921180 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a0eb753-4ddf-48c7-b122-1afd627aeb01 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314 tempest-FloatingIPsAssociationNegativeTestJSON-1682366314-project] 10.222.0.13 "GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7" status: 404 len: 111 microversion: 2.1 time: 0.093113 Dec 18 20:53:14.922398 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 947/1879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:14 2021] GET /compute/v2.1/servers/ce12ca16-56f4-459d-bc88-98eab54424b7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:14.926709 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71e0b502-445b-4953-b870-81eea5a018f5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.490989 Dec 18 20:53:14.937601 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 933/1880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:14 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:15.359207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:15.360593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:15.370904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:15.372858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:15.375207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:15.375925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:15.453898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:15.454789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:15.465854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:15.470176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:15.473211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:15.473669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:15.862293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:15.877782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1afca950-5b3d-4d86-be16-406c28b23d37 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.522483 Dec 18 20:53:15.879035 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 948/1881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:15 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:15.883773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:15.887009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:15.901156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:15.905134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:15.906230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:15.906860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:16.124023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:16.143019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:16.147058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:16.155902 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa9a971f-2b77-4af8-8556-5e1620f79301 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.704037 Dec 18 20:53:16.156664 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 934/1882] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:15 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:16.163491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:16.173370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:16.195694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:16.197480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:16.199060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:16.205117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:16.967818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:16.990113 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b36cb53e-7db6-4dbf-adc7-b79e46ac40db tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4" status: 200 len: 1318 microversion: 2.1 time: 1.109737 Dec 18 20:53:16.992442 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 949/1883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:15 2021] GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4 => generated 1318 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:17.000598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:17.010537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:17.018923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:17.019821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:17.020916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:17.021782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:17.349122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:17.373143 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c37eafad-dc85-4829-8682-7ef818498597 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 1.213430 Dec 18 20:53:17.376474 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 935/1884] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:16 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:17.386064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:17.387071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:17.398524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:17.399871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:17.401569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:17.402279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:17.627434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:17.635553 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-097aa216-f91f-41d1-ae4c-92b698c2e201 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.641746 Dec 18 20:53:17.642964 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 950/1885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:16 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:17.655566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-bd4275c7-cfe6-4fbf-86ee-d5a0182e0fea req-a6d5e946-201f-48b6-bc9c-bac37ba64bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23d751a-dbda-4976-a75f-1b418b3c1ef4", "name": "network-vif-plugged", "status": "completed", "tag": "49e4deb1-4b6d-4313-9ef1-0f5905853b16"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:17.664149 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:17.664149 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:17.678160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bd4275c7-cfe6-4fbf-86ee-d5a0182e0fea req-a6d5e946-201f-48b6-bc9c-bac37ba64bc4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:17.678638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bd4275c7-cfe6-4fbf-86ee-d5a0182e0fea req-a6d5e946-201f-48b6-bc9c-bac37ba64bc4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:17.700164 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-bd4275c7-cfe6-4fbf-86ee-d5a0182e0fea req-a6d5e946-201f-48b6-bc9c-bac37ba64bc4 service nova] Creating event network-vif-plugged:49e4deb1-4b6d-4313-9ef1-0f5905853b16 for instance f23d751a-dbda-4976-a75f-1b418b3c1ef4 on nch1-master-1 Dec 18 20:53:17.707028 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-bd4275c7-cfe6-4fbf-86ee-d5a0182e0fea req-a6d5e946-201f-48b6-bc9c-bac37ba64bc4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061739 Dec 18 20:53:17.708465 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 951/1886] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:17.947507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:17.964061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:17.966630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:17.984562 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-87423780-5487-4027-ac9a-d2c67f38328b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.606596 Dec 18 20:53:17.986521 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 936/1887] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:17 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:18.008889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:18.016203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:18.031282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:18.037250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:18.040875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:18.043753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:18.392923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:18.394115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:18.401935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:18.404498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:18.408707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:18.409392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:18.455715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:18.464029 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eae4cb7a-944e-403a-9742-c6dd7b36917d tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4" status: 200 len: 1318 microversion: 2.1 time: 0.460113 Dec 18 20:53:18.476906 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 952/1888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:18 2021] GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:18.659606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:18.660233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:18.673162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:18.676511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:18.680292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:18.681343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:19.031823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:19.039867 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58dde8b2-29dc-45d5-a54b-7580c93dce3a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1476 microversion: 2.1 time: 0.650838 Dec 18 20:53:19.054155 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 937/1889] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:18 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1476 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:19.059355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:19.064054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:19.079770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:19.080520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:19.081517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:19.082393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:19.273251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:19.281312 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d4ae040-e0c8-4ad4-bbab-247ef0615d24 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.626249 Dec 18 20:53:19.284911 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 953/1890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:18 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:19.485319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:19.486221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:19.497321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:19.500541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:19.506569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:19.507339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:19.759784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:19.769164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:19.779792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:19.781558 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcefbbde-2b77-4984-b14c-bb23594a0778 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.725939 Dec 18 20:53:19.782948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 938/1891] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:19 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:19.965929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:19.974711 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7bb7f203-72e6-4c10-8472-da9035b5b6fe tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4" status: 200 len: 1507 microversion: 2.1 time: 0.493790 Dec 18 20:53:19.991541 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 954/1892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:19 2021] GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4 => generated 1507 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:20.004032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:20.009244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:20.026660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6453ca5d-96e9-408e-b4aa-be7867fbdda8 req-65184213-8bf9-4992-9637-4ba7f43e4263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-plugged", "status": "completed", "tag": "f8de1dac-5fbd-4626-8379-c9547acc28fb"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:20.028281 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:20.028281 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:20.045641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6453ca5d-96e9-408e-b4aa-be7867fbdda8 req-65184213-8bf9-4992-9637-4ba7f43e4263 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:20.050656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:20.051338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:20.051720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6453ca5d-96e9-408e-b4aa-be7867fbdda8 req-65184213-8bf9-4992-9637-4ba7f43e4263 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:20.055161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:20.058425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:20.088662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6453ca5d-96e9-408e-b4aa-be7867fbdda8 req-65184213-8bf9-4992-9637-4ba7f43e4263 service nova] Creating event network-vif-plugged:f8de1dac-5fbd-4626-8379-c9547acc28fb for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:20.109612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6453ca5d-96e9-408e-b4aa-be7867fbdda8 req-65184213-8bf9-4992-9637-4ba7f43e4263 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086288 Dec 18 20:53:20.110670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 955/1893] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:53:20.123850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:20.124655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:20.132716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:53:20.137527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:20.141106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:20.142196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:20.142920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:20.312886 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3830c347-5318-4218-82e5-aa6c9ff24a80 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4" status: 204 len: 0 microversion: 2.1 time: 0.320446 Dec 18 20:53:20.316656 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 939/1894] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:19 2021] DELETE /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:53:20.323751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:20.324769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:20.339669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:20.342649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:20.349456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:20.349976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:21.036148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:21.046340 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed326c6c-3d4e-4694-ac17-0c45d67d06cd tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1475 microversion: 2.1 time: 0.934426 Dec 18 20:53:21.050412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 956/1895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:20 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1475 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:21.059342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:21.071304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:21.077736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:21.078429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:21.080061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:21.081023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:21.148499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:53:21.222158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:21.233689 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9f8bba0-314c-400a-ae83-e7d87ef4bec7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.918370 Dec 18 20:53:21.236441 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 940/1896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:20 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:21.257254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:21.257867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:21.277838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:21.287749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:21.288778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:21.289232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:21.392499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6900300-a474-4641-a887-30a8e0903ca8 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 204 len: 0 microversion: 2.1 time: 0.339693 Dec 18 20:53:21.395065 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 957/1897] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:21 2021] DELETE /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:53:21.408311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:21.411115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:21.429658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:21.433905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:21.435232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:21.437629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:22.622427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:22.638036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:22.639872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:22.641052 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b3282b9e-42a2-421f-9fd3-d7e410e2eefb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 1.394720 Dec 18 20:53:22.641618 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 941/1898] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:21 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:22.680042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:22.681260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:22.694567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:22.698831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:22.702286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:22.706286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:23.153049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:23.162706 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c02eda9-9700-4151-9142-dc11413737dc tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4" status: 200 len: 1513 microversion: 2.1 time: 1.763375 Dec 18 20:53:23.170716 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 958/1899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:21 2021] GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4 => generated 1513 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:23.175914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c1867d63-e629-4629-adab-8a4553d08d4f req-36326648-68ac-4991-ba9c-db72140c0b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-plugged", "status": "completed", "tag": "bf2508ae-cc73-498d-b496-3c1f2e87f0f4"}, {"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-plugged", "status": "completed", "tag": "ccb5043d-02af-492d-8f2d-78752159fb84"}, {"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-plugged", "status": "completed", "tag": "5740d94d-10b4-4d4f-b84a-14e2647f72c7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:23.193792 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:23.193792 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:23.216313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c1867d63-e629-4629-adab-8a4553d08d4f req-36326648-68ac-4991-ba9c-db72140c0b22 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:23.227082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c1867d63-e629-4629-adab-8a4553d08d4f req-36326648-68ac-4991-ba9c-db72140c0b22 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:23.261021 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c1867d63-e629-4629-adab-8a4553d08d4f req-36326648-68ac-4991-ba9c-db72140c0b22 service nova] Creating event network-vif-plugged:bf2508ae-cc73-498d-b496-3c1f2e87f0f4 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:23.265188 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c1867d63-e629-4629-adab-8a4553d08d4f req-36326648-68ac-4991-ba9c-db72140c0b22 service nova] Creating event network-vif-plugged:ccb5043d-02af-492d-8f2d-78752159fb84 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:23.265820 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c1867d63-e629-4629-adab-8a4553d08d4f req-36326648-68ac-4991-ba9c-db72140c0b22 service nova] Creating event network-vif-plugged:5740d94d-10b4-4d4f-b84a-14e2647f72c7 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:23.279942 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c1867d63-e629-4629-adab-8a4553d08d4f req-36326648-68ac-4991-ba9c-db72140c0b22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107600 Dec 18 20:53:23.280560 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 959/1900] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:23 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:23.292711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:23.306683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:23.314721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:23.315230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:23.316057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:23.322511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:23.830190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:23.847240 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31464b3d-8b6c-4c26-8fe6-a00ecc2bfa3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1475 microversion: 2.1 time: 1.201419 Dec 18 20:53:23.851889 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 942/1901] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:22 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1475 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:23.865931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:23.866641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:23.888085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:23.888832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:23.890706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:23.893090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:25.372333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:25.385276 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57533910-b943-40b2-9ba0-66b63c6c7bf7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 2.098649 Dec 18 20:53:25.386670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 960/1902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:23 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:25.394127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-bbb3460f-7eb7-444c-8f75-3fbc11ccb1ca req-36941ef0-5886-421c-a3af-45efcf3c3765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23d751a-dbda-4976-a75f-1b418b3c1ef4", "name": "network-vif-deleted", "tag": "49e4deb1-4b6d-4313-9ef1-0f5905853b16"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:25.400094 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:25.400094 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:25.418775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bbb3460f-7eb7-444c-8f75-3fbc11ccb1ca req-36941ef0-5886-421c-a3af-45efcf3c3765 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:25.427265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bbb3460f-7eb7-444c-8f75-3fbc11ccb1ca req-36941ef0-5886-421c-a3af-45efcf3c3765 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:25.450969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-bbb3460f-7eb7-444c-8f75-3fbc11ccb1ca req-36941ef0-5886-421c-a3af-45efcf3c3765 service nova] Creating event network-vif-deleted:49e4deb1-4b6d-4313-9ef1-0f5905853b16 for instance f23d751a-dbda-4976-a75f-1b418b3c1ef4 on nch1-master-1 Dec 18 20:53:25.458937 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-bbb3460f-7eb7-444c-8f75-3fbc11ccb1ca req-36941ef0-5886-421c-a3af-45efcf3c3765 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070781 Dec 18 20:53:25.464683 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 961/1903] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:25.474192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:25.478786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: f23d751a-dbda-4976-a75f-1b418b3c1ef4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:25.496009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:25.496982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:25.498345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:25.499972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:25.537720 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] HTTP exception thrown: Instance f23d751a-dbda-4976-a75f-1b418b3c1ef4 could not be found. Dec 18 20:53:25.541380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Returning 404 to user: Instance f23d751a-dbda-4976-a75f-1b418b3c1ef4 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:25.543480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ebc200fb-cf09-41a6-b0ed-451bf53a1038 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4" status: 404 len: 111 microversion: 2.1 time: 0.077279 Dec 18 20:53:25.545816 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 962/1904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:25 2021] GET /compute/v2.1/servers/f23d751a-dbda-4976-a75f-1b418b3c1ef4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:25.564072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:25.565036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:25.572417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:25.582185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:25.582757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:25.584921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:25.587437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:25.631884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:25.641591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:25.645276 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-899f7552-e5ae-4e8a-92e7-64e72b1ad817 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 1.790740 Dec 18 20:53:25.656462 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 943/1905] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:23 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:25.685231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:25.691300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:25.721212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:25.724381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:25.734413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:25.735639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:26.558697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:26.568849 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-108bef66-d6a8-4513-8a24-e590cf464426 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1473 microversion: 2.1 time: 1.021648 Dec 18 20:53:26.584248 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 963/1906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:25 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1473 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:26.600685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:26.611177 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b8ee16ec-cea1-43c6-8aef-e99fa2b75014 tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1512 microversion: 2.1 time: 0.950477 Dec 18 20:53:26.616370 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 944/1907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:25 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1512 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:26.622358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:26.623241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:26.629510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-plugged", "status": "completed", "tag": "04c02923-efaf-4b7a-9421-6c1c3df3d6eb"}, {"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-plugged", "status": "completed", "tag": "f1cdb751-5072-47e3-96f0-96e30fe3bc2f"}, {"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-plugged", "status": "completed", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}, {"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-plugged", "status": "completed", "tag": "e339efff-5759-4aa7-8925-f9e71e302622"}, {"server_uuid": "cfebec43-3354-4223-9f86-adc3ef6fb19d", "name": "network-vif-unplugged", "status": "completed", "tag": "b09fe15f-0b97-40bf-b218-e64ff9933df9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:26.634927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:26.635884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:26.636582 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:26.636582 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:26.637250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:26.638123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:26.655243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:26.655706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:26.691383 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Creating event network-vif-plugged:04c02923-efaf-4b7a-9421-6c1c3df3d6eb for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:26.691911 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Creating event network-vif-plugged:f1cdb751-5072-47e3-96f0-96e30fe3bc2f for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:26.692724 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Creating event network-vif-plugged:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:53:26.707693 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Creating event network-vif-plugged:e339efff-5759-4aa7-8925-f9e71e302622 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:26.708927 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Creating event network-vif-unplugged:b09fe15f-0b97-40bf-b218-e64ff9933df9 for instance cfebec43-3354-4223-9f86-adc3ef6fb19d on nch1-master-1 Dec 18 20:53:26.737655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] Instance cfebec43-3354-4223-9f86-adc3ef6fb19d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:53:26.762353 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e8d5cce4-5d83-411a-ac84-b9843ba8ef41 req-e59c8432-6007-4aab-9844-b8f48c834651 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.175860 Dec 18 20:53:26.763334 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 964/1908] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:26 2021] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:26.770010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:26.771551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:26.779004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:26.779909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:26.781549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:26.782195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.438122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:27.449102 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1aa4d505-0cb2-4964-b61a-087da5617af5 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.831326 Dec 18 20:53:27.449689 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 945/1909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:26 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:27.476322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-56862c93-4ab7-46c4-a399-375b73701211 req-3e877cbc-1cfd-4e79-9adb-d1a5b60c8a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e89dcf-25e5-4937-a138-a00b38f607bd", "name": "network-vif-deleted", "tag": "c5c1b4ce-768a-40ac-84a0-0e5dff3d7f03"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:27.496961 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:27.496961 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:27.524386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-56862c93-4ab7-46c4-a399-375b73701211 req-3e877cbc-1cfd-4e79-9adb-d1a5b60c8a86 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.524922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-56862c93-4ab7-46c4-a399-375b73701211 req-3e877cbc-1cfd-4e79-9adb-d1a5b60c8a86 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.541762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:27.555355 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-56862c93-4ab7-46c4-a399-375b73701211 req-3e877cbc-1cfd-4e79-9adb-d1a5b60c8a86 service nova] Creating event network-vif-deleted:c5c1b4ce-768a-40ac-84a0-0e5dff3d7f03 for instance 85e89dcf-25e5-4937-a138-a00b38f607bd on nch2-master-1 Dec 18 20:53:27.569105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:27.570798 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-56862c93-4ab7-46c4-a399-375b73701211 req-3e877cbc-1cfd-4e79-9adb-d1a5b60c8a86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115214 Dec 18 20:53:27.571751 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 946/1910] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:27.574505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:27.592020 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70f2cde4-64ad-415e-9691-9dbc072c3dcf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 0.819925 Dec 18 20:53:27.597188 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 965/1911] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:26 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:27.608707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:27.609940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:27.624715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.630118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.632823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.633576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.633813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:27.634464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:27.645627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.646005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.646878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.647326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.748884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.749819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.750505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lazy-loading 'fault' on Instance uuid 85e89dcf-25e5-4937-a138-a00b38f607bd {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:53:27.803370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a9edc0cd6b4eaababe6d74aa697bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0744714bbf4779a774d5d0d8fc18d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:27.812900 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93a1ab0a-d9d1-4e99-9aa0-d121818f4e5c tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 200 len: 1308 microversion: 2.1 time: 0.182324 Dec 18 20:53:27.814551 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 966/1912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:27 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:27.886746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:27.896333 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e893577-5b91-4024-9142-623371ef7c41 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1470 microversion: 2.1 time: 0.299240 Dec 18 20:53:27.903320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 947/1913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:27 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:27.918112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a8bb400b-c221-4967-94b9-f4559a338672 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:27.919450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8bb400b-c221-4967-94b9-f4559a338672 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:27.931540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8bb400b-c221-4967-94b9-f4559a338672 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.933681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8bb400b-c221-4967-94b9-f4559a338672 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:27.936106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8bb400b-c221-4967-94b9-f4559a338672 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:27.936728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8bb400b-c221-4967-94b9-f4559a338672 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:28.051559 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a8bb400b-c221-4967-94b9-f4559a338672 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d/action" status: 204 len: 0 microversion: 2.1 time: 0.139899 Dec 18 20:53:28.052652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 967/1914] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:27 2021] POST /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d/action => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:53:28.066583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:28.067202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:28.092346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:28.092810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:28.093629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:28.094077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:28.487840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:28.488835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:28.497270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:28.498008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:28.499438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:28.500079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:29.156851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:29.166222 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f60cfc55-d044-4582-880d-be1b2d24bbb8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1470 microversion: 2.1 time: 1.109216 Dec 18 20:53:29.175664 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 948/1915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:28 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1470 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:29.181282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:29.182084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:29.193706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:29.201003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:29.202150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:29.202781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:29.217052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:29.224660 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e020e21-0c8a-49bd-8594-60a04811e667 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.754190 Dec 18 20:53:29.227281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 968/1916] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:28 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:29.240767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:29.243113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] [instance: 85e89dcf-25e5-4937-a138-a00b38f607bd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:29.252397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:29.255942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:29.256989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:29.261170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:29.296656 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] HTTP exception thrown: Instance 85e89dcf-25e5-4937-a138-a00b38f607bd could not be found. Dec 18 20:53:29.304186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] Returning 404 to user: Instance 85e89dcf-25e5-4937-a138-a00b38f607bd could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:29.305570 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0ac4bf99-758a-499e-ad33-c7489fbd8ced tempest-MultipleCreateTestJSON-454040505 tempest-MultipleCreateTestJSON-454040505-project] 10.222.0.13 "GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd" status: 404 len: 111 microversion: 2.1 time: 0.076546 Dec 18 20:53:29.306747 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 969/1917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:29 2021] GET /compute/v2.1/servers/85e89dcf-25e5-4937-a138-a00b38f607bd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:30.152016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:30.174133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:30.178042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:30.179353 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-326f2893-fdaa-4b31-9b8a-f2cb327bf3bc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1875 microversion: 2.32 time: 1.002384 Dec 18 20:53:30.185320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 949/1918] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:29 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1875 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:30.202698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:30.203615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:30.221954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:30.223183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:30.224186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:30.224803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:30.244205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:30.245084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:30.261405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:30.261681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:30.265708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:30.266394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:30.751457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:30.760722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:30.774682 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2027d793-715b-4021-8dfd-03289c71d4c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1470 microversion: 2.1 time: 0.575689 Dec 18 20:53:30.777404 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 970/1919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:30 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1470 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:30.777562 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bbf0f6c1-5e84-421c-b3d3-36310938087c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.533483 Dec 18 20:53:30.792499 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 950/1920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:30 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:31.206337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:31.206927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:31.222405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:31.223049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:31.223666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:31.224111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:31.795044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:31.796221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:31.814970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:31.824452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:31.827412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:31.828042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:32.400279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:32.424049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:32.426884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:32.428215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ecf20be5-a1df-4a1e-85ab-71928991ae77 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2826 microversion: 2.32 time: 1.226757 Dec 18 20:53:32.428834 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 971/1921] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:53:31 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2826 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:32.454580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:32.456507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:32.466912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:32.468157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:32.485257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:32.486494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:32.549503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:32.564186 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a8923dbf-a3ff-4f2b-94aa-2621a4a1dd5b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1470 microversion: 2.1 time: 0.772802 Dec 18 20:53:32.565068 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 951/1922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:31 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1470 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:33.051443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:33.061313 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46046bcf-3692-4d36-9fcf-b01b7d23dd53 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.630944 Dec 18 20:53:33.066589 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 972/1923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:32 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:33.090858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a6f6fb5-2aaf-49d1-803c-16c992bc9425 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.091613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a6f6fb5-2aaf-49d1-803c-16c992bc9425 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:33.108155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a6f6fb5-2aaf-49d1-803c-16c992bc9425 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.112198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a6f6fb5-2aaf-49d1-803c-16c992bc9425 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.114828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a6f6fb5-2aaf-49d1-803c-16c992bc9425 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.115375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a6f6fb5-2aaf-49d1-803c-16c992bc9425 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.241756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78133d08-a748-42aa-adb7-bd1da38f3083 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Calling method '.version_select at 0x7f714fbf6430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.272313 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-78133d08-a748-42aa-adb7-bd1da38f3083 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] HTTP exception thrown: Image not found. Dec 18 20:53:33.273318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78133d08-a748-42aa-adb7-bd1da38f3083 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Returning 404 to user: Image not found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:33.274835 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78133d08-a748-42aa-adb7-bd1da38f3083 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] 10.222.0.13 "DELETE /compute/v2.1/images/7906a7ed-a5ce-4615-9624-9f3d7072d652/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.708027 Dec 18 20:53:33.275468 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 952/1924] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 20:53:32 2021] DELETE /compute/v2.1/images/7906a7ed-a5ce-4615-9624-9f3d7072d652/metadata/os_distro => generated 62 bytes in 710 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:33.301791 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a6f6fb5-2aaf-49d1-803c-16c992bc9425 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.233151 Dec 18 20:53:33.309945 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 973/1925] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/os-interface => generated 1830 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:33.309945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9de29ce-2f28-48a0-8e23-1e2371fb0484 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Calling method '.version_select at 0x7f714fc4bc10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.347485 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-a9de29ce-2f28-48a0-8e23-1e2371fb0484 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] HTTP exception thrown: Image not found. Dec 18 20:53:33.348193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9de29ce-2f28-48a0-8e23-1e2371fb0484 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:33.349134 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9de29ce-2f28-48a0-8e23-1e2371fb0484 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] 10.222.0.13 "GET /compute/v2.1/images/d65cac16-bbed-45d1-92da-d3c9aa2fa801/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.044948 Dec 18 20:53:33.352306 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 974/1926] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/images/d65cac16-bbed-45d1-92da-d3c9aa2fa801/metadata/os_version => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:33.367721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-272be1c0-df19-4a73-9593-cd72cb558412 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Calling method '.version_select at 0x7f714fe578b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.377372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Calling method '.version_select at 0x7f714ee85f70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.379181 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:33.379181 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:33.389442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.389910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.406033 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-272be1c0-df19-4a73-9593-cd72cb558412 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] HTTP exception thrown: Image not found. Dec 18 20:53:33.407369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-272be1c0-df19-4a73-9593-cd72cb558412 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:33.408505 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-272be1c0-df19-4a73-9593-cd72cb558412 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] 10.222.0.13 "GET /compute/v2.1/images/e21d42d3-4b27-47fe-b97e-3d4982ece9ab/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049962 Dec 18 20:53:33.410132 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 975/1927] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/images/e21d42d3-4b27-47fe-b97e-3d4982ece9ab/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:33.420696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d950cc2-5150-48c7-a67b-39c9568bf17d tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Action: 'update_all', calling method: .version_select at 0x7f714fc4b280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:33.428317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.429223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.458553 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-7d950cc2-5150-48c7-a67b-39c9568bf17d tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] HTTP exception thrown: Image not found. Dec 18 20:53:33.459353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d950cc2-5150-48c7-a67b-39c9568bf17d tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:33.460350 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d950cc2-5150-48c7-a67b-39c9568bf17d tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] 10.222.0.13 "PUT /compute/v2.1/images/a1ec89cd-339e-4b92-a67e-e3b560e68f51/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043466 Dec 18 20:53:33.461396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 976/1928] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:53:33 2021] PUT /compute/v2.1/images/a1ec89cd-339e-4b92-a67e-e3b560e68f51/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 18 20:53:33.470885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.471352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.473992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4e27e52-f72d-467b-8be9-c544b84d2366 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Action: 'update', calling method: .version_select at 0x7f715c495c10>, body: {"meta": {"os_distro": "alt"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:33.482885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d0ce4161-b00a-4c13-adb6-539809d8caf7 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.206167 Dec 18 20:53:33.483471 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 953/1929] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:33.512975 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e4e27e52-f72d-467b-8be9-c544b84d2366 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] HTTP exception thrown: Image not found. Dec 18 20:53:33.513926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Calling method '.version_select at 0x7f714fc89550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.514493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4e27e52-f72d-467b-8be9-c544b84d2366 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:33.515380 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4e27e52-f72d-467b-8be9-c544b84d2366 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] 10.222.0.13 "PUT /compute/v2.1/images/3b3f8a55-ed1f-4b8c-be71-01aebe436baa/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.046794 Dec 18 20:53:33.515951 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 977/1930] 10.222.0.13 () {60 vars in 1309 bytes} [Sat Dec 18 20:53:33 2021] PUT /compute/v2.1/images/3b3f8a55-ed1f-4b8c-be71-01aebe436baa/metadata/os_distro => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:33.516861 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:33.516861 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:33.519067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.520616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.530630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-928b4e3f-5a4b-4cbe-befd-6e8b2289a549 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Action: 'create', calling method: .version_select at 0x7f714fc4bca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:33.553955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.554458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.570222 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-928b4e3f-5a4b-4cbe-befd-6e8b2289a549 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] HTTP exception thrown: Image not found. Dec 18 20:53:33.571727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-928b4e3f-5a4b-4cbe-befd-6e8b2289a549 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:33.572754 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-928b4e3f-5a4b-4cbe-befd-6e8b2289a549 tempest-ImagesMetadataNegativeTestJSON-1744070768 tempest-ImagesMetadataNegativeTestJSON-1744070768-project] 10.222.0.13 "POST /compute/v2.1/images/14d37daf-7c30-4fe0-8443-8a64fe61421a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049734 Dec 18 20:53:33.574643 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 978/1931] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Dec 18 20:53:33 2021] POST /compute/v2.1/images/14d37daf-7c30-4fe0-8443-8a64fe61421a/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:33.600262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9108b102-f2d5-42d5-a04f-c02b5bb5985f req-c0e3875c-8d53-423a-9b86-8ef967425cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfebec43-3354-4223-9f86-adc3ef6fb19d", "name": "network-vif-plugged", "status": "completed", "tag": "b09fe15f-0b97-40bf-b218-e64ff9933df9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:33.604893 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:33.604893 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:33.631650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9108b102-f2d5-42d5-a04f-c02b5bb5985f req-c0e3875c-8d53-423a-9b86-8ef967425cb9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.640689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9108b102-f2d5-42d5-a04f-c02b5bb5985f req-c0e3875c-8d53-423a-9b86-8ef967425cb9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.667409 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9108b102-f2d5-42d5-a04f-c02b5bb5985f req-c0e3875c-8d53-423a-9b86-8ef967425cb9 service nova] Creating event network-vif-plugged:b09fe15f-0b97-40bf-b218-e64ff9933df9 for instance cfebec43-3354-4223-9f86-adc3ef6fb19d on nch1-master-1 Dec 18 20:53:33.674129 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9108b102-f2d5-42d5-a04f-c02b5bb5985f req-c0e3875c-8d53-423a-9b86-8ef967425cb9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096029 Dec 18 20:53:33.676842 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 979/1932] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:33.683227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.684260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.684677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:33.684798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.698045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.699486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.700681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.701322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.705804 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c9957c2d-8bf2-4d49-b219-6561af911404 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 433 microversion: 2.1 time: 0.216238 Dec 18 20:53:33.706453 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 954/1933] 10.222.0.13 () {58 vars in 1211 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 433 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:33.734647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Calling method '.version_select at 0x7f714fbf6430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.735960 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:33.735960 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:33.741069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.741541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.798427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.799053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.832872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.833358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.863457 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e82274bb-88d1-4d50-aa11-1a18805d18e6 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.141855 Dec 18 20:53:33.865061 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 955/1934] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:33.874493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-79fda06d-bfb2-4af9-9e90-ce122b19dd15 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Calling method '.version_select at 0x7f714ff873a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:33.875846 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:33.875846 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:33.880121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79fda06d-bfb2-4af9-9e90-ce122b19dd15 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.881022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79fda06d-bfb2-4af9-9e90-ce122b19dd15 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.907360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79fda06d-bfb2-4af9-9e90-ce122b19dd15 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:33.909321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79fda06d-bfb2-4af9-9e90-ce122b19dd15 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:33.923241 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-79fda06d-bfb2-4af9-9e90-ce122b19dd15 tempest-HypervisorAdminUnderV252Test-777162218 tempest-HypervisorAdminUnderV252Test-777162218-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.052347 Dec 18 20:53:33.926881 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 956/1935] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:34.081564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:34.082288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:34.091400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:34.094082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:34.105128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:34.105610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:34.370952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:34.391237 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0fc878b4-d0de-4be9-86bb-ef184b6ec73e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1462 microversion: 2.1 time: 0.712669 Dec 18 20:53:34.394325 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 980/1936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:33 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1462 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:34.414594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:34.422763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:34.438380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:34.442845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:34.448004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:34.450372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:34.781888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:34.791340 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c72bffd1-66ab-4d44-bc62-e28578a79da0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.713865 Dec 18 20:53:34.792496 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 957/1937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:34 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:35.156810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:35.169161 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-64e32b1f-05b6-4293-a84c-a6950363ccc0 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1462 microversion: 2.1 time: 0.758220 Dec 18 20:53:35.172455 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 981/1938] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:34 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1462 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:35.191305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2970a97a-dae7-4082-bc02-7bb80de7c933 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '.version_select at 0x7f714fb39700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:35.192666 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:35.192666 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:35.194165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2970a97a-dae7-4082-bc02-7bb80de7c933 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:35.194712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2970a97a-dae7-4082-bc02-7bb80de7c933 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:35.218656 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2970a97a-dae7-4082-bc02-7bb80de7c933 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.031104 Dec 18 20:53:35.219271 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 958/1939] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:53:35 2021] GET /compute/v2.1/os-migrations => generated 803 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:53:35.237075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab0d7b0a-641f-455b-9581-b8c52a70b108 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:35.248756 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab0d7b0a-641f-455b-9581-b8c52a70b108 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015613 Dec 18 20:53:35.253153 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 982/1940] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:53:35 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:35.263639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b591a661-ac91-4902-ad21-02f3730dd3d3 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-405707032", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:35.265409 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:35.265409 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:35.292107 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b591a661-ac91-4902-ad21-02f3730dd3d3 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.032064 Dec 18 20:53:35.298603 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 959/1941] 10.222.0.13 () {60 vars in 1145 bytes} [Sat Dec 18 20:53:35 2021] POST /compute/v2.1/flavors => generated 498 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:35.306211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32d61e5b-0e5c-4390-b36c-59da93c247e7 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:35.320251 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32d61e5b-0e5c-4390-b36c-59da93c247e7 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017698 Dec 18 20:53:35.321214 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 983/1942] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Dec 18 20:53:35 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:53:35.611555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1941112494", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "17b456fa-4d78-4080-b5f4-1159a31a1768"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:35.720316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c94881ab-69f9-4ade-a6ed-3e924d6baf11 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:35.722529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c94881ab-69f9-4ade-a6ed-3e924d6baf11 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:35.744512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:53:35.764341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94881ab-69f9-4ade-a6ed-3e924d6baf11 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:35.767030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94881ab-69f9-4ade-a6ed-3e924d6baf11 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:35.770037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94881ab-69f9-4ade-a6ed-3e924d6baf11 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:35.770751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94881ab-69f9-4ade-a6ed-3e924d6baf11 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:35.877019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c94881ab-69f9-4ade-a6ed-3e924d6baf11 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 14 microversion: 2.32 time: 0.173854 Dec 18 20:53:35.879409 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 984/1943] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:35 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:35.903505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c3a22f48-29b3-42b7-a49b-29c56854b617 req-0b932197-e9d9-400b-bcb6-1db26329baec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "tag": "bf2508ae-cc73-498d-b496-3c1f2e87f0f4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:35.909739 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:35.909739 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:35.934042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c3a22f48-29b3-42b7-a49b-29c56854b617 req-0b932197-e9d9-400b-bcb6-1db26329baec service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:35.936256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c3a22f48-29b3-42b7-a49b-29c56854b617 req-0b932197-e9d9-400b-bcb6-1db26329baec service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:35.968814 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c3a22f48-29b3-42b7-a49b-29c56854b617 req-0b932197-e9d9-400b-bcb6-1db26329baec service nova] Creating event network-changed:bf2508ae-cc73-498d-b496-3c1f2e87f0f4 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 20:53:35.987594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c3a22f48-29b3-42b7-a49b-29c56854b617 req-0b932197-e9d9-400b-bcb6-1db26329baec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104202 Dec 18 20:53:35.988886 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 985/1944] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:36.005341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:36.007365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:36.017213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:36.018503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:36.020372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:36.021018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:36.781646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:36.791428 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-221e25ba-57f9-4cd7-8216-ff69df6538f4 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1473 microversion: 2.1 time: 0.800184 Dec 18 20:53:36.792245 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 986/1945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:35 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1473 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:36.806948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:53:36.808352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:53:36.809008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:53:36.809583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:53:36.810372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:53:36.828056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:36.828910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:36.830809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:36.839032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:36.888903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e98dec3-f400-48b2-9d8f-7ae4d36ebd3c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:36.890119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7e98dec3-f400-48b2-9d8f-7ae4d36ebd3c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:36.898798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:53:36.903218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e98dec3-f400-48b2-9d8f-7ae4d36ebd3c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:36.905943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e98dec3-f400-48b2-9d8f-7ae4d36ebd3c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:36.911307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e98dec3-f400-48b2-9d8f-7ae4d36ebd3c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:36.914160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e98dec3-f400-48b2-9d8f-7ae4d36ebd3c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:36.921309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for user 09d32c08216a4035907c888a3c8cd70f and project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:53:36.949118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:53:36.951739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:53:37.043712 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7e98dec3-f400-48b2-9d8f-7ae4d36ebd3c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 14 microversion: 2.32 time: 0.154092 Dec 18 20:53:37.049017 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 987/1946] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:36 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:37.049909 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a756a57-a561-46e6-8f3e-b407ae41a989 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445681 Dec 18 20:53:37.051266 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 960/1947] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:53:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:53:37.118033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b825e920-0337-4dd0-a476-9eff2d0d0400 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:37.119639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b825e920-0337-4dd0-a476-9eff2d0d0400 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:37.809097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:37.810445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:37.826600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:37.827666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:37.829017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:37.830839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:37.893640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b825e920-0337-4dd0-a476-9eff2d0d0400 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:37.906170 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b825e920-0337-4dd0-a476-9eff2d0d0400 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1279 microversion: 2.1 time: 0.823646 Dec 18 20:53:37.919807 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 988/1948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:37 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1279 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:38.057151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4affd7be-e507-4a90-81ad-c20864030337 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:38.058500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4affd7be-e507-4a90-81ad-c20864030337 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:38.088578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4affd7be-e507-4a90-81ad-c20864030337 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:38.089250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4affd7be-e507-4a90-81ad-c20864030337 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:38.090300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4affd7be-e507-4a90-81ad-c20864030337 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:38.090942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4affd7be-e507-4a90-81ad-c20864030337 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:38.177307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:38.185058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fbaf5a9-9adb-4f7b-ba46-75fc24a6fa8f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1479 microversion: 2.1 time: 0.380194 Dec 18 20:53:38.199788 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 961/1949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:37 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1479 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:38.200176 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4affd7be-e507-4a90-81ad-c20864030337 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 14 microversion: 2.32 time: 0.144260 Dec 18 20:53:38.200176 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 989/1950] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:38 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:38.488240 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5c859ff1-c3a5-43e8-a0d5-10d4c0655b74 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] 10.222.0.13 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.296496 Dec 18 20:53:38.489179 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 962/1951] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:53:38 2021] DELETE /compute/v2.1/images/ => generated 112 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 18 20:53:38.509483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-980cffd5-3f0d-41c1-bb13-8f12deeba0aa tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Calling method '.version_select at 0x7f714fc2e0d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:38.623584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-980cffd5-3f0d-41c1-bb13-8f12deeba0aa tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] HTTP exception thrown: Image not found. Dec 18 20:53:38.624192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-980cffd5-3f0d-41c1-bb13-8f12deeba0aa tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:38.625086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-980cffd5-3f0d-41c1-bb13-8f12deeba0aa tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] 10.222.0.13 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.130005 Dec 18 20:53:38.625644 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 990/1952] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 20:53:38 2021] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:38.637983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88cd4a84-1474-4164-8a8c-a500e068c8ec tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Calling method '.version_select at 0x7f714f8bbe50>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:38.691915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-88cd4a84-1474-4164-8a8c-a500e068c8ec tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] HTTP exception thrown: Image not found. Dec 18 20:53:38.692672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88cd4a84-1474-4164-8a8c-a500e068c8ec tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Returning 404 to user: Image not found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:38.694347 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88cd4a84-1474-4164-8a8c-a500e068c8ec tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] 10.222.0.13 "DELETE /compute/v2.1/images/cab2403a-9360-416b-b56c-d472d7db999j" status: 404 len: 62 microversion: 2.1 time: 0.061531 Dec 18 20:53:38.698927 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 963/1953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:38 2021] DELETE /compute/v2.1/images/cab2403a-9360-416b-b56c-d472d7db999j => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:38.704537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a1ea58ad-6d9e-42cd-91bf-1d90b370f558 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Calling method '.version_select at 0x7f714fb00ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:38.763872 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-a1ea58ad-6d9e-42cd-91bf-1d90b370f558 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] HTTP exception thrown: Image not found. Dec 18 20:53:38.764467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a1ea58ad-6d9e-42cd-91bf-1d90b370f558 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:38.765306 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a1ea58ad-6d9e-42cd-91bf-1d90b370f558 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] 10.222.0.13 "DELETE /compute/v2.1/images/705b1053-9868-4e97-963e-85275a63c2cf1" status: 404 len: 62 microversion: 2.1 time: 0.065147 Dec 18 20:53:38.769618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 991/1954] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:38 2021] DELETE /compute/v2.1/images/705b1053-9868-4e97-963e-85275a63c2cf1 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:38.774644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bacc3510-b47b-496d-aff3-d89c53aba154 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Calling method '.version_select at 0x7f714f8bbca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:38.816631 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-bacc3510-b47b-496d-aff3-d89c53aba154 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] HTTP exception thrown: Image not found. Dec 18 20:53:38.817389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bacc3510-b47b-496d-aff3-d89c53aba154 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Returning 404 to user: Image not found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:38.819425 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bacc3510-b47b-496d-aff3-d89c53aba154 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] 10.222.0.13 "DELETE /compute/v2.1/images/tempest-invalid-2075578603" status: 404 len: 62 microversion: 2.1 time: 0.047547 Dec 18 20:53:38.819425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 964/1955] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Dec 18 20:53:38 2021] DELETE /compute/v2.1/images/tempest-invalid-2075578603 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:38.828815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd3b97a1-08bb-4e61-b53e-ccf3c70a74a8 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Calling method '.version_select at 0x7f715c44c040>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:38.872001 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-bd3b97a1-08bb-4e61-b53e-ccf3c70a74a8 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] HTTP exception thrown: Image not found. Dec 18 20:53:38.873025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd3b97a1-08bb-4e61-b53e-ccf3c70a74a8 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:38.874095 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd3b97a1-08bb-4e61-b53e-ccf3c70a74a8 tempest-ImagesDeleteNegativeTestJSON-2054794226 tempest-ImagesDeleteNegativeTestJSON-2054794226-project] 10.222.0.13 "DELETE /compute/v2.1/images/4690a6e6-40d9-4837-a680-280f8f2ef5a2" status: 404 len: 62 microversion: 2.1 time: 0.049057 Dec 18 20:53:38.887274 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 992/1956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:38 2021] DELETE /compute/v2.1/images/4690a6e6-40d9-4837-a680-280f8f2ef5a2 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:38.927125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:38.927900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:38.941051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:38.941427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:38.943317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:38.944752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:39.104689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:39.128513 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-db375458-b783-48d7-b840-95334e58ed0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1331 microversion: 2.1 time: 0.203912 Dec 18 20:53:39.131179 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 965/1957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:38 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:39.218047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9a305ade-8241-47bd-8708-a34d518cd353 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:39.223530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9a305ade-8241-47bd-8708-a34d518cd353 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:39.224754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:39.227576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:39.242522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a305ade-8241-47bd-8708-a34d518cd353 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:39.247744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a305ade-8241-47bd-8708-a34d518cd353 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:39.249348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a305ade-8241-47bd-8708-a34d518cd353 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:39.275565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:39.278842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a305ade-8241-47bd-8708-a34d518cd353 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:39.280253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:39.283383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:39.284811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:39.447842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9a305ade-8241-47bd-8708-a34d518cd353 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 14 microversion: 2.32 time: 0.240886 Dec 18 20:53:39.448856 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 966/1958] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:39 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:39.536748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:39.537458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:39.561657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:39.562145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:39.563043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:39.563486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.096712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:40.111503 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6d0f1767-3c57-42f6-8183-ff594078bafb tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1479 microversion: 2.1 time: 0.905514 Dec 18 20:53:40.113628 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 993/1959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:39 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1479 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:40.160494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:40.162512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:40.179317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.181900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.183563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.185498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.310882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:40.326801 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5cf237c7-26c1-47f7-9190-3c84156ff315 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.796804 Dec 18 20:53:40.327688 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 967/1960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:39 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:40.346506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c44129ef-a77f-4a68-b468-0ce711784787 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1835956931"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:40.349696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c44129ef-a77f-4a68-b468-0ce711784787 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:40.361797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44129ef-a77f-4a68-b468-0ce711784787 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.362798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44129ef-a77f-4a68-b468-0ce711784787 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.363618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44129ef-a77f-4a68-b468-0ce711784787 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.364208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44129ef-a77f-4a68-b468-0ce711784787 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.492594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:40.501593 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76daf0d4-7cc1-463e-a25c-7e68c5c76947 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1337 microversion: 2.1 time: 0.352285 Dec 18 20:53:40.505560 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 994/1961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:40 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1337 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:40.528484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff2b8300-e60f-4dc2-a188-6074f22000c7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:40.533895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff2b8300-e60f-4dc2-a188-6074f22000c7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:40.554288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff2b8300-e60f-4dc2-a188-6074f22000c7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.559071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff2b8300-e60f-4dc2-a188-6074f22000c7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.561975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff2b8300-e60f-4dc2-a188-6074f22000c7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.564433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff2b8300-e60f-4dc2-a188-6074f22000c7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.667365 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff2b8300-e60f-4dc2-a188-6074f22000c7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 14 microversion: 2.32 time: 0.148749 Dec 18 20:53:40.670488 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 995/1962] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:40 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:40.810277 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c44129ef-a77f-4a68-b468-0ce711784787 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.470318 Dec 18 20:53:40.812691 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 968/1963] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:40 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Dec 18 20:53:40.824397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:40.825685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:40.839609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.840508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:40.841556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:40.842438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.130355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:41.131246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:41.162435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:41.163097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.164340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:41.165013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.396487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:41.405266 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6c3ae5fb-2ad5-48ff-a37c-72be96e20868 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.588153 Dec 18 20:53:41.419302 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 996/1964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:40 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:41.526324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:41.527625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:41.544268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:41.546075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.549442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:41.550220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.795296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:41.817421 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7089ea7d-66a6-4451-b285-522b35986ad5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1337 microversion: 2.1 time: 0.295594 Dec 18 20:53:41.819398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:41.822637 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 997/1965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:41 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1337 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:41.828648 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1b1facc-62ab-4d09-a7a0-bba51f1c1f4b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1479 microversion: 2.1 time: 0.703187 Dec 18 20:53:41.832776 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 969/1966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:41 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1479 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:41.834272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dcb409f5-c460-4842-abc2-35ab827a4123 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:41.838957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dcb409f5-c460-4842-abc2-35ab827a4123 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:41.845732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0d1731fa-7afc-477c-9ad7-70c93c1faaf4 req-450d4b23-8c36-421a-861e-3f8bfc516cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d00b730-00ba-4bc7-be51-6de9d571a1b2", "name": "network-vif-plugged", "status": "completed", "tag": "659424cb-2544-4eb1-afc7-8c764a75b399"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:41.848057 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:41.848057 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:41.858229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb409f5-c460-4842-abc2-35ab827a4123 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:41.859041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb409f5-c460-4842-abc2-35ab827a4123 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.862377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb409f5-c460-4842-abc2-35ab827a4123 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:41.864853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0d1731fa-7afc-477c-9ad7-70c93c1faaf4 req-450d4b23-8c36-421a-861e-3f8bfc516cd9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:41.865112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb409f5-c460-4842-abc2-35ab827a4123 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.870685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0d1731fa-7afc-477c-9ad7-70c93c1faaf4 req-450d4b23-8c36-421a-861e-3f8bfc516cd9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:41.895153 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0d1731fa-7afc-477c-9ad7-70c93c1faaf4 req-450d4b23-8c36-421a-861e-3f8bfc516cd9 service nova] Creating event network-vif-plugged:659424cb-2544-4eb1-afc7-8c764a75b399 for instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 on nch2-master-1 Dec 18 20:53:41.905020 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0d1731fa-7afc-477c-9ad7-70c93c1faaf4 req-450d4b23-8c36-421a-861e-3f8bfc516cd9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070466 Dec 18 20:53:41.909257 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 970/1967] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:41.954702 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dcb409f5-c460-4842-abc2-35ab827a4123 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 14 microversion: 2.32 time: 0.130596 Dec 18 20:53:41.955604 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 998/1968] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:41 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:42.419887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b3ad33a5-7e3b-49c7-8d02-3476a907fab3 tempest-ListImagesTestJSON-1745715759 tempest-ListImagesTestJSON-1745715759-project] Calling method '.version_select at 0x7f714fb30ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.480694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ebe3066-8755-47db-a93c-83f4a470e303 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Calling method '.version_select at 0x7f714f6df4c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.481764 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:42.481764 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:42.483914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ebe3066-8755-47db-a93c-83f4a470e303 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd317a283bbf34206b63932b746332826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4aa5709616446a9905f1a6c0e382da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:42.485954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ebe3066-8755-47db-a93c-83f4a470e303 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:42.493277 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ebe3066-8755-47db-a93c-83f4a470e303 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.561140 Dec 18 20:53:42.499392 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 971/1969] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Dec 18 20:53:41 2021] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 563 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:42.500513 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b3ad33a5-7e3b-49c7-8d02-3476a907fab3 tempest-ListImagesTestJSON-1745715759 tempest-ListImagesTestJSON-1745715759-project] 10.222.0.13 "GET /compute/v2.1/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3" status: 200 len: 784 microversion: 2.1 time: 0.302918 Dec 18 20:53:42.501084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.501216 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 999/1970] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3 => generated 784 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:53:42.503528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:42.515017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad25ec64-7dbc-44ae-8f27-0b0b1e136ab4 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Calling method '.version_select at 0x7f714fe704c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.515915 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:42.515915 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:42.517971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad25ec64-7dbc-44ae-8f27-0b0b1e136ab4 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd317a283bbf34206b63932b746332826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4aa5709616446a9905f1a6c0e382da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:42.518870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad25ec64-7dbc-44ae-8f27-0b0b1e136ab4 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:42.519867 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad25ec64-7dbc-44ae-8f27-0b0b1e136ab4 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008538 Dec 18 20:53:42.521177 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1000/1971] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:42.522323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:42.522787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:42.524751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:42.524751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:42.529061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55f87980-4bf7-4656-96c1-97caa969a6c2 tempest-ListImagesTestJSON-1745715759 tempest-ListImagesTestJSON-1745715759-project] Calling method '.version_select at 0x7f714fe21ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.609510 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55f87980-4bf7-4656-96c1-97caa969a6c2 tempest-ListImagesTestJSON-1745715759 tempest-ListImagesTestJSON-1745715759-project] 10.222.0.13 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.086932 Dec 18 20:53:42.620682 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1001/1972] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/images => generated 445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:42.628096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8bec6825-2a78-4b71-ad8b-3cbbaced7bbd tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Calling method '.version_select at 0x7f714fc2e0d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.629231 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:42.629231 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:42.631383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8bec6825-2a78-4b71-ad8b-3cbbaced7bbd tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd317a283bbf34206b63932b746332826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4aa5709616446a9905f1a6c0e382da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:42.632320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8bec6825-2a78-4b71-ad8b-3cbbaced7bbd tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:42.633929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8bec6825-2a78-4b71-ad8b-3cbbaced7bbd tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.011879 Dec 18 20:53:42.634733 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1002/1973] 10.222.0.13 () {58 vars in 1178 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:42.642339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f925b630-652a-4352-a581-2a290e1de7ea tempest-ListImagesTestJSON-1745715759 tempest-ListImagesTestJSON-1745715759-project] Calling method '.version_select at 0x7f714fb00430>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.704271 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f925b630-652a-4352-a581-2a290e1de7ea tempest-ListImagesTestJSON-1745715759 tempest-ListImagesTestJSON-1745715759-project] 10.222.0.13 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.066420 Dec 18 20:53:42.704271 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1003/1974] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/images/detail => generated 787 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:42.941751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Calling method '.version_select at 0x7f714fb19310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:42.945936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:42.946309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:42.966516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:42.967904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:42.981984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:42.982799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:42.995376 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-29aebcd3-7b0c-4338-88cd-ee58781ee374 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.290945 Dec 18 20:53:42.997152 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1004/1975] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:43.002829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:43.003941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:43.011840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:43.012549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:43.013792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:43.015539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:43.287227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:43.302941 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9a8ac2e-d537-47f3-aeaf-4de4c7c1d4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1689 microversion: 2.1 time: 0.807624 Dec 18 20:53:43.313563 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 972/1976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1689 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:43.322720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:43.323632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:43.333819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:43.335185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:43.338967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:43.340249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.066212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:44.078531 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-471df341-5043-460a-b203-d32177aa3096 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1379 microversion: 2.1 time: 1.080037 Dec 18 20:53:44.079360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1005/1977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:42 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1379 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:44.085794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e66f80f9-b3a8-454e-a09d-3f5e475bc70f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:44.087720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e66f80f9-b3a8-454e-a09d-3f5e475bc70f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:44.095069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66f80f9-b3a8-454e-a09d-3f5e475bc70f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.095523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66f80f9-b3a8-454e-a09d-3f5e475bc70f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.096330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66f80f9-b3a8-454e-a09d-3f5e475bc70f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.097113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e66f80f9-b3a8-454e-a09d-3f5e475bc70f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.186660 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e66f80f9-b3a8-454e-a09d-3f5e475bc70f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 14 microversion: 2.32 time: 0.105377 Dec 18 20:53:44.190062 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1006/1978] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:44 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:44.194220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dca7ab0b-7ed1-4121-aaae-feb71829cc94 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Calling method '.version_select at 0x7f714fb14d30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:44.195136 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:44.195136 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:44.197221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dca7ab0b-7ed1-4121-aaae-feb71829cc94 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd317a283bbf34206b63932b746332826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4aa5709616446a9905f1a6c0e382da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:44.197891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dca7ab0b-7ed1-4121-aaae-feb71829cc94 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:44.198782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dca7ab0b-7ed1-4121-aaae-feb71829cc94 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009743 Dec 18 20:53:44.199755 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1007/1979] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Dec 18 20:53:44 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:44.205508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-60d21ba0-c33e-4726-bf41-224ad205171b req-6259f1bf-8913-4e8e-9e1d-35a06d2e0cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:44.207620 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:44.207620 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:44.221657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-60d21ba0-c33e-4726-bf41-224ad205171b req-6259f1bf-8913-4e8e-9e1d-35a06d2e0cc1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.222483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-60d21ba0-c33e-4726-bf41-224ad205171b req-6259f1bf-8913-4e8e-9e1d-35a06d2e0cc1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.264127 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-60d21ba0-c33e-4726-bf41-224ad205171b req-6259f1bf-8913-4e8e-9e1d-35a06d2e0cc1 service nova] Creating event network-vif-unplugged:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:53:44.273360 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-60d21ba0-c33e-4726-bf41-224ad205171b req-6259f1bf-8913-4e8e-9e1d-35a06d2e0cc1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071612 Dec 18 20:53:44.274529 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1008/1980] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:44.279806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e3334bb-df01-4747-ac00-e497c420e76e tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Calling method '.version_select at 0x7f714fde4af0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:44.280664 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:44.280664 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:44.286906 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-9e3334bb-df01-4747-ac00-e497c420e76e tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] HTTP exception thrown: Hypervisor with ID '67a52bd9-1256-42d0-8307-97459143c17d' could not be found. Dec 18 20:53:44.292492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e3334bb-df01-4747-ac00-e497c420e76e tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Returning 404 to user: Hypervisor with ID '67a52bd9-1256-42d0-8307-97459143c17d' could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:44.293615 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e3334bb-df01-4747-ac00-e497c420e76e tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/67a52bd9-1256-42d0-8307-97459143c17d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.017797 Dec 18 20:53:44.294362 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1009/1981] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Dec 18 20:53:44 2021] GET /compute/v2.1/os-hypervisors/67a52bd9-1256-42d0-8307-97459143c17d/uptime => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:44.303800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Calling method '.version_select at 0x7f714fff2a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:44.307337 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:44.307337 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:44.310269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.312734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.348469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.349878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.376441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.381212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.389947 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-290f25d9-688c-4dc0-809d-65560ca21281 tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.090446 Dec 18 20:53:44.390956 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1010/1982] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:53:44 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:53:44.395711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:44.396706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:44.404037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.404485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.405342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:44.405971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:44.460964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:44.469615 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-892b76ee-a279-494a-9787-fc3e39c746e6 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1479 microversion: 2.1 time: 1.153966 Dec 18 20:53:44.482867 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 973/1983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:43 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1479 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:44.502242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3996ce66-32ae-4c61-a801-aae9fe4f3494 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Calling method '.version_select at 0x7f714f6df4c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:44.506023 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:44.506023 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:53:44.511881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3996ce66-32ae-4c61-a801-aae9fe4f3494 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd317a283bbf34206b63932b746332826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4aa5709616446a9905f1a6c0e382da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:44.512573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3996ce66-32ae-4c61-a801-aae9fe4f3494 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:44.523675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3996ce66-32ae-4c61-a801-aae9fe4f3494 tempest-HypervisorAdminNegativeTestJSON-1469524441 tempest-HypervisorAdminNegativeTestJSON-1469524441-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.038978 Dec 18 20:53:44.529504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 974/1984] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 20:53:44 2021] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:44.535098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-630500b0-7b12-4d4a-af0a-298b08b4915a tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Calling method '.version_select at 0x7f714f852310>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:44.537244 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-630500b0-7b12-4d4a-af0a-298b08b4915a tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] HTTP exception thrown: Hypervisor with ID 'ad740478-c3ca-493e-8803-79761a89e24e' could not be found. Dec 18 20:53:44.539854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-630500b0-7b12-4d4a-af0a-298b08b4915a tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] Returning 404 to user: Hypervisor with ID 'ad740478-c3ca-493e-8803-79761a89e24e' could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:44.554039 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-630500b0-7b12-4d4a-af0a-298b08b4915a tempest-HypervisorAdminNegativeTestJSON-744010477 tempest-HypervisorAdminNegativeTestJSON-744010477-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/ad740478-c3ca-493e-8803-79761a89e24e" status: 404 len: 123 microversion: 2.1 time: 0.011668 Dec 18 20:53:44.554942 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 975/1985] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 20:53:44 2021] GET /compute/v2.1/os-hypervisors/ad740478-c3ca-493e-8803-79761a89e24e => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:44.869327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:44.877884 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b75af06-a305-4a88-b7a4-f02924843a9f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 0.485765 Dec 18 20:53:44.883004 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1011/1986] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:44 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:45.099924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:45.113234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:45.140228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.142966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.144357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.152149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.198226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b1ad75f-b97b-4e91-9ac8-f0456218565b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:45.200631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b1ad75f-b97b-4e91-9ac8-f0456218565b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:45.226454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b1ad75f-b97b-4e91-9ac8-f0456218565b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.229945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b1ad75f-b97b-4e91-9ac8-f0456218565b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.231419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b1ad75f-b97b-4e91-9ac8-f0456218565b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.231815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b1ad75f-b97b-4e91-9ac8-f0456218565b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.334366 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b1ad75f-b97b-4e91-9ac8-f0456218565b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 7866 microversion: 2.32 time: 0.140697 Dec 18 20:53:45.339675 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1012/1987] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:45 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 7866 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:53:45.351793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4f35b8dd-d845-41fa-82c1-21954a267f9b req-bad8314a-d9c1-4a2b-8e75-bd7f1c436c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784e8c5e-4c15-42ef-8cec-143c0b396585", "tag": "8c02c893-1629-4833-9998-e05787ad6250"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:45.353987 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:45.353987 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:45.362547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4f35b8dd-d845-41fa-82c1-21954a267f9b req-bad8314a-d9c1-4a2b-8e75-bd7f1c436c5f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.363307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4f35b8dd-d845-41fa-82c1-21954a267f9b req-bad8314a-d9c1-4a2b-8e75-bd7f1c436c5f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.379561 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4f35b8dd-d845-41fa-82c1-21954a267f9b req-bad8314a-d9c1-4a2b-8e75-bd7f1c436c5f service nova] Creating event network-changed:8c02c893-1629-4833-9998-e05787ad6250 for instance 784e8c5e-4c15-42ef-8cec-143c0b396585 on nch1-master-1 Dec 18 20:53:45.385423 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4f35b8dd-d845-41fa-82c1-21954a267f9b req-bad8314a-d9c1-4a2b-8e75-bd7f1c436c5f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043953 Dec 18 20:53:45.386592 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1013/1988] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:45.497922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:45.499137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:45.509271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.510437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.511856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.522698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.600358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:45.608614 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65fc472f-8c5e-46aa-bd50-0dccadc95d13 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1379 microversion: 2.1 time: 0.516531 Dec 18 20:53:45.626571 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 976/1989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:45 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1379 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:45.899313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:45.900183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:45.911399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.913166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:45.916339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:45.926977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.043869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:46.052466 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b91f2d1e-85a6-4b3a-a00e-74f87bf1d9d1 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1464 microversion: 2.1 time: 0.567561 Dec 18 20:53:46.059299 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1014/1990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:45 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1464 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:46.288464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13a12943-1ac1-4822-aad5-c505cf4cf3d9 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Calling method '.version_select at 0x7f714fb1a790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:46.313793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13a12943-1ac1-4822-aad5-c505cf4cf3d9 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.314669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13a12943-1ac1-4822-aad5-c505cf4cf3d9 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.316049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13a12943-1ac1-4822-aad5-c505cf4cf3d9 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.316772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13a12943-1ac1-4822-aad5-c505cf4cf3d9 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.364921 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13a12943-1ac1-4822-aad5-c505cf4cf3d9 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.304287 Dec 18 20:53:46.365809 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1015/1991] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:46 2021] GET /compute/v2.1/limits => generated 511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:46.383348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a31aead0-69e6-41c5-b49c-d745a833abe9 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:46.385416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a31aead0-69e6-41c5-b49c-d745a833abe9 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:46.392281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a31aead0-69e6-41c5-b49c-d745a833abe9 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.392997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a31aead0-69e6-41c5-b49c-d745a833abe9 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.393982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a31aead0-69e6-41c5-b49c-d745a833abe9 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.394626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a31aead0-69e6-41c5-b49c-d745a833abe9 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.417110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:46.429285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b94f9188-e897-4850-bdda-d65042ff57f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 0.533646 Dec 18 20:53:46.430934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 977/1992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:45 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:46.456460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-732c4576-b4a1-44d2-ae50-f4857d36b2b3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:46.457475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-732c4576-b4a1-44d2-ae50-f4857d36b2b3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:46.490696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-732c4576-b4a1-44d2-ae50-f4857d36b2b3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.491142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-732c4576-b4a1-44d2-ae50-f4857d36b2b3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.491954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-732c4576-b4a1-44d2-ae50-f4857d36b2b3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.492403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-732c4576-b4a1-44d2-ae50-f4857d36b2b3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.595509 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-732c4576-b4a1-44d2-ae50-f4857d36b2b3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 16060 microversion: 2.32 time: 0.142689 Dec 18 20:53:46.596267 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 978/1993] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:46 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 16060 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:46.601485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f45f0e10-14f9-42c3-b1bc-091c3c0ec107 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-258459781", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:46.604363 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a31aead0-69e6-41c5-b49c-d745a833abe9 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action" status: 202 len: 0 microversion: 2.1 time: 0.236646 Dec 18 20:53:46.605984 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1016/1994] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:46 2021] POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:46.619409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:46.624279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:46.646785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.647317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.648265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.648713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.714900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:46.721355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:46.724149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lazy-loading 'fault' on Instance uuid 1d00b730-00ba-4bc7-be51-6de9d571a1b2 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:53:46.756450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-f45f0e10-14f9-42c3-b1bc-091c3c0ec107 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:53:47.173113 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e5ed1dcc-7352-4b52-b20c-0b667c26bbde tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1598 microversion: 2.1 time: 0.561600 Dec 18 20:53:47.173683 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1017/1995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:46 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1598 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:53:47.184795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:47.199163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:47.215885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.216624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.217625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.230986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.518434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f45f0e10-14f9-42c3-b1bc-091c3c0ec107 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Getting quotas for project 5db81427f59c428288ece836e66da2b9. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:53:47.525369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f45f0e10-14f9-42c3-b1bc-091c3c0ec107 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Getting quotas for user 0b0d70afb7634afa8474c5e430ba681b and project 5db81427f59c428288ece836e66da2b9. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:53:47.566858 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f45f0e10-14f9-42c3-b1bc-091c3c0ec107 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Dec 18 20:53:47.567776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f45f0e10-14f9-42c3-b1bc-091c3c0ec107 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:47.568839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f45f0e10-14f9-42c3-b1bc-091c3c0ec107 tempest-AbsoluteLimitsNegativeTestJSON-1325443558 tempest-AbsoluteLimitsNegativeTestJSON-1325443558-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.971558 Dec 18 20:53:47.569905 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 979/1996] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Dec 18 20:53:46 2021] POST /compute/v2.1/servers => generated 87 bytes in 973 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:53:47.588495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d04d7aec-9e31-45ab-911e-86fbe69af7be tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:47.591903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d04d7aec-9e31-45ab-911e-86fbe69af7be tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:47.611590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04d7aec-9e31-45ab-911e-86fbe69af7be tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.613451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04d7aec-9e31-45ab-911e-86fbe69af7be tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.615115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04d7aec-9e31-45ab-911e-86fbe69af7be tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.616087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04d7aec-9e31-45ab-911e-86fbe69af7be tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.727357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:47.735444 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e403a91-f4e2-4e76-94c3-f0b2fe82c390 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1379 microversion: 2.1 time: 0.554681 Dec 18 20:53:47.738007 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1018/1997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:47 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1379 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:47.746996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:47.752293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:47.778871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.781810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.782933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.785173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.806420 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d04d7aec-9e31-45ab-911e-86fbe69af7be tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action" status: 202 len: 0 microversion: 2.1 time: 0.234526 Dec 18 20:53:47.807471 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 980/1998] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:53:47 2021] POST /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:47.822986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dfe7cb87-8c1f-4952-82a4-3c6d2ec95bcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:47.827421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dfe7cb87-8c1f-4952-82a4-3c6d2ec95bcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:47.847093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe7cb87-8c1f-4952-82a4-3c6d2ec95bcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.848733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe7cb87-8c1f-4952-82a4-3c6d2ec95bcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.850928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe7cb87-8c1f-4952-82a4-3c6d2ec95bcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.852644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe7cb87-8c1f-4952-82a4-3c6d2ec95bcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.915241 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dfe7cb87-8c1f-4952-82a4-3c6d2ec95bcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 16060 microversion: 2.32 time: 0.105161 Dec 18 20:53:47.920414 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 981/1999] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:47 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 16060 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:47.926668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75a62ffc-77f9-4f37-b84e-049ae9ea6556 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:47.934031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75a62ffc-77f9-4f37-b84e-049ae9ea6556 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:47.950964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75a62ffc-77f9-4f37-b84e-049ae9ea6556 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.955396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75a62ffc-77f9-4f37-b84e-049ae9ea6556 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:47.956257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75a62ffc-77f9-4f37-b84e-049ae9ea6556 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:47.958803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75a62ffc-77f9-4f37-b84e-049ae9ea6556 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:48.575154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:48.582743 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5efa53db-302d-4417-9c86-4b77786ded02 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 0.839204 Dec 18 20:53:48.583330 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1019/2000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:47 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:48.591953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1bcb2098-591d-4556-9414-6d92fe500767 req-bcca05f7-46bc-41c3-990f-c4d4016cb800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-plugged", "status": "completed", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:48.593547 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:48.593547 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:48.624405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1bcb2098-591d-4556-9414-6d92fe500767 req-bcca05f7-46bc-41c3-990f-c4d4016cb800 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:48.624853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1bcb2098-591d-4556-9414-6d92fe500767 req-bcca05f7-46bc-41c3-990f-c4d4016cb800 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:48.646666 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1bcb2098-591d-4556-9414-6d92fe500767 req-bcca05f7-46bc-41c3-990f-c4d4016cb800 service nova] Creating event network-vif-plugged:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:53:48.654831 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1bcb2098-591d-4556-9414-6d92fe500767 req-bcca05f7-46bc-41c3-990f-c4d4016cb800 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070250 Dec 18 20:53:48.663101 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1020/2001] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:48.716624 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75a62ffc-77f9-4f37-b84e-049ae9ea6556 tempest-ServersAdminTestJSON-1244048381 tempest-ServersAdminTestJSON-1244048381-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1615 microversion: 2.1 time: 0.793172 Dec 18 20:53:48.719006 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 982/2002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:47 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1615 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:48.737532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:48.738522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:48.752192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:48.752660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:48.755718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:48.758805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:48.764626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:48.765190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:48.773234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:48.774116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:48.775182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:48.775865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:48.855386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:53:49.089321 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da0b08ab-fd43-4450-8bdd-d786162bf452 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "DELETE /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 204 len: 0 microversion: 2.1 time: 0.355607 Dec 18 20:53:49.096658 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1021/2003] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:48 2021] DELETE /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:53:49.104066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6eb164f9-2a9f-4d33-b417-6ee4bbf91e9c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:49.105090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6eb164f9-2a9f-4d33-b417-6ee4bbf91e9c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:49.141196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eb164f9-2a9f-4d33-b417-6ee4bbf91e9c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:49.141657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eb164f9-2a9f-4d33-b417-6ee4bbf91e9c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:49.142505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eb164f9-2a9f-4d33-b417-6ee4bbf91e9c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:49.142950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eb164f9-2a9f-4d33-b417-6ee4bbf91e9c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:49.154936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:49.163828 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82323da6-7026-4cc3-b054-2c057d3e83d2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1379 microversion: 2.1 time: 0.412637 Dec 18 20:53:49.176328 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 983/2004] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:48 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1379 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:49.179338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:49.180779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:49.190834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:49.193199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:49.193199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:49.193199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:49.251473 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6eb164f9-2a9f-4d33-b417-6ee4bbf91e9c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 16060 microversion: 2.32 time: 0.154685 Dec 18 20:53:49.253098 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1022/2005] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:49 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 16060 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:49.470280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:49.494650 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e079fee-c227-4bec-86ed-2301f2221bc7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1470 microversion: 2.1 time: 0.319847 Dec 18 20:53:49.507261 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 984/2006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:49 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:49.600839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:49.603292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:49.611305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:49.612872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:49.613934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:49.614786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:50.111976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:50.129900 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-77784a71-605d-46bb-a5f2-e2fc7573aab9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 0.533998 Dec 18 20:53:50.135714 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1023/2007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:49 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:50.184498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:50.184871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:50.198420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:50.198926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:50.199788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:50.208190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:50.264519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1126c217-1faf-4ff8-9317-a5fde959ff29 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:50.265749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1126c217-1faf-4ff8-9317-a5fde959ff29 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:50.279678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1126c217-1faf-4ff8-9317-a5fde959ff29 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:50.280555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1126c217-1faf-4ff8-9317-a5fde959ff29 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:50.282769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1126c217-1faf-4ff8-9317-a5fde959ff29 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:50.283646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1126c217-1faf-4ff8-9317-a5fde959ff29 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:50.382739 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1126c217-1faf-4ff8-9317-a5fde959ff29 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 16060 microversion: 2.32 time: 0.118776 Dec 18 20:53:50.387244 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1024/2008] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:50 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 16060 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:53:50.517497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:50.518420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:50.538062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:50.539654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:50.541130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:50.543293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:51.424405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:51.467626 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ccc4c81-2b7e-44a2-a50b-8ba4f197e6ac tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1379 microversion: 2.1 time: 1.284722 Dec 18 20:53:51.470104 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 985/2009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:50 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1379 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:51.490541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:51.494481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:51.516798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:51.518906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:51.519815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:51.528526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:51.626073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:51.676052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e43a4233-2716-4ea7-aa41-c21142fd988f tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1470 microversion: 2.1 time: 1.160992 Dec 18 20:53:51.687030 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1025/2010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:50 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1470 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:51.708236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8467cd28-b758-48d7-9bdb-5705e7227b71 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:51.771082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8467cd28-b758-48d7-9bdb-5705e7227b71 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:51.811028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8467cd28-b758-48d7-9bdb-5705e7227b71 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:51.811750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8467cd28-b758-48d7-9bdb-5705e7227b71 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:51.818807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8467cd28-b758-48d7-9bdb-5705e7227b71 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:51.819694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8467cd28-b758-48d7-9bdb-5705e7227b71 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:51.948493 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8467cd28-b758-48d7-9bdb-5705e7227b71 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.253713 Dec 18 20:53:51.949157 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1026/2011] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:51 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:52.593265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1775059170", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e50169fc-b606-4273-ae66-869a743059d2"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:52.731675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:52.734878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] validate_networks() for [('e50169fc-b606-4273-ae66-869a743059d2', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:53:52.753361 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dbd3008c-2cff-49d4-b2fa-306cadea5f1a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 1.280798 Dec 18 20:53:52.756985 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 986/2012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:51 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:52.776572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:52.790482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:52.802653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:52.806926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:52.808408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:52.809505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:53.282878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:53.296213 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a5ff9ed3-cf8f-460d-9ca2-bd0377a0c2b9 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1379 microversion: 2.1 time: 0.537731 Dec 18 20:53:53.297716 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 987/2013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:52 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1379 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:53.313459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:53.316136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:53.345774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:53.346227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:53.347450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:53.349684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:54.801000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:53:54.802084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:53:54.802932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:53:54.803703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:53:54.804739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:53:54.842704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:54.843963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:54.852582 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7caca820-0f60-4dc8-9a4d-68ffe5758a91 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 200 len: 1470 microversion: 2.1 time: 1.550490 Dec 18 20:53:54.853615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:54.854686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:54.855872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 988/2014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:53 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 1470 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:54.865866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:54.866058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-826217a4-4cf0-4af5-afd3-d6e399feb05c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:54.872527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-826217a4-4cf0-4af5-afd3-d6e399feb05c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:54.887953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-826217a4-4cf0-4af5-afd3-d6e399feb05c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:54.889903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-826217a4-4cf0-4af5-afd3-d6e399feb05c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:54.890985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-826217a4-4cf0-4af5-afd3-d6e399feb05c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:54.893686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-826217a4-4cf0-4af5-afd3-d6e399feb05c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:54.984171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Getting quotas for project eaf2a3560d8e4c1993aa5a1dfdac5b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:53:55.013852 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-826217a4-4cf0-4af5-afd3-d6e399feb05c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.155195 Dec 18 20:53:55.014960 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 989/2015] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:54 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:55.021938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:55.023350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:55.034718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:55.035635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:55.036680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:55.037473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:55.041857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Getting quotas for user ad564476e1cf4a0b87fef4e3d08e6726 and project eaf2a3560d8e4c1993aa5a1dfdac5b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:53:55.112303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:53:55.129273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:53:55.397867 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-847ad9ca-e27e-4e17-922e-daa59c882f7d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.334406 Dec 18 20:53:55.398599 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1027/2016] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:53:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 3336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:53:55.427260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b9177f16-a149-41da-a9a5-187e5df7b894 req-d0c33d7e-5035-4110-982c-9cc22fb3fb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e8c5e-4c15-42ef-8cec-143c0b396585", "name": "network-vif-plugged", "status": "completed", "tag": "8c02c893-1629-4833-9998-e05787ad6250"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:55.434403 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:55.434403 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:55.472697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b9177f16-a149-41da-a9a5-187e5df7b894 req-d0c33d7e-5035-4110-982c-9cc22fb3fb60 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:55.473165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b9177f16-a149-41da-a9a5-187e5df7b894 req-d0c33d7e-5035-4110-982c-9cc22fb3fb60 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:55.513623 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b9177f16-a149-41da-a9a5-187e5df7b894 req-d0c33d7e-5035-4110-982c-9cc22fb3fb60 service nova] Creating event network-vif-plugged:8c02c893-1629-4833-9998-e05787ad6250 for instance 784e8c5e-4c15-42ef-8cec-143c0b396585 on nch1-master-1 Dec 18 20:53:55.526556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b9177f16-a149-41da-a9a5-187e5df7b894 req-d0c33d7e-5035-4110-982c-9cc22fb3fb60 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114633 Dec 18 20:53:55.527947 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1028/2017] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:55.542982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-33ab9533-b19b-45bb-a6e4-5ae801346a40 req-efa75762-e1ed-4baf-a1c2-488c1663eec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f5fb37-07c8-4714-8eb3-fad1fa1f51d6", "name": "network-vif-deleted", "tag": "82e2dc4f-305b-4f3d-be2d-709ad9dc49f0"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:55.546025 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:53:55.546025 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:53:55.567562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-33ab9533-b19b-45bb-a6e4-5ae801346a40 req-efa75762-e1ed-4baf-a1c2-488c1663eec3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:55.568210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-33ab9533-b19b-45bb-a6e4-5ae801346a40 req-efa75762-e1ed-4baf-a1c2-488c1663eec3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:55.630949 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-33ab9533-b19b-45bb-a6e4-5ae801346a40 req-efa75762-e1ed-4baf-a1c2-488c1663eec3 service nova] Creating event network-vif-deleted:82e2dc4f-305b-4f3d-be2d-709ad9dc49f0 for instance 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 on nch2-master-1 Dec 18 20:53:55.643647 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-33ab9533-b19b-45bb-a6e4-5ae801346a40 req-efa75762-e1ed-4baf-a1c2-488c1663eec3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113966 Dec 18 20:53:55.647188 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1029/2018] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:53:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:53:55.661294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:55.663762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:55.683978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:55.685765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:55.687692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:55.690897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:55.741764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:55.778392 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c83f66e8-2aed-483e-9219-210b20d86f4d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 0.761812 Dec 18 20:53:55.779689 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 990/2019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:55 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:55.799229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6b91f973-eeed-4d1e-a9d6-4fb78a917254 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:55.803038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6b91f973-eeed-4d1e-a9d6-4fb78a917254 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:56.057368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6b91f973-eeed-4d1e-a9d6-4fb78a917254 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:56.121439 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6b91f973-eeed-4d1e-a9d6-4fb78a917254 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1214 microversion: 2.1 time: 0.310062 Dec 18 20:53:56.124372 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 991/2020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:55 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:56.135631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:56.136585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:56.144741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.145934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.147497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.148754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.182517 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] HTTP exception thrown: Instance 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 could not be found. Dec 18 20:53:56.183829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Returning 404 to user: Instance 39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:53:56.189580 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7d4ce6ff-1e91-4030-ac2f-096f40344ef8 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6" status: 404 len: 111 microversion: 2.1 time: 0.063868 Dec 18 20:53:56.190178 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 992/2021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:56 2021] GET /compute/v2.1/servers/39f5fb37-07c8-4714-8eb3-fad1fa1f51d6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:56.204277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1dae701-5b49-4067-83f8-fc9e35fa1efc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:56.205920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1dae701-5b49-4067-83f8-fc9e35fa1efc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:56.214860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1dae701-5b49-4067-83f8-fc9e35fa1efc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.215603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1dae701-5b49-4067-83f8-fc9e35fa1efc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.216626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1dae701-5b49-4067-83f8-fc9e35fa1efc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.217236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1dae701-5b49-4067-83f8-fc9e35fa1efc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.284053 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1dae701-5b49-4067-83f8-fc9e35fa1efc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.090359 Dec 18 20:53:56.285969 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 993/2022] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:56 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:56.307442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:56.308024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:56.342611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.348083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.349638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.353773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.432514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:53:56.509390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:56.520806 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0f5fddd3-35cb-404d-9aab-04c5328f8607 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1379 microversion: 2.1 time: 0.871986 Dec 18 20:53:56.522729 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1030/2023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:55 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1379 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:56.673289 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c7639d6-ea0d-448a-afe5-9c3c88cf3f89 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "DELETE /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 204 len: 0 microversion: 2.1 time: 0.384732 Dec 18 20:53:56.676402 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 994/2024] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:53:56 2021] DELETE /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:53:56.687010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:56.689018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:56.700262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.701325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.702621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.703320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.796811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:56.797733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:56.826589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.828239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:56.834302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:56.834848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:57.818620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:57.831039 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01ee256d-13b8-4784-9527-78db0f7b0bd7 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1470 microversion: 2.1 time: 1.149594 Dec 18 20:53:57.833104 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1031/2025] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:56 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1470 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:57.856130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:57.859852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:57.874036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:57.875057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:57.878856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:57.880582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:58.190227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:58.206585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0530b0d-77fc-42ec-885f-b01d7fe62015 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1272 microversion: 2.1 time: 0.371370 Dec 18 20:53:58.207996 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1032/2026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:57 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:58.216670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-24c7d774-828d-4050-8916-0f8227119b63 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:53:58.218524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-24c7d774-828d-4050-8916-0f8227119b63 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:58.229593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:58.241462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c7d774-828d-4050-8916-0f8227119b63 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:58.242366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c7d774-828d-4050-8916-0f8227119b63 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:58.243625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c7d774-828d-4050-8916-0f8227119b63 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:58.243942 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a87d505-e55b-48b5-b77b-a05206e4da9a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 1.450793 Dec 18 20:53:58.244667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c7d774-828d-4050-8916-0f8227119b63 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:58.245926 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 995/2027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:56 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:58.269679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:58.274810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:58.296946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:58.298022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:58.301045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:58.301751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:58.327594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-24c7d774-828d-4050-8916-0f8227119b63 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.116981 Dec 18 20:53:58.332698 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1033/2028] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:53:58 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:53:58.855227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:58.856242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:58.885655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:58.886137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:58.887071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:58.887514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:59.664874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:59.678900 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c24df56-7f74-44b0-bd45-255a8767a4b6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1528 microversion: 2.1 time: 1.430775 Dec 18 20:53:59.686802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 996/2029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:58 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1528 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:59.692078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:59.707821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:59.715765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:59.720851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:59.721956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:59.722620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:59.891668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:53:59.903325 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dedd759e-e0dc-414e-aa2b-7a4c20ace078 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1272 microversion: 2.1 time: 0.213984 Dec 18 20:53:59.904657 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 997/2030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:59 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:53:59.910147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:53:59.911180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:53:59.920899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:59.921666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:53:59.923406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:53:59.924150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:01.093248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:01.108315 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-690fde6f-2390-443a-97c2-f2b82f5ddd48 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1470 microversion: 2.1 time: 2.259416 Dec 18 20:54:01.109844 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1034/2031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:58 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1470 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:01.115580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c2b75f75-37d1-44de-bed6-5a2dfe8c707d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:01.116889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c2b75f75-37d1-44de-bed6-5a2dfe8c707d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:01.125763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2b75f75-37d1-44de-bed6-5a2dfe8c707d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:01.126603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2b75f75-37d1-44de-bed6-5a2dfe8c707d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:01.127690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2b75f75-37d1-44de-bed6-5a2dfe8c707d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:01.128360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2b75f75-37d1-44de-bed6-5a2dfe8c707d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:01.187675 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c2b75f75-37d1-44de-bed6-5a2dfe8c707d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.076091 Dec 18 20:54:01.189231 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1035/2032] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:01 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:01.195048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:01.202099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:01.229090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:01.232404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:01.234804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:01.238313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:01.386826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:01.397656 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-27c238bd-7c1c-4301-9c16-875571946a47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 1.491779 Dec 18 20:54:01.402932 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 998/2033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:53:59 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:01.416316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:01.417204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:01.433728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:01.438474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:01.439773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:01.442223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:02.569815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:02.581167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:02.583974 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8478db2e-d2d3-4003-93dc-f0878c1e1556 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1528 microversion: 2.1 time: 1.392925 Dec 18 20:54:02.585181 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1036/2034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:01 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1528 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:02.591353 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-587738d3-390f-46f1-ab89-f2f029fb5fd8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1314 microversion: 2.1 time: 1.178982 Dec 18 20:54:02.595524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:02.595786 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 999/2035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:01 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1314 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:02.596543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:02.609956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ab4611f-83b2-4e65-9492-d82698f7c3cf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:02.613135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ab4611f-83b2-4e65-9492-d82698f7c3cf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:02.614871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:02.615651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:02.616719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:02.617625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:02.627294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab4611f-83b2-4e65-9492-d82698f7c3cf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:02.628431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab4611f-83b2-4e65-9492-d82698f7c3cf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:02.628560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab4611f-83b2-4e65-9492-d82698f7c3cf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:02.634684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ab4611f-83b2-4e65-9492-d82698f7c3cf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:02.733458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ab4611f-83b2-4e65-9492-d82698f7c3cf tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.135847 Dec 18 20:54:02.735776 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1000/2036] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:02 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:02.742743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:02.744296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:02.754282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:02.756970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:02.759046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:02.760052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:02.937563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:02.953048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12798d2a-4533-4f9e-bf86-129b02808224 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 200 len: 1299 microversion: 2.1 time: 0.366426 Dec 18 20:54:02.955487 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1037/2037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:02 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 1299 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:02.981955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6f0e38a0-2e8a-4947-8e11-1c70ac153853 req-2d73a7d1-6027-4ed6-b3a6-5cf23b3805e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8477c-e0d4-4c92-ab00-6ff2899911da", "name": "network-vif-deleted", "tag": "4b35e620-8957-42f7-a38a-5c515e281514"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:02.987052 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:02.987052 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:03.009927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6f0e38a0-2e8a-4947-8e11-1c70ac153853 req-2d73a7d1-6027-4ed6-b3a6-5cf23b3805e6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:03.014644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6f0e38a0-2e8a-4947-8e11-1c70ac153853 req-2d73a7d1-6027-4ed6-b3a6-5cf23b3805e6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:03.044622 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6f0e38a0-2e8a-4947-8e11-1c70ac153853 req-2d73a7d1-6027-4ed6-b3a6-5cf23b3805e6 service nova] Creating event network-vif-deleted:4b35e620-8957-42f7-a38a-5c515e281514 for instance 15b8477c-e0d4-4c92-ab00-6ff2899911da on nch2-master-1 Dec 18 20:54:03.056766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6f0e38a0-2e8a-4947-8e11-1c70ac153853 req-2d73a7d1-6027-4ed6-b3a6-5cf23b3805e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099781 Dec 18 20:54:03.058915 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1038/2038] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:03.078798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-534f9a5e-936b-4620-811f-621df9f2af0a tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:03.100085 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:03.100085 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:03.171155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-534f9a5e-936b-4620-811f-621df9f2af0a tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/17b456fa-4d78-4080-b5f4-1159a31a1768" status: 202 len: 0 microversion: 2.1 time: 0.108032 Dec 18 20:54:03.171789 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1039/2039] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:54:03 2021] DELETE /compute/v2.1/flavors/17b456fa-4d78-4080-b5f4-1159a31a1768 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:03.187806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b28fdfb-7f51-4cd6-93e5-42266241aaf1 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:03.231238 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b28fdfb-7f51-4cd6-93e5-42266241aaf1 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054491 Dec 18 20:54:03.235536 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1040/2040] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:54:03 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:03.259178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:03.261826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:03.286855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:03.287651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:03.290838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:03.291801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:03.575783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:03.583475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Old instance type tempest-test_resize_flavor_-405707032, new instance type m1.heat {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 20:54:03.606721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:03.607173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:03.607660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:03.608083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:03.609227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:03.968854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:03.996029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d5fff023-2c93-43bb-be8e-6c3ad99a6a0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 1.258612 Dec 18 20:54:04.015328 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1001/2041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:02 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:04.045647 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-29e4ea4c-ad06-4f3d-898b-842ae5f5ee55 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585/action" status: 202 len: 0 microversion: 2.1 time: 0.798320 Dec 18 20:54:04.049617 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1041/2042] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:03 2021] POST /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:04.051372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:04.055758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:04.064511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18d9f2ed-d29e-485b-9166-7a34a01271eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:04.068986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18d9f2ed-d29e-485b-9166-7a34a01271eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:04.096839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.099345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.109992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.111650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.118823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d9f2ed-d29e-485b-9166-7a34a01271eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.128376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d9f2ed-d29e-485b-9166-7a34a01271eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.129192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d9f2ed-d29e-485b-9166-7a34a01271eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.129652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d9f2ed-d29e-485b-9166-7a34a01271eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.263142 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18d9f2ed-d29e-485b-9166-7a34a01271eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.211981 Dec 18 20:54:04.276486 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1042/2043] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:04 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:04.315193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:04.328433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 15b8477c-e0d4-4c92-ab00-6ff2899911da] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:04.348908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.349363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.355996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.356326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.423305 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] HTTP exception thrown: Instance 15b8477c-e0d4-4c92-ab00-6ff2899911da could not be found. Dec 18 20:54:04.424569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Returning 404 to user: Instance 15b8477c-e0d4-4c92-ab00-6ff2899911da could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:54:04.425721 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf8f6776-910f-4076-a815-28911de97c88 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da" status: 404 len: 111 microversion: 2.1 time: 0.148041 Dec 18 20:54:04.426906 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1043/2044] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:04 2021] GET /compute/v2.1/servers/15b8477c-e0d4-4c92-ab00-6ff2899911da => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:04.439375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:04.442126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:04.464952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.467392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.470749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.471727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.675655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:04.687350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-521b76e1-99d5-46d7-a6cf-a05f2f4da282 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1314 microversion: 2.1 time: 0.656389 Dec 18 20:54:04.692868 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1002/2045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:04 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:04.703093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:04.705720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:04.720461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.721093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.724924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:04.725600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:04.795104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:54:05.003753 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0bd5f6f6-3add-419a-babc-0bee223513de tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 204 len: 0 microversion: 2.1 time: 0.307566 Dec 18 20:54:05.006703 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1003/2046] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:54:04 2021] DELETE /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:54:05.058977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:05.063264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:05.080980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:05.090542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:05.091504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:05.092615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:05.228908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:05.246824 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-335dc5a7-486c-4fac-bb5d-8485da0d7066 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1537 microversion: 2.1 time: 0.818515 Dec 18 20:54:05.248973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1044/2047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:04 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1537 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:05.264571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:05.279120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:05.286962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:05.287611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:05.288535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:05.290706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:05.761339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:05.775829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a67c9ece-2fa0-4e21-a13b-ea25935d71d0 tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1470 microversion: 2.1 time: 0.757124 Dec 18 20:54:05.777803 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1004/2048] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:05 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1470 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:05.946959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:05.970242 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae102d41-6084-441d-99c9-90f19c0af895 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 0.700117 Dec 18 20:54:05.975624 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1045/2049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:05 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:05.984577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d56caffd-4b03-4109-a920-538872cf0a8d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:05.990170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d56caffd-4b03-4109-a920-538872cf0a8d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:06.007387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d56caffd-4b03-4109-a920-538872cf0a8d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:06.010464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d56caffd-4b03-4109-a920-538872cf0a8d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:06.014497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d56caffd-4b03-4109-a920-538872cf0a8d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:06.016109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d56caffd-4b03-4109-a920-538872cf0a8d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:06.108794 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d56caffd-4b03-4109-a920-538872cf0a8d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.130994 Dec 18 20:54:06.111839 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1046/2050] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:05 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:06.125983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:06.127969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:06.150993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a488ed2-f5fa-4c7a-ac02-e094e6a2bf88 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'create', calling method: .version_select at 0x7f714f6e4d30>, body: {"keypair": {"name": "tempest-keypair-405209443"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:06.159646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:06.160164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:06.184361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5a488ed2-f5fa-4c7a-ac02-e094e6a2bf88 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:06.187355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:06.188431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:06.199845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5a488ed2-f5fa-4c7a-ac02-e094e6a2bf88 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for user 0ee5b92caab2431f97702541033df654 and project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:06.439575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5a488ed2-f5fa-4c7a-ac02-e094e6a2bf88 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:06.453422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5a488ed2-f5fa-4c7a-ac02-e094e6a2bf88 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for user 0ee5b92caab2431f97702541033df654 and project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:06.502141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a488ed2-f5fa-4c7a-ac02-e094e6a2bf88 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.718028 Dec 18 20:54:06.508803 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1005/2051] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:54:05 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:06.514736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-9b351f0f-e902-4a92-81a9-5a1e0246bc1b req-e2fa5e36-f854-49cb-8fc7-693dcb81a3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af230c2-c718-48a0-9991-6c0418c4618d", "tag": "f4df3e7c-2733-4319-be8f-892a0ca14aa9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:06.522547 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:06.522547 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:06.537969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9b351f0f-e902-4a92-81a9-5a1e0246bc1b req-e2fa5e36-f854-49cb-8fc7-693dcb81a3f5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:06.541282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9b351f0f-e902-4a92-81a9-5a1e0246bc1b req-e2fa5e36-f854-49cb-8fc7-693dcb81a3f5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:06.568167 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9b351f0f-e902-4a92-81a9-5a1e0246bc1b req-e2fa5e36-f854-49cb-8fc7-693dcb81a3f5 service nova] Creating event network-changed:f4df3e7c-2733-4319-be8f-892a0ca14aa9 for instance 2af230c2-c718-48a0-9991-6c0418c4618d on nch2-master-1 Dec 18 20:54:06.583888 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-9b351f0f-e902-4a92-81a9-5a1e0246bc1b req-e2fa5e36-f854-49cb-8fc7-693dcb81a3f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072963 Dec 18 20:54:06.585181 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1006/2052] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:06.596452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:06.598637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:06.614298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:06.618507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:06.620508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:06.623133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:08.082830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:08.099818 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4cca7e30-6f68-467b-920d-0ebbd2efeff7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1314 microversion: 2.1 time: 1.985798 Dec 18 20:54:08.104132 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1047/2053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:06 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1314 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:08.124937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:08.125638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:08.161086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:08.165169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:08.169539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:08.171230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:08.336573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:08.349749 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c31221f4-c283-41e2-be06-609305c3e829 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1537 microversion: 2.1 time: 1.762027 Dec 18 20:54:08.361784 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1007/2054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:06 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1537 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:08.375412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:08.376357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:08.396447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:08.397169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:08.399567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:08.402516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:10.095974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:10.108070 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23f66d95-08c7-4435-ba71-ae03d1f9144b tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1470 microversion: 2.1 time: 2.002233 Dec 18 20:54:10.109491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1048/2055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:08 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1470 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:10.114972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-404b4ace-9108-4d42-a2d9-dcb9877aaade tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:10.116389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-404b4ace-9108-4d42-a2d9-dcb9877aaade tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:10.129787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-404b4ace-9108-4d42-a2d9-dcb9877aaade tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:10.131092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-404b4ace-9108-4d42-a2d9-dcb9877aaade tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:10.132692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-404b4ace-9108-4d42-a2d9-dcb9877aaade tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:10.133925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-404b4ace-9108-4d42-a2d9-dcb9877aaade tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:10.202909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-404b4ace-9108-4d42-a2d9-dcb9877aaade tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.091212 Dec 18 20:54:10.208381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1049/2056] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:10 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:10.217498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:10.217498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:10.219265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:10.227466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:10.228823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:10.235504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:10.236144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:10.244198 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d01733f-edbf-4486-82d7-6569caee592c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 1.866118 Dec 18 20:54:10.248731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1008/2057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:08 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:10.284022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:10.294849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:10.306892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:10.307755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:10.308871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:10.309535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:11.525674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:11.540025 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba7d18dd-fed2-4905-b3ab-b64b58f4a0bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1314 microversion: 2.1 time: 1.329603 Dec 18 20:54:11.541214 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1050/2058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:10 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1314 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:11.549382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-954cbd7b-665f-4014-a950-9576172e547c req-86728a14-5256-4a25-973f-54cacc157b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d00b730-00ba-4bc7-be51-6de9d571a1b2", "name": "network-vif-unplugged", "status": "completed", "tag": "659424cb-2544-4eb1-afc7-8c764a75b399"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:11.556275 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:11.556275 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:11.572451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-954cbd7b-665f-4014-a950-9576172e547c req-86728a14-5256-4a25-973f-54cacc157b65 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:11.572864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-954cbd7b-665f-4014-a950-9576172e547c req-86728a14-5256-4a25-973f-54cacc157b65 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:11.599929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-954cbd7b-665f-4014-a950-9576172e547c req-86728a14-5256-4a25-973f-54cacc157b65 service nova] Creating event network-vif-unplugged:659424cb-2544-4eb1-afc7-8c764a75b399 for instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 on nch2-master-1 Dec 18 20:54:11.612931 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-954cbd7b-665f-4014-a950-9576172e547c req-86728a14-5256-4a25-973f-54cacc157b65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070172 Dec 18 20:54:11.616629 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1051/2059] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:11.635136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:11.636578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:11.656291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:11.660688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:11.665826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:11.666798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:11.667260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:11.687022 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b652331-f5b3-41dc-81ba-5127a558fc4f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1537 microversion: 2.1 time: 1.429530 Dec 18 20:54:11.688245 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1009/2060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:10 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1537 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:11.738472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5e1a30ed-a69e-4407-b982-a079f42aead3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:11.748449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5e1a30ed-a69e-4407-b982-a079f42aead3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:11.774463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e1a30ed-a69e-4407-b982-a079f42aead3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:11.779566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e1a30ed-a69e-4407-b982-a079f42aead3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:11.781793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e1a30ed-a69e-4407-b982-a079f42aead3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:11.782862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e1a30ed-a69e-4407-b982-a079f42aead3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:11.861118 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5e1a30ed-a69e-4407-b982-a079f42aead3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.143034 Dec 18 20:54:11.872066 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1010/2061] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:11 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:11.890988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:11.931832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:12.002660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:12.003579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:12.005765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:12.007004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:12.033390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca309394563d45ea9b911c14c5f7625f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f464a0dbea408cb3f43c2c96bdaaac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:12.047270 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-90f451fc-d49b-4170-8876-4324258fffbc tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 200 len: 1428 microversion: 2.1 time: 0.425931 Dec 18 20:54:12.050083 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1052/2062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:11 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 1428 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:12.069826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c31c801a-f447-4193-80ae-972c07341121 req-edf358ff-5e87-4dde-8264-21f2cbda4c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d00b730-00ba-4bc7-be51-6de9d571a1b2", "name": "network-vif-deleted", "tag": "659424cb-2544-4eb1-afc7-8c764a75b399"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:12.083722 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:12.083722 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:12.129354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c31c801a-f447-4193-80ae-972c07341121 req-edf358ff-5e87-4dde-8264-21f2cbda4c46 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:12.135244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c31c801a-f447-4193-80ae-972c07341121 req-edf358ff-5e87-4dde-8264-21f2cbda4c46 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:12.152122 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c31c801a-f447-4193-80ae-972c07341121 req-edf358ff-5e87-4dde-8264-21f2cbda4c46 service nova] Creating event network-vif-deleted:659424cb-2544-4eb1-afc7-8c764a75b399 for instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 on nch2-master-1 Dec 18 20:54:12.158889 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c31c801a-f447-4193-80ae-972c07341121 req-edf358ff-5e87-4dde-8264-21f2cbda4c46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106263 Dec 18 20:54:12.159924 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1053/2063] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:12.557352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:12.558097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:12.569804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:12.570806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:12.571632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:12.572077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:13.068869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:13.078137 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6b9008b7-07e3-404c-9983-e734ac735c54 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 1.203974 Dec 18 20:54:13.086372 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1011/2064] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:11 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:13.091290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:13.100485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:13.147078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:13.148778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:13.153624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:13.155019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:13.578560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:13.599035 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7479bf2f-205c-4473-a7a3-d8fcb076746f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1314 microversion: 2.1 time: 1.040901 Dec 18 20:54:13.617059 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1054/2065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:12 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1314 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:13.628422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd66d60d-1c57-4a5b-8220-d08fcdb27cd4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:13.641057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd66d60d-1c57-4a5b-8220-d08fcdb27cd4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:13.660721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd66d60d-1c57-4a5b-8220-d08fcdb27cd4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:13.661182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd66d60d-1c57-4a5b-8220-d08fcdb27cd4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:13.662007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd66d60d-1c57-4a5b-8220-d08fcdb27cd4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:13.667767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd66d60d-1c57-4a5b-8220-d08fcdb27cd4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:13.818178 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd66d60d-1c57-4a5b-8220-d08fcdb27cd4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.199251 Dec 18 20:54:13.819253 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1055/2066] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:13 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:13.832595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:13.833798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] [instance: 1d00b730-00ba-4bc7-be51-6de9d571a1b2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:13.849557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:13.853743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:13.856334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:13.858302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:13.891206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:13.897008 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] HTTP exception thrown: Instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 could not be found. Dec 18 20:54:13.901119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] Returning 404 to user: Instance 1d00b730-00ba-4bc7-be51-6de9d571a1b2 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:54:13.903594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f70002f1-d67c-4e62-91e0-e977bdebd02c tempest-ServersAdminTestJSON-2052237514 tempest-ServersAdminTestJSON-2052237514-project] 10.222.0.13 "GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2" status: 404 len: 111 microversion: 2.1 time: 0.081800 Dec 18 20:54:13.905230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1056/2067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:13 2021] GET /compute/v2.1/servers/1d00b730-00ba-4bc7-be51-6de9d571a1b2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:13.913690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66c9b19c-60b6-4fef-8f6f-df3aed025c33 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1537 microversion: 2.1 time: 0.825818 Dec 18 20:54:13.922356 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1012/2068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:13 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1537 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:14.101665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:14.102781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:14.122933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:14.123763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:14.125865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:14.126760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.167712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a0531b3-0c01-4bb3-95fd-e599aac1fcbe tempest-NetworksTest-756339059 tempest-NetworksTest-756339059-project-admin] Calling method '.version_select at 0x7f714eebd3a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:15.206651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:15.215831 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d021c24-38e7-46fd-a37a-e22120d76418 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1684 microversion: 2.1 time: 1.117880 Dec 18 20:54:15.229106 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1057/2069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:14 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1684 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:15.233849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:15.241414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:15.256206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:15.259693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.260857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:15.261330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.563676 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a0531b3-0c01-4bb3-95fd-e599aac1fcbe tempest-NetworksTest-756339059 tempest-NetworksTest-756339059-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 7376 microversion: 2.1 time: 1.237463 Dec 18 20:54:15.564627 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1013/2070] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:54:14 2021] GET /compute/v2.1/os-networks => generated 7376 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:15.571804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-55a53662-9fd4-44a9-889c-2fb3a40980dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:15.573072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-55a53662-9fd4-44a9-889c-2fb3a40980dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:15.595354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55a53662-9fd4-44a9-889c-2fb3a40980dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:15.595820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55a53662-9fd4-44a9-889c-2fb3a40980dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.599217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55a53662-9fd4-44a9-889c-2fb3a40980dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:15.599717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55a53662-9fd4-44a9-889c-2fb3a40980dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.675209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:15.682551 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-55a53662-9fd4-44a9-889c-2fb3a40980dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.116265 Dec 18 20:54:15.683738 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1014/2071] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:15 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:15.694840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-84594d7b-8a14-4114-8d19-9bec00f302e2 req-6f10e3c0-97f2-469f-a085-40ab8063798f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af230c2-c718-48a0-9991-6c0418c4618d", "name": "network-vif-plugged", "status": "completed", "tag": "f4df3e7c-2733-4319-be8f-892a0ca14aa9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:15.698698 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:15.698698 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:15.722004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-84594d7b-8a14-4114-8d19-9bec00f302e2 req-6f10e3c0-97f2-469f-a085-40ab8063798f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:15.723185 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e364e4b9-b8ae-42f1-9f80-d25e8d47a968 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1314 microversion: 2.1 time: 0.490049 Dec 18 20:54:15.723921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-84594d7b-8a14-4114-8d19-9bec00f302e2 req-6f10e3c0-97f2-469f-a085-40ab8063798f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.727360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1058/2072] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:15 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:15.740800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:15.744828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:15.760254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:15.760520 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-84594d7b-8a14-4114-8d19-9bec00f302e2 req-6f10e3c0-97f2-469f-a085-40ab8063798f service nova] Creating event network-vif-plugged:f4df3e7c-2733-4319-be8f-892a0ca14aa9 for instance 2af230c2-c718-48a0-9991-6c0418c4618d on nch2-master-1 Dec 18 20:54:15.761315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.765027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:15.765549 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-84594d7b-8a14-4114-8d19-9bec00f302e2 req-6f10e3c0-97f2-469f-a085-40ab8063798f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079559 Dec 18 20:54:15.766559 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1015/2073] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:15.768455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:15.771859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-083e11ac-e334-4465-b651-f02afca53f80 tempest-NetworksTest-756339059 tempest-NetworksTest-756339059-project-admin] Calling method '.version_select at 0x7f714faa79d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:16.012921 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-083e11ac-e334-4465-b651-f02afca53f80 tempest-NetworksTest-756339059 tempest-NetworksTest-756339059-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks/c1abfdfc-0c98-4a48-868b-8cd075b12438" status: 200 len: 652 microversion: 2.1 time: 0.244919 Dec 18 20:54:16.014390 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1016/2074] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 20:54:15 2021] GET /compute/v2.1/os-networks/c1abfdfc-0c98-4a48-868b-8cd075b12438 => generated 652 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:16.024817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec56a924-5446-4f66-80e2-f0f2dda4db05 tempest-NetworksTest-756339059 tempest-NetworksTest-756339059-project-admin] Calling method '.version_select at 0x7f714eebda60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:16.263727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:16.276903 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a65b0d90-9c18-423a-b030-01e4ce6afd70 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.544481 Dec 18 20:54:16.279039 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1059/2075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:15 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:16.283687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:16.284287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:16.304182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:16.305485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:16.306492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:16.311134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:16.506764 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec56a924-5446-4f66-80e2-f0f2dda4db05 tempest-NetworksTest-756339059 tempest-NetworksTest-756339059-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 7376 microversion: 2.1 time: 0.486703 Dec 18 20:54:16.507834 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1017/2076] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:54:16 2021] GET /compute/v2.1/os-networks => generated 7376 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:16.660161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:16.669465 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c1278c5-4cc3-4d6c-9f64-4a0c03096168 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.388395 Dec 18 20:54:16.670690 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1060/2077] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:16 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:16.700091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-94d6044b-0572-4e2f-9bac-fc8cbb9d10e7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:16.702135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-94d6044b-0572-4e2f-9bac-fc8cbb9d10e7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:16.744567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:16.745367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:16.748660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94d6044b-0572-4e2f-9bac-fc8cbb9d10e7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:16.749125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94d6044b-0572-4e2f-9bac-fc8cbb9d10e7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:16.750504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94d6044b-0572-4e2f-9bac-fc8cbb9d10e7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:16.750950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94d6044b-0572-4e2f-9bac-fc8cbb9d10e7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:16.761051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:16.762118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:16.763262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:16.764372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:16.822322 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-94d6044b-0572-4e2f-9bac-fc8cbb9d10e7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.130838 Dec 18 20:54:16.827047 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1018/2078] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:16 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:54:17.051586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:17.065091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7368b97-12b9-47a0-8f04-b0333d5c60d4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1314 microversion: 2.1 time: 0.321732 Dec 18 20:54:17.070756 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1061/2079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:16 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:17.312844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:17.316327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:17.353803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:17.357565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:17.371568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:17.372557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:17.566684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:17.584062 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b59d41e9-21e8-470d-a7c2-c6db9c3f18ad tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.289112 Dec 18 20:54:17.584939 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1019/2080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:17 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:17.837819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99d573ae-40a0-4ce4-a2c4-459a320243c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:17.848223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99d573ae-40a0-4ce4-a2c4-459a320243c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:17.858137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:17.858785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:17.889172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:17.890201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:17.891676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:17.893920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d573ae-40a0-4ce4-a2c4-459a320243c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:17.894223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:17.901975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d573ae-40a0-4ce4-a2c4-459a320243c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:17.902909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d573ae-40a0-4ce4-a2c4-459a320243c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:17.903355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d573ae-40a0-4ce4-a2c4-459a320243c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:17.974082 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99d573ae-40a0-4ce4-a2c4-459a320243c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.141089 Dec 18 20:54:17.978129 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1062/2081] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:17 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:18.089271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:18.090134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:18.101026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:18.106020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:18.107070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:18.109151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:18.196196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:18.205390 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58673be1-9fee-48bd-ad0d-03a2d86688c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.351217 Dec 18 20:54:18.207987 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1020/2082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:17 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:18.365669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:18.375330 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-df162b9d-b4bd-4dd8-9ab8-6f7d220d7526 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1500 microversion: 2.1 time: 0.292136 Dec 18 20:54:18.386936 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1063/2083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:18 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1500 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:18.394317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:18.395614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:18.408779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:18.409236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:18.410394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:18.410935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:18.441735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lazy-loading 'flavor' on Instance uuid 2af230c2-c718-48a0-9991-6c0418c4618d {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:54:18.478701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2007479798", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d857e3b8-aa79-4523-91ed-5ea023d39eaf"}], "security_groups": [{"name": "tempest-securitygroup--674149230"}], "key_name": "tempest-keypair-405209443", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4bdb5baa-b93d-4799-a653-1de77543ed53", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:18.571739 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b110cf54-004a-42c6-8f91-cd793e22dd69 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "POST /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d/action" status: 200 len: 32 microversion: 2.1 time: 0.181942 Dec 18 20:54:18.572964 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1021/2084] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:18 2021] POST /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:54:18.582979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:18.583923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:18.591448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:18.592403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:18.593505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:18.594601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:18.608163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] validate_networks() for [('d857e3b8-aa79-4523-91ed-5ea023d39eaf', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:18.987343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:19.004262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-854b1619-ac8a-44ca-923d-cc4834285c44 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.419237 Dec 18 20:54:19.006434 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1022/2085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:18 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:19.015288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:19.015906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:19.037949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:19.039595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:19.041866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:19.043237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:19.665814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:19.678204 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-198b4213-3c05-4205-977d-27c3b160e2ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.668943 Dec 18 20:54:19.688457 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1023/2086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:19 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:19.690465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1c3dd40-2f35-4234-884a-c807b4a157dc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:19.692203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1c3dd40-2f35-4234-884a-c807b4a157dc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:19.719208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1c3dd40-2f35-4234-884a-c807b4a157dc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:19.721384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1c3dd40-2f35-4234-884a-c807b4a157dc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:19.722348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1c3dd40-2f35-4234-884a-c807b4a157dc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:19.727616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:19.737367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1c3dd40-2f35-4234-884a-c807b4a157dc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:19.747541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for user 0ee5b92caab2431f97702541033df654 and project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:19.790610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:19.791055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:19.791517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:19.791924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:19.792342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:19.812502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:19.813175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:19.814503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:19.815114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:19.821855 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1c3dd40-2f35-4234-884a-c807b4a157dc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.140912 Dec 18 20:54:19.823624 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1024/2087] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:19 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:19.834612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3fa5721d-221c-408f-b8b4-b8f4d716e522 req-e5777d29-7c49-46e6-9857-35f4583321b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:19.842025 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:19.842025 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:19.853535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3fa5721d-221c-408f-b8b4-b8f4d716e522 req-e5777d29-7c49-46e6-9857-35f4583321b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:19.853985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3fa5721d-221c-408f-b8b4-b8f4d716e522 req-e5777d29-7c49-46e6-9857-35f4583321b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:19.864985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:19.875225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Getting quotas for user 0ee5b92caab2431f97702541033df654 and project 8efd6d0e0ed74857b4b6265fdacc68cc. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:19.884063 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3fa5721d-221c-408f-b8b4-b8f4d716e522 req-e5777d29-7c49-46e6-9857-35f4583321b7 service nova] Creating event network-vif-unplugged:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:54:19.892173 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3fa5721d-221c-408f-b8b4-b8f4d716e522 req-e5777d29-7c49-46e6-9857-35f4583321b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066596 Dec 18 20:54:19.904600 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1025/2088] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:19.977762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:54:19.987640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bdb5baa-b93d-4799-a653-1de77543ed53',volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:54:20.025414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:20.026144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:20.036767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:20.037464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:20.039337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:20.040782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:20.254620 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74bd90db-0d17-495e-ada9-1e86dbe7c76e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.779807 Dec 18 20:54:20.255827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1064/2089] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:18 2021] POST /compute/v2.1/servers => generated 406 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:54:20.261339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac36257f-280f-47b5-b019-994cf08300db tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f714fb004c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:20.307077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:20.321673 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8339b990-e3f2-4713-94f6-82dd9c785bd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.303312 Dec 18 20:54:20.325710 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1026/2090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:20 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:20.337515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bc372ec-2c03-430b-ba02-b2bdea37b0c4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:20.341169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bc372ec-2c03-430b-ba02-b2bdea37b0c4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:20.430766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac36257f-280f-47b5-b019-994cf08300db tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19" status: 200 len: 637 microversion: 2.1 time: 0.171092 Dec 18 20:54:20.433067 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1065/2091] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:20 2021] GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19 => generated 637 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:20.448298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bc372ec-2c03-430b-ba02-b2bdea37b0c4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:20.455899 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bc372ec-2c03-430b-ba02-b2bdea37b0c4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1121 microversion: 2.1 time: 0.128699 Dec 18 20:54:20.457932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04306e9c-b2f9-4e89-bae0-2f2b980be500 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update_all', calling method: .version_select at 0x7f714fae4dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:20.462946 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1027/2092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:20 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1121 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:20.512752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:20.513470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:20.528832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:20.530149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:20.531298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:20.535953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:20.594598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-04306e9c-b2f9-4e89-bae0-2f2b980be500 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:20.636771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-04306e9c-b2f9-4e89-bae0-2f2b980be500 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:20.740757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:20.761660 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c4835ecc-43f2-4dfb-af96-ba5b3e8ba89f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.258599 Dec 18 20:54:20.762363 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1028/2093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:20 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:20.768899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:20.769954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:20.785402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:20.786061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:20.787076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:20.787686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.055246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:21.069036 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7a8b1af-87b9-4675-94a8-d19631d8a2b2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.305599 Dec 18 20:54:21.069926 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1029/2094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:20 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:21.075107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c2e9aea-c661-4926-9e67-3e67f712b6d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:21.096853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c2e9aea-c661-4926-9e67-3e67f712b6d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:21.108440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c2e9aea-c661-4926-9e67-3e67f712b6d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.108952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c2e9aea-c661-4926-9e67-3e67f712b6d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.109762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c2e9aea-c661-4926-9e67-3e67f712b6d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.110199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c2e9aea-c661-4926-9e67-3e67f712b6d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.256817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c2e9aea-c661-4926-9e67-3e67f712b6d0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.184952 Dec 18 20:54:21.257779 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1030/2095] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:21 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:21.269124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4e95fce4-240f-4934-afaf-a4be1ecd525b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:21.271069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4e95fce4-240f-4934-afaf-a4be1ecd525b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:21.271435 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04306e9c-b2f9-4e89-bae0-2f2b980be500 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.828610 Dec 18 20:54:21.277435 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1066/2096] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:54:20 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 61 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:21.282421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:21.283325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:21.285888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e95fce4-240f-4934-afaf-a4be1ecd525b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.286440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e95fce4-240f-4934-afaf-a4be1ecd525b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.289549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e95fce4-240f-4934-afaf-a4be1ecd525b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.290752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e95fce4-240f-4934-afaf-a4be1ecd525b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.300488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.301068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.301981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.302609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.392360 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4e95fce4-240f-4934-afaf-a4be1ecd525b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.132408 Dec 18 20:54:21.393888 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1031/2097] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:21 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:21.401125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8319eb6e-3ea1-4f44-8a61-82ac5ad7d7d6 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f714eedddc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:21.602364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:21.614420 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-832b06cd-719d-497c-90d8-66869d6f509b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1673 microversion: 2.1 time: 0.335542 Dec 18 20:54:21.615414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1067/2098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:21 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1673 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:21.622926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:21.624242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:21.635586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.636554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.637603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.639021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.906931 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8319eb6e-3ea1-4f44-8a61-82ac5ad7d7d6 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "DELETE /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.511677 Dec 18 20:54:21.907781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1032/2099] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Dec 18 20:54:21 2021] DELETE /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata/os_version => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:54:21.920475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:21.920475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:21.944578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.944949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:21.946723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:21.947314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:22.055730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:22.074209 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f7d2cf5c-fa86-46b3-977c-a18237b64b56 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1237 microversion: 2.1 time: 0.165186 Dec 18 20:54:22.074864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1033/2100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:21 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:22.095135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7385b5e8-d07a-4efb-89f9-4d5162f696dd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f714fb50550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:22.102639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:22.112892 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a15886df-9489-4d95-9a2c-b0c55ba6661c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.495764 Dec 18 20:54:22.114491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1068/2101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:21 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:22.130647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:22.132906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:22.140734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:22.148993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:22.153350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:22.154986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:22.168705 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7385b5e8-d07a-4efb-89f9-4d5162f696dd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 37 microversion: 2.1 time: 0.089562 Dec 18 20:54:22.169265 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1034/2102] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:54:22 2021] GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 37 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:22.180953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ee65b172-a400-423b-ba11-6a1033a2bccd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update_all', calling method: .version_select at 0x7f714f47fdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:22.253693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ee65b172-a400-423b-ba11-6a1033a2bccd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:22.260419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ee65b172-a400-423b-ba11-6a1033a2bccd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:22.649898 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ee65b172-a400-423b-ba11-6a1033a2bccd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.473589 Dec 18 20:54:22.650761 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1035/2103] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:54:22 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 61 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:22.837495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1909344314", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:22.906679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:22.965262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:22.981587 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a90e5099-8da4-457c-864f-e8ff45cfd5f4 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.861129 Dec 18 20:54:22.983205 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1069/2104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:22 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:22.988560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26d3af21-314e-4fad-97c9-63fe2ccbd51d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:22.990891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26d3af21-314e-4fad-97c9-63fe2ccbd51d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:23.001582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26d3af21-314e-4fad-97c9-63fe2ccbd51d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.003283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26d3af21-314e-4fad-97c9-63fe2ccbd51d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.004735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26d3af21-314e-4fad-97c9-63fe2ccbd51d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.005544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26d3af21-314e-4fad-97c9-63fe2ccbd51d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.063002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26d3af21-314e-4fad-97c9-63fe2ccbd51d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.078372 Dec 18 20:54:23.063743 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1070/2105] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:22 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:23.072354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:23.074186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:23.084950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.086581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.088220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.088994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.392068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:23.392563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:23.392989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:23.414629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:23.415665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:23.441471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.442084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.442946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.443383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.467955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Getting quotas for project 6af640d59dee48c59f1f191bc541829d. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:23.478191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:23.482136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Getting quotas for user 753e7daa3b814c789fd6451101113666 and project 6af640d59dee48c59f1f191bc541829d. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:23.500210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68610366-eadc-436f-a34b-e7ea3709cdac tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1678 microversion: 2.1 time: 0.435016 Dec 18 20:54:23.511183 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1071/2106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:23 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1678 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:23.511183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce9c4127-f966-4274-89ef-ceb37d0b9459 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f714fb0dd30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:23.562187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:54:23.569932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:54:23.604784 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce9c4127-f966-4274-89ef-ceb37d0b9459 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.099998 Dec 18 20:54:23.613016 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1072/2107] 10.222.0.13 () {58 vars in 1289 bytes} [Sat Dec 18 20:54:23 2021] GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata/os_distro => generated 33 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:23.618951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:23.619585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:23.626093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.626590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.627454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.627920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.643727 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd4cabdc-6b78-4e93-89b7-1ebd92a0c5bc tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991355 Dec 18 20:54:23.644566 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1036/2108] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:54:23.659832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:23.662792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:23.675481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.676164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.677151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:23.677766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:23.714188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:23.724468 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-049d33cc-df98-4939-bc9e-8fe15f0320d3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1225 microversion: 2.1 time: 0.110063 Dec 18 20:54:23.727876 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1073/2109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:23 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:23.744111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34e63966-aee1-4708-8708-889255761e43 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update_all', calling method: .version_select at 0x7f715c1a31f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:23.822440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-34e63966-aee1-4708-8708-889255761e43 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:23.834463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-34e63966-aee1-4708-8708-889255761e43 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:24.048157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:24.058149 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-055dea92-1faf-4e6e-812f-b22759981d18 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.412199 Dec 18 20:54:24.061766 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1037/2110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:23 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:24.086452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-14feaedf-c29a-488b-9f2f-a23bde2969ec tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:24.087282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-14feaedf-c29a-488b-9f2f-a23bde2969ec tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:24.233429 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34e63966-aee1-4708-8708-889255761e43 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.504060 Dec 18 20:54:24.234485 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1074/2111] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:54:23 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 61 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:24.241144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:24.243236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:24.252152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.253070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.254078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.254612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.257573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-14feaedf-c29a-488b-9f2f-a23bde2969ec tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:24.267692 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-14feaedf-c29a-488b-9f2f-a23bde2969ec tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1223 microversion: 2.1 time: 0.204547 Dec 18 20:54:24.268969 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1038/2112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:24 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1223 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:24.276774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57f978d2-0e12-4758-806b-c10f78d38e4f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:24.282951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57f978d2-0e12-4758-806b-c10f78d38e4f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:24.293857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f978d2-0e12-4758-806b-c10f78d38e4f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.294206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f978d2-0e12-4758-806b-c10f78d38e4f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.295064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f978d2-0e12-4758-806b-c10f78d38e4f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.295463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57f978d2-0e12-4758-806b-c10f78d38e4f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.357800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57f978d2-0e12-4758-806b-c10f78d38e4f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.087186 Dec 18 20:54:24.365110 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1039/2113] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:24 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:24.371186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d81f872d-49f5-40e6-ace1-5ac77892007d tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f714f47f1f0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:24.442566 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d81f872d-49f5-40e6-ace1-5ac77892007d tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.075428 Dec 18 20:54:24.444766 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1040/2114] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:54:24 2021] GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 61 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:24.458981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abe9eafd-6e63-441c-8338-d4aa83c627dd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update_all', calling method: .version_select at 0x7f714f5da700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:24.574417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-abe9eafd-6e63-441c-8338-d4aa83c627dd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:24.586139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-abe9eafd-6e63-441c-8338-d4aa83c627dd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:24.645297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:24.657061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d96df5a-7a6a-4aa1-a15a-5a81a1f659e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.419665 Dec 18 20:54:24.658607 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1075/2115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:24 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:24.669960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:24.670626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:24.683616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.684743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.686021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.687416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.937945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abe9eafd-6e63-441c-8338-d4aa83c627dd tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.483619 Dec 18 20:54:24.938716 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1041/2116] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:54:24 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 61 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:24.948741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:24.949468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:24.957075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.957897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.959748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:24.960323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:24.979554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:24.995300 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0f6f75cc-a4ba-4726-ae6e-a0953fdd5b3b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.334459 Dec 18 20:54:24.995892 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1076/2117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:24 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:25.003948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d58e851a-e12b-4ada-9a8c-97f4b45ef82b tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update_all', calling method: .version_select at 0x7f714f627280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:25.080298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d58e851a-e12b-4ada-9a8c-97f4b45ef82b tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:25.088538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d58e851a-e12b-4ada-9a8c-97f4b45ef82b tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:25.259164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:25.273857 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4bca41cf-24d6-44cc-a9d3-62d22c28db58 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1292 microversion: 2.1 time: 0.329391 Dec 18 20:54:25.274784 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1042/2118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:24 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1292 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:25.279541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ebe3a715-82b2-42d6-83fe-eb1026a96ff8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:25.295079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ebe3a715-82b2-42d6-83fe-eb1026a96ff8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:25.321265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebe3a715-82b2-42d6-83fe-eb1026a96ff8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:25.322558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebe3a715-82b2-42d6-83fe-eb1026a96ff8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:25.323749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebe3a715-82b2-42d6-83fe-eb1026a96ff8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:25.324468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebe3a715-82b2-42d6-83fe-eb1026a96ff8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:25.431485 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ebe3a715-82b2-42d6-83fe-eb1026a96ff8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 322 microversion: 2.1 time: 0.154577 Dec 18 20:54:25.433203 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1043/2119] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:25 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:25.441560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:25.442708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:25.457031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:25.458185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:25.459735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:25.461995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:25.804399 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d58e851a-e12b-4ada-9a8c-97f4b45ef82b tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 64 microversion: 2.1 time: 0.807095 Dec 18 20:54:25.805059 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1077/2120] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:54:24 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 64 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:25.813885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:25.814663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:25.823711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:25.824471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:25.825673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:25.826500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:25.978038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:25.986189 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51334e68-ce40-4530-9a6e-1c4e2582075e tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1281 microversion: 2.1 time: 0.176205 Dec 18 20:54:25.987905 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1078/2121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:25 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1281 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:25.992259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3186435c-1f19-4083-b53d-181d84a0d23b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:25.993223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3186435c-1f19-4083-b53d-181d84a0d23b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:26.000157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3186435c-1f19-4083-b53d-181d84a0d23b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.000807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3186435c-1f19-4083-b53d-181d84a0d23b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.001640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3186435c-1f19-4083-b53d-181d84a0d23b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.002123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3186435c-1f19-4083-b53d-181d84a0d23b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.049774 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3186435c-1f19-4083-b53d-181d84a0d23b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.060827 Dec 18 20:54:26.054360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1079/2122] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:25 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:26.054716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:26.058696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:26.059467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:26.062380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3baed66-1fc1-4d2b-b209-1ef18fce28a8 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.626851 Dec 18 20:54:26.067232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.067798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.068617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.069243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.073063 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1044/2123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:25 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:26.078430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:26.079047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:26.088402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.089187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.091797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.092460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.573964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:26.582428 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0b0fc840-c639-48cd-a02b-28dd7d786391 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.507996 Dec 18 20:54:26.583035 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1045/2124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:26 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:26.594802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ef2fefa-03d6-4060-8437-c70d9607163a tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f714ec338b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:26.608359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:26.626403 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8ec48b8-240e-447c-97cc-4ddf38d59180 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.574416 Dec 18 20:54:26.627553 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1080/2125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:26 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:26.641595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:26.643315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:26.654539 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ef2fefa-03d6-4060-8437-c70d9607163a tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 64 microversion: 2.1 time: 0.063360 Dec 18 20:54:26.655114 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1046/2126] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:54:26 2021] GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 64 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:26.657910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.660473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-006024f6-6c51-417d-9913-bb3cd4c6669c req-daba6e41-a34a-4d2f-ad2a-4fd102e26597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c911e5-ab47-4315-b264-1c7ab04c57a5", "tag": "b60f4815-ec88-4e24-968e-a604b4771eb4"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:26.660888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.662116 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:26.662116 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:26.662698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.663355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.673832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-006024f6-6c51-417d-9913-bb3cd4c6669c req-daba6e41-a34a-4d2f-ad2a-4fd102e26597 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.674690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-006024f6-6c51-417d-9913-bb3cd4c6669c req-daba6e41-a34a-4d2f-ad2a-4fd102e26597 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.689035 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-006024f6-6c51-417d-9913-bb3cd4c6669c req-daba6e41-a34a-4d2f-ad2a-4fd102e26597 service nova] Creating event network-changed:b60f4815-ec88-4e24-968e-a604b4771eb4 for instance 57c911e5-ab47-4315-b264-1c7ab04c57a5 on nch2-master-1 Dec 18 20:54:26.696550 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-006024f6-6c51-417d-9913-bb3cd4c6669c req-daba6e41-a34a-4d2f-ad2a-4fd102e26597 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040080 Dec 18 20:54:26.698950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1047/2127] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:26.711168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:26.712197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:26.719167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.719666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:26.720556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:26.721211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:27.135288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:27.146882 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-42c46fea-913f-4b09-8f0e-d7eba8537546 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1292 microversion: 2.1 time: 0.516804 Dec 18 20:54:27.147556 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1081/2128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:26 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1292 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:27.154751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1a91c5c-c457-4649-9f31-678ce45164c5 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update_all', calling method: .version_select at 0x7f715c0dd4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:27.214060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:27.219477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b1a91c5c-c457-4649-9f31-678ce45164c5 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:27.224123 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d46ab24-d82c-4d8b-9128-67571253aeeb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.517649 Dec 18 20:54:27.224930 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1048/2129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:26 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:27.231114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b1a91c5c-c457-4649-9f31-678ce45164c5 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:27.240348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:27.241937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:27.255625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:27.256250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:27.258281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:27.259445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:27.754879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:27.772796 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-95a9c35d-5a7d-4950-9baf-87b9678e0435 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1281 microversion: 2.1 time: 0.539841 Dec 18 20:54:27.773568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1049/2130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:27 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1281 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:27.789123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f587f01-cb22-46e5-acd9-a69b2bf051d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:27.790157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f587f01-cb22-46e5-acd9-a69b2bf051d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:27.805630 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1a91c5c-c457-4649-9f31-678ce45164c5 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.653769 Dec 18 20:54:27.806668 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1082/2131] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:54:27 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 61 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:27.812515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:27.813253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:27.816834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f587f01-cb22-46e5-acd9-a69b2bf051d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:27.817574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f587f01-cb22-46e5-acd9-a69b2bf051d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:27.818803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f587f01-cb22-46e5-acd9-a69b2bf051d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:27.821171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f587f01-cb22-46e5-acd9-a69b2bf051d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:27.834161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:27.835171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:27.836665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:27.837284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:27.877982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f587f01-cb22-46e5-acd9-a69b2bf051d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.092786 Dec 18 20:54:27.880829 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1050/2132] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:27 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:27.890082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1661630112", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b682fe11-354f-40ac-961b-a0ccac207599"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:27.969396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] validate_networks() for [('b682fe11-354f-40ac-961b-a0ccac207599', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:28.467004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:28.476821 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-28075484-e49c-4faa-bafe-e9e9d5a3ee0f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.668133 Dec 18 20:54:28.477973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1083/2133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:27 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:28.494016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:28.494729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:28.506373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:28.506742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:28.507937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:28.508393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.045777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:29.059388 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-73dd185e-a9e9-4113-82c0-dc6940552210 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1542 microversion: 2.1 time: 0.569790 Dec 18 20:54:29.060256 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1084/2134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:28 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1542 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:29.066239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87a10073-4ec6-4e25-b07f-9421fc7c69ba tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update', calling method: .version_select at 0x7f714fe21550>, body: {"meta": {"os_version": "alt"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:29.124415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-87a10073-4ec6-4e25-b07f-9421fc7c69ba tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:29.130070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-87a10073-4ec6-4e25-b07f-9421fc7c69ba tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:29.342930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:29.344348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:29.345238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:29.346426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:29.347135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:29.360923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.361733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.363290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.364477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.391546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:29.403769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for user ebd83848fe8d4e7284291660eb51da51 and project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:29.426204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:54:29.431617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:54:29.517598 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80558f97-0dfb-46f9-b106-8f0e1ac1d627 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.629512 Dec 18 20:54:29.518387 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1051/2135] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:54:29.530504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:29.531344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:29.540217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.541114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.543067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.543608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.599454 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87a10073-4ec6-4e25-b07f-9421fc7c69ba tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.537760 Dec 18 20:54:29.602337 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1085/2136] 10.222.0.13 () {60 vars in 1312 bytes} [Sat Dec 18 20:54:29 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata/os_version => generated 31 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:29.609857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:29.612742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:29.636758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.638725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.641072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.643713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.839231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:29.847950 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c6f7c63-1c71-4b35-9087-0450ca6ff283 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1292 microversion: 2.1 time: 0.323521 Dec 18 20:54:29.848834 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1052/2137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:29 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1292 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:29.854184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c14b81e2-e49f-47e8-b4dd-85e031ab6aba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:29.855456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c14b81e2-e49f-47e8-b4dd-85e031ab6aba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:29.862351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c14b81e2-e49f-47e8-b4dd-85e031ab6aba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.863060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c14b81e2-e49f-47e8-b4dd-85e031ab6aba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.864505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c14b81e2-e49f-47e8-b4dd-85e031ab6aba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.865133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c14b81e2-e49f-47e8-b4dd-85e031ab6aba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.941123 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c14b81e2-e49f-47e8-b4dd-85e031ab6aba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.090702 Dec 18 20:54:29.944048 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1053/2138] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:29 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:29.951632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:29.952788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:29.962168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.962949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:29.964092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:29.964883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:30.116790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:30.140149 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d416a88c-e893-4752-9082-51591b831da5 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1323 microversion: 2.1 time: 0.525751 Dec 18 20:54:30.141135 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1086/2139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:29 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:30.149546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:30.154289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:30.166704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:30.167165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:30.171529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:30.172335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:30.315820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:30.325301 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4754a0e2-675f-4102-baa6-1dcce2a37dc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1219 microversion: 2.1 time: 0.182837 Dec 18 20:54:30.335405 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1087/2140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:30 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:30.341501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e1b9320-4cc3-4ed3-96df-144907f6cb85 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f715c09d430>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:30.420047 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e1b9320-4cc3-4ed3-96df-144907f6cb85 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 58 microversion: 2.1 time: 0.082521 Dec 18 20:54:30.420983 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1088/2141] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:54:30 2021] GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 58 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:30.427652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:30.439268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:30.447346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:30.447832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:30.448705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:30.449124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:30.508357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:30.526732 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-604fa19d-c26e-41a1-9643-f6978db271e5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.580099 Dec 18 20:54:30.527692 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1054/2142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:29 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:30.532441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-108f4096-8f77-4711-9b5c-edefc92aadbc tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'update_all', calling method: .version_select at 0x7f714f563ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:30.607817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-108f4096-8f77-4711-9b5c-edefc92aadbc tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:30.617229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-108f4096-8f77-4711-9b5c-edefc92aadbc tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:30.967828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:30.977998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2b3ebf9-be1c-4e47-a04f-c2dc283e54d5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1541 microversion: 2.1 time: 0.555640 Dec 18 20:54:30.980651 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1089/2143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:30 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1541 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:30.991296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-061df996-6e36-4d34-8d93-aea02eb720e1 req-eecc72d8-bc45-4797-9fdc-22fc85e4ce3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9db8beb-c633-4057-bece-f74ed402b4e3", "tag": "15cf2ca3-314e-4d54-9165-6824f4715cf9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:31.000189 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:31.000189 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:31.011946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-061df996-6e36-4d34-8d93-aea02eb720e1 req-eecc72d8-bc45-4797-9fdc-22fc85e4ce3b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:31.019672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-061df996-6e36-4d34-8d93-aea02eb720e1 req-eecc72d8-bc45-4797-9fdc-22fc85e4ce3b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:31.053272 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-061df996-6e36-4d34-8d93-aea02eb720e1 req-eecc72d8-bc45-4797-9fdc-22fc85e4ce3b service nova] Creating event network-changed:15cf2ca3-314e-4d54-9165-6824f4715cf9 for instance a9db8beb-c633-4057-bece-f74ed402b4e3 on nch1-master-1 Dec 18 20:54:31.059400 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-061df996-6e36-4d34-8d93-aea02eb720e1 req-eecc72d8-bc45-4797-9fdc-22fc85e4ce3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072044 Dec 18 20:54:31.060663 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1090/2144] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:31.068040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:31.069174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:31.080181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:31.080181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:31.080181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:31.080940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:31.186412 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-108f4096-8f77-4711-9b5c-edefc92aadbc tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.657299 Dec 18 20:54:31.187694 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1055/2145] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 20:54:30 2021] PUT /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 61 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:31.194630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0d6d7aa-c8d0-45a9-b30b-f5c97d78da50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:31.196167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0d6d7aa-c8d0-45a9-b30b-f5c97d78da50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:31.206965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0d6d7aa-c8d0-45a9-b30b-f5c97d78da50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:31.207368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0d6d7aa-c8d0-45a9-b30b-f5c97d78da50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:31.208442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0d6d7aa-c8d0-45a9-b30b-f5c97d78da50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:31.209389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0d6d7aa-c8d0-45a9-b30b-f5c97d78da50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:31.268583 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0d6d7aa-c8d0-45a9-b30b-f5c97d78da50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.077594 Dec 18 20:54:31.269641 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1056/2146] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:31 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:31.278571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:31.280461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:31.289576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:31.290534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:31.291521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:31.292229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.072875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:32.085087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:32.095825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-219ca835-8cc9-4090-8684-115a89080afe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1292 microversion: 2.1 time: 1.030832 Dec 18 20:54:32.120291 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1091/2147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:31 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1292 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:32.131773 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de4579a4-f5b1-4d2b-be33-20d342b4d625 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1323 microversion: 2.1 time: 0.858982 Dec 18 20:54:32.134745 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1057/2148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:31 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1323 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:32.135110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56dc1cba-60cb-4d4a-9c8a-591834b6eb5d tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Action: 'create', calling method: .version_select at 0x7f714fcfb160>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:32.144646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:32.146232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:32.158216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.159268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.162106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.162968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.226207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-56dc1cba-60cb-4d4a-9c8a-591834b6eb5d tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:32.233435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-56dc1cba-60cb-4d4a-9c8a-591834b6eb5d tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Getting quotas for user cdb721e9b80b4c70b1c2b234bfb5f3ef and project c0137551df8b4152946bfeeb726bec69. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:32.312707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:32.325487 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24cfde11-f02a-4c16-ac93-ebe0c1a22e30 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1273 microversion: 2.1 time: 0.188336 Dec 18 20:54:32.326375 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1058/2149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:32 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:32.345666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:32.346639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:32.357664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.358449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.360439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.360887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.790840 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56dc1cba-60cb-4d4a-9c8a-591834b6eb5d tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "POST /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 85 microversion: 2.1 time: 0.668832 Dec 18 20:54:32.791765 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1092/2150] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Dec 18 20:54:32 2021] POST /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 85 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:32.803603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:32.805445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:32.814417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.814981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.816457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.817002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.868029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:32.876341 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30cf03ca-3bd8-4af0-9b29-d74c450beae2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.535383 Dec 18 20:54:32.877437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1059/2151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:32 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:32.882091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a02e6020-1740-4cb6-81fd-561f6322d1a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:32.883126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a02e6020-1740-4cb6-81fd-561f6322d1a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:32.894678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a02e6020-1740-4cb6-81fd-561f6322d1a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.905337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a02e6020-1740-4cb6-81fd-561f6322d1a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.906512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a02e6020-1740-4cb6-81fd-561f6322d1a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:32.907115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a02e6020-1740-4cb6-81fd-561f6322d1a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:32.952056 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a02e6020-1740-4cb6-81fd-561f6322d1a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.072960 Dec 18 20:54:32.953093 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1060/2152] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:32 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:32.963344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5a178f0-23c5-4da0-bc04-274fb96201e3 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] Calling method '.version_select at 0x7f714f6e4820>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:33.021378 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5a178f0-23c5-4da0-bc04-274fb96201e3 tempest-ImagesMetadataTestJSON-1431694885 tempest-ImagesMetadataTestJSON-1431694885-project] 10.222.0.13 "GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata" status: 200 len: 85 microversion: 2.1 time: 0.066782 Dec 18 20:54:33.022688 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1061/2153] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:54:32 2021] GET /compute/v2.1/images/9390d80f-7f85-4447-ad33-49f820328a19/metadata => generated 85 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:33.124516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:33.126090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:33.135089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:33.136297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:33.147492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:33.148953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:33.580751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:33.599482 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-821b683a-cf5c-4585-a2d2-068883e96f92 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1473 microversion: 2.1 time: 0.801953 Dec 18 20:54:33.605098 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1093/2154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:32 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1473 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:33.619059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:33.619906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:33.637453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:33.641503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:33.644362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:33.646579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:33.869020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:33.878922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ecb94b6-d6ab-4fc1-b773-fdf771b46abe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1292 microversion: 2.1 time: 0.758804 Dec 18 20:54:33.879973 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1062/2155] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:33 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1292 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:33.887866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:33.888741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:33.895742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:33.896200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:33.896994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:33.897433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.338961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:34.369215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-be2547d5-b8ee-4cad-a072-dc05fde34f49 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1323 microversion: 2.1 time: 0.761343 Dec 18 20:54:34.374401 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1094/2156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:33 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1323 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:34.380774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6aca7fa5-de8c-4c8b-a780-9c7aa40b0a4c req-7271073d-38b1-45cb-a9b8-68ffdeeafc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e8c5e-4c15-42ef-8cec-143c0b396585", "name": "network-vif-unplugged", "status": "completed", "tag": "8c02c893-1629-4833-9998-e05787ad6250"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:34.383854 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:34.383854 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:34.394009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6aca7fa5-de8c-4c8b-a780-9c7aa40b0a4c req-7271073d-38b1-45cb-a9b8-68ffdeeafc73 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.395200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6aca7fa5-de8c-4c8b-a780-9c7aa40b0a4c req-7271073d-38b1-45cb-a9b8-68ffdeeafc73 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.414175 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6aca7fa5-de8c-4c8b-a780-9c7aa40b0a4c req-7271073d-38b1-45cb-a9b8-68ffdeeafc73 service nova] Creating event network-vif-unplugged:8c02c893-1629-4833-9998-e05787ad6250 for instance 784e8c5e-4c15-42ef-8cec-143c0b396585 on nch1-master-1 Dec 18 20:54:34.428490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-6aca7fa5-de8c-4c8b-a780-9c7aa40b0a4c req-7271073d-38b1-45cb-a9b8-68ffdeeafc73 service nova] Instance 784e8c5e-4c15-42ef-8cec-143c0b396585 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:54:34.439227 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6aca7fa5-de8c-4c8b-a780-9c7aa40b0a4c req-7271073d-38b1-45cb-a9b8-68ffdeeafc73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064495 Dec 18 20:54:34.440378 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1095/2157] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:34.448835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:34.451040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:34.462375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.463345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.465160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.466572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.714464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:34.720410 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-95587637-e8ff-41ea-a627-def06e782e81 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1315 microversion: 2.1 time: 0.837265 Dec 18 20:54:34.721034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1063/2158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:33 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:34.729289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa424998-139e-46c6-9b62-6afd9d25798c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:34.730283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa424998-139e-46c6-9b62-6afd9d25798c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:34.740152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa424998-139e-46c6-9b62-6afd9d25798c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.740981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa424998-139e-46c6-9b62-6afd9d25798c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.743183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa424998-139e-46c6-9b62-6afd9d25798c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.744569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa424998-139e-46c6-9b62-6afd9d25798c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.819423 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa424998-139e-46c6-9b62-6afd9d25798c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.097008 Dec 18 20:54:34.821223 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1064/2159] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:34 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:34.832886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:34.833639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:34.853141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.853665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.857106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.857694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.938551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:34.948937 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9c8d9a8-bb8d-46ac-ba1d-dc628682e272 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.506476 Dec 18 20:54:34.960890 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1096/2160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:34 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:34.962583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:34.967688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:34.981358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.981956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:34.982974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:34.983425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:35.871135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:35.887873 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bfb2989-f1ef-4469-9ad3-9da541d9ce0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1470 microversion: 2.1 time: 1.065118 Dec 18 20:54:35.889378 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1065/2161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:34 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1470 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:35.895877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:35.896803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:35.906472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:35.908509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:35.909937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:35.923885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:35.951955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:35.965320 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e7a7d69-4868-4287-b0fc-c76a9581d3c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1292 microversion: 2.1 time: 1.011298 Dec 18 20:54:35.965915 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1097/2162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:34 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1292 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:35.980948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:35.981565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:35.992517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:35.994856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:35.996395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:35.999254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.492335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:36.501377 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa8a0465-8cd5-40b1-8286-1d893657f680 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1323 microversion: 2.1 time: 0.609710 Dec 18 20:54:36.502320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1066/2163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:35 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1323 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:36.511073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64d23018-38a7-4e03-9ba9-690406666650 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:36.515635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64d23018-38a7-4e03-9ba9-690406666650 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:36.526009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64d23018-38a7-4e03-9ba9-690406666650 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.527034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64d23018-38a7-4e03-9ba9-690406666650 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.528068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64d23018-38a7-4e03-9ba9-690406666650 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.528720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64d23018-38a7-4e03-9ba9-690406666650 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.536623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:36.547242 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1019a43d-8402-4ac6-b8e1-6d4cbcc91087 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1315 microversion: 2.1 time: 0.571101 Dec 18 20:54:36.558428 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1098/2164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:35 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:36.575893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:36.576535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:36.583936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.584734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.585886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.586558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.607902 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64d23018-38a7-4e03-9ba9-690406666650 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.103313 Dec 18 20:54:36.610173 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1067/2165] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:36 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:36.626164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:36.626859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:36.634319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.635032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.636307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.636857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.636971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.637550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.638001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.638504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.673395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for project f15c3e2ec1194924bee37b0161adc237. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:36.683388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for user 09d32c08216a4035907c888a3c8cd70f and project f15c3e2ec1194924bee37b0161adc237. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:36.916202 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2821f6e9-a370-435f-8b27-8193f81411ca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585/action" status: 202 len: 0 microversion: 2.1 time: 0.355849 Dec 18 20:54:36.917240 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1099/2166] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:36 2021] POST /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:36.926097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c45e4d49-12cf-44a3-bfa9-b5c538e4cafd req-53d2eca6-7852-490c-9d94-5ef096996bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c911e5-ab47-4315-b264-1c7ab04c57a5", "name": "network-vif-plugged", "status": "completed", "tag": "b60f4815-ec88-4e24-968e-a604b4771eb4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:36.928352 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:36.928352 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:36.938195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c45e4d49-12cf-44a3-bfa9-b5c538e4cafd req-53d2eca6-7852-490c-9d94-5ef096996bf2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.938996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c45e4d49-12cf-44a3-bfa9-b5c538e4cafd req-53d2eca6-7852-490c-9d94-5ef096996bf2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.955663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c45e4d49-12cf-44a3-bfa9-b5c538e4cafd req-53d2eca6-7852-490c-9d94-5ef096996bf2 service nova] Creating event network-vif-plugged:b60f4815-ec88-4e24-968e-a604b4771eb4 for instance 57c911e5-ab47-4315-b264-1c7ab04c57a5 on nch2-master-1 Dec 18 20:54:36.970118 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c45e4d49-12cf-44a3-bfa9-b5c538e4cafd req-53d2eca6-7852-490c-9d94-5ef096996bf2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050655 Dec 18 20:54:36.972250 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1100/2167] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:36.980252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:36.981234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:36.990570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.991312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:36.993066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:36.993688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:37.215821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:37.227847 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0dec4d54-821a-4025-a529-3399e0586f4d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.615251 Dec 18 20:54:37.229194 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1068/2168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:36 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:37.243451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:37.244136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:37.257097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:37.265893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:37.267883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:37.269044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:37.791778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:37.807699 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3be3d3d5-9ae3-4aa6-83af-4bf8277360ec tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1469 microversion: 2.1 time: 0.834038 Dec 18 20:54:37.808965 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1101/2169] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:36 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1469 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:37.816928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b1889769-b164-4dbd-a354-90c038034036 req-b6b2eb74-1013-4265-bd8f-f2c8d628c262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9031e0-037c-409f-8807-2847c9499293", "tag": "32869e6e-5796-4fce-881e-b53b1eb6f63a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:37.820512 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:37.820512 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:37.834057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b1889769-b164-4dbd-a354-90c038034036 req-b6b2eb74-1013-4265-bd8f-f2c8d628c262 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:37.835254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b1889769-b164-4dbd-a354-90c038034036 req-b6b2eb74-1013-4265-bd8f-f2c8d628c262 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:37.858376 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b1889769-b164-4dbd-a354-90c038034036 req-b6b2eb74-1013-4265-bd8f-f2c8d628c262 service nova] Creating event network-changed:32869e6e-5796-4fce-881e-b53b1eb6f63a for instance ed9031e0-037c-409f-8807-2847c9499293 on nch2-master-1 Dec 18 20:54:37.867426 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b1889769-b164-4dbd-a354-90c038034036 req-b6b2eb74-1013-4265-bd8f-f2c8d628c262 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056394 Dec 18 20:54:37.869244 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1102/2170] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:37.880845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:37.884125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:37.899238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:37.902899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:37.904353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:37.905521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:37.999669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:38.020735 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72260359-1f6a-4e6b-b286-265c3df05b67 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1292 microversion: 2.1 time: 0.789982 Dec 18 20:54:38.021802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1069/2171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:37 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1292 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:38.035734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:38.036604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:38.043594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:38.044339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:38.045359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:38.045992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:38.501433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:38.511032 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f76ab9bc-21df-4e2a-b6fc-d3d85f8e8290 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1323 microversion: 2.1 time: 0.640216 Dec 18 20:54:38.520891 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1103/2172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:37 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1323 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:38.527868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8de3230f-1cb3-414f-9ba5-8dde7e6a6a75 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:38.529194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8de3230f-1cb3-414f-9ba5-8dde7e6a6a75 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:38.536626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de3230f-1cb3-414f-9ba5-8dde7e6a6a75 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:38.537830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de3230f-1cb3-414f-9ba5-8dde7e6a6a75 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:38.538134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de3230f-1cb3-414f-9ba5-8dde7e6a6a75 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:38.538811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de3230f-1cb3-414f-9ba5-8dde7e6a6a75 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:38.560905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:38.572392 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6685a7b0-bfe3-4e8d-8af1-75b3a2a9658f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1315 microversion: 2.1 time: 0.540278 Dec 18 20:54:38.582641 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1070/2173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:38 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:38.590317 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8de3230f-1cb3-414f-9ba5-8dde7e6a6a75 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.066409 Dec 18 20:54:38.591755 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1104/2174] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:38 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:38.598312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:38.599079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:38.608886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:38.609349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:38.610161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:38.610655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:38.775942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1534661825", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b4249639-6520-4b9d-908b-e792b10734b1"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:38.876019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] validate_networks() for [('b4249639-6520-4b9d-908b-e792b10734b1', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:39.089831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:39.103473 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6710960-8906-4cf6-8db1-ca67e406646a tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.510320 Dec 18 20:54:39.104606 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1105/2175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:38 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:39.119913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:39.120859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:39.127616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:39.128293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:39.129492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:39.130419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:39.529661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:39.539325 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f70df7ae-d7fc-4453-b3f4-851462229462 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1469 microversion: 2.1 time: 0.424839 Dec 18 20:54:39.550600 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1106/2176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:39 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1469 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:39.556382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2056be1c-a0b7-470c-bd98-de6a8875bcee req-0f6bdd34-e126-4136-99d6-5407768b91c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e8c5e-4c15-42ef-8cec-143c0b396585", "name": "network-vif-plugged", "status": "completed", "tag": "8c02c893-1629-4833-9998-e05787ad6250"}, {"server_uuid": "a9db8beb-c633-4057-bece-f74ed402b4e3", "name": "network-vif-plugged", "status": "completed", "tag": "15cf2ca3-314e-4d54-9165-6824f4715cf9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:39.558208 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:39.558208 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:39.568355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2056be1c-a0b7-470c-bd98-de6a8875bcee req-0f6bdd34-e126-4136-99d6-5407768b91c7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:39.569506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2056be1c-a0b7-470c-bd98-de6a8875bcee req-0f6bdd34-e126-4136-99d6-5407768b91c7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:39.596990 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2056be1c-a0b7-470c-bd98-de6a8875bcee req-0f6bdd34-e126-4136-99d6-5407768b91c7 service nova] Creating event network-vif-plugged:8c02c893-1629-4833-9998-e05787ad6250 for instance 784e8c5e-4c15-42ef-8cec-143c0b396585 on nch1-master-1 Dec 18 20:54:39.597662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2056be1c-a0b7-470c-bd98-de6a8875bcee req-0f6bdd34-e126-4136-99d6-5407768b91c7 service nova] Creating event network-vif-plugged:15cf2ca3-314e-4d54-9165-6824f4715cf9 for instance a9db8beb-c633-4057-bece-f74ed402b4e3 on nch1-master-1 Dec 18 20:54:39.612666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-2056be1c-a0b7-470c-bd98-de6a8875bcee req-0f6bdd34-e126-4136-99d6-5407768b91c7 service nova] Instance 784e8c5e-4c15-42ef-8cec-143c0b396585 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:54:39.621944 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2056be1c-a0b7-470c-bd98-de6a8875bcee req-0f6bdd34-e126-4136-99d6-5407768b91c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069942 Dec 18 20:54:39.623007 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1107/2177] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:39 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:39.630577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:39.631544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:39.651636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:39.652125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:39.653064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:39.653508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.321327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:40.322661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:40.323377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:40.324250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:40.324801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:40.337979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.338559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.340119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.342096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.364926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:40.371209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for user 216cd2c0d4b249e797990918152b4749 and project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:40.389308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:54:40.401185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:54:40.468965 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0033705f-f61a-476b-a4f8-a16e3b22587a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884368 Dec 18 20:54:40.470315 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1071/2178] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:54:40.477867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:40.478880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:40.487579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.488528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.489705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.490552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.510740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:40.523622 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53be5979-fcf4-4843-8984-b9ee0cac4157 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1483 microversion: 2.1 time: 0.898403 Dec 18 20:54:40.526046 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1108/2179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:39 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1483 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:40.539172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:40.541634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:40.552614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.553379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.555221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.555828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.855800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:40.865006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:40.873917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ed7989c-694c-49ae-8eb5-420efbf316e8 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1323 microversion: 2.1 time: 0.401505 Dec 18 20:54:40.874548 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1072/2180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:40 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:40.884949 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4afd705-9971-4fed-bc11-eb7f0f42a114 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1315 microversion: 2.1 time: 0.355065 Dec 18 20:54:40.887515 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1109/2181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:40 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:40.889731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6659788e-cc59-41c5-9531-f2842fedd114 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:40.890733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6659788e-cc59-41c5-9531-f2842fedd114 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:40.898049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6659788e-cc59-41c5-9531-f2842fedd114 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.898505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6659788e-cc59-41c5-9531-f2842fedd114 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.899316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6659788e-cc59-41c5-9531-f2842fedd114 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.899811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6659788e-cc59-41c5-9531-f2842fedd114 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.908667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:40.911782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:40.933781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.934389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.938341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:40.940954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:40.987373 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6659788e-cc59-41c5-9531-f2842fedd114 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.101663 Dec 18 20:54:40.988041 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1073/2182] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:40 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:40.995856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-76632f28-95a8-4944-8536-0fb060c852f4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:40.996572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-76632f28-95a8-4944-8536-0fb060c852f4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:41.143476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-76632f28-95a8-4944-8536-0fb060c852f4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:41.151921 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-76632f28-95a8-4944-8536-0fb060c852f4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1208 microversion: 2.1 time: 0.162678 Dec 18 20:54:41.153862 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1074/2183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:40 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:41.165589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af6dc8d6-59b9-4a18-9f3b-5d9b11b70f83 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:41.166121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af6dc8d6-59b9-4a18-9f3b-5d9b11b70f83 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:41.177860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af6dc8d6-59b9-4a18-9f3b-5d9b11b70f83 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.178346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af6dc8d6-59b9-4a18-9f3b-5d9b11b70f83 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:41.180294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af6dc8d6-59b9-4a18-9f3b-5d9b11b70f83 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.180958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af6dc8d6-59b9-4a18-9f3b-5d9b11b70f83 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:41.299240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:41.315810 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60f7a291-42c6-47f6-8be2-b3d68bbade20 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.426865 Dec 18 20:54:41.318302 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1110/2184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:40 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:41.329899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:41.331090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:41.345451 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af6dc8d6-59b9-4a18-9f3b-5d9b11b70f83 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190282 Dec 18 20:54:41.346680 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1075/2185] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:54:41 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:41.352083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.352667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:41.353621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.354369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:41.665240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:41.676439 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-285f063e-e412-49ef-899a-896798792881 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1469 microversion: 2.1 time: 0.355760 Dec 18 20:54:41.679669 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1111/2186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:41 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:41.895812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:41.896705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:41.904257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:41.904934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:41.915353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.915887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.917007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:41.919516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:41.920391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.921010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:41.924124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:41.925128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.630223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:42.633744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:42.639735 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56bc22ea-2127-4343-8050-62cd417ebb12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1315 microversion: 2.1 time: 0.739292 Dec 18 20:54:42.641155 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1112/2187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:41 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:42.646338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32890b41-e875-4a3c-9815-dff4a3f7a2ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:42.647420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-32890b41-e875-4a3c-9815-dff4a3f7a2ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:42.656117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f38abb3a-9de7-46d3-8f77-1d9fcfd18ab0 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1472 microversion: 2.1 time: 0.765929 Dec 18 20:54:42.673207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32890b41-e875-4a3c-9815-dff4a3f7a2ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.673920 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1076/2188] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:41 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1472 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:42.680640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32890b41-e875-4a3c-9815-dff4a3f7a2ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.682362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32890b41-e875-4a3c-9815-dff4a3f7a2ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.683038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32890b41-e875-4a3c-9815-dff4a3f7a2ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.685872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:42.687413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:42.702039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.702876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.703904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.704352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.763142 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32890b41-e875-4a3c-9815-dff4a3f7a2ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.119200 Dec 18 20:54:42.766550 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1113/2189] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:42 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:42.773901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:42.775299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:42.784118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.784599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.786137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.786754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.853269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:42.865596 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15184475-865d-4068-a398-bf5cb6af1327 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1266 microversion: 2.1 time: 0.189955 Dec 18 20:54:42.869252 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1077/2190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:42 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:42.874031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:42.874820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:42.884089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.884541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.885448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.885936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.912440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:42.914108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:54:42.915018 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83391c57-9917-4ab7-bbfa-32fd6cef96ac tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.044612 Dec 18 20:54:42.915784 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1078/2191] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:54:42 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3/diagnostics => generated 117 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:42.925660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:42.927281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:42.933996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.934787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:42.935768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:42.936380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:43.258187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:43.274573 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2b57ad8-4dae-4f57-826d-3c5367e1b6d3 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.505348 Dec 18 20:54:43.275945 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1114/2192] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:42 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:43.281266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:43.281922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:43.292357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:43.293347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:43.295160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:43.295905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:43.339004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:54:43.450910 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a8d2281-a850-4d92-8020-f3ee269e172c tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 204 len: 0 microversion: 2.1 time: 0.173078 Dec 18 20:54:43.452418 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1115/2193] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:54:43 2021] DELETE /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:54:43.472875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:43.474055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:43.483745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:43.484531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:43.486667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:43.487324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:43.798781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:43.807736 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc952e6c-39e9-4e1e-b3b5-faa8fa78bb11 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1535 microversion: 2.1 time: 0.890765 Dec 18 20:54:43.815255 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1079/2194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:42 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1535 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:43.815255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:43.815255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:43.824602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:43.825063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:43.825941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:43.826331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.154700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:44.171425 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7aed7bec-8fdb-4f3b-a9c2-836f756241b6 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1478 microversion: 2.1 time: 0.712316 Dec 18 20:54:44.172026 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1116/2195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:43 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1478 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:44.176999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-27b7ebe8-0cb9-4393-b6c4-702111483540 req-4ee63381-72d5-43e6-98bb-872d8abff248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9031e0-037c-409f-8807-2847c9499293", "name": "network-vif-plugged", "status": "completed", "tag": "32869e6e-5796-4fce-881e-b53b1eb6f63a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:44.178710 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:44.178710 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:44.199099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-27b7ebe8-0cb9-4393-b6c4-702111483540 req-4ee63381-72d5-43e6-98bb-872d8abff248 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.199549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-27b7ebe8-0cb9-4393-b6c4-702111483540 req-4ee63381-72d5-43e6-98bb-872d8abff248 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.212171 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-27b7ebe8-0cb9-4393-b6c4-702111483540 req-4ee63381-72d5-43e6-98bb-872d8abff248 service nova] Creating event network-vif-plugged:32869e6e-5796-4fce-881e-b53b1eb6f63a for instance ed9031e0-037c-409f-8807-2847c9499293 on nch2-master-1 Dec 18 20:54:44.217709 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-27b7ebe8-0cb9-4393-b6c4-702111483540 req-4ee63381-72d5-43e6-98bb-872d8abff248 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043991 Dec 18 20:54:44.218588 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1117/2196] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:44.225338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a05f6fa-551f-42ca-b9cf-eaa6dd22d88e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:44.228294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a05f6fa-551f-42ca-b9cf-eaa6dd22d88e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:44.236132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a05f6fa-551f-42ca-b9cf-eaa6dd22d88e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.236940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a05f6fa-551f-42ca-b9cf-eaa6dd22d88e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.237753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a05f6fa-551f-42ca-b9cf-eaa6dd22d88e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.238191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a05f6fa-551f-42ca-b9cf-eaa6dd22d88e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.287016 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a05f6fa-551f-42ca-b9cf-eaa6dd22d88e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.066137 Dec 18 20:54:44.287778 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1118/2197] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:44 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:44.294457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:44.295162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:44.303666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.304162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.304962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.305405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.366835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:44.375169 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1319c16e-73f6-43cc-a7ae-234fd1886a50 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1315 microversion: 2.1 time: 0.565395 Dec 18 20:54:44.376012 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1080/2198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:43 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:44.380775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cf4bb736-9c4e-4036-99fb-d213edf04496 req-89d41df6-cc84-4e77-a1fb-bfbf16890cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89fffd39-f05f-4540-8067-b4528d22357a", "tag": "89de2c2f-41bf-4b1d-8047-873c576b5419"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:44.382399 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:44.382399 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:44.390284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cf4bb736-9c4e-4036-99fb-d213edf04496 req-89d41df6-cc84-4e77-a1fb-bfbf16890cca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.391342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cf4bb736-9c4e-4036-99fb-d213edf04496 req-89d41df6-cc84-4e77-a1fb-bfbf16890cca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.410656 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cf4bb736-9c4e-4036-99fb-d213edf04496 req-89d41df6-cc84-4e77-a1fb-bfbf16890cca service nova] Creating event network-changed:89de2c2f-41bf-4b1d-8047-873c576b5419 for instance 89fffd39-f05f-4540-8067-b4528d22357a on nch1-master-1 Dec 18 20:54:44.418293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cf4bb736-9c4e-4036-99fb-d213edf04496 req-89d41df6-cc84-4e77-a1fb-bfbf16890cca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040890 Dec 18 20:54:44.420591 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1081/2199] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:44.425743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:44.426458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:44.433235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.433761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.434499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.434937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.778948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:44.787057 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3f9ea07c-cb11-45b2-8ad4-a06a8f5cb215 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.496648 Dec 18 20:54:44.788216 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1119/2200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:44 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:44.794742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-584506e6-9ed9-47eb-ab03-79f76385f2db tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:44.796834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-584506e6-9ed9-47eb-ab03-79f76385f2db tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:44.802081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:44.807963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584506e6-9ed9-47eb-ab03-79f76385f2db tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.808752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584506e6-9ed9-47eb-ab03-79f76385f2db tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.809816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584506e6-9ed9-47eb-ab03-79f76385f2db tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.809943 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-694d1960-1499-457c-b724-bccc5e6b1a12 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.387917 Dec 18 20:54:44.810508 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1082/2201] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:44 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:44.811049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584506e6-9ed9-47eb-ab03-79f76385f2db tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.815392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5e821aa7-dc71-42c5-8fba-67256b382726 req-60b6102d-95a5-4c17-856c-0825fef6a826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c911e5-ab47-4315-b264-1c7ab04c57a5", "tag": "b60f4815-ec88-4e24-968e-a604b4771eb4"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:44.817136 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:44.817136 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:44.824984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5e821aa7-dc71-42c5-8fba-67256b382726 req-60b6102d-95a5-4c17-856c-0825fef6a826 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.825434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5e821aa7-dc71-42c5-8fba-67256b382726 req-60b6102d-95a5-4c17-856c-0825fef6a826 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.838640 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5e821aa7-dc71-42c5-8fba-67256b382726 req-60b6102d-95a5-4c17-856c-0825fef6a826 service nova] Creating event network-changed:b60f4815-ec88-4e24-968e-a604b4771eb4 for instance 57c911e5-ab47-4315-b264-1c7ab04c57a5 on nch2-master-1 Dec 18 20:54:44.843782 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5e821aa7-dc71-42c5-8fba-67256b382726 req-60b6102d-95a5-4c17-856c-0825fef6a826 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032015 Dec 18 20:54:44.844770 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1083/2202] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:44.850171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:44.850949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:44.858160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.858670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.859482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:44.860038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:44.883626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-584506e6-9ed9-47eb-ab03-79f76385f2db tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 14 microversion: 2.1 time: 0.093380 Dec 18 20:54:44.884674 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1120/2203] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:44 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:45.186926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:45.190351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:45.191074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:45.205082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.205572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.207302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.207758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.217475 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07536dc3-9859-484e-b9ee-7619c87d73d7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1535 microversion: 2.1 time: 0.371192 Dec 18 20:54:45.221114 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1084/2204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:44 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1535 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:45.301523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b069390c-b957-4ad5-8cc6-2f9177a8f7eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:45.302940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b069390c-b957-4ad5-8cc6-2f9177a8f7eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:45.312754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b069390c-b957-4ad5-8cc6-2f9177a8f7eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.314830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b069390c-b957-4ad5-8cc6-2f9177a8f7eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.316347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b069390c-b957-4ad5-8cc6-2f9177a8f7eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.317047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b069390c-b957-4ad5-8cc6-2f9177a8f7eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.379765 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b069390c-b957-4ad5-8cc6-2f9177a8f7eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.082753 Dec 18 20:54:45.383014 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1085/2205] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:45 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:45.397074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:45.398423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:45.412360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.414595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.415728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.416468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.752081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:45.766744 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55b6793f-94a5-45d7-bc70-ad9468578e27 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1478 microversion: 2.1 time: 0.580652 Dec 18 20:54:45.769479 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1121/2206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:45 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1478 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:45.805281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:45.805897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:45.823687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.829284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.831738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.832535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:45.963455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:45.974712 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c6a9bf20-615a-4f1f-bebf-ba2ae0bc7b5c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1315 microversion: 2.1 time: 0.585985 Dec 18 20:54:45.977842 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1086/2207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:45 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:45.983776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:45.984624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:45.997218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:45.997995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.001456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.002184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.419215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:46.427097 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e381fe39-4934-4012-a3c9-1f8fbaa9dbdb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.626654 Dec 18 20:54:46.432840 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1122/2208] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:45 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:46.452003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f29ac798-4a39-4822-96fa-0c9200b8de82 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:46.453267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f29ac798-4a39-4822-96fa-0c9200b8de82 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:46.468049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f29ac798-4a39-4822-96fa-0c9200b8de82 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.468385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f29ac798-4a39-4822-96fa-0c9200b8de82 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.475683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f29ac798-4a39-4822-96fa-0c9200b8de82 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.487039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f29ac798-4a39-4822-96fa-0c9200b8de82 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.549501 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f29ac798-4a39-4822-96fa-0c9200b8de82 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 14 microversion: 2.1 time: 0.114238 Dec 18 20:54:46.551132 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1123/2209] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:46 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:46.555847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:46.569696 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bdb06606-cb0c-43ad-92ab-d3e126da95ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1506 microversion: 2.1 time: 0.586728 Dec 18 20:54:46.576951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:46.580142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:46.581586 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1087/2210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:45 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:46.593282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.595386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.596389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8b2f896d-c671-4db4-baef-48015bf12774 req-69c16e11-4c23-4101-8db4-14f39a5bf487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e8c5e-4c15-42ef-8cec-143c0b396585", "name": "network-vif-unplugged", "status": "completed", "tag": "8c02c893-1629-4833-9998-e05787ad6250"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:46.596637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.597647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.602731 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:46.602731 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:46.612671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8b2f896d-c671-4db4-baef-48015bf12774 req-69c16e11-4c23-4101-8db4-14f39a5bf487 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.613402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8b2f896d-c671-4db4-baef-48015bf12774 req-69c16e11-4c23-4101-8db4-14f39a5bf487 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.641760 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8b2f896d-c671-4db4-baef-48015bf12774 req-69c16e11-4c23-4101-8db4-14f39a5bf487 service nova] Creating event network-vif-unplugged:8c02c893-1629-4833-9998-e05787ad6250 for instance 784e8c5e-4c15-42ef-8cec-143c0b396585 on nch1-master-1 Dec 18 20:54:46.658952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8b2f896d-c671-4db4-baef-48015bf12774 req-69c16e11-4c23-4101-8db4-14f39a5bf487 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074213 Dec 18 20:54:46.659908 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1088/2211] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:46.667468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fe81ea65-6c49-47dd-8b97-8751d24eeeff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:46.668804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fe81ea65-6c49-47dd-8b97-8751d24eeeff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:46.675539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe81ea65-6c49-47dd-8b97-8751d24eeeff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.676329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe81ea65-6c49-47dd-8b97-8751d24eeeff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.677417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe81ea65-6c49-47dd-8b97-8751d24eeeff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.678089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe81ea65-6c49-47dd-8b97-8751d24eeeff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.749882 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fe81ea65-6c49-47dd-8b97-8751d24eeeff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 24252 microversion: 2.32 time: 0.088055 Dec 18 20:54:46.754134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1089/2212] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:46 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 24252 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:46.793249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:46.794460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:46.806949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.807558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.808595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.809246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.923923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753e7daa3b814c789fd6451101113666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af640d59dee48c59f1f191bc541829d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:46.932197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-10f9305e-fc47-4020-8466-a1db67651395 tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 200 len: 1308 microversion: 2.1 time: 0.148342 Dec 18 20:54:46.942100 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1090/2213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:46 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:46.947344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8a769104-3218-4878-b424-955ce16b6c34 req-0e6b2f5e-c820-4b3a-8caa-be83fba3ccdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9db8beb-c633-4057-bece-f74ed402b4e3", "name": "network-vif-deleted", "tag": "15cf2ca3-314e-4d54-9165-6824f4715cf9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:46.949116 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:46.949116 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:46.956653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:46.963667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8a769104-3218-4878-b424-955ce16b6c34 req-0e6b2f5e-c820-4b3a-8caa-be83fba3ccdb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.964163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8a769104-3218-4878-b424-955ce16b6c34 req-0e6b2f5e-c820-4b3a-8caa-be83fba3ccdb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.965086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3643baa8-8937-4541-8b99-f53353f0b0a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1528 microversion: 2.1 time: 0.412535 Dec 18 20:54:46.965830 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1124/2214] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:46 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1528 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:46.975368 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8a769104-3218-4878-b424-955ce16b6c34 req-0e6b2f5e-c820-4b3a-8caa-be83fba3ccdb service nova] Creating event network-vif-deleted:15cf2ca3-314e-4d54-9165-6824f4715cf9 for instance a9db8beb-c633-4057-bece-f74ed402b4e3 on nch1-master-1 Dec 18 20:54:46.981313 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8a769104-3218-4878-b424-955ce16b6c34 req-0e6b2f5e-c820-4b3a-8caa-be83fba3ccdb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037648 Dec 18 20:54:46.981902 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1091/2215] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:46.987110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:46.987997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:46.994354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:46.994880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:46.995527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.996161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:46.996904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:46.997902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:47.001139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:47.001681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:47.002437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:47.003029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:47.219747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:47.228475 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3710d2e0-17a0-4c36-9459-018a4ca4fbff tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1502 microversion: 2.1 time: 0.238959 Dec 18 20:54:47.229069 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1092/2216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:46 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:47.231384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:47.240812 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dacdcfff-9df0-473d-89f7-382dfb3a118a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1528 microversion: 2.1 time: 0.261971 Dec 18 20:54:47.242142 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1125/2217] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:46 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1528 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:47.253875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99dd3c54-bb08-45e0-a065-2d01ba0d85fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:47.258766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51920409-dcd3-4334-9edd-471c87cfe817 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:47.259830 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:47.259830 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:47.267789 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-51920409-dcd3-4334-9edd-471c87cfe817 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] HTTP exception thrown: Flavor 17b456fa-4d78-4080-b5f4-1159a31a1768 could not be found. Dec 18 20:54:47.268564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51920409-dcd3-4334-9edd-471c87cfe817 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Returning 404 to user: Flavor 17b456fa-4d78-4080-b5f4-1159a31a1768 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:54:47.269580 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51920409-dcd3-4334-9edd-471c87cfe817 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/17b456fa-4d78-4080-b5f4-1159a31a1768" status: 404 len: 109 microversion: 2.1 time: 0.015490 Dec 18 20:54:47.270327 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1126/2218] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:54:47 2021] DELETE /compute/v2.1/flavors/17b456fa-4d78-4080-b5f4-1159a31a1768 => generated 109 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:54:47.274573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99dd3c54-bb08-45e0-a065-2d01ba0d85fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:47.274573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99dd3c54-bb08-45e0-a065-2d01ba0d85fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:47.388004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-99dd3c54-bb08-45e0-a065-2d01ba0d85fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Going to try to stop instance {{(pid=140732) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 20:54:47.409010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1386583020", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:47.455261 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99dd3c54-bb08-45e0-a065-2d01ba0d85fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293/action" status: 202 len: 0 microversion: 2.1 time: 0.208037 Dec 18 20:54:47.457577 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1093/2219] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:47 2021] POST /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:47.465220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:47.466061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:47.474364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:47.475414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:47.477154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:47.477607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:47.493318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:48.205116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:48.222029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-851d2073-56de-4b54-9bcd-316b2873cb5b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.763325 Dec 18 20:54:48.223156 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1094/2220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:47 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:48.231330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:48.232622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:48.240100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.242818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.244318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.244777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.292398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:48.292833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:48.293306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:48.293722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:48.294140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:48.310298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.310774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.311606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.312120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.347341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:48.354546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Getting quotas for user 09d32c08216a4035907c888a3c8cd70f and project f15c3e2ec1194924bee37b0161adc237. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:48.379694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:54:48.382425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:54:48.423432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:48.436424 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e195e8ba-b6df-4fc0-8c3d-c0d37793e5b5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.211210 Dec 18 20:54:48.438099 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1095/2221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:48 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:48.443795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f82a4849-b664-4d8b-8f52-75857b4871cb tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:48.446754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f82a4849-b664-4d8b-8f52-75857b4871cb tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:48.460600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f82a4849-b664-4d8b-8f52-75857b4871cb tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.461741 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e339432e-c661-47f9-b9e4-5348a28e4958 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055358 Dec 18 20:54:48.463234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f82a4849-b664-4d8b-8f52-75857b4871cb tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.464896 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1127/2222] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:54:48.465282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f82a4849-b664-4d8b-8f52-75857b4871cb tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.465976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f82a4849-b664-4d8b-8f52-75857b4871cb tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.469879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:48.470732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:48.480453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.480933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.481768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.482216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.526664 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f82a4849-b664-4d8b-8f52-75857b4871cb tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 14 microversion: 2.1 time: 0.086968 Dec 18 20:54:48.528483 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1096/2223] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:48 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:48.535371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f01f74e7-4ad1-4d54-a12b-ef26d4e65bbb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:48.537126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f01f74e7-4ad1-4d54-a12b-ef26d4e65bbb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:48.548698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f01f74e7-4ad1-4d54-a12b-ef26d4e65bbb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.549149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f01f74e7-4ad1-4d54-a12b-ef26d4e65bbb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.549949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f01f74e7-4ad1-4d54-a12b-ef26d4e65bbb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.550415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f01f74e7-4ad1-4d54-a12b-ef26d4e65bbb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.626350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f01f74e7-4ad1-4d54-a12b-ef26d4e65bbb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 32277 microversion: 2.32 time: 0.086440 Dec 18 20:54:48.627166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1097/2224] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:48 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 32277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:48.634073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:48.636271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] [instance: a9db8beb-c633-4057-bece-f74ed402b4e3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:48.638877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:48.648371 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ca7eaa5-cf73-41c5-ab57-5dacf424731c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1486 microversion: 2.1 time: 0.182380 Dec 18 20:54:48.648642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.649699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.651276 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1128/2225] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:48 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1486 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:48.661031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c2cb6e9a-1258-43d7-9d4c-038770cb22f3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:48.661859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c2cb6e9a-1258-43d7-9d4c-038770cb22f3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:48.663707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:48.664451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:48.687978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] HTTP exception thrown: Instance a9db8beb-c633-4057-bece-f74ed402b4e3 could not be found. Dec 18 20:54:48.689025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] Returning 404 to user: Instance a9db8beb-c633-4057-bece-f74ed402b4e3 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:54:48.690486 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-47182759-d69e-48b2-975a-fa4fb619e37d tempest-ServerDiagnosticsNegativeTest-2006128567 tempest-ServerDiagnosticsNegativeTest-2006128567-project] 10.222.0.13 "GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3" status: 404 len: 111 microversion: 2.1 time: 0.061794 Dec 18 20:54:48.695645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1098/2226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:48 2021] GET /compute/v2.1/servers/a9db8beb-c633-4057-bece-f74ed402b4e3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:48.801606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c2cb6e9a-1258-43d7-9d4c-038770cb22f3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:48.813252 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c2cb6e9a-1258-43d7-9d4c-038770cb22f3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1213 microversion: 2.1 time: 0.158759 Dec 18 20:54:48.814880 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1129/2227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:48 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:48.845790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1468846796", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e50169fc-b606-4273-ae66-869a743059d2"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:48.905919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] validate_networks() for [('e50169fc-b606-4273-ae66-869a743059d2', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:49.240174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:49.241086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:49.249356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.259325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.261643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.267339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.527082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:49.527593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:49.527994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:49.528408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:49.529008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:49.534015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:49.541991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.542635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.543371 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2de4fbab-1ec7-46f9-ab8c-e5700dd8bf2f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.305717 Dec 18 20:54:49.543936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.544699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.544927 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1130/2228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:49 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:49.550357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:49.551184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:49.559333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.560193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.561216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.561881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.568819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Getting quotas for project eaf2a3560d8e4c1993aa5a1dfdac5b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:49.575477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Getting quotas for user ad564476e1cf4a0b87fef4e3d08e6726 and project eaf2a3560d8e4c1993aa5a1dfdac5b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:49.588385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:54:49.591172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:54:49.657753 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae31e0bb-6e8f-4f17-b55b-4bbd92791834 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.819470 Dec 18 20:54:49.659056 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1099/2229] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:48 2021] POST /compute/v2.1/servers => generated 383 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:54:49.671330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c6b4575-68e0-4b6e-b968-43f6c195eb21 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:49.695582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c6b4575-68e0-4b6e-b968-43f6c195eb21 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:49.728318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6b4575-68e0-4b6e-b968-43f6c195eb21 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.730940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6b4575-68e0-4b6e-b968-43f6c195eb21 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.742507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6b4575-68e0-4b6e-b968-43f6c195eb21 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.743460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6b4575-68e0-4b6e-b968-43f6c195eb21 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.802811 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c6b4575-68e0-4b6e-b968-43f6c195eb21 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 14 microversion: 2.1 time: 0.141679 Dec 18 20:54:49.803601 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1100/2230] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:49 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:49.811178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4dcae18c-1efc-4654-87af-11787553aa64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:49.812481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4dcae18c-1efc-4654-87af-11787553aa64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:49.827050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcae18c-1efc-4654-87af-11787553aa64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.827495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcae18c-1efc-4654-87af-11787553aa64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.831082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcae18c-1efc-4654-87af-11787553aa64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.831532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcae18c-1efc-4654-87af-11787553aa64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.910073 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4dcae18c-1efc-4654-87af-11787553aa64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 32277 microversion: 2.32 time: 0.104526 Dec 18 20:54:49.918703 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1101/2231] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:49 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 32277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:49.926634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:49.932111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-130a930d-15c4-4107-9180-156a9e8faf8d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:49.934117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-130a930d-15c4-4107-9180-156a9e8faf8d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:49.941766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cabbc61c-33d5-4663-82fe-1ba86181dac3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.390530 Dec 18 20:54:49.951841 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1131/2232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:49 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:49.956044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:49.956662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:49.971679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.972509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:49.974243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:49.974797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.025045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-130a930d-15c4-4107-9180-156a9e8faf8d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:50.036583 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-130a930d-15c4-4107-9180-156a9e8faf8d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1214 microversion: 2.1 time: 0.116024 Dec 18 20:54:50.047425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1102/2233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:49 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:50.080103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:50.093115 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f33ec42f-2961-4e5f-9003-69a3353ebf05 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1271 microversion: 2.1 time: 0.142836 Dec 18 20:54:50.094188 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1132/2234] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:49 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:50.560208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:50.563326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:50.571666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.572490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.573562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.574235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.817692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b8ff819d-b731-427d-a1cb-7086968524c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:50.818859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b8ff819d-b731-427d-a1cb-7086968524c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:50.829473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8ff819d-b731-427d-a1cb-7086968524c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.830230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8ff819d-b731-427d-a1cb-7086968524c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.831647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8ff819d-b731-427d-a1cb-7086968524c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.832274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8ff819d-b731-427d-a1cb-7086968524c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.876556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:50.884958 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7843552b-096a-491e-b101-f4759ff8190b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.328620 Dec 18 20:54:50.892499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b8ff819d-b731-427d-a1cb-7086968524c1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 14 microversion: 2.1 time: 0.080441 Dec 18 20:54:50.897586 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1133/2235] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:50 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:50.901027 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1103/2236] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:50 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:50.926135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f057cc9b-a662-40ff-baed-2194ebb8caa6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:50.927475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f057cc9b-a662-40ff-baed-2194ebb8caa6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:50.940514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f057cc9b-a662-40ff-baed-2194ebb8caa6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.940975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f057cc9b-a662-40ff-baed-2194ebb8caa6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.941804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f057cc9b-a662-40ff-baed-2194ebb8caa6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.942292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f057cc9b-a662-40ff-baed-2194ebb8caa6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.959988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:50.961336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:50.978006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.978489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:50.979504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:50.980167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:51.037748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f057cc9b-a662-40ff-baed-2194ebb8caa6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 32277 microversion: 2.32 time: 0.116095 Dec 18 20:54:51.046911 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1134/2237] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:50 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 32277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:51.067764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:51.068643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:51.089993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:51.094664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:51.097805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:51.098574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:51.504112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:51.512927 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-141d5342-9353-464e-81ff-b39d0acd1b66 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1266 microversion: 2.1 time: 0.460502 Dec 18 20:54:51.515502 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1135/2238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:51 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:51.544454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:51.545979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:51.580407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:51.580885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:51.581732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:51.582186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:51.839286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:51.858907 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bf90d117-63a6-4a15-80b7-6c4267ca64da tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.901197 Dec 18 20:54:51.871009 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1104/2239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:50 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:51.907610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cdebfc21-aff4-4e70-842c-ba0f8727cf65 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:51.908990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cdebfc21-aff4-4e70-842c-ba0f8727cf65 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:51.921178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdebfc21-aff4-4e70-842c-ba0f8727cf65 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:51.925064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdebfc21-aff4-4e70-842c-ba0f8727cf65 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:51.928625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdebfc21-aff4-4e70-842c-ba0f8727cf65 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:51.929968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdebfc21-aff4-4e70-842c-ba0f8727cf65 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.046079 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cdebfc21-aff4-4e70-842c-ba0f8727cf65 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 14 microversion: 2.1 time: 0.144316 Dec 18 20:54:52.046764 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1105/2240] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:51 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:52.058395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:52.059393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:52.070463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.071319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.072419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.073112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.283104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:52.298429 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-89a81751-afb0-411b-8f90-1af6da0443e5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 0.778361 Dec 18 20:54:52.300581 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1136/2241] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:51 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:52.318717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7d784558-ab2e-4644-9586-dca5bfb51491 req-8b780d6b-59a3-4694-bca8-c17c6a0a2484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e8c5e-4c15-42ef-8cec-143c0b396585", "name": "network-vif-plugged", "status": "completed", "tag": "8c02c893-1629-4833-9998-e05787ad6250"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:52.325357 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:52.325357 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:52.346150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7d784558-ab2e-4644-9586-dca5bfb51491 req-8b780d6b-59a3-4694-bca8-c17c6a0a2484 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.346969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7d784558-ab2e-4644-9586-dca5bfb51491 req-8b780d6b-59a3-4694-bca8-c17c6a0a2484 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.373127 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7d784558-ab2e-4644-9586-dca5bfb51491 req-8b780d6b-59a3-4694-bca8-c17c6a0a2484 service nova] Creating event network-vif-plugged:8c02c893-1629-4833-9998-e05787ad6250 for instance 784e8c5e-4c15-42ef-8cec-143c0b396585 on nch1-master-1 Dec 18 20:54:52.386968 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7d784558-ab2e-4644-9586-dca5bfb51491 req-8b780d6b-59a3-4694-bca8-c17c6a0a2484 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082494 Dec 18 20:54:52.387911 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1137/2242] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:52.401735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5b89192-553c-4ab6-a52d-c542494268d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:52.405955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5b89192-553c-4ab6-a52d-c542494268d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:52.419995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5b89192-553c-4ab6-a52d-c542494268d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.420457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5b89192-553c-4ab6-a52d-c542494268d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.425142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5b89192-553c-4ab6-a52d-c542494268d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.426224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5b89192-553c-4ab6-a52d-c542494268d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.498644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5b89192-553c-4ab6-a52d-c542494268d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 32277 microversion: 2.32 time: 0.105497 Dec 18 20:54:52.500593 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1138/2243] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:52 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 32277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:52.539871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:52.541928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:52.561206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.566296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.567671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.570380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.575372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:52.584378 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b28ba55-0d45-47e6-846b-e2d0b310602f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.532654 Dec 18 20:54:52.592001 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1106/2244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:52 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:52.877417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:52.878102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:52.891001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.891734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:52.892732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:52.893192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.180981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:53.237827 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1945c450-608e-4312-a680-5df276f1cd7b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 0.696625 Dec 18 20:54:53.241262 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1139/2245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:52 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:53.267101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e73aec0-0bfc-4004-9c77-7099deb1ff1f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:53.268290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e73aec0-0bfc-4004-9c77-7099deb1ff1f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:53.279977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e73aec0-0bfc-4004-9c77-7099deb1ff1f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.280451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e73aec0-0bfc-4004-9c77-7099deb1ff1f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.281266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e73aec0-0bfc-4004-9c77-7099deb1ff1f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.282055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e73aec0-0bfc-4004-9c77-7099deb1ff1f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.341184 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e73aec0-0bfc-4004-9c77-7099deb1ff1f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 14 microversion: 2.1 time: 0.098301 Dec 18 20:54:53.348269 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1140/2246] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:53 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:54:53.357650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:53.359315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:53.367298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.368129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.369366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.370035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.420853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:53.430434 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58641ade-9ef8-4351-8596-66f0bb67be78 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.557016 Dec 18 20:54:53.431992 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1107/2247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:52 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:53.512450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74ba1917-ccfb-4a1a-9cfa-52964d829c89 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:53.513769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74ba1917-ccfb-4a1a-9cfa-52964d829c89 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:53.522293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74ba1917-ccfb-4a1a-9cfa-52964d829c89 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.523552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74ba1917-ccfb-4a1a-9cfa-52964d829c89 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.524845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74ba1917-ccfb-4a1a-9cfa-52964d829c89 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.525455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74ba1917-ccfb-4a1a-9cfa-52964d829c89 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.572395 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74ba1917-ccfb-4a1a-9cfa-52964d829c89 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 32277 microversion: 2.32 time: 0.064874 Dec 18 20:54:53.573786 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1108/2248] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:53 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 32277 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:53.609214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:53.610146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:53.625029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.625942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:53.629772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:53.631343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.417398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:54.427467 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70837006-e0a6-4b2b-9921-4b50b946f275 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 1.077003 Dec 18 20:54:54.438972 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1141/2249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:53 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:54.445830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1b6df1f4-78ec-488a-8337-ab2c6c7a5492 req-4eca869e-770d-403f-87a7-58d98a069532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490a83d0-be20-498a-8e6d-036b4f27f890", "tag": "24ea0eab-019c-481e-a0e8-afff63a3a8c8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:54.447423 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:54.447423 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:54.456749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1b6df1f4-78ec-488a-8337-ab2c6c7a5492 req-4eca869e-770d-403f-87a7-58d98a069532 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.457592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1b6df1f4-78ec-488a-8337-ab2c6c7a5492 req-4eca869e-770d-403f-87a7-58d98a069532 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.469533 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1b6df1f4-78ec-488a-8337-ab2c6c7a5492 req-4eca869e-770d-403f-87a7-58d98a069532 service nova] Creating event network-changed:24ea0eab-019c-481e-a0e8-afff63a3a8c8 for instance 490a83d0-be20-498a-8e6d-036b4f27f890 on nch1-master-1 Dec 18 20:54:54.477245 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1b6df1f4-78ec-488a-8337-ab2c6c7a5492 req-4eca869e-770d-403f-87a7-58d98a069532 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Dec 18 20:54:54.478299 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1142/2250] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:54.485377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d3c85022-2d40-47ff-ad14-1e37183da0da req-10545112-20c9-428e-adf8-1dda66b6a319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2536cb7d-644f-4ed4-bdf8-eb3873d16d9a", "tag": "3638caa9-84ba-4b7e-b9be-44279669b05b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:54.488033 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:54.488033 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:54:54.498063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d3c85022-2d40-47ff-ad14-1e37183da0da req-10545112-20c9-428e-adf8-1dda66b6a319 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.498557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d3c85022-2d40-47ff-ad14-1e37183da0da req-10545112-20c9-428e-adf8-1dda66b6a319 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.512331 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d3c85022-2d40-47ff-ad14-1e37183da0da req-10545112-20c9-428e-adf8-1dda66b6a319 service nova] Creating event network-changed:3638caa9-84ba-4b7e-b9be-44279669b05b for instance 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a on nch1-master-1 Dec 18 20:54:54.518175 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d3c85022-2d40-47ff-ad14-1e37183da0da req-10545112-20c9-428e-adf8-1dda66b6a319 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038246 Dec 18 20:54:54.518803 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1143/2251] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:54.524821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:54.525511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:54.533619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.534238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.535102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.535827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.556283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:54.564777 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35681c05-c6db-447e-a294-69ac6674e131 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.960250 Dec 18 20:54:54.566062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1109/2252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:53 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:54.581945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f1b77c7-8080-48ba-a35d-ee68a11cca95 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614eda60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:54.645257 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f1b77c7-8080-48ba-a35d-ee68a11cca95 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/0bc417b0-01a1-4e1c-971e-235b42f50215" status: 200 len: 662 microversion: 2.1 time: 0.077932 Dec 18 20:54:54.645982 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1110/2253] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:54 2021] GET /compute/v2.1/images/0bc417b0-01a1-4e1c-971e-235b42f50215 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:54.657402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-944e707a-782d-4486-b478-3b784b2f1f69 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:54.659514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-944e707a-782d-4486-b478-3b784b2f1f69 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:54.669208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-944e707a-782d-4486-b478-3b784b2f1f69 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.669928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-944e707a-782d-4486-b478-3b784b2f1f69 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.670756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-944e707a-782d-4486-b478-3b784b2f1f69 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.671347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-944e707a-782d-4486-b478-3b784b2f1f69 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.749673 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-944e707a-782d-4486-b478-3b784b2f1f69 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 8208 microversion: 2.1 time: 0.102506 Dec 18 20:54:54.750390 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1111/2254] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:54 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 8208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:54.756743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a6e312e3-6bba-465a-8a1d-4b26cb9e3505 req-70d69960-1048-4a80-9de8-d87d73c0c01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fffd39-f05f-4540-8067-b4528d22357a", "name": "network-vif-plugged", "status": "completed", "tag": "89de2c2f-41bf-4b1d-8047-873c576b5419"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:54.764978 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:54:54.764978 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:54:54.790927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a6e312e3-6bba-465a-8a1d-4b26cb9e3505 req-70d69960-1048-4a80-9de8-d87d73c0c01d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.804743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a6e312e3-6bba-465a-8a1d-4b26cb9e3505 req-70d69960-1048-4a80-9de8-d87d73c0c01d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.840479 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a6e312e3-6bba-465a-8a1d-4b26cb9e3505 req-70d69960-1048-4a80-9de8-d87d73c0c01d service nova] Creating event network-vif-plugged:89de2c2f-41bf-4b1d-8047-873c576b5419 for instance 89fffd39-f05f-4540-8067-b4528d22357a on nch1-master-1 Dec 18 20:54:54.854491 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a6e312e3-6bba-465a-8a1d-4b26cb9e3505 req-70d69960-1048-4a80-9de8-d87d73c0c01d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100971 Dec 18 20:54:54.856513 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1112/2255] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:54:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:54.863968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:54.866993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:54.869571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:54.886439 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c77f6119-dcd0-44ad-8621-92ffa3f7b12b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 0.363022 Dec 18 20:54:54.899672 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1144/2256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:54 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:54.910360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-37d2139c-cad4-415b-8657-340427652c4a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:54.912719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-37d2139c-cad4-415b-8657-340427652c4a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:54.913070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.914279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.917255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.921817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.928009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d2139c-cad4-415b-8657-340427652c4a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.928476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d2139c-cad4-415b-8657-340427652c4a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:54.930836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d2139c-cad4-415b-8657-340427652c4a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:54.933103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37d2139c-cad4-415b-8657-340427652c4a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.021609 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-37d2139c-cad4-415b-8657-340427652c4a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 32277 microversion: 2.32 time: 0.118773 Dec 18 20:54:55.026089 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1145/2257] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:54 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 32277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:55.034797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f421dac4-91bb-4643-971e-5f02589dec02 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613be040>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:55.129806 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f421dac4-91bb-4643-971e-5f02589dec02 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/0bc417b0-01a1-4e1c-971e-235b42f50215" status: 200 len: 662 microversion: 2.1 time: 0.100504 Dec 18 20:54:55.133499 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1146/2258] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:55 2021] GET /compute/v2.1/images/0bc417b0-01a1-4e1c-971e-235b42f50215 => generated 662 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:55.249945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:55.257868 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf28b62b-8bb8-4cdc-a1b2-a503c3d67483 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.399837 Dec 18 20:54:55.259034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1113/2259] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:54 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:55.446958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:55.448308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:55.458164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.459537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.462386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.462943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.582960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:55.585635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:55.596616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.598110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.599200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.599980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.738470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:55.746768 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-febb5843-1508-4e60-bb51-3883479ad901 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 0.305686 Dec 18 20:54:55.750498 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1147/2260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:55 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:55.762758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-09ec3ba5-e30e-42ae-9d2c-ae15cfee4360 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:55.765528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-09ec3ba5-e30e-42ae-9d2c-ae15cfee4360 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:55.775080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09ec3ba5-e30e-42ae-9d2c-ae15cfee4360 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.775581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09ec3ba5-e30e-42ae-9d2c-ae15cfee4360 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.776475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09ec3ba5-e30e-42ae-9d2c-ae15cfee4360 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.776933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09ec3ba5-e30e-42ae-9d2c-ae15cfee4360 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.843125 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-09ec3ba5-e30e-42ae-9d2c-ae15cfee4360 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 16384 microversion: 2.1 time: 0.084370 Dec 18 20:54:55.847071 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1148/2261] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:55 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 16384 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:54:55.879196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:55.894620 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-954a4378-4385-49c3-9b0a-af05e496bdf8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1308 microversion: 2.1 time: 0.315822 Dec 18 20:54:55.907643 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1114/2262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:55 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:55.910226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:55.910973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:55.922674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.923454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:55.924562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:55.925212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.036886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f75330e-dab0-4d09-981f-b23afbcf3b7d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:56.038311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f75330e-dab0-4d09-981f-b23afbcf3b7d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:56.047028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f75330e-dab0-4d09-981f-b23afbcf3b7d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.048149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f75330e-dab0-4d09-981f-b23afbcf3b7d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.049368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f75330e-dab0-4d09-981f-b23afbcf3b7d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.050021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f75330e-dab0-4d09-981f-b23afbcf3b7d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.120610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f75330e-dab0-4d09-981f-b23afbcf3b7d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.088035 Dec 18 20:54:56.127362 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1115/2263] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:56 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:54:56.174724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:56.182982 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48d955bc-f1dd-4db2-9508-6276b873fb92 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 0.281370 Dec 18 20:54:56.183588 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1149/2264] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:55 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:56.277128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:56.278309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:56.287814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.289218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.290035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.290727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.521483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:56.537433 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9ca3499-478a-423f-a385-ce1db8d7e218 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.265199 Dec 18 20:54:56.547556 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1116/2265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:56 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:56.632923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c2512f5e-71f3-42af-8e43-7584d2a4b02b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613be820>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:56.687082 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c2512f5e-71f3-42af-8e43-7584d2a4b02b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/b75d14c0-9a6d-4577-9014-8718e87df4b6" status: 200 len: 661 microversion: 2.1 time: 0.058477 Dec 18 20:54:56.688520 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1150/2266] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:56 2021] GET /compute/v2.1/images/b75d14c0-9a6d-4577-9014-8718e87df4b6 => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:56.700106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b9c6d4d-917c-4805-953a-5f9f444731d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716150c280>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:56.777072 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b9c6d4d-917c-4805-953a-5f9f444731d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/b75d14c0-9a6d-4577-9014-8718e87df4b6" status: 200 len: 661 microversion: 2.1 time: 0.080534 Dec 18 20:54:56.778212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:56.779114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:56.790734 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1117/2267] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:56 2021] GET /compute/v2.1/images/b75d14c0-9a6d-4577-9014-8718e87df4b6 => generated 661 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:56.796433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.797261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.798561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.799265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.861904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fe67f39b-928f-43d3-a670-031bc1bd8b44 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:56.865998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fe67f39b-928f-43d3-a670-031bc1bd8b44 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:56.878880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe67f39b-928f-43d3-a670-031bc1bd8b44 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.879343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe67f39b-928f-43d3-a670-031bc1bd8b44 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.880160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe67f39b-928f-43d3-a670-031bc1bd8b44 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.880608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe67f39b-928f-43d3-a670-031bc1bd8b44 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.951653 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fe67f39b-928f-43d3-a670-031bc1bd8b44 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 16384 microversion: 2.1 time: 0.099824 Dec 18 20:54:56.956695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1118/2268] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:56 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 16384 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:54:56.963391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:56.965166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:56.973400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.974124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:56.975110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:56.975753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.051473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:57.059693 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7046c7c2-4bde-4923-89e3-14dc2442489b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 0.298072 Dec 18 20:54:57.060715 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1151/2269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:56 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:57.133641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe70cf25-934d-433b-bb46-a2ffa4608dc3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:57.135458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe70cf25-934d-433b-bb46-a2ffa4608dc3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:57.143079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe70cf25-934d-433b-bb46-a2ffa4608dc3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.143897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe70cf25-934d-433b-bb46-a2ffa4608dc3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.144937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe70cf25-934d-433b-bb46-a2ffa4608dc3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.145816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe70cf25-934d-433b-bb46-a2ffa4608dc3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.160228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:57.171928 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc4430bc-e6cf-4b1d-b636-37efbc13affc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1487 microversion: 2.1 time: 0.213590 Dec 18 20:54:57.173082 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1119/2270] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:56 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1487 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:57.190373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9333b092-5a2b-4fb9-b52e-9fce9b0577d3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:57.191185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9333b092-5a2b-4fb9-b52e-9fce9b0577d3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:57.198524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9333b092-5a2b-4fb9-b52e-9fce9b0577d3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.199242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9333b092-5a2b-4fb9-b52e-9fce9b0577d3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.200279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9333b092-5a2b-4fb9-b52e-9fce9b0577d3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.200905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9333b092-5a2b-4fb9-b52e-9fce9b0577d3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.227243 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe70cf25-934d-433b-bb46-a2ffa4608dc3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.096310 Dec 18 20:54:57.233672 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1152/2271] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:57 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:54:57.247876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:57.249042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:57.257628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.258473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.259795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.260848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.291828 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9333b092-5a2b-4fb9-b52e-9fce9b0577d3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a/action" status: 202 len: 0 microversion: 2.1 time: 0.105614 Dec 18 20:54:57.295357 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1120/2272] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:57 2021] POST /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:54:57.301884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:57.307096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:57.318421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.323346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.335082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.335854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.596861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:57.608134 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0445bda-50f9-495d-a193-cc7463ae721e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 0.371332 Dec 18 20:54:57.610440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1153/2273] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:57 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:57.620709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:57.629519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:57.630386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:57.632863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e358671-a6f4-408d-856a-ad0a6c799670 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1492 microversion: 2.1 time: 0.335556 Dec 18 20:54:57.633769 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1121/2274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:57 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1492 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:57.637672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.638199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.638978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.639480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.891485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:57.903741 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a41be5e5-63b4-4773-9c82-103817cc4733 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.291080 Dec 18 20:54:57.904976 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1154/2275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:57 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:57.964359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9031014e-5d51-4d42-abc3-b25d7acea743 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:57.965406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9031014e-5d51-4d42-abc3-b25d7acea743 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:57.978471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9031014e-5d51-4d42-abc3-b25d7acea743 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.978924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9031014e-5d51-4d42-abc3-b25d7acea743 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:57.979725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9031014e-5d51-4d42-abc3-b25d7acea743 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:57.980161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9031014e-5d51-4d42-abc3-b25d7acea743 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.040158 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9031014e-5d51-4d42-abc3-b25d7acea743 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 16384 microversion: 2.1 time: 0.080058 Dec 18 20:54:58.041091 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1122/2276] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:57 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 16384 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:54:58.076762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:58.077468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:58.084683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.085824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.086655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.087093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.217659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2d957d4-7dd2-4f99-bfe4-d7a3a802a64b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614f2c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:58.275092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2d957d4-7dd2-4f99-bfe4-d7a3a802a64b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/422764cf-fded-41cc-93a7-e2349052fea8" status: 200 len: 662 microversion: 2.1 time: 0.061621 Dec 18 20:54:58.275738 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1123/2277] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:58 2021] GET /compute/v2.1/images/422764cf-fded-41cc-93a7-e2349052fea8 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:58.280909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ae0220e-4ef0-4007-9621-3bf83cb8a0f7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:58.282773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ae0220e-4ef0-4007-9621-3bf83cb8a0f7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:58.289731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ae0220e-4ef0-4007-9621-3bf83cb8a0f7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.290423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ae0220e-4ef0-4007-9621-3bf83cb8a0f7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.291557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ae0220e-4ef0-4007-9621-3bf83cb8a0f7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.292194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ae0220e-4ef0-4007-9621-3bf83cb8a0f7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.347822 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ae0220e-4ef0-4007-9621-3bf83cb8a0f7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.070337 Dec 18 20:54:58.350541 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1124/2278] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:54:58 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:54:58.358851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-53a9f57a-2309-4612-b004-a2982962951c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716150c280>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:58.383541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:58.394116 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c811c3e-8b1e-4de0-944c-f0f0a61a3e60 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 0.321435 Dec 18 20:54:58.401421 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1155/2279] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:58 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:58.437042 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-53a9f57a-2309-4612-b004-a2982962951c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/422764cf-fded-41cc-93a7-e2349052fea8" status: 200 len: 662 microversion: 2.1 time: 0.083398 Dec 18 20:54:58.438526 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1125/2280] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:58 2021] GET /compute/v2.1/images/422764cf-fded-41cc-93a7-e2349052fea8 => generated 662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:54:58.510542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-556254642", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:58.579931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:58.629195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:58.630415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:58.638389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.639079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.639902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.640339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.914149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:58.914661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:58.915076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:58.915488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:58.917100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:58.919884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:58.933931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.934669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aed9b555-310c-4e2f-a1c2-caf7673a5730 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 0.308920 Dec 18 20:54:58.935571 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1126/2281] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:58 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:54:58.939945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.941038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.941655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.943550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:58.944617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:58.953062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.953585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.954909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:58.955417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:58.970869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Getting quotas for project 3c3cfd30b80f46d798958d02e20cb5fd. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:54:58.981766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Getting quotas for user b46b47b65699443083a47a2c8bab63cf and project 3c3cfd30b80f46d798958d02e20cb5fd. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:54:59.011324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:54:59.014168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:54:59.078733 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26ddccd7-b977-429f-91ca-227b7270d4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572984 Dec 18 20:54:59.091314 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1156/2282] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 20:54:59.098315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:54:59.099575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:59.108100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.109132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:59.125219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.127256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:59.247239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:59.268273 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0afe6d6c-c6e0-42ca-b71a-2acfbfd5a5c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 200 len: 1472 microversion: 2.1 time: 0.329050 Dec 18 20:54:59.269397 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1127/2283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:58 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:59.287021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb20c4f8-da90-44af-b945-6c68088bb162 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:59.289880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb20c4f8-da90-44af-b945-6c68088bb162 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:59.307753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb20c4f8-da90-44af-b945-6c68088bb162 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.308208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb20c4f8-da90-44af-b945-6c68088bb162 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:59.310426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb20c4f8-da90-44af-b945-6c68088bb162 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.311586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb20c4f8-da90-44af-b945-6c68088bb162 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:59.402644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:54:59.419220 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb20c4f8-da90-44af-b945-6c68088bb162 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 16384 microversion: 2.1 time: 0.147983 Dec 18 20:54:59.420576 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1128/2284] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:59 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 16384 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:54:59.424701 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-052cc926-c894-466c-bd96-069238f8831d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.331876 Dec 18 20:54:59.425348 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1157/2285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:54:59 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:54:59.428126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-174792806", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:59.447027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-674d96dd-3e18-4715-937f-40ee23bc58dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-736261142"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:54:59.448524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-674d96dd-3e18-4715-937f-40ee23bc58dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:54:59.455990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-674d96dd-3e18-4715-937f-40ee23bc58dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.456454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-674d96dd-3e18-4715-937f-40ee23bc58dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:59.457291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-674d96dd-3e18-4715-937f-40ee23bc58dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.457867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-674d96dd-3e18-4715-937f-40ee23bc58dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:59.505781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:54:59.848901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:54:59.849721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:54:59.851092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:54:59.852363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:54:59.853303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:54:59.901690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.905000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:54:59.905753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:54:59.909580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.002147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Getting quotas for project 3c3cfd30b80f46d798958d02e20cb5fd. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:55:00.015947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Getting quotas for user b46b47b65699443083a47a2c8bab63cf and project 3c3cfd30b80f46d798958d02e20cb5fd. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:55:00.040684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:55:00.044131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:55:00.059521 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-674d96dd-3e18-4715-937f-40ee23bc58dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a/action" status: 202 len: 0 microversion: 2.1 time: 0.629719 Dec 18 20:55:00.065847 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1158/2286] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:54:59 2021] POST /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:55:00.095115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c083bc1c-8ce7-4df1-878e-259906d7bac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:00.099588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c083bc1c-8ce7-4df1-878e-259906d7bac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:00.135172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c083bc1c-8ce7-4df1-878e-259906d7bac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.141539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c083bc1c-8ce7-4df1-878e-259906d7bac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.142951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c083bc1c-8ce7-4df1-878e-259906d7bac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.145863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c083bc1c-8ce7-4df1-878e-259906d7bac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.195557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fcbc21c-a4b5-4f17-94b8-505ce31b5683 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773274 Dec 18 20:55:00.209197 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1129/2287] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:54:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:55:00.223733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:00.224650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:00.241239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.243045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.245913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.246608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.281688 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c083bc1c-8ce7-4df1-878e-259906d7bac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.213634 Dec 18 20:55:00.282734 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1159/2288] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:00 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:00.295013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:00.296019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:00.321607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.324276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.325428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.328024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.642636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:00.656435 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7c70c690-1190-4718-89ba-7f9ac0607d6a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 0.444990 Dec 18 20:55:00.657425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1130/2289] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:00 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:00.672933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01727a78-5a82-4189-a6a0-872bc6dd5521 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f716150c430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:00.755425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:00.775667 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b3e8e9ba-0a1d-4355-bfca-b57fb2094638 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 0.490928 Dec 18 20:55:00.777688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01727a78-5a82-4189-a6a0-872bc6dd5521 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.108953 Dec 18 20:55:00.779807 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1160/2290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:00 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:00.781388 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1131/2291] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:00 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:00.793275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab5620d2-3b74-4519-a4d9-640403483a1c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:00.794054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a01b057-e9df-4ab0-a4d7-6bae96991672 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:00.795197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a01b057-e9df-4ab0-a4d7-6bae96991672 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:00.795959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab5620d2-3b74-4519-a4d9-640403483a1c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:00.810888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab5620d2-3b74-4519-a4d9-640403483a1c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.814109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab5620d2-3b74-4519-a4d9-640403483a1c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.816515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab5620d2-3b74-4519-a4d9-640403483a1c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.817071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab5620d2-3b74-4519-a4d9-640403483a1c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.936242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a01b057-e9df-4ab0-a4d7-6bae96991672 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:00.945469 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab5620d2-3b74-4519-a4d9-640403483a1c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.159147 Dec 18 20:55:00.947323 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1132/2292] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:00 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:00.961624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:00.962962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:00.965304 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a01b057-e9df-4ab0-a4d7-6bae96991672 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1217 microversion: 2.1 time: 0.182914 Dec 18 20:55:00.968192 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1161/2293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:00 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:00.970969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.971632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:00.972652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:00.973309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:01.295332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7df7d806-df61-4ae7-ad26-de0818b2cf2f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:01.296327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7df7d806-df61-4ae7-ad26-de0818b2cf2f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:01.305210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7df7d806-df61-4ae7-ad26-de0818b2cf2f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:01.309230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7df7d806-df61-4ae7-ad26-de0818b2cf2f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:01.312053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7df7d806-df61-4ae7-ad26-de0818b2cf2f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:01.313139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7df7d806-df61-4ae7-ad26-de0818b2cf2f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:01.380843 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7df7d806-df61-4ae7-ad26-de0818b2cf2f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.087183 Dec 18 20:55:01.381592 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1162/2294] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:01 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:55:01.423771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:01.435208 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dbb7abef-346f-4bca-9f27-e600db85e793 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.486419 Dec 18 20:55:01.435806 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1133/2295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:00 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:01.678679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:01.679781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:01.688125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:01.688760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:01.689732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:01.690365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:01.795086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-016bec68-a5d5-4ef8-8c61-8c4fdf21a1ef tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714eb640d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:01.882237 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-016bec68-a5d5-4ef8-8c61-8c4fdf21a1ef tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.090754 Dec 18 20:55:01.886594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1134/2296] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:01 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:01.891350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:01.895114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:01.906940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:01.909674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:01.910781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:01.912189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:02.630880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:02.651006 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7c5ec09e-442f-4528-89f4-2d584074e57a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 0.976043 Dec 18 20:55:02.651928 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1163/2297] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:01 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:02.660439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3e0eac6b-d79d-49f1-82f9-7cb2b34d6143 req-797f1ec1-f8d7-4c97-a1ae-e40a06ee5b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490a83d0-be20-498a-8e6d-036b4f27f890", "name": "network-vif-plugged", "status": "completed", "tag": "24ea0eab-019c-481e-a0e8-afff63a3a8c8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:02.663691 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:02.663691 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:55:02.675115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3e0eac6b-d79d-49f1-82f9-7cb2b34d6143 req-797f1ec1-f8d7-4c97-a1ae-e40a06ee5b15 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:02.675919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3e0eac6b-d79d-49f1-82f9-7cb2b34d6143 req-797f1ec1-f8d7-4c97-a1ae-e40a06ee5b15 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:02.695803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3e0eac6b-d79d-49f1-82f9-7cb2b34d6143 req-797f1ec1-f8d7-4c97-a1ae-e40a06ee5b15 service nova] Creating event network-vif-plugged:24ea0eab-019c-481e-a0e8-afff63a3a8c8 for instance 490a83d0-be20-498a-8e6d-036b4f27f890 on nch1-master-1 Dec 18 20:55:02.702297 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3e0eac6b-d79d-49f1-82f9-7cb2b34d6143 req-797f1ec1-f8d7-4c97-a1ae-e40a06ee5b15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048771 Dec 18 20:55:02.703525 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1164/2298] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:02.713202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82d46bca-1715-41e9-a920-a967e432b0a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:02.714986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82d46bca-1715-41e9-a920-a967e432b0a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:02.723887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82d46bca-1715-41e9-a920-a967e432b0a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:02.724617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82d46bca-1715-41e9-a920-a967e432b0a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:02.725662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82d46bca-1715-41e9-a920-a967e432b0a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:02.726795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82d46bca-1715-41e9-a920-a967e432b0a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:02.795463 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82d46bca-1715-41e9-a920-a967e432b0a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.089244 Dec 18 20:55:02.796887 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1165/2299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:02 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:02.804615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:02.805275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:02.813920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:02.814484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:02.815350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:02.815800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:02.997999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:03.007165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:03.007651 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eee106bc-6db7-4d93-b505-e8f30ce6cc6d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 1.119782 Dec 18 20:55:03.008905 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1135/2300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:01 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:03.018988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07a7e68e-0d8b-4110-80ac-f5b3aba2ca05 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:03.020453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07a7e68e-0d8b-4110-80ac-f5b3aba2ca05 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:03.024491 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4b4169a-4be3-45a3-97c2-bcd1a9d7dfca tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1275 microversion: 2.1 time: 0.225964 Dec 18 20:55:03.025395 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1166/2301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:02 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:03.032213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:03.033200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:03.040780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a7e68e-0d8b-4110-80ac-f5b3aba2ca05 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.041560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a7e68e-0d8b-4110-80ac-f5b3aba2ca05 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.042548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a7e68e-0d8b-4110-80ac-f5b3aba2ca05 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.043170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a7e68e-0d8b-4110-80ac-f5b3aba2ca05 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.044792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.046710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.047581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.048122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.171985 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07a7e68e-0d8b-4110-80ac-f5b3aba2ca05 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.161038 Dec 18 20:55:03.173135 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1136/2302] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:03 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:03.181167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d55e6105-2734-4428-be58-2558e972a73c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ebafd30>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:03.287590 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d55e6105-2734-4428-be58-2558e972a73c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.112570 Dec 18 20:55:03.289952 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1137/2303] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:03 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:03.511349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:03.526725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cde9e520-6141-489a-b604-601bbf41dd8b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.499692 Dec 18 20:55:03.528851 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1167/2304] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:03 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:03.672585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:03.674098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:03.699654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.700512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.701759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.703556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.816487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-84732f4a-dc81-467f-8572-3d46c58fb44e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:03.818599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-84732f4a-dc81-467f-8572-3d46c58fb44e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:03.849937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84732f4a-dc81-467f-8572-3d46c58fb44e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.851818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84732f4a-dc81-467f-8572-3d46c58fb44e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.852699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84732f4a-dc81-467f-8572-3d46c58fb44e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:03.853193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84732f4a-dc81-467f-8572-3d46c58fb44e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:03.953441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-84732f4a-dc81-467f-8572-3d46c58fb44e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.143878 Dec 18 20:55:03.955396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1168/2305] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:03 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:04.033052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:04.034772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:04.047540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:04.049008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:04.050238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:04.051491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:04.617897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:04.627414 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf0d14a8-1f3f-4631-a724-4ff2cae448bc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1313 microversion: 2.1 time: 0.960759 Dec 18 20:55:04.638667 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1138/2306] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:03 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1313 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:04.644146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:04.645190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:04.653715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:04.654482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:04.655772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:04.656455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.002198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:05.015280 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b310edd-c3c0-4fe4-89e6-d191c8f23c3c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 0.987610 Dec 18 20:55:05.016560 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1169/2307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:04 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:05.030753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a99dccb-c121-4b23-aa10-cdd866c93273 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:05.031838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a99dccb-c121-4b23-aa10-cdd866c93273 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:05.048985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a99dccb-c121-4b23-aa10-cdd866c93273 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.053083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a99dccb-c121-4b23-aa10-cdd866c93273 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.054116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a99dccb-c121-4b23-aa10-cdd866c93273 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.054696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a99dccb-c121-4b23-aa10-cdd866c93273 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.145002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a99dccb-c121-4b23-aa10-cdd866c93273 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.126663 Dec 18 20:55:05.150604 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1170/2308] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:05 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:05.172629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-414410f8-85f5-4efe-a9c0-39b03cd6f985 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f7161426790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:05.295965 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-414410f8-85f5-4efe-a9c0-39b03cd6f985 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.138397 Dec 18 20:55:05.305269 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1171/2309] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:05 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:05.320908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:05.323677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:05.344695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.345242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.347117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.353946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.572081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:05.594198 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7302dad3-d637-4a58-a377-e5c3ad3d6f5c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 0.953038 Dec 18 20:55:05.595189 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1139/2310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:04 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:05.605208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a3428747-4b2d-4371-921f-7ed9f56d8464 req-8ad0aedc-8f5c-400c-9a5f-c21bf640171a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2536cb7d-644f-4ed4-bdf8-eb3873d16d9a", "name": "network-vif-plugged", "status": "completed", "tag": "3638caa9-84ba-4b7e-b9be-44279669b05b"}, {"server_uuid": "89fffd39-f05f-4540-8067-b4528d22357a", "name": "network-vif-plugged", "status": "completed", "tag": "89de2c2f-41bf-4b1d-8047-873c576b5419"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:05.607868 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:05.607868 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:05.635964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a3428747-4b2d-4371-921f-7ed9f56d8464 req-8ad0aedc-8f5c-400c-9a5f-c21bf640171a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.637371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a3428747-4b2d-4371-921f-7ed9f56d8464 req-8ad0aedc-8f5c-400c-9a5f-c21bf640171a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.673124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a3428747-4b2d-4371-921f-7ed9f56d8464 req-8ad0aedc-8f5c-400c-9a5f-c21bf640171a service nova] Creating event network-vif-plugged:3638caa9-84ba-4b7e-b9be-44279669b05b for instance 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a on nch1-master-1 Dec 18 20:55:05.673882 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a3428747-4b2d-4371-921f-7ed9f56d8464 req-8ad0aedc-8f5c-400c-9a5f-c21bf640171a service nova] Creating event network-vif-plugged:89de2c2f-41bf-4b1d-8047-873c576b5419 for instance 89fffd39-f05f-4540-8067-b4528d22357a on nch1-master-1 Dec 18 20:55:05.694743 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a3428747-4b2d-4371-921f-7ed9f56d8464 req-8ad0aedc-8f5c-400c-9a5f-c21bf640171a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091593 Dec 18 20:55:05.697436 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1140/2311] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:05 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:05.728968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0dc8d63e-aa62-4a17-a6ba-bcef4dc12713 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:05.741480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0dc8d63e-aa62-4a17-a6ba-bcef4dc12713 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:05.756162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dc8d63e-aa62-4a17-a6ba-bcef4dc12713 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.757710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dc8d63e-aa62-4a17-a6ba-bcef4dc12713 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.759059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dc8d63e-aa62-4a17-a6ba-bcef4dc12713 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.762315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dc8d63e-aa62-4a17-a6ba-bcef4dc12713 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.854839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0dc8d63e-aa62-4a17-a6ba-bcef4dc12713 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.139480 Dec 18 20:55:05.859413 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1141/2312] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:05 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:05.869017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:05.872752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:05.881025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.883104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:05.884225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:05.884915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:06.080944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:06.089780 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9fe273a-4792-4cff-8b9f-148ddd6838d6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.782565 Dec 18 20:55:06.099520 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1172/2313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:05 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:06.105210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:06.106325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:06.124498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:06.125446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:06.126541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:06.127220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:06.863304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:06.875194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6fe2f81-3758-444c-a2d9-b913372c047e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1463 microversion: 2.1 time: 1.012928 Dec 18 20:55:06.875781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1142/2314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:05 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1463 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:06.898602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d18370f4-cef6-4123-8b3e-adfcb62df1cc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:06.899634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d18370f4-cef6-4123-8b3e-adfcb62df1cc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:06.924382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d18370f4-cef6-4123-8b3e-adfcb62df1cc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:06.925050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d18370f4-cef6-4123-8b3e-adfcb62df1cc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:06.925947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d18370f4-cef6-4123-8b3e-adfcb62df1cc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:06.926541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d18370f4-cef6-4123-8b3e-adfcb62df1cc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:07.045160 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d18370f4-cef6-4123-8b3e-adfcb62df1cc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.161278 Dec 18 20:55:07.049378 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1143/2315] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:06 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:07.057267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1427f6ad-7cfd-48f1-8678-4a48ad73e66d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71614a4280>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:07.152616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:07.171082 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cac59129-7097-4047-aafd-caebfec8e32e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1314 microversion: 2.1 time: 1.069883 Dec 18 20:55:07.171930 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1173/2316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:06 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:07.181265 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1427f6ad-7cfd-48f1-8678-4a48ad73e66d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.133546 Dec 18 20:55:07.182102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1144/2317] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:07 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:07.211541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ecfdaff-1237-4004-abac-6369797acc5a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:07.212652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:07.213664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:07.219155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ecfdaff-1237-4004-abac-6369797acc5a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:07.229261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:07.230327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:07.233542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:07.234683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecfdaff-1237-4004-abac-6369797acc5a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:07.235899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:07.236719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecfdaff-1237-4004-abac-6369797acc5a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:07.238603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecfdaff-1237-4004-abac-6369797acc5a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:07.240348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ecfdaff-1237-4004-abac-6369797acc5a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:07.322033 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ecfdaff-1237-4004-abac-6369797acc5a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.137092 Dec 18 20:55:07.323557 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1145/2318] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:07 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:07.331277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a91fd727-d3e7-418b-8e5f-35617af55c6c tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:07.333022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a91fd727-d3e7-418b-8e5f-35617af55c6c tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:07.347639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a91fd727-d3e7-418b-8e5f-35617af55c6c tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:07.349386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a91fd727-d3e7-418b-8e5f-35617af55c6c tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:07.351155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a91fd727-d3e7-418b-8e5f-35617af55c6c tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:07.362924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a91fd727-d3e7-418b-8e5f-35617af55c6c tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.050748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:08.064248 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-253daf5f-2249-4d3a-b6f4-9f64e9210b43 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 0.890738 Dec 18 20:55:08.066483 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1174/2319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:07 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:08.072888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:08.074414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:08.084561 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a91fd727-d3e7-418b-8e5f-35617af55c6c tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1614 microversion: 2.1 time: 0.759426 Dec 18 20:55:08.085181 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1146/2320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:07 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1614 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:08.087031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.088056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.090329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.091807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.105742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0119f2e-b29e-4f27-954d-de9e8290bcb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:08.106767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0119f2e-b29e-4f27-954d-de9e8290bcb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:08.114639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0119f2e-b29e-4f27-954d-de9e8290bcb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.115454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0119f2e-b29e-4f27-954d-de9e8290bcb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.117083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0119f2e-b29e-4f27-954d-de9e8290bcb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.117768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0119f2e-b29e-4f27-954d-de9e8290bcb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.208059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0119f2e-b29e-4f27-954d-de9e8290bcb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.105703 Dec 18 20:55:08.208776 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1147/2321] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:08 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:08.217653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:08.226583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:08.238108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.246018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.251892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.252452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.353468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f2372afe520416386d5e961633ba6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc853b43346c4b80a888930d782d7bbc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:08.354742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] flavor_id is None. Assuming migration. {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 18 20:55:08.355672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 20:55:08.681735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:08.702291 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab3e3ade-489e-4426-9925-16b330c47463 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.634467 Dec 18 20:55:08.707227 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1175/2322] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:08 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:08.742557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:08.743347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:08.761671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.762145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:08.763975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:08.764431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:09.035145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a82ffefb-5158-442d-a5d2-e999e5758a05 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890/action" status: 202 len: 0 microversion: 2.1 time: 0.824772 Dec 18 20:55:09.036615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1148/2323] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:08 2021] POST /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890/action => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:09.050701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f99c9704-0731-491c-882e-33701b5d5ac2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71614ed040>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:09.168122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f99c9704-0731-491c-882e-33701b5d5ac2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.128813 Dec 18 20:55:09.170157 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1149/2324] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:09 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:09.190908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13d46c75-2b54-4ddc-b27b-1d54b480b2d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:09.193610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13d46c75-2b54-4ddc-b27b-1d54b480b2d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:09.203415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13d46c75-2b54-4ddc-b27b-1d54b480b2d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:09.206185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13d46c75-2b54-4ddc-b27b-1d54b480b2d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:09.207438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13d46c75-2b54-4ddc-b27b-1d54b480b2d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:09.209148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13d46c75-2b54-4ddc-b27b-1d54b480b2d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:09.288106 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13d46c75-2b54-4ddc-b27b-1d54b480b2d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.114517 Dec 18 20:55:09.288832 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1150/2325] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:09 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:09.296963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-18fa5bf0-4079-4e9d-998b-b8550278beaf req-5bc00df7-d5f1-4fea-b2ef-35de9dbe69f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f709f32-beb6-4558-8d64-0d56d0981842", "tag": "53d8cf94-d048-4858-b43d-3d641ffb86d5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:09.299072 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:09.299072 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:09.325842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-18fa5bf0-4079-4e9d-998b-b8550278beaf req-5bc00df7-d5f1-4fea-b2ef-35de9dbe69f9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:09.326352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-18fa5bf0-4079-4e9d-998b-b8550278beaf req-5bc00df7-d5f1-4fea-b2ef-35de9dbe69f9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:09.350810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-18fa5bf0-4079-4e9d-998b-b8550278beaf req-5bc00df7-d5f1-4fea-b2ef-35de9dbe69f9 service nova] Creating event network-changed:53d8cf94-d048-4858-b43d-3d641ffb86d5 for instance 6f709f32-beb6-4558-8d64-0d56d0981842 on nch2-master-1 Dec 18 20:55:09.369556 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-18fa5bf0-4079-4e9d-998b-b8550278beaf req-5bc00df7-d5f1-4fea-b2ef-35de9dbe69f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078643 Dec 18 20:55:09.370590 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1151/2326] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:09.376014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:09.376748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:09.397944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:09.399425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:09.403023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:09.403740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:10.338024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:10.363279 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab3a1aa0-0abc-409f-9d5f-4ea4cc5b4e3e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1472 microversion: 2.1 time: 0.991044 Dec 18 20:55:10.376872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1152/2327] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:09 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1472 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:10.387533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:10.393690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:10.402276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:10.425782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:10.430565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:10.432726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:10.433354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:10.433579 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d14034e2-2ce2-4040-95f3-f6f0eec566d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1500 microversion: 2.1 time: 1.706387 Dec 18 20:55:10.435831 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1176/2328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:08 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1500 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:10.451139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13c26429-e86b-4cc0-8f16-f4938ce06bca tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:10.452883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13c26429-e86b-4cc0-8f16-f4938ce06bca tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:10.464946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13c26429-e86b-4cc0-8f16-f4938ce06bca tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:10.465926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13c26429-e86b-4cc0-8f16-f4938ce06bca tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:10.467683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13c26429-e86b-4cc0-8f16-f4938ce06bca tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:10.468497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13c26429-e86b-4cc0-8f16-f4938ce06bca tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:10.570229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13c26429-e86b-4cc0-8f16-f4938ce06bca tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.130050 Dec 18 20:55:10.571216 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1177/2329] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:10 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:10.585584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:10.589191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:10.613107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:10.614070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:10.615702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:10.622586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.010794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:11.024528 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78659104-51f0-46e4-b269-df77358a05f4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 0.644148 Dec 18 20:55:11.037244 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1153/2330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:10 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:11.051522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a38ca4bf-a68b-4aa2-af6d-418025f89f3e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71614ed550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:11.182689 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a38ca4bf-a68b-4aa2-af6d-418025f89f3e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.143702 Dec 18 20:55:11.192710 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1154/2331] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:11 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:11.201705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-580e3244-8209-4e1a-88a7-986469b24e24 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:11.212719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-580e3244-8209-4e1a-88a7-986469b24e24 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:11.236625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-580e3244-8209-4e1a-88a7-986469b24e24 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.241379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-580e3244-8209-4e1a-88a7-986469b24e24 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.243186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-580e3244-8209-4e1a-88a7-986469b24e24 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.243872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-580e3244-8209-4e1a-88a7-986469b24e24 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.354326 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-580e3244-8209-4e1a-88a7-986469b24e24 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.141125 Dec 18 20:55:11.357148 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1155/2332] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:11 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:11.383378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:11.389259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:11.421092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.421622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.422646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.423195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.440748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:11.481325 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-415ab50c-e9af-412b-b6bb-14422c951839 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.903128 Dec 18 20:55:11.482405 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1178/2333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:10 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:11.493701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:11.495023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:11.515089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.516335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.525954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.526504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lazy-loading 'flavor' on Instance uuid 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:55:11.527094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.722137 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a9a9688f-0d9f-4789-af2f-8a43e7868e54 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "POST /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a/action" status: 200 len: 32 microversion: 2.1 time: 0.355508 Dec 18 20:55:11.730108 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1156/2334] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:11 2021] POST /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a/action => generated 32 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:11.736296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6d2e8537-171e-4e7a-a29b-95a3f67fdde7 req-263d6436-0427-4ff0-9f80-49f9cb350939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd93280f-4987-4eea-b229-7cc365db43ff", "tag": "2b8e5c57-7646-45bc-8bdf-d19b316188ed"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:11.738463 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:11.738463 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:11.747220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6d2e8537-171e-4e7a-a29b-95a3f67fdde7 req-263d6436-0427-4ff0-9f80-49f9cb350939 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.748128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6d2e8537-171e-4e7a-a29b-95a3f67fdde7 req-263d6436-0427-4ff0-9f80-49f9cb350939 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.766880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6d2e8537-171e-4e7a-a29b-95a3f67fdde7 req-263d6436-0427-4ff0-9f80-49f9cb350939 service nova] Creating event network-changed:2b8e5c57-7646-45bc-8bdf-d19b316188ed for instance bd93280f-4987-4eea-b229-7cc365db43ff on nch1-master-1 Dec 18 20:55:11.773139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6d2e8537-171e-4e7a-a29b-95a3f67fdde7 req-263d6436-0427-4ff0-9f80-49f9cb350939 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040286 Dec 18 20:55:11.774350 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1157/2335] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:11.779831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-20ec9d7c-0d42-4d6a-bdc3-22d17dbdc55c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:11.781253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-20ec9d7c-0d42-4d6a-bdc3-22d17dbdc55c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:11.788250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ec9d7c-0d42-4d6a-bdc3-22d17dbdc55c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.789100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ec9d7c-0d42-4d6a-bdc3-22d17dbdc55c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.790229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ec9d7c-0d42-4d6a-bdc3-22d17dbdc55c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.791116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ec9d7c-0d42-4d6a-bdc3-22d17dbdc55c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.867137 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-20ec9d7c-0d42-4d6a-bdc3-22d17dbdc55c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.090967 Dec 18 20:55:11.868199 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1158/2336] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:11 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:11.888306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:11.890239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:11.912992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.913958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:11.917334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:11.918096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:12.346790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:12.370343 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff91fb94-3e46-4b67-80f1-fa720163506d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1472 microversion: 2.1 time: 0.884657 Dec 18 20:55:12.372043 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1179/2337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:11 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1472 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:12.391908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:12.394211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:12.407067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:12.407516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:12.408326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:12.408761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:12.692160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:12.726897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-86949c9b-be53-4e69-89e7-dbb0c2e4cc2c tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.857121 Dec 18 20:55:12.732879 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1159/2338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:11 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:12.748892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8ff32c3-062b-40cb-8ff9-a8da134f9abf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ebbf550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:12.839846 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8ff32c3-062b-40cb-8ff9-a8da134f9abf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.105210 Dec 18 20:55:12.852843 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1160/2339] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:12 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:12.858786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-babb98ea-98d6-4daa-9cd6-3b862f721a0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:12.864109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-babb98ea-98d6-4daa-9cd6-3b862f721a0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:12.877775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-babb98ea-98d6-4daa-9cd6-3b862f721a0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:12.884098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-babb98ea-98d6-4daa-9cd6-3b862f721a0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:12.885276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-babb98ea-98d6-4daa-9cd6-3b862f721a0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:12.886140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-babb98ea-98d6-4daa-9cd6-3b862f721a0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:12.961427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-babb98ea-98d6-4daa-9cd6-3b862f721a0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.106173 Dec 18 20:55:12.966971 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1161/2340] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:12 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:13.240764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:13.254242 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-36487367-013b-47f8-85c1-d1d58633dce8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 0.879342 Dec 18 20:55:13.255618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1180/2341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:12 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:13.271592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b5033d5-5061-4e87-934e-8c4374d99974 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:13.273293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b5033d5-5061-4e87-934e-8c4374d99974 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:13.291164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b5033d5-5061-4e87-934e-8c4374d99974 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.297997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b5033d5-5061-4e87-934e-8c4374d99974 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.299137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b5033d5-5061-4e87-934e-8c4374d99974 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.299590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b5033d5-5061-4e87-934e-8c4374d99974 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.401442 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b5033d5-5061-4e87-934e-8c4374d99974 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.143053 Dec 18 20:55:13.409101 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1181/2342] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:13 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:13.424379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:13.425265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:13.445863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.446371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.449841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.450350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.537821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:13.538678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:13.555710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.556072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.560933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.561393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.884496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:13.896822 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67d30204-e284-4297-8b71-31a240599959 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1472 microversion: 2.1 time: 0.489408 Dec 18 20:55:13.909184 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1182/2343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:13 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:13.920008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:13.922957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:13.936703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:13.951168 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58eebcb0-379a-4cc3-a3c1-f6fe432ce2c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.981786 Dec 18 20:55:13.954396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.954874 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1162/2344] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:12 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:13.960468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.962556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:13.964155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:13.970195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca1fa975-a36d-48e3-ba46-ec34bb36e7dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71614f24c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:14.051994 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca1fa975-a36d-48e3-ba46-ec34bb36e7dd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.095875 Dec 18 20:55:14.053735 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1163/2345] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:13 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:14.058957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15ff0a37-ec51-418e-aabd-328fe7e5a653 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:14.060351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15ff0a37-ec51-418e-aabd-328fe7e5a653 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:14.068730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15ff0a37-ec51-418e-aabd-328fe7e5a653 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.070061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15ff0a37-ec51-418e-aabd-328fe7e5a653 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.071124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15ff0a37-ec51-418e-aabd-328fe7e5a653 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.071796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15ff0a37-ec51-418e-aabd-328fe7e5a653 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.130047 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15ff0a37-ec51-418e-aabd-328fe7e5a653 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.074416 Dec 18 20:55:14.131089 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1164/2346] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:14 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:14.215318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:14.228961 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60d80d79-918e-46f7-a895-2e511fd2e841 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.318289 Dec 18 20:55:14.240338 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1183/2347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:13 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:14.275725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:14.276430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:14.295154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.295866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.296935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.297608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.419094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7dac1937-c057-4b93-9cff-aa8ad8c0aa8e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:14.420032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7dac1937-c057-4b93-9cff-aa8ad8c0aa8e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:14.436622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dac1937-c057-4b93-9cff-aa8ad8c0aa8e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.452978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dac1937-c057-4b93-9cff-aa8ad8c0aa8e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.452978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dac1937-c057-4b93-9cff-aa8ad8c0aa8e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.453600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dac1937-c057-4b93-9cff-aa8ad8c0aa8e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.546930 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7dac1937-c057-4b93-9cff-aa8ad8c0aa8e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.132099 Dec 18 20:55:14.548257 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1184/2348] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:14 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:55:14.697639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:14.715924 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88ba5f90-32a1-407f-ba49-35c68824380a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 0.446369 Dec 18 20:55:14.716919 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1165/2349] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:14 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:14.926782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:14.927876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:14.948131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.950832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.951920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.954053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.971715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:14.973358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:14.986766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.988083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:14.992138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:14.995194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.446480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:15.464589 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6aba6bf1-ea82-4393-9b93-36f02b2f3dca tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.542245 Dec 18 20:55:15.470731 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1185/2350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:14 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:15.475824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c212912b-0824-4a1a-9af2-3f86ea9ca298 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f7161352e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:15.567416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c212912b-0824-4a1a-9af2-3f86ea9ca298 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.095761 Dec 18 20:55:15.568344 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1186/2351] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:15 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:15.575357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-33279dc1-5ecc-41c5-8474-b1316888f65e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:15.581252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-33279dc1-5ecc-41c5-8474-b1316888f65e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:15.586831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:15.591112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33279dc1-5ecc-41c5-8474-b1316888f65e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.591868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33279dc1-5ecc-41c5-8474-b1316888f65e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.592930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33279dc1-5ecc-41c5-8474-b1316888f65e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.593553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33279dc1-5ecc-41c5-8474-b1316888f65e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.602210 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9454c53a-44ed-44cb-82bf-001136e3fd12 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.636868 Dec 18 20:55:15.612671 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1166/2352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:14 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:15.625907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:15.629577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:15.649125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.652804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.653607 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-33279dc1-5ecc-41c5-8474-b1316888f65e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.081467 Dec 18 20:55:15.655124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.655534 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1187/2353] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:15 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:15.657485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.669301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-583dd1a5-e76d-4a6d-beaf-18e446d180c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:15.670545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-583dd1a5-e76d-4a6d-beaf-18e446d180c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:15.683194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-583dd1a5-e76d-4a6d-beaf-18e446d180c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.687315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-583dd1a5-e76d-4a6d-beaf-18e446d180c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.692360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-583dd1a5-e76d-4a6d-beaf-18e446d180c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.694795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-583dd1a5-e76d-4a6d-beaf-18e446d180c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.812038 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-583dd1a5-e76d-4a6d-beaf-18e446d180c6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.154630 Dec 18 20:55:15.814066 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1188/2354] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:15 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:15.828737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:15.829590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:15.844404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.845342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.846448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:15.847120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:15.933141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:15.952059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96f96ae2-8741-4186-a636-8cefd76b877d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.337933 Dec 18 20:55:15.962140 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1167/2355] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:15 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:16.257137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:16.268645 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f02a1c5d-fdf3-43d9-8072-bdd48324758c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 0.448272 Dec 18 20:55:16.269558 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1189/2356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:15 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:16.488549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:16.495214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:16.505149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:16.506005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:16.507654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:16.510905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:16.584900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ecbcfe76-8d7c-4210-872e-5f5893c71efa tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613b9c10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:16.682085 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ecbcfe76-8d7c-4210-872e-5f5893c71efa tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.103710 Dec 18 20:55:16.683232 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1190/2357] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:16 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:16.688539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:16.689433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:16.696559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:16.697122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:16.698087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:16.698781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:16.900105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:16.910120 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7935cad2-47e2-4aab-9e9a-4b28b3a747dc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.425609 Dec 18 20:55:16.916954 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1168/2358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:16 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:16.932994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cd31d2ea-3bbb-45bc-a48c-b47467ff3336 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:16.936521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd31d2ea-3bbb-45bc-a48c-b47467ff3336 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:16.961473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31d2ea-3bbb-45bc-a48c-b47467ff3336 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:16.961838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31d2ea-3bbb-45bc-a48c-b47467ff3336 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:16.975743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31d2ea-3bbb-45bc-a48c-b47467ff3336 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:16.976214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31d2ea-3bbb-45bc-a48c-b47467ff3336 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:16.998755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:17.006983 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41aafc24-f2fe-4cc2-bef4-a9707aa1f0c5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1512 microversion: 2.1 time: 0.322150 Dec 18 20:55:17.019271 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1191/2359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:16 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:17.019271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71589990-ce26-4a81-8835-fb7d215ec0fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:17.019271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71589990-ce26-4a81-8835-fb7d215ec0fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:17.050464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71589990-ce26-4a81-8835-fb7d215ec0fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:17.050939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71589990-ce26-4a81-8835-fb7d215ec0fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:17.054007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71589990-ce26-4a81-8835-fb7d215ec0fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:17.054500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71589990-ce26-4a81-8835-fb7d215ec0fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:17.063703 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cd31d2ea-3bbb-45bc-a48c-b47467ff3336 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.144979 Dec 18 20:55:17.064609 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1169/2360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:16 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:17.082360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:17.087159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:17.120559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:17.121039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:17.129293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:17.129764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:17.134568 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71589990-ce26-4a81-8835-fb7d215ec0fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.121978 Dec 18 20:55:17.148724 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1192/2361] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:17 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:17.287274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:17.288463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:17.307554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:17.308335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:17.309819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:17.311174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.236389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:18.253382 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81ad5c47-a4bb-48ce-bfa4-9af1a7967d98 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 1.185614 Dec 18 20:55:18.264386 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1170/2362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:17 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:18.278713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b4dd34c-45fd-480e-892e-dc0217ecc14d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f7161368280>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:18.307773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:18.321686 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-446f42d4-e034-4599-a59d-dd0381e3b0e5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 1.039036 Dec 18 20:55:18.335479 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1193/2363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:17 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:18.354977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:18.355662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:18.375426 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b4dd34c-45fd-480e-892e-dc0217ecc14d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.109476 Dec 18 20:55:18.376358 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1171/2364] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:18 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:18.385321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.386547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:18.387301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.388134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:18.391065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.391800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.401135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.404946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.407329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.411329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.662229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:18.670873 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60b814ff-4f22-418a-bb76-c99e6686595a tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.331761 Dec 18 20:55:18.676943 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1194/2365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:18 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:18.682279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9fa8f748-13f6-42bc-b75e-84f4949e9d85 req-9fb26a01-ddab-4722-b15b-32b9a1f03379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93280f-4987-4eea-b229-7cc365db43ff", "name": "network-vif-plugged", "status": "completed", "tag": "2b8e5c57-7646-45bc-8bdf-d19b316188ed"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:18.686615 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:18.686615 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:55:18.701431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9fa8f748-13f6-42bc-b75e-84f4949e9d85 req-9fb26a01-ddab-4722-b15b-32b9a1f03379 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.702302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9fa8f748-13f6-42bc-b75e-84f4949e9d85 req-9fb26a01-ddab-4722-b15b-32b9a1f03379 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.717594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:18.724416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9fa8f748-13f6-42bc-b75e-84f4949e9d85 req-9fb26a01-ddab-4722-b15b-32b9a1f03379 service nova] Creating event network-vif-plugged:2b8e5c57-7646-45bc-8bdf-d19b316188ed for instance bd93280f-4987-4eea-b229-7cc365db43ff on nch1-master-1 Dec 18 20:55:18.726293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-036b3fe1-d448-4e1e-adc9-cc880c1395dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1489 microversion: 2.1 time: 0.348535 Dec 18 20:55:18.726904 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1172/2366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:18 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1489 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:18.736418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fbf93a4d-8aa1-4619-87d6-56efec430538 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:18.740343 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9fa8f748-13f6-42bc-b75e-84f4949e9d85 req-9fb26a01-ddab-4722-b15b-32b9a1f03379 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061233 Dec 18 20:55:18.750069 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1195/2367] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:18.755448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cbc3dca3-216f-4280-bb21-6916759d47f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:18.756235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fbf93a4d-8aa1-4619-87d6-56efec430538 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:18.759295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cbc3dca3-216f-4280-bb21-6916759d47f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:18.768593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbf93a4d-8aa1-4619-87d6-56efec430538 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.771126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbf93a4d-8aa1-4619-87d6-56efec430538 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.773788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc3dca3-216f-4280-bb21-6916759d47f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.774920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbf93a4d-8aa1-4619-87d6-56efec430538 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.775551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbf93a4d-8aa1-4619-87d6-56efec430538 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.777926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc3dca3-216f-4280-bb21-6916759d47f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.778777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc3dca3-216f-4280-bb21-6916759d47f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.782340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbc3dca3-216f-4280-bb21-6916759d47f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.853308 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fbf93a4d-8aa1-4619-87d6-56efec430538 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.120221 Dec 18 20:55:18.862008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1173/2368] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:18 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:18.868491 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cbc3dca3-216f-4280-bb21-6916759d47f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.116820 Dec 18 20:55:18.870760 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1196/2369] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:18 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:18.873111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c6939d2-a71f-4773-b75c-512e74d4c641 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:18.874449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c6939d2-a71f-4773-b75c-512e74d4c641 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:18.884134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6939d2-a71f-4773-b75c-512e74d4c641 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.884947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6939d2-a71f-4773-b75c-512e74d4c641 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.885959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6939d2-a71f-4773-b75c-512e74d4c641 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.886596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c6939d2-a71f-4773-b75c-512e74d4c641 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.953731 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c6939d2-a71f-4773-b75c-512e74d4c641 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 200 len: 149 microversion: 2.1 time: 0.086587 Dec 18 20:55:18.955421 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1174/2370] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:18 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 149 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:18.970954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:18.971890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:18.992741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.994900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:18.996842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:18.999219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:19.271312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:19.272617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:19.303084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:19.303585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:19.304454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:19.314650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:19.322902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:19.352717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b99bd29-31f0-4d74-a798-4dd53716dbc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.389335 Dec 18 20:55:19.360950 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1197/2371] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:18 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:19.380534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:19.382703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:19.399993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:19.402830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:19.406067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:19.406771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:19.844209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:19.855395 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f052219-956c-44b5-825d-be3e141d1c6f tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.587913 Dec 18 20:55:19.865346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1175/2372] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:19 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:19.871174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:19.871960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:19.874095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:19.880539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:19.881199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:19.882979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:19.884584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:19.885916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-de1f2b79-1cb1-41b2-8e6a-76c4e08fab1a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1317 microversion: 2.1 time: 0.522447 Dec 18 20:55:19.887182 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1198/2373] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:19 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:19.900028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af52d5ca-5cca-41fa-b50f-1f58d7e2cc8c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714fb1a8b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:19.990655 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af52d5ca-5cca-41fa-b50f-1f58d7e2cc8c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.101877 Dec 18 20:55:19.996768 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1199/2374] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:19 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:20.002829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:20.003765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:20.011975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.012699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.013662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.014371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.439406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:20.449410 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0270d409-f434-42ae-a7db-62873adf1e17 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.582019 Dec 18 20:55:20.452864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1176/2375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:19 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:20.461303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fad324b2-cd72-4131-8a1b-cf4485e47789 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:20.462809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fad324b2-cd72-4131-8a1b-cf4485e47789 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:20.477138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad324b2-cd72-4131-8a1b-cf4485e47789 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.478050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad324b2-cd72-4131-8a1b-cf4485e47789 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.479255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad324b2-cd72-4131-8a1b-cf4485e47789 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.480041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fad324b2-cd72-4131-8a1b-cf4485e47789 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.528366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:20.544520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fed83d75-d555-4bc2-97bc-1c2793d2fd09 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.546474 Dec 18 20:55:20.549371 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1200/2376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:19 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:20.557404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52a620f7-9e4a-4aff-9174-c9f06e25f03c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:20.569421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52a620f7-9e4a-4aff-9174-c9f06e25f03c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:20.582692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a620f7-9e4a-4aff-9174-c9f06e25f03c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.583294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a620f7-9e4a-4aff-9174-c9f06e25f03c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.584118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a620f7-9e4a-4aff-9174-c9f06e25f03c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.584651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a620f7-9e4a-4aff-9174-c9f06e25f03c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.591512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fad324b2-cd72-4131-8a1b-cf4485e47789 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.137045 Dec 18 20:55:20.592157 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1177/2377] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:20 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:20.617387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1152299307", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b682fe11-354f-40ac-961b-a0ccac207599"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:20.704542 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52a620f7-9e4a-4aff-9174-c9f06e25f03c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.153468 Dec 18 20:55:20.708301 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1201/2378] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:20 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:20.725588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] validate_networks() for [('b682fe11-354f-40ac-961b-a0ccac207599', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:55:20.768295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e678e586-1da5-49dc-bcc9-c549e46d5c1c req-3d3b4ca5-a52e-4ece-941e-845434bbca2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f709f32-beb6-4558-8d64-0d56d0981842", "name": "network-vif-plugged", "status": "completed", "tag": "53d8cf94-d048-4858-b43d-3d641ffb86d5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:20.770078 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:20.770078 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:55:20.789652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e678e586-1da5-49dc-bcc9-c549e46d5c1c req-3d3b4ca5-a52e-4ece-941e-845434bbca2d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.790344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e678e586-1da5-49dc-bcc9-c549e46d5c1c req-3d3b4ca5-a52e-4ece-941e-845434bbca2d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.809694 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e678e586-1da5-49dc-bcc9-c549e46d5c1c req-3d3b4ca5-a52e-4ece-941e-845434bbca2d service nova] Creating event network-vif-plugged:53d8cf94-d048-4858-b43d-3d641ffb86d5 for instance 6f709f32-beb6-4558-8d64-0d56d0981842 on nch2-master-1 Dec 18 20:55:20.816706 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e678e586-1da5-49dc-bcc9-c549e46d5c1c req-3d3b4ca5-a52e-4ece-941e-845434bbca2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056453 Dec 18 20:55:20.818946 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1202/2379] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:20.880945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:20.883127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:20.901732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.923175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:20.932490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:20.935213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.306719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:21.321232 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ecb0781-5bff-479b-b831-e0b7870c2757 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.450540 Dec 18 20:55:21.322745 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1203/2380] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:20 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:21.327269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:21.327860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:21.354024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.361009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.365136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.365683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.695157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:21.715096 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-27e5aa99-7b12-451e-a78a-7cbbe25d913d tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1467 microversion: 2.1 time: 0.391131 Dec 18 20:55:21.718310 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1204/2381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:21 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1467 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:21.724869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:55:21.725403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:55:21.725960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:55:21.726575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:55:21.727251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:55:21.729041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ce2151d-c3cc-47e4-b288-b5d2859595d8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714f5cb550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:21.758954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.764754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.771699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.774805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.820323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:55:21.829338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for user ebd83848fe8d4e7284291660eb51da51 and project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:55:21.836588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ce2151d-c3cc-47e4-b288-b5d2859595d8 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1411 microversion: 2.1 time: 0.111601 Dec 18 20:55:21.837326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1205/2382] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:21 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1411 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:21.847932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:21.850231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:21.856127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:55:21.868887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.869468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.872096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:55:21.873666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.874331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.945860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d19c24a-b597-4d31-b85a-b28e81ff2186 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.332623 Dec 18 20:55:21.946883 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1178/2383] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:55:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 20:55:21.951674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18f68b58-3e56-421b-ab06-caa76557eb8c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:21.953303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-18f68b58-3e56-421b-ab06-caa76557eb8c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:21.960162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18f68b58-3e56-421b-ab06-caa76557eb8c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.960907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18f68b58-3e56-421b-ab06-caa76557eb8c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:21.962976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18f68b58-3e56-421b-ab06-caa76557eb8c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:21.963611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18f68b58-3e56-421b-ab06-caa76557eb8c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:22.088325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:22.097448 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18f68b58-3e56-421b-ab06-caa76557eb8c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.148836 Dec 18 20:55:22.102139 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-85a0189f-be15-4a5e-8ca1-5a704439e826 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.260745 Dec 18 20:55:22.112261 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1179/2384] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:21 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:22.117988 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1206/2385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:21 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:22.126091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:22.127194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:22.134513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6a5ae0f-9111-42cd-9552-ded9c88f36e4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:22.149387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:22.150047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6a5ae0f-9111-42cd-9552-ded9c88f36e4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:22.150180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:22.151141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:22.151591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:22.157160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6a5ae0f-9111-42cd-9552-ded9c88f36e4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:22.157661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6a5ae0f-9111-42cd-9552-ded9c88f36e4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:22.158497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6a5ae0f-9111-42cd-9552-ded9c88f36e4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:22.158972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6a5ae0f-9111-42cd-9552-ded9c88f36e4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:22.236011 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6a5ae0f-9111-42cd-9552-ded9c88f36e4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.127136 Dec 18 20:55:22.250615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1180/2386] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:22 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:22.256478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-469c2de2-ff59-479d-a74c-399ca7281b72 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:22.257989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-469c2de2-ff59-479d-a74c-399ca7281b72 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:22.453631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-469c2de2-ff59-479d-a74c-399ca7281b72 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:22.464780 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-469c2de2-ff59-479d-a74c-399ca7281b72 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1215 microversion: 2.1 time: 0.210925 Dec 18 20:55:22.481283 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1181/2387] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:22 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:22.491540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:22.494519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:22.508638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:22.509073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:22.511512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:22.513145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:22.564525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:22.584363 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3876849-1a97-48dc-93c6-e8cce83274d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 1317 microversion: 2.1 time: 0.461769 Dec 18 20:55:22.595425 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1207/2388] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:22 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:22.823046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:22.835024 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-645925bc-8f5f-4e49-ac56-741e65795c89 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.349828 Dec 18 20:55:22.836700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1182/2389] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:22 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:22.852278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d2bb653-3be4-4203-9102-dc4b7d35c457 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613bdb80>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:22.934215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d2bb653-3be4-4203-9102-dc4b7d35c457 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1420 microversion: 2.1 time: 0.087759 Dec 18 20:55:22.934881 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1208/2390] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:22 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:22.950471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dff79467-d7a3-4b10-ac79-66b6436c249f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71614c5310>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:23.032882 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dff79467-d7a3-4b10-ac79-66b6436c249f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 200 len: 1420 microversion: 2.1 time: 0.088102 Dec 18 20:55:23.034783 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1183/2391] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:22 2021] GET /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:23.047077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee1714f8-3ee0-43cf-a7db-daa8ac5bf371 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613654c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:23.120711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:23.121336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:23.129128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.129778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.130636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.131080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.367838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:23.376511 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64de198d-9905-40b5-a90a-c34a73a5de43 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.260725 Dec 18 20:55:23.377116 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1184/2392] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:23 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:23.383084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11fe9934-821e-4f8d-bd24-13180a3cc975 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:23.384151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11fe9934-821e-4f8d-bd24-13180a3cc975 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:23.398877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11fe9934-821e-4f8d-bd24-13180a3cc975 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.399322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11fe9934-821e-4f8d-bd24-13180a3cc975 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.400450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11fe9934-821e-4f8d-bd24-13180a3cc975 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.401068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11fe9934-821e-4f8d-bd24-13180a3cc975 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.492635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11fe9934-821e-4f8d-bd24-13180a3cc975 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.112823 Dec 18 20:55:23.498345 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1185/2393] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:23 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:23.508968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2eaba9e2-4bd9-4c8b-ab26-700994a8e933 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:23.510356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2eaba9e2-4bd9-4c8b-ab26-700994a8e933 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:23.524987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eaba9e2-4bd9-4c8b-ab26-700994a8e933 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.525614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eaba9e2-4bd9-4c8b-ab26-700994a8e933 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.526642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eaba9e2-4bd9-4c8b-ab26-700994a8e933 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.527343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eaba9e2-4bd9-4c8b-ab26-700994a8e933 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.622997 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2eaba9e2-4bd9-4c8b-ab26-700994a8e933 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.121594 Dec 18 20:55:23.624585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1186/2394] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:23 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:23.633774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:23.636177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:23.649029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.649510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.654375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.655659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.832422 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee1714f8-3ee0-43cf-a7db-daa8ac5bf371 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 204 len: 0 microversion: 2.1 time: 0.789796 Dec 18 20:55:23.832998 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1209/2395] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:23 2021] DELETE /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:55:23.839718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:23.840636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:23.857128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.858032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.864472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:23.865397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:23.989155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:24.003463 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-290e3132-712e-4ae3-85c1-c63e0b39e3f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1267 microversion: 2.1 time: 0.377101 Dec 18 20:55:24.004196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1187/2396] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:23 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1267 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:24.018320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:24.019179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:24.031936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:24.032486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:24.033397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:24.033836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:24.080429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:55:24.187178 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f65114fb-47ee-48bd-aa15-24d1118cee37 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 204 len: 0 microversion: 2.1 time: 0.180220 Dec 18 20:55:24.191927 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1188/2397] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:55:24 2021] DELETE /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:55:24.233986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:24.238819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:24.254385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:24.255290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:24.255762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:24.256531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:24.404257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:24.419425 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5dbcbbf6-5f92-401f-926e-f7c3845f96c1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 1467 microversion: 2.1 time: 0.584937 Dec 18 20:55:24.420957 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1210/2398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:23 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 1467 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:24.426707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-137874502", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b4249639-6520-4b9d-908b-e792b10734b1"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:24.492758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] validate_networks() for [('b4249639-6520-4b9d-908b-e792b10734b1', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:55:24.802123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:24.813911 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-734af609-9cba-4313-a9e7-26278c4efeea tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.619849 Dec 18 20:55:24.815061 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1189/2399] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:24 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:24.845855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:24.849520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:24.867016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:24.867628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:24.869304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:24.871330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:25.362867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:25.377145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-634c3d2a-fe34-45be-abb3-0ceb0576e5a3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.560775 Dec 18 20:55:25.387794 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1190/2400] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:24 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:25.393154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0965d41e-0450-49e3-9182-66071a55f348 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1128626813"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:25.394690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0965d41e-0450-49e3-9182-66071a55f348 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:25.404654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0965d41e-0450-49e3-9182-66071a55f348 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:25.405412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0965d41e-0450-49e3-9182-66071a55f348 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:25.406784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0965d41e-0450-49e3-9182-66071a55f348 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:25.411726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0965d41e-0450-49e3-9182-66071a55f348 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:25.845672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0965d41e-0450-49e3-9182-66071a55f348 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "POST /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842/action" status: 202 len: 0 microversion: 2.1 time: 0.454038 Dec 18 20:55:25.847628 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1191/2401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:25 2021] POST /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:55:25.860275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5b7ccdef-8abb-4218-9c9a-8f1ecb848500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:25.861991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5b7ccdef-8abb-4218-9c9a-8f1ecb848500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:25.872695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b7ccdef-8abb-4218-9c9a-8f1ecb848500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:25.873747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b7ccdef-8abb-4218-9c9a-8f1ecb848500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:25.875270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b7ccdef-8abb-4218-9c9a-8f1ecb848500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:25.875938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b7ccdef-8abb-4218-9c9a-8f1ecb848500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:25.952153 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5b7ccdef-8abb-4218-9c9a-8f1ecb848500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.095864 Dec 18 20:55:25.954371 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1192/2402] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:25 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:25.965899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35ffc282-e624-4812-a2aa-8f3b2d43f351 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:25.969768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35ffc282-e624-4812-a2aa-8f3b2d43f351 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:25.993728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35ffc282-e624-4812-a2aa-8f3b2d43f351 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:25.993728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35ffc282-e624-4812-a2aa-8f3b2d43f351 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:25.993728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35ffc282-e624-4812-a2aa-8f3b2d43f351 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:25.993728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35ffc282-e624-4812-a2aa-8f3b2d43f351 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.074794 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35ffc282-e624-4812-a2aa-8f3b2d43f351 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.115408 Dec 18 20:55:26.077367 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1193/2403] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:25 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:26.084270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:26.085630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:26.094342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.094885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.095716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.096820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.297522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:26.321236 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aaa1a1a5-298e-42d9-a4c5-17bce57df95a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1273 microversion: 2.1 time: 0.241378 Dec 18 20:55:26.325081 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1194/2404] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:26 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:26.339402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8decdb68-8770-4d04-9723-89ae6a6b6e44 req-b0bcbefd-4a5b-44d4-8c5d-9bce9e9d8093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fffd39-f05f-4540-8067-b4528d22357a", "name": "network-vif-unplugged", "status": "completed", "tag": "89de2c2f-41bf-4b1d-8047-873c576b5419"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:26.344416 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:26.344416 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:26.354243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8decdb68-8770-4d04-9723-89ae6a6b6e44 req-b0bcbefd-4a5b-44d4-8c5d-9bce9e9d8093 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.355296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8decdb68-8770-4d04-9723-89ae6a6b6e44 req-b0bcbefd-4a5b-44d4-8c5d-9bce9e9d8093 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.373122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8decdb68-8770-4d04-9723-89ae6a6b6e44 req-b0bcbefd-4a5b-44d4-8c5d-9bce9e9d8093 service nova] Creating event network-vif-unplugged:89de2c2f-41bf-4b1d-8047-873c576b5419 for instance 89fffd39-f05f-4540-8067-b4528d22357a on nch1-master-1 Dec 18 20:55:26.382865 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8decdb68-8770-4d04-9723-89ae6a6b6e44 req-b0bcbefd-4a5b-44d4-8c5d-9bce9e9d8093 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053523 Dec 18 20:55:26.383860 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1195/2405] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:26.400370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:26.400614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:26.409825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.410414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.412654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.412654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.423101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:55:26.423670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:55:26.423985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:55:26.424396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:55:26.424815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:55:26.449402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.453888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.455146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.456384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.512371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:55:26.527866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for user 216cd2c0d4b249e797990918152b4749 and project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:55:26.575155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:55:26.582290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:55:26.696543 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7859bcf-b67f-4014-ae4c-f84d2be0b97c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.262598 Dec 18 20:55:26.700635 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1211/2406] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:55:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:55:26.716005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-94f0103c-e53b-42c0-9609-52bcd4a4cde1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716132a670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:26.822908 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-94f0103c-e53b-42c0-9609-52bcd4a4cde1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.120846 Dec 18 20:55:26.829219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1212/2407] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:26 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:26.834160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:26.838045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:26.861197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.861899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.863309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:26.864120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:26.986828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:27.020353 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd4f576e-0182-466c-8e8c-319aae30c816 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.632072 Dec 18 20:55:27.024169 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1196/2408] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:26 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:27.050318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d5fa79a-9071-4ccf-bb3b-fa4c27b671cd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:27.052457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8d5fa79a-9071-4ccf-bb3b-fa4c27b671cd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:27.256926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8d5fa79a-9071-4ccf-bb3b-fa4c27b671cd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:27.273332 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8d5fa79a-9071-4ccf-bb3b-fa4c27b671cd tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1207 microversion: 2.1 time: 0.247327 Dec 18 20:55:27.275461 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1197/2409] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:27 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1207 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:27.283888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e848de0b-887a-41a9-8dde-cf106fb1c111 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:27.285191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e848de0b-887a-41a9-8dde-cf106fb1c111 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:27.314093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e848de0b-887a-41a9-8dde-cf106fb1c111 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:27.315853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e848de0b-887a-41a9-8dde-cf106fb1c111 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:27.317950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e848de0b-887a-41a9-8dde-cf106fb1c111 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:27.319262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e848de0b-887a-41a9-8dde-cf106fb1c111 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:27.398751 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e848de0b-887a-41a9-8dde-cf106fb1c111 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.117973 Dec 18 20:55:27.401083 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1198/2410] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:27 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:27.407465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4e99a12-a8fc-469c-b5d2-fe532a347173 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:27.409314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4e99a12-a8fc-469c-b5d2-fe532a347173 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:27.410926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:27.417191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99a12-a8fc-469c-b5d2-fe532a347173 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:27.417827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99a12-a8fc-469c-b5d2-fe532a347173 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:27.418648 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b308f5bc-821b-474f-b463-8ea3ffc244a2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.588369 Dec 18 20:55:27.419064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99a12-a8fc-469c-b5d2-fe532a347173 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:27.420109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4e99a12-a8fc-469c-b5d2-fe532a347173 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:27.422471 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1213/2411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:26 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:27.434581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:27.436835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:27.449024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:27.452437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:27.454289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:27.455024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:27.486713 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4e99a12-a8fc-469c-b5d2-fe532a347173 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.083571 Dec 18 20:55:27.488964 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1199/2412] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:27 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:27.756823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:27.781577 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a99f88d8-7cf1-4e6e-b675-771c4f91c17c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.357667 Dec 18 20:55:27.782831 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1214/2413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:27 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:27.839663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d336408-be0d-4358-ad2b-12a59c81bcaf tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613b23a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:27.906364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d336408-be0d-4358-ad2b-12a59c81bcaf tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.072942 Dec 18 20:55:27.915104 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1200/2414] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:27 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:28.040981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:28.043538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:28.059158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.059623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.062156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.064243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.126637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-03151994-ac96-4bd2-b77c-413ae558bff4 req-b943e88e-49b1-4325-8d79-90bbaa41c9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fffd39-f05f-4540-8067-b4528d22357a", "name": "network-vif-deleted", "tag": "89de2c2f-41bf-4b1d-8047-873c576b5419"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:28.129525 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:28.129525 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:28.142094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-03151994-ac96-4bd2-b77c-413ae558bff4 req-b943e88e-49b1-4325-8d79-90bbaa41c9b5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.143177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-03151994-ac96-4bd2-b77c-413ae558bff4 req-b943e88e-49b1-4325-8d79-90bbaa41c9b5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.180707 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-03151994-ac96-4bd2-b77c-413ae558bff4 req-b943e88e-49b1-4325-8d79-90bbaa41c9b5 service nova] Creating event network-vif-deleted:89de2c2f-41bf-4b1d-8047-873c576b5419 for instance 89fffd39-f05f-4540-8067-b4528d22357a on nch1-master-1 Dec 18 20:55:28.202487 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-03151994-ac96-4bd2-b77c-413ae558bff4 req-b943e88e-49b1-4325-8d79-90bbaa41c9b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081826 Dec 18 20:55:28.203861 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1201/2415] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:28.294056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:28.294895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:28.311261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.311631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.313554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.313935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.377374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:28.386071 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-346fba34-eb7e-4475-8810-88d617d94e5e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.349895 Dec 18 20:55:28.390369 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1215/2416] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:28 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:28.416296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5791e113-182d-4529-b3ad-a536ecf5ec0c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:28.417493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5791e113-182d-4529-b3ad-a536ecf5ec0c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:28.431140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5791e113-182d-4529-b3ad-a536ecf5ec0c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.432357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5791e113-182d-4529-b3ad-a536ecf5ec0c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.433620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5791e113-182d-4529-b3ad-a536ecf5ec0c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.434180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5791e113-182d-4529-b3ad-a536ecf5ec0c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.441486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:28.453674 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b6b51e3f-eb17-4974-900f-c44882bd39f0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1259 microversion: 2.1 time: 0.164575 Dec 18 20:55:28.454404 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1202/2417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:28 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:28.464149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:28.464149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:28.471046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.471502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.472431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.472873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.518946 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5791e113-182d-4529-b3ad-a536ecf5ec0c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.110894 Dec 18 20:55:28.523597 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1216/2418] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:28 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:28.531881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf05d261-d592-43b7-81c6-0780f196bf32 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:28.533226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf05d261-d592-43b7-81c6-0780f196bf32 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:28.544819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf05d261-d592-43b7-81c6-0780f196bf32 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.545357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf05d261-d592-43b7-81c6-0780f196bf32 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.548000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf05d261-d592-43b7-81c6-0780f196bf32 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.548803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf05d261-d592-43b7-81c6-0780f196bf32 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.616825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf05d261-d592-43b7-81c6-0780f196bf32 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.090813 Dec 18 20:55:28.618218 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1217/2419] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:28 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:28.719000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3e538642-8908-49ff-be30-d1a6f9fefa1b req-27caf2ee-9cf4-431a-b780-113aa500780a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0093720e-0f18-4f7f-81a6-51de2283143e", "tag": "dcd26d53-013a-41a0-b028-6f833c1afdf4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:28.720546 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:28.720546 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:55:28.735477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3e538642-8908-49ff-be30-d1a6f9fefa1b req-27caf2ee-9cf4-431a-b780-113aa500780a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.738912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3e538642-8908-49ff-be30-d1a6f9fefa1b req-27caf2ee-9cf4-431a-b780-113aa500780a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.773916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3e538642-8908-49ff-be30-d1a6f9fefa1b req-27caf2ee-9cf4-431a-b780-113aa500780a service nova] Creating event network-changed:dcd26d53-013a-41a0-b028-6f833c1afdf4 for instance 0093720e-0f18-4f7f-81a6-51de2283143e on nch2-master-1 Dec 18 20:55:28.786242 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3e538642-8908-49ff-be30-d1a6f9fefa1b req-27caf2ee-9cf4-431a-b780-113aa500780a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071648 Dec 18 20:55:28.787161 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1218/2420] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:55:28.808179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:28.809395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:28.827687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.828186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:28.829013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:28.829450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.280533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:29.295208 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59632bf5-e06e-4606-881a-501c94b28429 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.839067 Dec 18 20:55:29.296408 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1203/2421] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:28 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:29.304424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d629cdbf-826c-407c-b88f-4fe846be956f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614c5ca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:29.372946 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d629cdbf-826c-407c-b88f-4fe846be956f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.074982 Dec 18 20:55:29.373813 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1204/2422] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:29 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:29.408485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:29.409371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:29.417972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.418467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.419361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.420043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.488544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:29.508422 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48a827d2-a94d-448a-84c1-b01f24cfa0a4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.699855 Dec 18 20:55:29.510987 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1219/2423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:28 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:29.524553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:29.526630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:29.535454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.536580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.538947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.539840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.646209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:29.661019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9ed6ddf-582c-4a52-9558-7626621e62a1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1265 microversion: 2.1 time: 0.147287 Dec 18 20:55:29.674153 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1220/2424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:29 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:29.682442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce1302af-cf30-4936-ae47-ad6001d98f4c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:29.684902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce1302af-cf30-4936-ae47-ad6001d98f4c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:29.692373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1302af-cf30-4936-ae47-ad6001d98f4c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.694468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1302af-cf30-4936-ae47-ad6001d98f4c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.696507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1302af-cf30-4936-ae47-ad6001d98f4c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.697158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce1302af-cf30-4936-ae47-ad6001d98f4c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.783746 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce1302af-cf30-4936-ae47-ad6001d98f4c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.107716 Dec 18 20:55:29.785125 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1221/2425] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:29 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:29.792917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b62896e-0213-450f-af78-9231f33ee0ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:29.795027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b62896e-0213-450f-af78-9231f33ee0ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:29.804465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b62896e-0213-450f-af78-9231f33ee0ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.805986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b62896e-0213-450f-af78-9231f33ee0ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.807127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b62896e-0213-450f-af78-9231f33ee0ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:29.807840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b62896e-0213-450f-af78-9231f33ee0ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:29.888155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b62896e-0213-450f-af78-9231f33ee0ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.101069 Dec 18 20:55:29.896641 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1222/2426] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:29 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:30.070484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:30.083296 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03aff33d-8797-4ae4-a874-f9e861171ddb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.678565 Dec 18 20:55:30.094981 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1205/2427] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:29 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:30.315830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:30.316473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:30.336763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:30.339081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:30.341126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:30.343489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:30.386984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2faf85da-1f51-4e04-a8a8-9dde43791da2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716149ef70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:30.455752 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2faf85da-1f51-4e04-a8a8-9dde43791da2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.072799 Dec 18 20:55:30.458111 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1206/2428] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:30 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:30.527767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:30.528879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:30.536571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:30.538133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:30.539465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:30.540273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:30.842613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:30.856592 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-019c1674-0f90-4981-99e2-81d234d0d0e2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.546447 Dec 18 20:55:30.858400 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1223/2429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:30 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:30.873818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:30.876741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:30.900745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:30.901338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:30.902399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:30.903098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.018188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:31.032825 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e90f4093-a3f7-4b8a-a83f-a8f824b6a8e5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.509256 Dec 18 20:55:31.037140 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1207/2430] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:30 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:31.048806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1d5421c-2925-4112-a3e6-5f35864f40e9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:31.050152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1d5421c-2925-4112-a3e6-5f35864f40e9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:31.065170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1d5421c-2925-4112-a3e6-5f35864f40e9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.067884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1d5421c-2925-4112-a3e6-5f35864f40e9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.072084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1d5421c-2925-4112-a3e6-5f35864f40e9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.073596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1d5421c-2925-4112-a3e6-5f35864f40e9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.184629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d1d5421c-2925-4112-a3e6-5f35864f40e9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.145285 Dec 18 20:55:31.185613 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1208/2431] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:31 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:31.199622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccee1ddd-4b47-4c98-b049-ce327c098b31 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:31.202747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccee1ddd-4b47-4c98-b049-ce327c098b31 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:31.230002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccee1ddd-4b47-4c98-b049-ce327c098b31 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.234687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccee1ddd-4b47-4c98-b049-ce327c098b31 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.241967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccee1ddd-4b47-4c98-b049-ce327c098b31 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.242675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccee1ddd-4b47-4c98-b049-ce327c098b31 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.338112 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccee1ddd-4b47-4c98-b049-ce327c098b31 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.150340 Dec 18 20:55:31.341547 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1209/2432] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:31 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:31.366305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:31.370504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:31.387289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.387781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.392836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.394578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.509659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:31.527361 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-376d905c-4d3c-4d51-b33e-75f7d74b5b27 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.666629 Dec 18 20:55:31.531470 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1224/2433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:30 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:31.544727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fafceb03-ee3c-435d-8260-b649b13992f8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613b9ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:31.621995 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fafceb03-ee3c-435d-8260-b649b13992f8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.087553 Dec 18 20:55:31.623314 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1225/2434] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:31 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:31.876313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:31.877086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:31.886309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.886722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:31.894225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:31.897490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:32.540397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:32.563176 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac4ab626-35f4-4d0a-8389-689f65f7a55b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 1.217903 Dec 18 20:55:32.577235 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1210/2435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:31 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:32.585226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8b920206-7123-4ff2-8043-8a09014d81ed req-8ee267e9-1edc-42e5-931d-c8e1908f881b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f709f32-beb6-4558-8d64-0d56d0981842", "name": "network-vif-plugged", "status": "completed", "tag": "53d8cf94-d048-4858-b43d-3d641ffb86d5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:32.589628 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:32.589628 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:32.605397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8b920206-7123-4ff2-8043-8a09014d81ed req-8ee267e9-1edc-42e5-931d-c8e1908f881b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:32.606219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8b920206-7123-4ff2-8043-8a09014d81ed req-8ee267e9-1edc-42e5-931d-c8e1908f881b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:32.622235 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8b920206-7123-4ff2-8043-8a09014d81ed req-8ee267e9-1edc-42e5-931d-c8e1908f881b service nova] Creating event network-vif-plugged:53d8cf94-d048-4858-b43d-3d641ffb86d5 for instance 6f709f32-beb6-4558-8d64-0d56d0981842 on nch2-master-1 Dec 18 20:55:32.629570 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8b920206-7123-4ff2-8043-8a09014d81ed req-8ee267e9-1edc-42e5-931d-c8e1908f881b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050099 Dec 18 20:55:32.631785 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1211/2436] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:32.643961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:32.645470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:32.654409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:32.655493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:32.656572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:32.657494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:32.905642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:32.922170 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07ba1a3c-f2d6-4b71-824b-1dfe95f1a3e3 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 1.046875 Dec 18 20:55:32.923045 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1226/2437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:31 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:32.950749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11684a03-ab32-43ac-b414-eca76f7e8299 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:32.955665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11684a03-ab32-43ac-b414-eca76f7e8299 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:32.971561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11684a03-ab32-43ac-b414-eca76f7e8299 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:32.981704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11684a03-ab32-43ac-b414-eca76f7e8299 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:32.983507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11684a03-ab32-43ac-b414-eca76f7e8299 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:32.986537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11684a03-ab32-43ac-b414-eca76f7e8299 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.074614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11684a03-ab32-43ac-b414-eca76f7e8299 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.138886 Dec 18 20:55:33.075765 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1227/2438] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:32 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:33.089989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0aa56ea8-892f-49d6-a9c6-a61d87c59c5b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:33.095524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0aa56ea8-892f-49d6-a9c6-a61d87c59c5b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:33.096958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:33.113971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa56ea8-892f-49d6-a9c6-a61d87c59c5b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.114577 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-33f21f18-ffe8-4e21-8a11-0e3fd68015ca tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.474273 Dec 18 20:55:33.114728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa56ea8-892f-49d6-a9c6-a61d87c59c5b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.115960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa56ea8-892f-49d6-a9c6-a61d87c59c5b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.116700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1212/2439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:32 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:33.131635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa56ea8-892f-49d6-a9c6-a61d87c59c5b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.134240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:33.135231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:33.161712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.163921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.165356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.169566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.235297 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0aa56ea8-892f-49d6-a9c6-a61d87c59c5b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.157933 Dec 18 20:55:33.237351 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1228/2440] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:33 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:33.252226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53b86e49-9fc5-492a-b4d3-7a6f148cb6b4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613a1c10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:33.358068 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53b86e49-9fc5-492a-b4d3-7a6f148cb6b4 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.119066 Dec 18 20:55:33.363987 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1229/2441] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:33 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:33.582516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:33.583411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:33.597120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.597664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.598537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.598978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.629852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:33.645529 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0eb480fa-2875-4647-aec7-24f62bd31584 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.523875 Dec 18 20:55:33.646349 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1213/2442] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:33 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:33.941174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:33.942235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:33.953593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.955632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:33.960369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:33.961139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.062628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:34.079089 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-665a5d24-0f7d-498c-8b77-9d1d7479f148 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.501315 Dec 18 20:55:34.090328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1230/2443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:33 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:34.103738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29b85e07-b272-4315-af24-ed20f8efc229 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:34.104995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29b85e07-b272-4315-af24-ed20f8efc229 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:34.121197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29b85e07-b272-4315-af24-ed20f8efc229 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.122359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29b85e07-b272-4315-af24-ed20f8efc229 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.124432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29b85e07-b272-4315-af24-ed20f8efc229 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.130675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29b85e07-b272-4315-af24-ed20f8efc229 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.313525 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-29b85e07-b272-4315-af24-ed20f8efc229 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.216263 Dec 18 20:55:34.325840 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1231/2444] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:34 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:34.364474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:34.365653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:34.389150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:34.389816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.391902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.397926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.399428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.413287 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-705017d4-45c3-494c-be11-180baa01e7c2 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.475024 Dec 18 20:55:34.416975 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1214/2445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:33 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:34.424615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5d7ec980-44ed-49b4-ab91-deb8bbc75067 req-a255b030-4e09-40ad-a44b-2a4a6bc2a441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9f6243-3663-449e-89e7-c1a511e9313d", "tag": "36011601-d6a5-4062-8c92-593078687bde"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:34.429067 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:34.429067 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:34.442895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5d7ec980-44ed-49b4-ab91-deb8bbc75067 req-a255b030-4e09-40ad-a44b-2a4a6bc2a441 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.444390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5d7ec980-44ed-49b4-ab91-deb8bbc75067 req-a255b030-4e09-40ad-a44b-2a4a6bc2a441 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.463438 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5d7ec980-44ed-49b4-ab91-deb8bbc75067 req-a255b030-4e09-40ad-a44b-2a4a6bc2a441 service nova] Creating event network-changed:36011601-d6a5-4062-8c92-593078687bde for instance bf9f6243-3663-449e-89e7-c1a511e9313d on nch2-master-1 Dec 18 20:55:34.492425 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5d7ec980-44ed-49b4-ab91-deb8bbc75067 req-a255b030-4e09-40ad-a44b-2a4a6bc2a441 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071776 Dec 18 20:55:34.495493 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1215/2446] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:34.512441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b19b7aad-a230-4ccf-a936-3c20c76aec6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:34.515865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b19b7aad-a230-4ccf-a936-3c20c76aec6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:34.525758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b19b7aad-a230-4ccf-a936-3c20c76aec6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.526642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b19b7aad-a230-4ccf-a936-3c20c76aec6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.528018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b19b7aad-a230-4ccf-a936-3c20c76aec6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.528698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b19b7aad-a230-4ccf-a936-3c20c76aec6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.605534 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b19b7aad-a230-4ccf-a936-3c20c76aec6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.104128 Dec 18 20:55:34.619590 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1216/2447] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:34 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:34.643063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcb5af0f-bdf9-467a-b4f7-fd0e48aede9f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714eb6d9d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:34.772812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcb5af0f-bdf9-467a-b4f7-fd0e48aede9f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.149008 Dec 18 20:55:34.775327 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1217/2448] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:34 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:34.792361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:34.794189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:34.811716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.814567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:34.816236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:34.819233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.157110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:35.171733 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ab53dde-9492-4b51-9653-40495d5c5341 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.833545 Dec 18 20:55:35.174636 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1232/2449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:34 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:35.197726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:35.199133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:35.217544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.218357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.221941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.222715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.414955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:35.426103 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52a74b10-17d3-4e7b-a6b0-5629e60b7eab tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.647811 Dec 18 20:55:35.441168 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1218/2450] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:34 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:35.441168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fcd9d10f-283e-41e4-b1fb-6f81a5291cfa tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:35.441168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fcd9d10f-283e-41e4-b1fb-6f81a5291cfa tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:35.446161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcd9d10f-283e-41e4-b1fb-6f81a5291cfa tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.446824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcd9d10f-283e-41e4-b1fb-6f81a5291cfa tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.447807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcd9d10f-283e-41e4-b1fb-6f81a5291cfa tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.448384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcd9d10f-283e-41e4-b1fb-6f81a5291cfa tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.497246 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fcd9d10f-283e-41e4-b1fb-6f81a5291cfa tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.066276 Dec 18 20:55:35.498615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1219/2451] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:35 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:35.507325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:35.510452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:35.521635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.522704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.523770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.524563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.668299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:35.679696 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53d8fb21-da29-46f8-8aba-fd0446bc2ae7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.493766 Dec 18 20:55:35.682619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1233/2452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:35 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:35.689574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c4992dc-e411-4bb8-bfe3-66ab2ae93dcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:35.695590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c4992dc-e411-4bb8-bfe3-66ab2ae93dcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:35.710034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c4992dc-e411-4bb8-bfe3-66ab2ae93dcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.720509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c4992dc-e411-4bb8-bfe3-66ab2ae93dcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.721799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c4992dc-e411-4bb8-bfe3-66ab2ae93dcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:35.722227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c4992dc-e411-4bb8-bfe3-66ab2ae93dcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:35.785055 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c4992dc-e411-4bb8-bfe3-66ab2ae93dcb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.100851 Dec 18 20:55:35.786065 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1234/2453] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:35 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:35.795044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c369c449-cec2-42ab-a708-35262b560816 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161365e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:35.917230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:35.931070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bdcd88bf-b3b5-4e54-9fcb-54e0f1323615 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.426721 Dec 18 20:55:35.942503 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1220/2454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:35 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:35.959685 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c369c449-cec2-42ab-a708-35262b560816 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.171472 Dec 18 20:55:35.960912 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1235/2455] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:35 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:36.191734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:36.192334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:36.218025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.218839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:36.219939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.220390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:36.450037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:36.460662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:36.484546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.490221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:36.504054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.504625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:36.566360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:36.576974 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ababd106-15ff-41f1-ac0e-4e3b23afe902 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.387043 Dec 18 20:55:36.579323 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1221/2456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:36 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:36.592515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1aee942d-da3b-4227-b2e4-40e3925543bd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:36.598090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1aee942d-da3b-4227-b2e4-40e3925543bd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:36.612103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aee942d-da3b-4227-b2e4-40e3925543bd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.612559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aee942d-da3b-4227-b2e4-40e3925543bd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:36.613367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aee942d-da3b-4227-b2e4-40e3925543bd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.613807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aee942d-da3b-4227-b2e4-40e3925543bd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:36.678839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1aee942d-da3b-4227-b2e4-40e3925543bd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.097312 Dec 18 20:55:36.682505 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1222/2457] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:36 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:36.700938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:36.701562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:36.719649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.720868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:36.721369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:36.721793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.047186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:37.073155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d3b6d529-9d8c-4bb7-a316-bdb9fa237578 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.628120 Dec 18 20:55:37.074191 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1236/2458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:36 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:37.080697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5acc9ba-a6c2-4b76-9c47-4592b5b30ef5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:37.081691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c5acc9ba-a6c2-4b76-9c47-4592b5b30ef5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:37.097249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5acc9ba-a6c2-4b76-9c47-4592b5b30ef5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.097713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5acc9ba-a6c2-4b76-9c47-4592b5b30ef5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.101639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5acc9ba-a6c2-4b76-9c47-4592b5b30ef5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.102140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5acc9ba-a6c2-4b76-9c47-4592b5b30ef5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.180403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:37.191896 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bd66bfc-5d1c-45cc-a292-f351d6eb28e2 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.496133 Dec 18 20:55:37.192260 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5acc9ba-a6c2-4b76-9c47-4592b5b30ef5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.116539 Dec 18 20:55:37.192919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1237/2459] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:37 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:37.205246 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1223/2460] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:36 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:37.206436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec7ffaca-f7c7-448b-80c1-6b31428cd354 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614e0dc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:37.208612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:37.211707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:37.245363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.250948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.253041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.253508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.303549 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec7ffaca-f7c7-448b-80c1-6b31428cd354 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.104237 Dec 18 20:55:37.305708 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1224/2461] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:37 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:37.562727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:37.575259 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cdc567d7-6980-472f-8a64-2e306aa1e3cc tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.380631 Dec 18 20:55:37.576494 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1238/2462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:37 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:37.595157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:37.595767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:37.608414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.609402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.616391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.617958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.692782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e96a93e-d348-4e35-a050-67a7a9602363 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:37.693811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e96a93e-d348-4e35-a050-67a7a9602363 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:37.703298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e96a93e-d348-4e35-a050-67a7a9602363 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.703777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e96a93e-d348-4e35-a050-67a7a9602363 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.704553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e96a93e-d348-4e35-a050-67a7a9602363 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:37.705000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e96a93e-d348-4e35-a050-67a7a9602363 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:37.768511 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e96a93e-d348-4e35-a050-67a7a9602363 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.079194 Dec 18 20:55:37.773389 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1239/2463] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:37 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:55:37.923189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:37.944738 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-071e49f6-b1c7-4d4b-a093-3d2d63383cd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.351612 Dec 18 20:55:37.946766 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1225/2464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:37 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:38.091061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:38.092680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:38.106568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.107371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.108356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.109150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.204116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-33f9d4ee-f913-4381-bd6d-275514c33f8a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:38.205315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-33f9d4ee-f913-4381-bd6d-275514c33f8a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:38.216584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f9d4ee-f913-4381-bd6d-275514c33f8a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.217344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f9d4ee-f913-4381-bd6d-275514c33f8a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.218361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f9d4ee-f913-4381-bd6d-275514c33f8a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.219163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33f9d4ee-f913-4381-bd6d-275514c33f8a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.280123 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-33f9d4ee-f913-4381-bd6d-275514c33f8a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.079008 Dec 18 20:55:38.282225 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1226/2465] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:38 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:38.289546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:38.291302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:38.301043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.301850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.303321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.304097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.576237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:38.585945 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87e4ac78-b56a-4d44-b2d4-8a9aa24388c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.498851 Dec 18 20:55:38.586864 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1240/2466] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:38 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:38.592719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1dc81b63-2a7c-48b5-ae87-2aeacf21823e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161387940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:38.646221 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1dc81b63-2a7c-48b5-ae87-2aeacf21823e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.058055 Dec 18 20:55:38.647532 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1241/2467] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:38 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:38.652828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-07d71558-2fb7-4f11-9f98-fe5868ee6e97 req-cc5fb9b1-1d4e-42ea-b1a5-f38eaeea8f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0093720e-0f18-4f7f-81a6-51de2283143e", "name": "network-vif-plugged", "status": "completed", "tag": "dcd26d53-013a-41a0-b028-6f833c1afdf4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:38.654750 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:38.654750 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:55:38.662743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-07d71558-2fb7-4f11-9f98-fe5868ee6e97 req-cc5fb9b1-1d4e-42ea-b1a5-f38eaeea8f72 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.663463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-07d71558-2fb7-4f11-9f98-fe5868ee6e97 req-cc5fb9b1-1d4e-42ea-b1a5-f38eaeea8f72 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.680303 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-07d71558-2fb7-4f11-9f98-fe5868ee6e97 req-cc5fb9b1-1d4e-42ea-b1a5-f38eaeea8f72 service nova] Creating event network-vif-plugged:dcd26d53-013a-41a0-b028-6f833c1afdf4 for instance 0093720e-0f18-4f7f-81a6-51de2283143e on nch2-master-1 Dec 18 20:55:38.686211 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-07d71558-2fb7-4f11-9f98-fe5868ee6e97 req-cc5fb9b1-1d4e-42ea-b1a5-f38eaeea8f72 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036949 Dec 18 20:55:38.687630 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1242/2468] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:38.694744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:38.696024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:38.705588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.706369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.707906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.708426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.865343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:38.873894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65d6f5b6-cbc5-4521-b693-5fdbc80e5fcf tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.590047 Dec 18 20:55:38.881469 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1227/2469] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:38 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:38.890551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0942ae2-360c-4cca-bde2-8a418b9dda3e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:38.891501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0942ae2-360c-4cca-bde2-8a418b9dda3e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:38.908827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0942ae2-360c-4cca-bde2-8a418b9dda3e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.918665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0942ae2-360c-4cca-bde2-8a418b9dda3e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:38.923662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0942ae2-360c-4cca-bde2-8a418b9dda3e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:38.924540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0942ae2-360c-4cca-bde2-8a418b9dda3e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.001241 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0942ae2-360c-4cca-bde2-8a418b9dda3e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.118343 Dec 18 20:55:39.002525 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1228/2470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:38 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:39.010233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:39.011301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:39.019648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.020454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.021981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.022775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.111393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:39.129328 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2dbf79b9-e7b4-47c6-8b5b-c8dbb99d32c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.439980 Dec 18 20:55:39.130616 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1243/2471] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:38 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:39.293980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fba54a9c-f30c-45f9-bff1-0e4609377056 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:39.295427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fba54a9c-f30c-45f9-bff1-0e4609377056 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:39.305233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba54a9c-f30c-45f9-bff1-0e4609377056 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.311136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba54a9c-f30c-45f9-bff1-0e4609377056 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.314067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba54a9c-f30c-45f9-bff1-0e4609377056 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.315620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba54a9c-f30c-45f9-bff1-0e4609377056 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.358198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:39.368868 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ee00f69a-8abe-4c9c-9d90-641154805944 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.364685 Dec 18 20:55:39.379087 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1229/2472] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:39 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:39.392550 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fba54a9c-f30c-45f9-bff1-0e4609377056 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.102480 Dec 18 20:55:39.395572 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1244/2473] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:39 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:55:39.606138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:39.606880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:39.619267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.629091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.630172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.631572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.667081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0221b396-464d-4fa1-99d0-537137d0a264 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161352550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:39.758194 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0221b396-464d-4fa1-99d0-537137d0a264 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.101749 Dec 18 20:55:39.759094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1245/2474] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:39 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:39.892487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:39.893712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:39.906674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.907129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.910718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:39.916523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:39.970706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:39.996431 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5fc9ab79-12bd-40d4-ab37-40eb2be2825d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.395084 Dec 18 20:55:40.008116 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1230/2475] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:39 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:40.013235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-73cdbbd7-1650-4fef-82f1-30d3a0ae3af2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:40.022200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-73cdbbd7-1650-4fef-82f1-30d3a0ae3af2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:40.042812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73cdbbd7-1650-4fef-82f1-30d3a0ae3af2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.043625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73cdbbd7-1650-4fef-82f1-30d3a0ae3af2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.044650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73cdbbd7-1650-4fef-82f1-30d3a0ae3af2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.045307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73cdbbd7-1650-4fef-82f1-30d3a0ae3af2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.094207 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-73cdbbd7-1650-4fef-82f1-30d3a0ae3af2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.084474 Dec 18 20:55:40.098732 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1231/2476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:40 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:40.147966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:40.149012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:40.159814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.168775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.172493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.176884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.198682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:40.219592 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5aace989-9c7c-480f-b667-29e45dd7e765 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.332285 Dec 18 20:55:40.231740 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1246/2477] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:39 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:40.395293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:40.395927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:40.411172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.411619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.420249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.420715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.527358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:40.538871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58d9658d-a7dd-4fc8-988d-4437b86a0b99 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.395073 Dec 18 20:55:40.541284 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1232/2478] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:40 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:40.547071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa9b1ae8-6bc0-421b-a85f-84691f41b464 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:40.548226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa9b1ae8-6bc0-421b-a85f-84691f41b464 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:40.555921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ae8-6bc0-421b-a85f-84691f41b464 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.556870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ae8-6bc0-421b-a85f-84691f41b464 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.557885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ae8-6bc0-421b-a85f-84691f41b464 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:40.558521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ae8-6bc0-421b-a85f-84691f41b464 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:40.659565 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa9b1ae8-6bc0-421b-a85f-84691f41b464 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.111678 Dec 18 20:55:40.665209 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1233/2479] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:40 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:40.773008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c33a7f9c-5086-470b-b6dd-545a6b088526 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614e00d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:40.809195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:40.819198 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81ddc19e-395c-4abe-9f5f-e2442670d7d9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1315 microversion: 2.1 time: 0.428066 Dec 18 20:55:40.826069 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1247/2480] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:40 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:40.868438 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c33a7f9c-5086-470b-b6dd-545a6b088526 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.100437 Dec 18 20:55:40.869185 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1234/2481] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:40 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:41.014640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:41.021090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:41.030459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.031261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.032313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.032999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.108602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-404ed8e8-11e3-4165-8ebd-2d088b3ff59e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:41.110512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-404ed8e8-11e3-4165-8ebd-2d088b3ff59e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:41.128931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-404ed8e8-11e3-4165-8ebd-2d088b3ff59e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.129557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-404ed8e8-11e3-4165-8ebd-2d088b3ff59e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.130427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-404ed8e8-11e3-4165-8ebd-2d088b3ff59e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.131448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-404ed8e8-11e3-4165-8ebd-2d088b3ff59e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.270875 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-404ed8e8-11e3-4165-8ebd-2d088b3ff59e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 24546 microversion: 2.1 time: 0.165915 Dec 18 20:55:41.272516 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1235/2482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:41 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 24546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:55:41.279893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:41.280974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:41.289511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.290456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.291252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.291801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.435066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:41.449045 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7e8a36bf-f138-4df8-8d94-da34323d8d6d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.436394 Dec 18 20:55:41.451355 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1248/2483] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:41 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:41.571049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:41.573538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:41.580437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:41.594016 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bbcd6f57-51f7-4ee3-be9f-72424b0704bc tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.318894 Dec 18 20:55:41.598305 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1236/2484] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:41 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:41.598493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.598493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.601519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.601994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.677391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a431d0a1-e72c-429a-ae3d-67a8f2b620e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:41.678951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a431d0a1-e72c-429a-ae3d-67a8f2b620e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:41.696590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a431d0a1-e72c-429a-ae3d-67a8f2b620e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.697343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a431d0a1-e72c-429a-ae3d-67a8f2b620e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.698354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a431d0a1-e72c-429a-ae3d-67a8f2b620e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.698974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a431d0a1-e72c-429a-ae3d-67a8f2b620e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.783044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a431d0a1-e72c-429a-ae3d-67a8f2b620e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.108867 Dec 18 20:55:41.789898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1237/2485] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:41 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:41.841414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:41.842494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:41.852661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.854777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.857189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:41.857648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:41.993766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:42.005496 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e8db4e4c-403a-4a65-b364-bfb8acd3397b tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.442354 Dec 18 20:55:42.008060 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1249/2486] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:41 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:42.015009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-838caa09-0ee7-4e07-8350-28f94a977c04 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161365af0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:42.113015 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-838caa09-0ee7-4e07-8350-28f94a977c04 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.102667 Dec 18 20:55:42.119145 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1250/2487] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:42 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:42.134017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:42.147313 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30999b2e-6c0c-4664-8aab-1ed16926ff0b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1502 microversion: 2.1 time: 0.311503 Dec 18 20:55:42.148204 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1238/2488] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:41 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1502 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:42.180863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56de6acb-a382-4563-aa63-4497ed3e5740 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:42.181870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-56de6acb-a382-4563-aa63-4497ed3e5740 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:42.194119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56de6acb-a382-4563-aa63-4497ed3e5740 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.194890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56de6acb-a382-4563-aa63-4497ed3e5740 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.196084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56de6acb-a382-4563-aa63-4497ed3e5740 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.196706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56de6acb-a382-4563-aa63-4497ed3e5740 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.217804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0609edec-99ce-4b75-b7bf-eb390f237cb8 req-7b64b947-6b11-4f0d-b13d-65b0cad36cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9f6243-3663-449e-89e7-c1a511e9313d", "name": "network-vif-plugged", "status": "completed", "tag": "36011601-d6a5-4062-8c92-593078687bde"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:42.220515 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:42.220515 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:42.237387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0609edec-99ce-4b75-b7bf-eb390f237cb8 req-7b64b947-6b11-4f0d-b13d-65b0cad36cdd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.238453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0609edec-99ce-4b75-b7bf-eb390f237cb8 req-7b64b947-6b11-4f0d-b13d-65b0cad36cdd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.268939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0609edec-99ce-4b75-b7bf-eb390f237cb8 req-7b64b947-6b11-4f0d-b13d-65b0cad36cdd service nova] Creating event network-vif-plugged:36011601-d6a5-4062-8c92-593078687bde for instance bf9f6243-3663-449e-89e7-c1a511e9313d on nch2-master-1 Dec 18 20:55:42.283652 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56de6acb-a382-4563-aa63-4497ed3e5740 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.115256 Dec 18 20:55:42.284447 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1251/2489] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:42 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:42.296334 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0609edec-99ce-4b75-b7bf-eb390f237cb8 req-7b64b947-6b11-4f0d-b13d-65b0cad36cdd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082461 Dec 18 20:55:42.303772 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1239/2490] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:55:42.316767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34a6d33a-44bd-44b6-b096-d7bb353d057c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:42.319941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-34a6d33a-44bd-44b6-b096-d7bb353d057c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:42.336927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34a6d33a-44bd-44b6-b096-d7bb353d057c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.340210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34a6d33a-44bd-44b6-b096-d7bb353d057c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.343972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34a6d33a-44bd-44b6-b096-d7bb353d057c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.344880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34a6d33a-44bd-44b6-b096-d7bb353d057c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.425751 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34a6d33a-44bd-44b6-b096-d7bb353d057c tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.125573 Dec 18 20:55:42.427521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1252/2491] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:42 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:42.469760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:42.471420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:42.494901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.498051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.500292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.500749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.614893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:42.616659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:42.628308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.628911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.629836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.630421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.908213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:42.916752 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a7d609a-66c4-4544-ba3c-ebcfc98a3717 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.452850 Dec 18 20:55:42.922072 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1240/2492] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:42 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:42.926923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-598033ff-6992-4571-a47a-9bf9f9aef2d8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:42.939582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-598033ff-6992-4571-a47a-9bf9f9aef2d8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:42.946837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-598033ff-6992-4571-a47a-9bf9f9aef2d8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.947538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-598033ff-6992-4571-a47a-9bf9f9aef2d8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:42.948537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-598033ff-6992-4571-a47a-9bf9f9aef2d8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:42.949153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-598033ff-6992-4571-a47a-9bf9f9aef2d8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.013550 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-598033ff-6992-4571-a47a-9bf9f9aef2d8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.089943 Dec 18 20:55:43.017679 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1241/2493] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:42 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:43.027306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:43.028025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:43.038475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:43.048339 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9604c0cf-1038-4023-994d-7ee76a8f69ee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.439743 Dec 18 20:55:43.050698 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1253/2494] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:42 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:43.055532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.055886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.056949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.057332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.130057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b2306ab-15ee-4397-bc0d-a14518fa1af3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716134d8b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:43.239766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b2306ab-15ee-4397-bc0d-a14518fa1af3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.117318 Dec 18 20:55:43.244398 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1254/2495] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:43 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:43.297358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03d789dc-081b-4129-af3b-c782ebd66bd7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:43.301381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03d789dc-081b-4129-af3b-c782ebd66bd7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:43.312381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03d789dc-081b-4129-af3b-c782ebd66bd7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.314779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03d789dc-081b-4129-af3b-c782ebd66bd7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.316098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03d789dc-081b-4129-af3b-c782ebd66bd7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.316794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03d789dc-081b-4129-af3b-c782ebd66bd7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.378697 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03d789dc-081b-4129-af3b-c782ebd66bd7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.086887 Dec 18 20:55:43.379667 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1255/2496] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:43 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:43.440942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b30bb4c4-d3dc-46ab-9c01-400ccc9551da tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:43.442447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b30bb4c4-d3dc-46ab-9c01-400ccc9551da tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:43.450079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b30bb4c4-d3dc-46ab-9c01-400ccc9551da tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.451064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b30bb4c4-d3dc-46ab-9c01-400ccc9551da tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.452124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b30bb4c4-d3dc-46ab-9c01-400ccc9551da tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.452787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b30bb4c4-d3dc-46ab-9c01-400ccc9551da tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.532398 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b30bb4c4-d3dc-46ab-9c01-400ccc9551da tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.096629 Dec 18 20:55:43.537832 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1256/2497] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:43 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:55:43.752508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:43.764268 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96c2ce9b-00b1-48d4-a5f7-73b68cfe204e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.742922 Dec 18 20:55:43.765252 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1242/2498] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:43 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:43.939053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:43.939901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:43.948006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.948829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:43.949841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:43.950513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.027817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e33bd72e-2de1-4bea-8cf9-60a0c2d64ef7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:44.028977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e33bd72e-2de1-4bea-8cf9-60a0c2d64ef7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:44.035904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e33bd72e-2de1-4bea-8cf9-60a0c2d64ef7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.036733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e33bd72e-2de1-4bea-8cf9-60a0c2d64ef7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.038821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e33bd72e-2de1-4bea-8cf9-60a0c2d64ef7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.039641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e33bd72e-2de1-4bea-8cf9-60a0c2d64ef7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.104965 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e33bd72e-2de1-4bea-8cf9-60a0c2d64ef7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.083060 Dec 18 20:55:44.106148 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1243/2499] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:44 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:55:44.116953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:44.119260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:44.129118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.129926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.131016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.131749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.193286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:44.205781 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f397786f-af5b-4667-a2fc-a10e0108517e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1307 microversion: 2.1 time: 0.270791 Dec 18 20:55:44.207140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1257/2500] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:43 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:44.254009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc24f63a-034a-4cee-9f63-f278109c85c8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71612d85e0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:44.332215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc24f63a-034a-4cee-9f63-f278109c85c8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.078470 Dec 18 20:55:44.334801 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1258/2501] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:44 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:44.385966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:44.397642 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a64e78b-311b-4425-a1d9-4245f9182b00 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.289695 Dec 18 20:55:44.399081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6d87bb69-d6b7-4a50-bc37-1c84678ed3ae tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:44.400581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6d87bb69-d6b7-4a50-bc37-1c84678ed3ae tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:44.407442 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1244/2502] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:44 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:44.417009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d87bb69-d6b7-4a50-bc37-1c84678ed3ae tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.418090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d87bb69-d6b7-4a50-bc37-1c84678ed3ae tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.419212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d87bb69-d6b7-4a50-bc37-1c84678ed3ae tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.419663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d87bb69-d6b7-4a50-bc37-1c84678ed3ae tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.474472 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6d87bb69-d6b7-4a50-bc37-1c84678ed3ae tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.086732 Dec 18 20:55:44.475981 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1259/2503] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:44 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:44.544862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1fe2690d-2803-4ad3-9ccc-97328670fc6a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:44.545826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1fe2690d-2803-4ad3-9ccc-97328670fc6a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:44.554556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fe2690d-2803-4ad3-9ccc-97328670fc6a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.554886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fe2690d-2803-4ad3-9ccc-97328670fc6a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.555694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fe2690d-2803-4ad3-9ccc-97328670fc6a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.556138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fe2690d-2803-4ad3-9ccc-97328670fc6a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.612521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1fe2690d-2803-4ad3-9ccc-97328670fc6a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.071124 Dec 18 20:55:44.616548 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1245/2504] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:44 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:44.782097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:44.783018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:44.790757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.791209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.792022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:44.792463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:44.997679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:45.007300 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6cf627b-2b18-4d97-b64f-3abe17dc1b3f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.229671 Dec 18 20:55:45.008281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1260/2505] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:44 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:45.118962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66b67216-9ffa-4468-b044-0830290ec595 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:45.119959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66b67216-9ffa-4468-b044-0830290ec595 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:45.136956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b67216-9ffa-4468-b044-0830290ec595 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.141754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b67216-9ffa-4468-b044-0830290ec595 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.144736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b67216-9ffa-4468-b044-0830290ec595 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.147115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b67216-9ffa-4468-b044-0830290ec595 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.225042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:45.226442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:45.242236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.244285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.245546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.246587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.254850 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66b67216-9ffa-4468-b044-0830290ec595 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.140445 Dec 18 20:55:45.256880 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1246/2506] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:45 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:55:45.350192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a34a91b-1015-44db-91ce-f0f33d494c5e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161368c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:45.446552 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a34a91b-1015-44db-91ce-f0f33d494c5e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.100862 Dec 18 20:55:45.449004 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1247/2507] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:45 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:45.460780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:45.461537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:45.480410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:45.491375 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39c4402b-ee26-4120-9fdb-35c896ec307e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1486 microversion: 2.1 time: 0.268519 Dec 18 20:55:45.504988 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1261/2508] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:45 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1486 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:45.509208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.515758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.517177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.520543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98dbce42-29b2-443e-b0b0-f1aa81786dd1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:45.521779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.525972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-98dbce42-29b2-443e-b0b0-f1aa81786dd1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:45.541018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98dbce42-29b2-443e-b0b0-f1aa81786dd1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.541470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98dbce42-29b2-443e-b0b0-f1aa81786dd1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.542319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98dbce42-29b2-443e-b0b0-f1aa81786dd1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.542827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98dbce42-29b2-443e-b0b0-f1aa81786dd1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.598397 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98dbce42-29b2-443e-b0b0-f1aa81786dd1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.080214 Dec 18 20:55:45.598397 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1262/2509] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:45 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:45.604891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ffd1bcaa-95e4-414f-952f-07d38bb2dd26 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:45.618077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffd1bcaa-95e4-414f-952f-07d38bb2dd26 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.620492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffd1bcaa-95e4-414f-952f-07d38bb2dd26 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.657860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ffd1bcaa-95e4-414f-952f-07d38bb2dd26 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Going to try to stop instance {{(pid=140731) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 20:55:45.784275 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ffd1bcaa-95e4-414f-952f-07d38bb2dd26 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d/action" status: 202 len: 0 microversion: 2.1 time: 0.185879 Dec 18 20:55:45.792145 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1263/2510] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:45 2021] POST /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:45.800042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d1ea3411-d7a6-49fd-9b3a-d7ad3a58fcd0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:45.802215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d1ea3411-d7a6-49fd-9b3a-d7ad3a58fcd0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:45.834897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ea3411-d7a6-49fd-9b3a-d7ad3a58fcd0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.834897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ea3411-d7a6-49fd-9b3a-d7ad3a58fcd0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.834897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ea3411-d7a6-49fd-9b3a-d7ad3a58fcd0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.834897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ea3411-d7a6-49fd-9b3a-d7ad3a58fcd0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44a7e119-7650-4385-90b3-56a472abe669 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.368891 Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1248/2511] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:45 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:45.835572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:45.854985 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d1ea3411-d7a6-49fd-9b3a-d7ad3a58fcd0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.060516 Dec 18 20:55:45.859149 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1264/2512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:45 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:46.025398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:46.026276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:46.053422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.054620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.057885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.059483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.227077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:46.237589 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b436ed78-9d29-4f83-a32d-71b5e568d775 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.416794 Dec 18 20:55:46.239407 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1249/2513] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:45 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:46.267698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-04a039a7-1eda-43b0-8b68-a04c8440f1fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:46.268692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-04a039a7-1eda-43b0-8b68-a04c8440f1fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:46.283133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04a039a7-1eda-43b0-8b68-a04c8440f1fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.283840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04a039a7-1eda-43b0-8b68-a04c8440f1fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.284846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04a039a7-1eda-43b0-8b68-a04c8440f1fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.285458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04a039a7-1eda-43b0-8b68-a04c8440f1fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.336580 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-04a039a7-1eda-43b0-8b68-a04c8440f1fd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.071625 Dec 18 20:55:46.339060 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1250/2514] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:46 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:55:46.449007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:46.458056 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8ad2eb6d-cd93-48e2-9c7a-84db5f9ad0b7 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1477 microversion: 2.1 time: 0.437090 Dec 18 20:55:46.462418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a86431c-b0c2-4a6a-ae32-017d7eab7cc2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716131fa60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:46.472326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1265/2515] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:46 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1477 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:46.558995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a86431c-b0c2-4a6a-ae32-017d7eab7cc2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1455 microversion: 2.1 time: 0.100758 Dec 18 20:55:46.559967 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1251/2516] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:46 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:46.606125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ebbb6b8-9efe-42e1-b249-e0bbfc165d18 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:46.607159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ebbb6b8-9efe-42e1-b249-e0bbfc165d18 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:46.617850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebbb6b8-9efe-42e1-b249-e0bbfc165d18 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.618878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebbb6b8-9efe-42e1-b249-e0bbfc165d18 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.621304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebbb6b8-9efe-42e1-b249-e0bbfc165d18 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.621805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ebbb6b8-9efe-42e1-b249-e0bbfc165d18 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.702989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ebbb6b8-9efe-42e1-b249-e0bbfc165d18 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.101557 Dec 18 20:55:46.706817 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1266/2517] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:46 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:55:46.853096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:46.853947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:46.860864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.869170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c5d91d5-955d-4ec9-876f-68870901fe1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:46.870282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c5d91d5-955d-4ec9-876f-68870901fe1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:46.874937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.875907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.876285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.878068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c5d91d5-955d-4ec9-876f-68870901fe1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.878687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c5d91d5-955d-4ec9-876f-68870901fe1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.879518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c5d91d5-955d-4ec9-876f-68870901fe1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:46.879953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c5d91d5-955d-4ec9-876f-68870901fe1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:46.947001 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c5d91d5-955d-4ec9-876f-68870901fe1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.083731 Dec 18 20:55:46.968321 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1267/2518] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:46 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:55:47.257812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:47.259236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:47.269637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.270728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.272506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.273238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.325128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:47.350438 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-060712cc-54e9-4009-859f-5704c4203d73 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.501782 Dec 18 20:55:47.352105 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1252/2519] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:46 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:47.357945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f18f3857-4258-4f5b-bdd0-f852af29d69b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:47.359172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f18f3857-4258-4f5b-bdd0-f852af29d69b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:47.371971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f18f3857-4258-4f5b-bdd0-f852af29d69b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.372654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f18f3857-4258-4f5b-bdd0-f852af29d69b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.373676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f18f3857-4258-4f5b-bdd0-f852af29d69b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.374346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f18f3857-4258-4f5b-bdd0-f852af29d69b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.428789 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f18f3857-4258-4f5b-bdd0-f852af29d69b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.074883 Dec 18 20:55:47.430220 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1253/2520] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:47 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:47.480699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:47.482068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:47.491003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.491806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.493099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.493783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.690877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:47.707515 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cd005c11-2dfd-48ab-89f7-862dcb39d066 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.453513 Dec 18 20:55:47.711904 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1268/2521] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:47 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:47.743107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1021279e-f180-42e5-809e-31c238fab895 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613b9dc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:47.863248 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1021279e-f180-42e5-809e-31c238fab895 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1464 microversion: 2.1 time: 0.145673 Dec 18 20:55:47.864392 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1269/2522] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:47 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:47.869422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc0981c9-6a6d-4d20-b376-9835d1e27eb8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:47.872769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc0981c9-6a6d-4d20-b376-9835d1e27eb8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:47.879939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc0981c9-6a6d-4d20-b376-9835d1e27eb8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.880388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc0981c9-6a6d-4d20-b376-9835d1e27eb8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.881853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc0981c9-6a6d-4d20-b376-9835d1e27eb8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.882245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc0981c9-6a6d-4d20-b376-9835d1e27eb8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:47.892429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:47.903959 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1daf112d-2f31-4619-957c-40a59168efcb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1476 microversion: 2.1 time: 0.428317 Dec 18 20:55:47.922102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1254/2523] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:47 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1476 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:47.927790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0023950e-f66b-48c5-8e03-7fabf6c19b42 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614a4790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:47.941608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc0981c9-6a6d-4d20-b376-9835d1e27eb8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.074116 Dec 18 20:55:47.942876 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1270/2524] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:47 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:47.981370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f0a1ffe-e38f-4361-b5b1-74f76b468253 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:47.982749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f0a1ffe-e38f-4361-b5b1-74f76b468253 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:47.995025 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0023950e-f66b-48c5-8e03-7fabf6c19b42 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 200 len: 1464 microversion: 2.1 time: 0.071027 Dec 18 20:55:47.998956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0a1ffe-e38f-4361-b5b1-74f76b468253 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:47.999600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0a1ffe-e38f-4361-b5b1-74f76b468253 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.000462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0a1ffe-e38f-4361-b5b1-74f76b468253 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.001070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0a1ffe-e38f-4361-b5b1-74f76b468253 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.002886 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1255/2525] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:47 2021] GET /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 1464 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:48.014174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5a44d271-bb5e-43e7-9373-c4790bbb5fc4 req-d43dd093-6f09-449f-b1ad-c25bdb0aff3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490a83d0-be20-498a-8e6d-036b4f27f890", "name": "network-vif-unplugged", "status": "completed", "tag": "24ea0eab-019c-481e-a0e8-afff63a3a8c8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:48.016548 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:48.016548 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:48.026407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5a44d271-bb5e-43e7-9373-c4790bbb5fc4 req-d43dd093-6f09-449f-b1ad-c25bdb0aff3b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.026925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5a44d271-bb5e-43e7-9373-c4790bbb5fc4 req-d43dd093-6f09-449f-b1ad-c25bdb0aff3b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.052279 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5a44d271-bb5e-43e7-9373-c4790bbb5fc4 req-d43dd093-6f09-449f-b1ad-c25bdb0aff3b service nova] Creating event network-vif-unplugged:24ea0eab-019c-481e-a0e8-afff63a3a8c8 for instance 490a83d0-be20-498a-8e6d-036b4f27f890 on nch2-master-1 Dec 18 20:55:48.060643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-5a44d271-bb5e-43e7-9373-c4790bbb5fc4 req-d43dd093-6f09-449f-b1ad-c25bdb0aff3b service nova] Instance 490a83d0-be20-498a-8e6d-036b4f27f890 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:55:48.089297 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f0a1ffe-e38f-4361-b5b1-74f76b468253 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.116965 Dec 18 20:55:48.090219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1271/2526] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:47 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:55:48.100778 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5a44d271-bb5e-43e7-9373-c4790bbb5fc4 req-d43dd093-6f09-449f-b1ad-c25bdb0aff3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094455 Dec 18 20:55:48.101398 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1256/2527] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:48.103200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:48.107215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:48.125591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.126144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.127463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.128079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.370438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:48.371245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:48.383721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.390553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.391540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.391991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.421351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:48.440438 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8381c7b3-1a06-4330-af0a-373df2bf10a9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 1467 microversion: 2.1 time: 0.340404 Dec 18 20:55:48.441177 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1272/2528] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:48 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 1467 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:48.445824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-adbb53e8-5c9d-48b7-924a-bf7ea8858fe8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:48.446902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-adbb53e8-5c9d-48b7-924a-bf7ea8858fe8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:48.455165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adbb53e8-5c9d-48b7-924a-bf7ea8858fe8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.455922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adbb53e8-5c9d-48b7-924a-bf7ea8858fe8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.456739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adbb53e8-5c9d-48b7-924a-bf7ea8858fe8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.457185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adbb53e8-5c9d-48b7-924a-bf7ea8858fe8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.510353 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-adbb53e8-5c9d-48b7-924a-bf7ea8858fe8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.066919 Dec 18 20:55:48.513048 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1273/2529] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:48 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:48.521538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-627604dd-fbcd-4aa1-a119-8a83af1c1c61 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-230152071"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:48.524159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-627604dd-fbcd-4aa1-a119-8a83af1c1c61 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:48.532525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-627604dd-fbcd-4aa1-a119-8a83af1c1c61 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.533019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-627604dd-fbcd-4aa1-a119-8a83af1c1c61 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.534566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-627604dd-fbcd-4aa1-a119-8a83af1c1c61 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.534924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-627604dd-fbcd-4aa1-a119-8a83af1c1c61 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.744265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:48.755618 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96f8e000-a79f-428c-bee4-9fde8d79e6d7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1486 microversion: 2.1 time: 0.390707 Dec 18 20:55:48.757222 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1257/2530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:48 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1486 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:48.770578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:48.772860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:48.801047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.802046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.807359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.808209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.912534 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-627604dd-fbcd-4aa1-a119-8a83af1c1c61 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "POST /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff/action" status: 202 len: 0 microversion: 2.1 time: 0.397401 Dec 18 20:55:48.913513 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1274/2531] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:48 2021] POST /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:55:48.918954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ffb9497-6718-42e6-b184-7511999f4856 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:48.919538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ffb9497-6718-42e6-b184-7511999f4856 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:48.930278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ffb9497-6718-42e6-b184-7511999f4856 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.930816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ffb9497-6718-42e6-b184-7511999f4856 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:48.932364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ffb9497-6718-42e6-b184-7511999f4856 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:48.933547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ffb9497-6718-42e6-b184-7511999f4856 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.034286 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ffb9497-6718-42e6-b184-7511999f4856 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "POST /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a/action" status: 202 len: 0 microversion: 2.1 time: 0.119111 Dec 18 20:55:49.038414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1275/2532] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:48 2021] POST /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:49.043044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b041bc02-cf06-4a56-b0a3-014ce06cd971 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161352280>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:49.104707 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b041bc02-cf06-4a56-b0a3-014ce06cd971 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.067751 Dec 18 20:55:49.105611 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1276/2533] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:49 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:49.112503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:49.113274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:49.120858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.124689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.126195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.127346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.195493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:49.203764 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59ab5878-7dd4-404f-aa6b-cd36d6b5e44c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.445257 Dec 18 20:55:49.204676 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1258/2534] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:48 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:49.216620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6772aa7f-d4b8-457e-949f-387cb2d00a29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:49.217765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6772aa7f-d4b8-457e-949f-387cb2d00a29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:49.225119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6772aa7f-d4b8-457e-949f-387cb2d00a29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.225699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6772aa7f-d4b8-457e-949f-387cb2d00a29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.226660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6772aa7f-d4b8-457e-949f-387cb2d00a29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.227256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6772aa7f-d4b8-457e-949f-387cb2d00a29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.276336 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6772aa7f-d4b8-457e-949f-387cb2d00a29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.069840 Dec 18 20:55:49.281172 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1259/2535] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:49 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:49.288588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:49.289362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:49.297565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.298416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.299317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.299964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.491570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:49.507248 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39b4a239-4124-461b-b6b4-cc9d814421c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1476 microversion: 2.1 time: 0.400517 Dec 18 20:55:49.518840 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1277/2536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:49 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:49.525355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c45ce349-1072-4d99-8924-888e59b99d9e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:49.527244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c45ce349-1072-4d99-8924-888e59b99d9e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:49.535190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c45ce349-1072-4d99-8924-888e59b99d9e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.536242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c45ce349-1072-4d99-8924-888e59b99d9e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.538288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c45ce349-1072-4d99-8924-888e59b99d9e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.539175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c45ce349-1072-4d99-8924-888e59b99d9e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.594457 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c45ce349-1072-4d99-8924-888e59b99d9e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.073932 Dec 18 20:55:49.595610 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1278/2537] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:49 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:49.602633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0fd65d6-5248-41f6-b261-b98b775ee794 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:49.604117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0fd65d6-5248-41f6-b261-b98b775ee794 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:49.625527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0fd65d6-5248-41f6-b261-b98b775ee794 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.625527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0fd65d6-5248-41f6-b261-b98b775ee794 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.625527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0fd65d6-5248-41f6-b261-b98b775ee794 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:49.625527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0fd65d6-5248-41f6-b261-b98b775ee794 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:49.637648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:49.650779 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aab480b7-74f4-4f5b-8863-6613f7f3397b tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1494 microversion: 2.1 time: 0.366068 Dec 18 20:55:49.651898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1260/2538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:49 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1494 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:49.725194 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0fd65d6-5248-41f6-b261-b98b775ee794 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.127162 Dec 18 20:55:49.726938 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1279/2539] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:49 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:49.984585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e871db65-a620-44bc-bd46-2f911b5a42dd req-5f16c59a-6324-46d6-914d-427fc27aeb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f709f32-beb6-4558-8d64-0d56d0981842", "name": "network-vif-unplugged", "status": "completed", "tag": "53d8cf94-d048-4858-b43d-3d641ffb86d5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:49.987766 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:49.987766 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:50.027590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e871db65-a620-44bc-bd46-2f911b5a42dd req-5f16c59a-6324-46d6-914d-427fc27aeb28 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.028114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e871db65-a620-44bc-bd46-2f911b5a42dd req-5f16c59a-6324-46d6-914d-427fc27aeb28 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.044305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e871db65-a620-44bc-bd46-2f911b5a42dd req-5f16c59a-6324-46d6-914d-427fc27aeb28 service nova] Creating event network-vif-unplugged:53d8cf94-d048-4858-b43d-3d641ffb86d5 for instance 6f709f32-beb6-4558-8d64-0d56d0981842 on nch2-master-1 Dec 18 20:55:50.056953 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e871db65-a620-44bc-bd46-2f911b5a42dd req-5f16c59a-6324-46d6-914d-427fc27aeb28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080594 Dec 18 20:55:50.058940 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1261/2540] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:50.120788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb2b44e0-c121-40bf-987f-f1ee7f0d2122 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161352040>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:50.155569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cb716396-5e03-4ed8-ad3a-d97fcab4086e req-ba76ec83-172f-4cc1-a494-7fd3d4975a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490a83d0-be20-498a-8e6d-036b4f27f890", "tag": "24ea0eab-019c-481e-a0e8-afff63a3a8c8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:50.157715 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:50.157715 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:55:50.166649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cb716396-5e03-4ed8-ad3a-d97fcab4086e req-ba76ec83-172f-4cc1-a494-7fd3d4975a19 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.167288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cb716396-5e03-4ed8-ad3a-d97fcab4086e req-ba76ec83-172f-4cc1-a494-7fd3d4975a19 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.182515 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cb716396-5e03-4ed8-ad3a-d97fcab4086e req-ba76ec83-172f-4cc1-a494-7fd3d4975a19 service nova] Creating event network-changed:24ea0eab-019c-481e-a0e8-afff63a3a8c8 for instance 490a83d0-be20-498a-8e6d-036b4f27f890 on nch2-master-1 Dec 18 20:55:50.186380 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb2b44e0-c121-40bf-987f-f1ee7f0d2122 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.068308 Dec 18 20:55:50.187599 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1280/2541] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:50 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:50.194781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-cb716396-5e03-4ed8-ad3a-d97fcab4086e req-ba76ec83-172f-4cc1-a494-7fd3d4975a19 service nova] Instance 490a83d0-be20-498a-8e6d-036b4f27f890 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:55:50.207890 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cb716396-5e03-4ed8-ad3a-d97fcab4086e req-ba76ec83-172f-4cc1-a494-7fd3d4975a19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056903 Dec 18 20:55:50.208609 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1262/2542] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:50.234521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:50.235533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:50.246808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.247543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.248565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.249203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.288468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b28511de-0fd7-4c96-a5e2-ebb864728fd0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:50.289550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b28511de-0fd7-4c96-a5e2-ebb864728fd0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:50.303567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b28511de-0fd7-4c96-a5e2-ebb864728fd0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.307639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b28511de-0fd7-4c96-a5e2-ebb864728fd0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.310744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b28511de-0fd7-4c96-a5e2-ebb864728fd0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.311575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b28511de-0fd7-4c96-a5e2-ebb864728fd0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.378402 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b28511de-0fd7-4c96-a5e2-ebb864728fd0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.094372 Dec 18 20:55:50.379435 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1263/2543] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:50 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:55:50.516651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:50.536435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:50.542764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:50.552281 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-111ab3e4-669c-45ba-82b1-bd402301bba2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.325263 Dec 18 20:55:50.562306 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1281/2544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:50 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:50.562554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.562554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.562554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.562554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.608536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70f96e5f-7ba4-4a72-98ac-14ee53b89f4b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:50.609952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70f96e5f-7ba4-4a72-98ac-14ee53b89f4b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:50.618569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f96e5f-7ba4-4a72-98ac-14ee53b89f4b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.619449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f96e5f-7ba4-4a72-98ac-14ee53b89f4b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.620524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f96e5f-7ba4-4a72-98ac-14ee53b89f4b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.621396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70f96e5f-7ba4-4a72-98ac-14ee53b89f4b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.723986 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70f96e5f-7ba4-4a72-98ac-14ee53b89f4b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.120429 Dec 18 20:55:50.725360 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1282/2545] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:50 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:55:50.731249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:50.732288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:50.742462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.743811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.745051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.745673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.910759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:50.921115 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7d3ac161-edd1-419b-b442-dcb54de0d178 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1474 microversion: 2.1 time: 0.397405 Dec 18 20:55:50.923523 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1264/2546] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:50 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:50.929790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60a9fd0d-15be-49ca-bab2-5cdc239d4100 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:50.931895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60a9fd0d-15be-49ca-bab2-5cdc239d4100 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:50.941627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a9fd0d-15be-49ca-bab2-5cdc239d4100 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.942786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a9fd0d-15be-49ca-bab2-5cdc239d4100 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:50.945386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a9fd0d-15be-49ca-bab2-5cdc239d4100 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:50.946652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a9fd0d-15be-49ca-bab2-5cdc239d4100 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.011217 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60a9fd0d-15be-49ca-bab2-5cdc239d4100 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.085755 Dec 18 20:55:51.013378 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1265/2547] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:50 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:51.128247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:51.142557 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd157714-ce19-4645-bf27-002e64cc367d tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1494 microversion: 2.1 time: 0.415279 Dec 18 20:55:51.143149 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1283/2548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:50 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1494 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:51.201825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-54f83bd0-c109-43a0-8e0e-4be860ecd7f2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613c0c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:51.268593 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-54f83bd0-c109-43a0-8e0e-4be860ecd7f2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.071383 Dec 18 20:55:51.269235 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1266/2549] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:51 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:51.389803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae676f19-2ad1-493a-a75e-a8d88a94fef9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:51.390857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae676f19-2ad1-493a-a75e-a8d88a94fef9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:51.399501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae676f19-2ad1-493a-a75e-a8d88a94fef9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.400013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae676f19-2ad1-493a-a75e-a8d88a94fef9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.400877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae676f19-2ad1-493a-a75e-a8d88a94fef9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.401353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae676f19-2ad1-493a-a75e-a8d88a94fef9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.441322 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae676f19-2ad1-493a-a75e-a8d88a94fef9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.055625 Dec 18 20:55:51.442005 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1284/2550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:51 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:51.571071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:51.572425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:51.580715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.581167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.581958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.582536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.737307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-249b8dc6-87f4-401b-b263-282a4bc2e35d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:51.738644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-249b8dc6-87f4-401b-b263-282a4bc2e35d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:51.747967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249b8dc6-87f4-401b-b263-282a4bc2e35d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.748448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249b8dc6-87f4-401b-b263-282a4bc2e35d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.749429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249b8dc6-87f4-401b-b263-282a4bc2e35d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.750194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249b8dc6-87f4-401b-b263-282a4bc2e35d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.808799 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-249b8dc6-87f4-401b-b263-282a4bc2e35d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.076161 Dec 18 20:55:51.810477 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1285/2551] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:51 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:55:51.832711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:51.848416 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af2a18c4-93f2-495a-b9fe-55495af02cb2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.282799 Dec 18 20:55:51.849424 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1267/2552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:51 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:51.945645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:51.946400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:51.954841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.955361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:51.956315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:51.956830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.026315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf13a9a9-d06a-40c0-89df-1f596442a2d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:52.028589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf13a9a9-d06a-40c0-89df-1f596442a2d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:52.036412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf13a9a9-d06a-40c0-89df-1f596442a2d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.037868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf13a9a9-d06a-40c0-89df-1f596442a2d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.039011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf13a9a9-d06a-40c0-89df-1f596442a2d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.039612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf13a9a9-d06a-40c0-89df-1f596442a2d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.095448 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf13a9a9-d06a-40c0-89df-1f596442a2d6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.073179 Dec 18 20:55:52.096277 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1268/2553] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:52 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:52.160790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:52.161500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:52.178352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.179124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.180238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.180719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.691114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:52.702102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:52.704225 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-08bf54ec-ffac-4b57-b143-76f4f1210a1e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1471 microversion: 2.1 time: 0.763361 Dec 18 20:55:52.726487 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1286/2554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:51 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1471 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:52.737467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fbd0b0bb-91ae-49ce-bfb8-f04e33cb8237 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161309940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:52.741355 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fc523dc-89dd-4759-b472-0dbb78c225d6 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1494 microversion: 2.1 time: 0.584696 Dec 18 20:55:52.759094 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1269/2555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:52 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1494 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:52.778129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bba33c0e-f7cb-4e5c-9efe-975a8b25fc45 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:52.779598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bba33c0e-f7cb-4e5c-9efe-975a8b25fc45 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:52.788002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bba33c0e-f7cb-4e5c-9efe-975a8b25fc45 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.788935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bba33c0e-f7cb-4e5c-9efe-975a8b25fc45 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.790841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bba33c0e-f7cb-4e5c-9efe-975a8b25fc45 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.792805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bba33c0e-f7cb-4e5c-9efe-975a8b25fc45 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.817841 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fbd0b0bb-91ae-49ce-bfb8-f04e33cb8237 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.087164 Dec 18 20:55:52.824096 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1287/2556] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:52 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:52.835521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5ed8e33-73f3-4938-aaed-ae9ce9fdd286 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:52.836083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e5ed8e33-73f3-4938-aaed-ae9ce9fdd286 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:52.842634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed8e33-73f3-4938-aaed-ae9ce9fdd286 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.843142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed8e33-73f3-4938-aaed-ae9ce9fdd286 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.843996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed8e33-73f3-4938-aaed-ae9ce9fdd286 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.844636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ed8e33-73f3-4938-aaed-ae9ce9fdd286 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.857014 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bba33c0e-f7cb-4e5c-9efe-975a8b25fc45 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.094039 Dec 18 20:55:52.858112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1270/2557] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:52 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:52.871728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-450ba270-cff0-417f-9b1b-ce2da756e034 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:52.879507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-450ba270-cff0-417f-9b1b-ce2da756e034 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:52.891702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-450ba270-cff0-417f-9b1b-ce2da756e034 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.892435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-450ba270-cff0-417f-9b1b-ce2da756e034 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.893859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-450ba270-cff0-417f-9b1b-ce2da756e034 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.894908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-450ba270-cff0-417f-9b1b-ce2da756e034 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:52.967395 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-450ba270-cff0-417f-9b1b-ce2da756e034 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.104695 Dec 18 20:55:52.976472 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1271/2558] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:52 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:52.987347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:52.988256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:52.998939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:52.999666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.001407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.002039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.080727 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e5ed8e33-73f3-4938-aaed-ae9ce9fdd286 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "POST /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890/action" status: 202 len: 0 microversion: 2.1 time: 0.249033 Dec 18 20:55:53.081361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1288/2559] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:52 2021] POST /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:53.107055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:53.108683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:53.119531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.120119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.121515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.122108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.322470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:53.330480 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80511149-c441-45b8-9d16-a3e2a120681e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.350888 Dec 18 20:55:53.331049 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1272/2560] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:52 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:53.339364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28943339-45de-4836-8de8-0e75d4cdb523 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:53.346054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28943339-45de-4836-8de8-0e75d4cdb523 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:53.358183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28943339-45de-4836-8de8-0e75d4cdb523 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.358911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28943339-45de-4836-8de8-0e75d4cdb523 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.359875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28943339-45de-4836-8de8-0e75d4cdb523 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.360473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28943339-45de-4836-8de8-0e75d4cdb523 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.420612 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28943339-45de-4836-8de8-0e75d4cdb523 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.081685 Dec 18 20:55:53.422082 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1273/2561] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:53 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:53.509577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:53.521492 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a14f419a-3718-4680-af21-07ae549b8617 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1470 microversion: 2.1 time: 0.433096 Dec 18 20:55:53.532040 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1289/2562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:53 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1470 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:53.759671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:53.760720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:53.780899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.781674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.783886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.784588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.838212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f36f9c9-ffe5-4346-a7fb-7bffd52c0a83 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161309310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:53.906053 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f36f9c9-ffe5-4346-a7fb-7bffd52c0a83 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.073039 Dec 18 20:55:53.906944 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1290/2563] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:53 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:53.919586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9d77677-7117-4d8c-a0d3-93b5f3f47d34 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:53.920824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9d77677-7117-4d8c-a0d3-93b5f3f47d34 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:53.928868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9d77677-7117-4d8c-a0d3-93b5f3f47d34 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.929688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9d77677-7117-4d8c-a0d3-93b5f3f47d34 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:53.930733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9d77677-7117-4d8c-a0d3-93b5f3f47d34 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:53.931400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9d77677-7117-4d8c-a0d3-93b5f3f47d34 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.002487 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9d77677-7117-4d8c-a0d3-93b5f3f47d34 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.094065 Dec 18 20:55:54.003993 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1291/2564] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:53 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:54.019366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f4a6c94-a0aa-4262-89f0-ec19a9d95d43 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:54.020696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4f4a6c94-a0aa-4262-89f0-ec19a9d95d43 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:54.039018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f4a6c94-a0aa-4262-89f0-ec19a9d95d43 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.046671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f4a6c94-a0aa-4262-89f0-ec19a9d95d43 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.047569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f4a6c94-a0aa-4262-89f0-ec19a9d95d43 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.048030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f4a6c94-a0aa-4262-89f0-ec19a9d95d43 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.099805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:54.111048 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84ed3bda-ba1c-45c4-a27b-e75f280dc70e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1500 microversion: 2.1 time: 0.355814 Dec 18 20:55:54.114319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1274/2565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:53 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1500 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:54.149665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:54.151022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:54.160205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.162675 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4f4a6c94-a0aa-4262-89f0-ec19a9d95d43 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.156730 Dec 18 20:55:54.166752 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1292/2566] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:54 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:54.166949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.166949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.167437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.238496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:55:54.351512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:54.352775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:54.368607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.371619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.372778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.375546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.422941 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9184b6c-fd3d-4b25-8cbe-ede250b95f24 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 204 len: 0 microversion: 2.1 time: 0.279058 Dec 18 20:55:54.423971 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1275/2567] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:55:54 2021] DELETE /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:55:54.439489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:54.441576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:54.453222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.453837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.455043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.455638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.711687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:54.725351 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e165239e-b026-4b42-9aa0-79b31accabcf tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.380557 Dec 18 20:55:54.726613 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1293/2568] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:54 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:54.741922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2f80fcaf-605f-447b-890e-4051f3236b87 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:54.742993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2f80fcaf-605f-447b-890e-4051f3236b87 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:54.755222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fcaf-605f-447b-890e-4051f3236b87 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.763155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fcaf-605f-447b-890e-4051f3236b87 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.764287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fcaf-605f-447b-890e-4051f3236b87 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.764886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fcaf-605f-447b-890e-4051f3236b87 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.778189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:54.785681 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae8cca7c-c44b-4b77-82e7-2acf3182b260 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.357023 Dec 18 20:55:54.796139 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1276/2569] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:54 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:54.796139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:54.796139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:54.798596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.799049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.799835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:54.800269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:54.846667 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2f80fcaf-605f-447b-890e-4051f3236b87 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.118518 Dec 18 20:55:54.848097 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1294/2570] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:54 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:54.924421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b10b2fe7-4df2-4b13-b4c6-b4cefce343c9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71612d6e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:55.000281 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b10b2fe7-4df2-4b13-b4c6-b4cefce343c9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.082529 Dec 18 20:55:55.000947 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1295/2571] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:54 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:55.015764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:55.016245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8dfe8c92-568a-497e-86da-b408f3ca6737 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:55.019115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8dfe8c92-568a-497e-86da-b408f3ca6737 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:55.028725 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b5675177-dd5a-46c4-b091-b5b0430509c6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1470 microversion: 2.1 time: 0.239919 Dec 18 20:55:55.029562 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1277/2572] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:54 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:55.043012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dfe8c92-568a-497e-86da-b408f3ca6737 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.043658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dfe8c92-568a-497e-86da-b408f3ca6737 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.044622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dfe8c92-568a-497e-86da-b408f3ca6737 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.045079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dfe8c92-568a-497e-86da-b408f3ca6737 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.133653 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8dfe8c92-568a-497e-86da-b408f3ca6737 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 14 microversion: 2.1 time: 0.122654 Dec 18 20:55:55.134927 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1296/2573] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:55 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:55:55.174820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-27996556-df0b-4027-bd36-d32e7ba6e964 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:55.176051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-27996556-df0b-4027-bd36-d32e7ba6e964 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:55.182365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27996556-df0b-4027-bd36-d32e7ba6e964 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.182825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27996556-df0b-4027-bd36-d32e7ba6e964 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.184886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27996556-df0b-4027-bd36-d32e7ba6e964 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.185512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27996556-df0b-4027-bd36-d32e7ba6e964 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.235138 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-27996556-df0b-4027-bd36-d32e7ba6e964 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.063411 Dec 18 20:55:55.240289 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1278/2574] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:55 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:55.744326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:55.745521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:55.763090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.763540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.764358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.764808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.805890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:55.807253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:55.833188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.837219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.844439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:55.848798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:55.990807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:56.001507 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-007f2f44-49f0-45f1-8fc2-f525abaf3a70 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.262815 Dec 18 20:55:56.019308 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1297/2575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:55 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:56.025273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ed053d5a-3521-414a-8bc2-dbd68fb9af5b req-b0bc9791-061f-4f7d-9dde-242d16c9d14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93280f-4987-4eea-b229-7cc365db43ff", "name": "network-vif-plugged", "status": "completed", "tag": "2b8e5c57-7646-45bc-8bdf-d19b316188ed"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:56.028411 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:55:56.028411 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:55:56.047752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ed053d5a-3521-414a-8bc2-dbd68fb9af5b req-b0bc9791-061f-4f7d-9dde-242d16c9d14f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.048550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ed053d5a-3521-414a-8bc2-dbd68fb9af5b req-b0bc9791-061f-4f7d-9dde-242d16c9d14f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.070651 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ed053d5a-3521-414a-8bc2-dbd68fb9af5b req-b0bc9791-061f-4f7d-9dde-242d16c9d14f service nova] Creating event network-vif-plugged:2b8e5c57-7646-45bc-8bdf-d19b316188ed for instance bd93280f-4987-4eea-b229-7cc365db43ff on nch1-master-1 Dec 18 20:55:56.076642 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ed053d5a-3521-414a-8bc2-dbd68fb9af5b req-b0bc9791-061f-4f7d-9dde-242d16c9d14f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055769 Dec 18 20:55:56.081734 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1298/2576] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:55:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:55:56.088058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9cccb30-ee4f-4d95-9cd6-cb82803b20da tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:56.089706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9cccb30-ee4f-4d95-9cd6-cb82803b20da tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:56.097918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9cccb30-ee4f-4d95-9cd6-cb82803b20da tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.098769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9cccb30-ee4f-4d95-9cd6-cb82803b20da tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.100658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9cccb30-ee4f-4d95-9cd6-cb82803b20da tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.101411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9cccb30-ee4f-4d95-9cd6-cb82803b20da tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.122332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:56.132578 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ad9591e0-269d-4182-b7ac-4a6e80d3d69e tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.331826 Dec 18 20:55:56.140655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1279/2577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:55 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:55:56.147357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb9ab854-88bc-4169-8b18-ed876dd16604 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714f45a5e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:56.225330 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9cccb30-ee4f-4d95-9cd6-cb82803b20da tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.106230 Dec 18 20:55:56.225330 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1299/2578] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:56 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:56.225330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:56.225330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:56.304137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.304137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.304137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.304137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.347567 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb9ab854-88bc-4169-8b18-ed876dd16604 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.203928 Dec 18 20:55:56.348196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1280/2579] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:56 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:56.374524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d633e4e-2421-4d6d-8dc5-4e5a281e6b5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:56.375848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d633e4e-2421-4d6d-8dc5-4e5a281e6b5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:56.387195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d633e4e-2421-4d6d-8dc5-4e5a281e6b5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.387647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d633e4e-2421-4d6d-8dc5-4e5a281e6b5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.388441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d633e4e-2421-4d6d-8dc5-4e5a281e6b5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.390592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d633e4e-2421-4d6d-8dc5-4e5a281e6b5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.463603 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d633e4e-2421-4d6d-8dc5-4e5a281e6b5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action" status: 200 len: 8185 microversion: 2.1 time: 0.105321 Dec 18 20:55:56.465207 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1281/2580] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:56 2021] POST /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e/action => generated 8185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:56.476937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1088b601-8aef-403d-94c0-b9b9c3723500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:56.483020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1088b601-8aef-403d-94c0-b9b9c3723500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:56.496793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1088b601-8aef-403d-94c0-b9b9c3723500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.497519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1088b601-8aef-403d-94c0-b9b9c3723500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.498687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1088b601-8aef-403d-94c0-b9b9c3723500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.499326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1088b601-8aef-403d-94c0-b9b9c3723500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.571266 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1088b601-8aef-403d-94c0-b9b9c3723500 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.102497 Dec 18 20:55:56.577487 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1282/2581] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:56 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:56.585905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:56.599901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:56.601933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:56.609877 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a091233f-f401-4876-b661-16ae9962fcb6 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1470 microversion: 2.1 time: 0.415375 Dec 18 20:55:56.610510 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1300/2582] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:56 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:56.615913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.617505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.619672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.621003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.917361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:56.926522 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38df6b6d-5895-4737-9c56-62b70c4bf947 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.346336 Dec 18 20:55:56.930390 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1283/2583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:56 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:56.954886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:56.956566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:56.973771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.974313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:56.977310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:56.977793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.019014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:57.020065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:57.028580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.034624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.035799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.036383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.393200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:57.402189 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f4de5b6-240b-4d3e-b728-e1a88778f79f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.387386 Dec 18 20:55:57.405064 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1284/2584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:57 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:57.413333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:57.415934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:57.417986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:57.423443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.424076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.425017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.425623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.441548 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40ad258c-b58d-493f-92d5-31261b6b0223 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.490064 Dec 18 20:55:57.442697 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1301/2585] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:56 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:57.448271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-331f1e77-ce51-4562-a7fb-427a94ccddb8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:57.449418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-331f1e77-ce51-4562-a7fb-427a94ccddb8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:57.467105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-331f1e77-ce51-4562-a7fb-427a94ccddb8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.467848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-331f1e77-ce51-4562-a7fb-427a94ccddb8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.469620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-331f1e77-ce51-4562-a7fb-427a94ccddb8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.472017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-331f1e77-ce51-4562-a7fb-427a94ccddb8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.544348 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-331f1e77-ce51-4562-a7fb-427a94ccddb8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.099555 Dec 18 20:55:57.545031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1302/2586] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:57 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:57.552380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13b03716-a78b-4065-8b0c-53c0a644e120 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef6b670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:57.634005 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13b03716-a78b-4065-8b0c-53c0a644e120 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.087625 Dec 18 20:55:57.636855 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1303/2587] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:57 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:57.648920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:57.649840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:57.667639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.668321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.669284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.669660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:57.670032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.678892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f47edaef-a8ff-4da9-b825-516e4e2062f5 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 0.271434 Dec 18 20:55:57.679487 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1285/2588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:57 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:57.686925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50019a75-b860-46df-b4d3-9077244b3275 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:57.689438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50019a75-b860-46df-b4d3-9077244b3275 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:57.730836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50019a75-b860-46df-b4d3-9077244b3275 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.733214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50019a75-b860-46df-b4d3-9077244b3275 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.734491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50019a75-b860-46df-b4d3-9077244b3275 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.737229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50019a75-b860-46df-b4d3-9077244b3275 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.809720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Locking {{(pid=140731) lock /opt/stack/nova/nova/compute/api.py:4624}} Dec 18 20:55:57.820392 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50019a75-b860-46df-b4d3-9077244b3275 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.137999 Dec 18 20:55:57.823529 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1286/2589] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:57 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:57.833186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:57.835844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:57.845485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.846048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.847176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.847521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.901098 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f52d0f8f-1cb2-4c15-a1ea-183f20a53908 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.261758 Dec 18 20:55:57.902720 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1304/2590] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:57 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:57.911563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:57.913131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:57.924196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.924665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:57.926010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:57.926497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.278580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:58.287677 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7c7b72e4-7185-4e3f-810c-045ca1e6ae23 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1470 microversion: 2.1 time: 0.462967 Dec 18 20:55:58.291343 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1287/2591] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:57 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:58.352118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:58.364782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f02e6590-6ca8-4abf-9892-3cb2168fd6f3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.457311 Dec 18 20:55:58.367194 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1305/2592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:57 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:58.384860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d99b12c2-f819-4c57-889b-90184f51b004 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:58.392091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d99b12c2-f819-4c57-889b-90184f51b004 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.395704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d99b12c2-f819-4c57-889b-90184f51b004 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.421509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:58.422711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:58.436183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.436666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.437473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.437817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d99b12c2-f819-4c57-889b-90184f51b004 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] HTTP exception thrown: Instance d025fcfa-d293-483a-80c3-2100f89d26f4 is locked Dec 18 20:55:58.437934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.438739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d99b12c2-f819-4c57-889b-90184f51b004 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Returning 409 to user: Instance d025fcfa-d293-483a-80c3-2100f89d26f4 is locked {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:55:58.439576 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d99b12c2-f819-4c57-889b-90184f51b004 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 409 len: 107 microversion: 2.1 time: 0.058632 Dec 18 20:55:58.440126 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1288/2593] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:58 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 107 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:55:58.449637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:58.450540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:58.460178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.460849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.462094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.463515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.557012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Unlocking {{(pid=140732) unlock /opt/stack/nova/nova/compute/api.py:4653}} Dec 18 20:55:58.702187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:55:58.715679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-79c03687-689b-49d9-b797-b242bff0355d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.294611 Dec 18 20:55:58.716640 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1306/2594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:58 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:58.719276 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c013c64a-e957-4c23-b79c-8c358898fc52 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.268195 Dec 18 20:55:58.720568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1289/2595] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:58 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:55:58.727252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a50b178-144d-4ad7-b3fb-a8a20ccb2602 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:58.728887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a50b178-144d-4ad7-b3fb-a8a20ccb2602 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:58.737773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a50b178-144d-4ad7-b3fb-a8a20ccb2602 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.738219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a50b178-144d-4ad7-b3fb-a8a20ccb2602 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.739410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a50b178-144d-4ad7-b3fb-a8a20ccb2602 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.739935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a50b178-144d-4ad7-b3fb-a8a20ccb2602 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.783240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f447fe2c-c960-49c9-807f-22ef022ae4d3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef60550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:58.877568 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a50b178-144d-4ad7-b3fb-a8a20ccb2602 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.159572 Dec 18 20:55:58.884141 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1307/2596] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:55:58 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:58.901981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:58.917052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:58.932799 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f447fe2c-c960-49c9-807f-22ef022ae4d3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.202945 Dec 18 20:55:58.933329 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1290/2597] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:58 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:55:58.942390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.948490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.950042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbbf28f4-125f-4e4c-b4a8-251627c9b9a9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:58.957865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.961242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:58.976614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbbf28f4-125f-4e4c-b4a8-251627c9b9a9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:58.977534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbbf28f4-125f-4e4c-b4a8-251627c9b9a9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:59.062910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbbf28f4-125f-4e4c-b4a8-251627c9b9a9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Going to try to stop instance {{(pid=140732) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 20:55:59.174095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbbf28f4-125f-4e4c-b4a8-251627c9b9a9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.228419 Dec 18 20:55:59.182122 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1291/2598] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:58 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:55:59.187580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-273a58ee-a943-4bb2-b439-46cbad941eb2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:55:59.195012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-273a58ee-a943-4bb2-b439-46cbad941eb2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:59.223622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a58ee-a943-4bb2-b439-46cbad941eb2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:59.224087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a58ee-a943-4bb2-b439-46cbad941eb2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:59.225568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a58ee-a943-4bb2-b439-46cbad941eb2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:59.226017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a58ee-a943-4bb2-b439-46cbad941eb2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:59.314035 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-273a58ee-a943-4bb2-b439-46cbad941eb2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.130034 Dec 18 20:55:59.318614 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1292/2599] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:55:59 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:55:59.330788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:55:59.331640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:55:59.366295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:59.366717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:55:59.367567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:55:59.368007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:00.091671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:00.102575 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-de19bc79-30dd-4483-8cbe-134154adbae4 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 200 len: 1506 microversion: 2.1 time: 1.215906 Dec 18 20:56:00.103572 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1308/2600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:58 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 1506 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:00.118726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:00.120535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:00.144176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:00.144975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:00.146198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:00.146818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:00.210357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:00.220670 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-677b6dbf-8792-4b99-86d2-5d3a9fede336 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.903748 Dec 18 20:56:00.221272 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1293/2601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:55:59 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:00.233453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-21fce935-d13f-4433-81ef-92a253f4fb82 req-32428a0b-ca72-4369-9306-e2d7847f3bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490a83d0-be20-498a-8e6d-036b4f27f890", "tag": "24ea0eab-019c-481e-a0e8-afff63a3a8c8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:00.238479 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:00.238479 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:00.258656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-21fce935-d13f-4433-81ef-92a253f4fb82 req-32428a0b-ca72-4369-9306-e2d7847f3bf3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:00.259270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-21fce935-d13f-4433-81ef-92a253f4fb82 req-32428a0b-ca72-4369-9306-e2d7847f3bf3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:00.303028 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-21fce935-d13f-4433-81ef-92a253f4fb82 req-32428a0b-ca72-4369-9306-e2d7847f3bf3 service nova] Creating event network-changed:24ea0eab-019c-481e-a0e8-afff63a3a8c8 for instance 490a83d0-be20-498a-8e6d-036b4f27f890 on nch1-master-1 Dec 18 20:56:00.327626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-21fce935-d13f-4433-81ef-92a253f4fb82 req-32428a0b-ca72-4369-9306-e2d7847f3bf3 service nova] Instance 490a83d0-be20-498a-8e6d-036b4f27f890 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 20:56:00.389115 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-21fce935-d13f-4433-81ef-92a253f4fb82 req-32428a0b-ca72-4369-9306-e2d7847f3bf3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166573 Dec 18 20:56:00.390003 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1294/2602] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:00.425859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:00.430185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:00.467915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:00.468852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:00.473427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:00.474640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.040549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:01.056361 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f07ce30-02d6-40d2-8397-751458c6c259 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1470 microversion: 2.1 time: 0.950818 Dec 18 20:56:01.059287 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1309/2603] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:00 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1470 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:01.081235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67e8100b-49ed-4436-9b61-52df4e8ec78a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:01.084482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67e8100b-49ed-4436-9b61-52df4e8ec78a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:01.106325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:01.109539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e8100b-49ed-4436-9b61-52df4e8ec78a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.112416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e8100b-49ed-4436-9b61-52df4e8ec78a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.113480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e8100b-49ed-4436-9b61-52df4e8ec78a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.117197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e8100b-49ed-4436-9b61-52df4e8ec78a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.118394 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d89fa2e6-de9b-4d04-8a3b-214efb989d31 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.709506 Dec 18 20:56:01.120594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1295/2604] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:00 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:01.128389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-00ad39c4-59b1-48c5-8b48-abc0864524f7 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613434c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:01.242424 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67e8100b-49ed-4436-9b61-52df4e8ec78a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.171777 Dec 18 20:56:01.243972 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1310/2605] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:01 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:01.254072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bcdc5603-6b1e-4c66-91bd-a2a873d04ba0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:01.256759 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-00ad39c4-59b1-48c5-8b48-abc0864524f7 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.134314 Dec 18 20:56:01.257407 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1296/2606] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:01 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:01.260623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bcdc5603-6b1e-4c66-91bd-a2a873d04ba0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:01.279096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcdc5603-6b1e-4c66-91bd-a2a873d04ba0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.279301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:01.279942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:01.281181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcdc5603-6b1e-4c66-91bd-a2a873d04ba0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.282288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcdc5603-6b1e-4c66-91bd-a2a873d04ba0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.291646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcdc5603-6b1e-4c66-91bd-a2a873d04ba0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.294195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.294842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.298968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.301227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.341914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] HTTP exception thrown: Instance 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a could not be found. Dec 18 20:56:01.350662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Returning 404 to user: Instance 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:01.352095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-16cc628e-c9e4-4482-ab7e-98a7c55fedd7 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a" status: 404 len: 111 microversion: 2.1 time: 0.086540 Dec 18 20:56:01.360109 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1297/2607] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:01 2021] GET /compute/v2.1/servers/2536cb7d-644f-4ed4-bdf8-eb3873d16d9a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:01.378777 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bcdc5603-6b1e-4c66-91bd-a2a873d04ba0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.129861 Dec 18 20:56:01.379697 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1311/2608] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:01 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:01.382418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:01.383169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:01.387161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:01.394064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:01.406820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.407275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.413029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.413797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.414502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.415202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.415304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.415965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.500619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:01.727103 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7fb1b02-8e1f-4649-9f75-e092d9ccba31 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 204 len: 0 microversion: 2.1 time: 0.342419 Dec 18 20:56:01.729538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1312/2609] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:01 2021] DELETE /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:01.742186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:01.745725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:01.764258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.764730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:01.765660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:01.766182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.173617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:02.186386 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d4c949a-d93d-4818-9a86-45e93f44a40f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.821834 Dec 18 20:56:02.189397 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1298/2610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:01 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:02.203407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:02.215295 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9ae5aa2-f08c-49c1-b410-d66895f41bee tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1492 microversion: 2.1 time: 0.480295 Dec 18 20:56:02.215891 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1313/2611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:01 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1492 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:02.216040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:02.227036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:02.230087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:02.230983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:02.233689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.234399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.235399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.236036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.243018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.243482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.245776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.250059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.609698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:02.631543 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af31c862-0971-49c6-ac81-52771261124d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1470 microversion: 2.1 time: 0.438621 Dec 18 20:56:02.654567 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1299/2612] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:02 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1470 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:02.670399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fee5b011-0dec-4259-a0f5-9dd5e8283810 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:02.674596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fee5b011-0dec-4259-a0f5-9dd5e8283810 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:02.683127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fee5b011-0dec-4259-a0f5-9dd5e8283810 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.684073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fee5b011-0dec-4259-a0f5-9dd5e8283810 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.685793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fee5b011-0dec-4259-a0f5-9dd5e8283810 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.686487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fee5b011-0dec-4259-a0f5-9dd5e8283810 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.698069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:02.718011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-954ff687-b21a-4528-b0a2-70b3b2f6aa2c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.492872 Dec 18 20:56:02.718732 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1314/2613] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:02 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:02.743771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b686b6b3-2bc7-4702-b9ac-465c243454da tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613524c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:02.764260 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fee5b011-0dec-4259-a0f5-9dd5e8283810 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.103740 Dec 18 20:56:02.765966 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1300/2614] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:02 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:02.774355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ddcbdf50-46c4-4170-b4d5-e4d2b6c76899 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:02.783529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ddcbdf50-46c4-4170-b4d5-e4d2b6c76899 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:02.798160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddcbdf50-46c4-4170-b4d5-e4d2b6c76899 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.798653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddcbdf50-46c4-4170-b4d5-e4d2b6c76899 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.799464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddcbdf50-46c4-4170-b4d5-e4d2b6c76899 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.804478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddcbdf50-46c4-4170-b4d5-e4d2b6c76899 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.810014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b686b6b3-2bc7-4702-b9ac-465c243454da tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.085863 Dec 18 20:56:02.816206 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1315/2615] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:02 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:02.820009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-753afc20-4041-4ceb-bf23-7ee21d541c65 req-edcf271b-fc8f-4772-a7fc-813d5547f2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2536cb7d-644f-4ed4-bdf8-eb3873d16d9a", "name": "network-vif-deleted", "tag": "3638caa9-84ba-4b7e-b9be-44279669b05b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:02.821663 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:02.821663 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:02.839844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-753afc20-4041-4ceb-bf23-7ee21d541c65 req-edcf271b-fc8f-4772-a7fc-813d5547f2c4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:02.840299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-753afc20-4041-4ceb-bf23-7ee21d541c65 req-edcf271b-fc8f-4772-a7fc-813d5547f2c4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:02.868432 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-753afc20-4041-4ceb-bf23-7ee21d541c65 req-edcf271b-fc8f-4772-a7fc-813d5547f2c4 service nova] Creating event network-vif-deleted:3638caa9-84ba-4b7e-b9be-44279669b05b for instance 2536cb7d-644f-4ed4-bdf8-eb3873d16d9a on nch1-master-1 Dec 18 20:56:02.885701 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-753afc20-4041-4ceb-bf23-7ee21d541c65 req-edcf271b-fc8f-4772-a7fc-813d5547f2c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073481 Dec 18 20:56:02.886654 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1316/2616] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:02.934111 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ddcbdf50-46c4-4170-b4d5-e4d2b6c76899 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.166727 Dec 18 20:56:02.940808 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1301/2617] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:02 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:03.206740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:03.207584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:03.226186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.235888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:03.236702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:03.252344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.253301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:03.254394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.254911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:03.270531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:03.275482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.278280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:03.744559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:03.762011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-efb8e1d1-868e-4857-b49c-2a1589f2edd9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.561103 Dec 18 20:56:03.762666 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1317/2618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:03 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:03.764522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:03.770806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:03.771975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:03.780624 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5fd4430b-24fd-4bc8-be54-5ba7a05c0897 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1492 microversion: 2.1 time: 0.550897 Dec 18 20:56:03.798881 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1302/2619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:03 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1492 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:03.799062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.799062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:03.799062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.799062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:03.802506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:03.806716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:03.819286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.820682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:03.829673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:03.830229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.240986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:04.255593 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92cd4c83-433c-4ff1-b316-ce7fb236168e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1463 microversion: 2.1 time: 0.491683 Dec 18 20:56:04.256566 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1318/2620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:03 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1463 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:04.273934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b87c41ec-75f8-42a7-b816-35d2d90af403 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:04.275891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b87c41ec-75f8-42a7-b816-35d2d90af403 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:04.289470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b87c41ec-75f8-42a7-b816-35d2d90af403 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.290162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b87c41ec-75f8-42a7-b816-35d2d90af403 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.291886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b87c41ec-75f8-42a7-b816-35d2d90af403 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.296450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b87c41ec-75f8-42a7-b816-35d2d90af403 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.337921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:04.348861 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5b4cf501-75cb-4db1-aa2e-c8a18de6602d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.552123 Dec 18 20:56:04.350543 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1303/2621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:03 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:04.366547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b36b8f24-31d4-4b37-8bbb-bcbac695420f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716132ee50>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:04.408750 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b87c41ec-75f8-42a7-b816-35d2d90af403 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.148751 Dec 18 20:56:04.415895 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1319/2622] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:04 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:04.440893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07429258-2a49-4c1e-b733-3b1864b1275e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:04.443598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07429258-2a49-4c1e-b733-3b1864b1275e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:04.467118 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b36b8f24-31d4-4b37-8bbb-bcbac695420f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.113170 Dec 18 20:56:04.468326 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1304/2623] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:04 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:04.478170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07429258-2a49-4c1e-b733-3b1864b1275e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.480329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07429258-2a49-4c1e-b733-3b1864b1275e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.481301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07429258-2a49-4c1e-b733-3b1864b1275e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.481683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0ac5c9f9-8b88-4172-a890-a382f5cf5944 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:04.482439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0ac5c9f9-8b88-4172-a890-a382f5cf5944 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:04.483066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07429258-2a49-4c1e-b733-3b1864b1275e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.504782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ac5c9f9-8b88-4172-a890-a382f5cf5944 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.506142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ac5c9f9-8b88-4172-a890-a382f5cf5944 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.509993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ac5c9f9-8b88-4172-a890-a382f5cf5944 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.514028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ac5c9f9-8b88-4172-a890-a382f5cf5944 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.563139 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07429258-2a49-4c1e-b733-3b1864b1275e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.145654 Dec 18 20:56:04.582685 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1320/2624] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:04 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:04.783726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:04.784461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:04.812455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.814571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:04.818391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:04.818717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:05.149643 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0ac5c9f9-8b88-4172-a890-a382f5cf5944 tempest-MigrationsAdminTest-1204409510 tempest-MigrationsAdminTest-1204409510-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1614 microversion: 2.1 time: 0.679030 Dec 18 20:56:05.179407 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1305/2625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:04 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1614 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:05.198116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:05.199734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:05.240914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:05.241609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:05.245468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:05.246107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:05.760392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:05.772289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:05.789514 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59a9eab0-1e8a-4854-8632-aa01916a07bb tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1492 microversion: 2.1 time: 0.608834 Dec 18 20:56:05.803943 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1306/2626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:05 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1492 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:05.805011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0c6834c-cb99-45d1-bba6-59669b47e55a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 1.014047 Dec 18 20:56:05.806239 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1321/2627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:04 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:05.817378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:05.818585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:05.819402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:05.821402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:05.846873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:05.850387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:05.854161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:05.854673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:05.857230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:05.857767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:05.858685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:05.859062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:05.980205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:06.206767 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-544472ce-c7f5-42df-a2ba-6116d82831db tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "DELETE /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 204 len: 0 microversion: 2.1 time: 0.399763 Dec 18 20:56:06.207472 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1307/2628] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:05 2021] DELETE /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:06.215061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-170927d4-66f1-4a19-9953-2809cd18c763 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:06.219538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-170927d4-66f1-4a19-9953-2809cd18c763 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:06.234593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170927d4-66f1-4a19-9953-2809cd18c763 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.235039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170927d4-66f1-4a19-9953-2809cd18c763 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.235847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170927d4-66f1-4a19-9953-2809cd18c763 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.236294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170927d4-66f1-4a19-9953-2809cd18c763 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.429344 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-170927d4-66f1-4a19-9953-2809cd18c763 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.220345 Dec 18 20:56:06.434561 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1308/2629] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:06 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:06.446485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b3d6b363-d2ac-4183-98ac-ae0e41e4f1c9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714e60c550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:06.476493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:06.493988 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23b957f2-9cb7-4768-a31e-38943df1b58e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.681136 Dec 18 20:56:06.499304 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1322/2630] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:05 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:06.526371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4567e34-a396-4ea7-ac85-2e1ecdaebf85 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:06.527452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4567e34-a396-4ea7-ac85-2e1ecdaebf85 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:06.568534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4567e34-a396-4ea7-ac85-2e1ecdaebf85 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.575673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4567e34-a396-4ea7-ac85-2e1ecdaebf85 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.578294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4567e34-a396-4ea7-ac85-2e1ecdaebf85 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.581453 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b3d6b363-d2ac-4183-98ac-ae0e41e4f1c9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.144607 Dec 18 20:56:06.582313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4567e34-a396-4ea7-ac85-2e1ecdaebf85 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.584234 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1309/2631] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:06 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:06.595369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:06.599003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:06.610007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.610552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.613102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.614181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.697075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4567e34-a396-4ea7-ac85-2e1ecdaebf85 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.193154 Dec 18 20:56:06.701277 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1323/2632] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:06 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:06.708043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-cf6d6b9e-6d41-47b1-bff9-4a46ec08c1c5 req-60e6e64b-1f46-47f6-ba37-5419aa873e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af230c2-c718-48a0-9991-6c0418c4618d", "name": "network-vif-deleted", "tag": "f4df3e7c-2733-4319-be8f-892a0ca14aa9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:06.719891 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:06.719891 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:06.741341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cf6d6b9e-6d41-47b1-bff9-4a46ec08c1c5 req-60e6e64b-1f46-47f6-ba37-5419aa873e1e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.741789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cf6d6b9e-6d41-47b1-bff9-4a46ec08c1c5 req-60e6e64b-1f46-47f6-ba37-5419aa873e1e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.782686 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-cf6d6b9e-6d41-47b1-bff9-4a46ec08c1c5 req-60e6e64b-1f46-47f6-ba37-5419aa873e1e service nova] Creating event network-vif-deleted:f4df3e7c-2733-4319-be8f-892a0ca14aa9 for instance 2af230c2-c718-48a0-9991-6c0418c4618d on nch2-master-1 Dec 18 20:56:06.792597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-cf6d6b9e-6d41-47b1-bff9-4a46ec08c1c5 req-60e6e64b-1f46-47f6-ba37-5419aa873e1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089363 Dec 18 20:56:06.801126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1324/2633] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:06.821296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:06.826219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:06.826505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:06.836754 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e48cfb1-bf61-4ca9-8967-a3da25a5e5e1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1469 microversion: 2.1 time: 0.250932 Dec 18 20:56:06.837419 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1310/2634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:06 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:06.846519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:06.846519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:06.848012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.849676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.853008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.855931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.857108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.857808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:06.859123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:06.859912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.001723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.004250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.004850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lazy-loading 'fault' on Instance uuid 2af230c2-c718-48a0-9991-6c0418c4618d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:56:07.086565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad564476e1cf4a0b87fef4e3d08e6726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:07.098165 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-05606aaf-c933-462c-93c0-03e04c1074be tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 200 len: 1304 microversion: 2.1 time: 0.288931 Dec 18 20:56:07.113489 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1325/2635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:06 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 1304 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:07.246750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:07.257339 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cac4bec4-8a48-4d1f-bb9c-b006e4865a88 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.418246 Dec 18 20:56:07.261710 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1311/2636] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:06 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:07.442643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5cdea25b-e8c6-41e2-bea7-216d84cf6170 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:07.444877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5cdea25b-e8c6-41e2-bea7-216d84cf6170 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:07.462069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdea25b-e8c6-41e2-bea7-216d84cf6170 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.463081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdea25b-e8c6-41e2-bea7-216d84cf6170 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.464210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdea25b-e8c6-41e2-bea7-216d84cf6170 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.464879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdea25b-e8c6-41e2-bea7-216d84cf6170 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.517490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:07.519130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:07.531773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.534904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.539798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.540956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.565099 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5cdea25b-e8c6-41e2-bea7-216d84cf6170 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.126274 Dec 18 20:56:07.566815 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1326/2637] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:07 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:07.598879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c63a112-f71e-4d0b-bb3a-1570761c3619 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716134d670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:07.686576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c63a112-f71e-4d0b-bb3a-1570761c3619 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.092364 Dec 18 20:56:07.687155 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1327/2638] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:07 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:07.725160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3044b66b-109f-4a3e-821a-68de7e50994a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:07.726576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3044b66b-109f-4a3e-821a-68de7e50994a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:07.740815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3044b66b-109f-4a3e-821a-68de7e50994a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.741486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3044b66b-109f-4a3e-821a-68de7e50994a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.742560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3044b66b-109f-4a3e-821a-68de7e50994a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.743595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3044b66b-109f-4a3e-821a-68de7e50994a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.814936 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3044b66b-109f-4a3e-821a-68de7e50994a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.098030 Dec 18 20:56:07.821468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1328/2639] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:07 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:56:07.857226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:07.858227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:07.864306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:07.873987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.874765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.875921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:07.876509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:07.877576 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89bb8cae-ac16-4b24-a952-e27a9927d390 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.364285 Dec 18 20:56:07.895075 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1312/2640] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:07 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:08.070093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:08.084108 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d770b1ec-e049-426e-aac6-fe31565089c1 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1469 microversion: 2.1 time: 0.231752 Dec 18 20:56:08.086288 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1329/2641] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:07 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:08.118524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:08.119274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] [instance: 2af230c2-c718-48a0-9991-6c0418c4618d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:08.127519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.128086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.129109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.129552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.150180 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] HTTP exception thrown: Instance 2af230c2-c718-48a0-9991-6c0418c4618d could not be found. Dec 18 20:56:08.150923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] Returning 404 to user: Instance 2af230c2-c718-48a0-9991-6c0418c4618d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:08.151763 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2bb96999-cad7-48d2-9f41-d5024cbb7384 tempest-ServerRescueTestJSON-149283055 tempest-ServerRescueTestJSON-149283055-project] 10.222.0.13 "GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d" status: 404 len: 111 microversion: 2.1 time: 0.039872 Dec 18 20:56:08.155602 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1313/2642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:08 2021] GET /compute/v2.1/servers/2af230c2-c718-48a0-9991-6c0418c4618d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:08.218035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-617867db-a139-4f9f-87fc-a6cc77b6a5d8 req-28ac56fd-3ad5-4d9b-a05f-f492c4380407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490a83d0-be20-498a-8e6d-036b4f27f890", "name": "network-vif-plugged", "status": "completed", "tag": "24ea0eab-019c-481e-a0e8-afff63a3a8c8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:08.220252 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:08.220252 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:08.264012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-617867db-a139-4f9f-87fc-a6cc77b6a5d8 req-28ac56fd-3ad5-4d9b-a05f-f492c4380407 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.264012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-617867db-a139-4f9f-87fc-a6cc77b6a5d8 req-28ac56fd-3ad5-4d9b-a05f-f492c4380407 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.280041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:08.281188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:08.296216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.296677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.301098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.301730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.313802 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-617867db-a139-4f9f-87fc-a6cc77b6a5d8 req-28ac56fd-3ad5-4d9b-a05f-f492c4380407 service nova] Creating event network-vif-plugged:24ea0eab-019c-481e-a0e8-afff63a3a8c8 for instance 490a83d0-be20-498a-8e6d-036b4f27f890 on nch1-master-1 Dec 18 20:56:08.343334 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-617867db-a139-4f9f-87fc-a6cc77b6a5d8 req-28ac56fd-3ad5-4d9b-a05f-f492c4380407 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129350 Dec 18 20:56:08.346454 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1330/2643] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:08.579672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e8bf4a06-2969-464b-bae2-c6594f9c8155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:08.582455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e8bf4a06-2969-464b-bae2-c6594f9c8155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:08.595150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8bf4a06-2969-464b-bae2-c6594f9c8155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.595877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8bf4a06-2969-464b-bae2-c6594f9c8155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.598395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8bf4a06-2969-464b-bae2-c6594f9c8155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.599320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8bf4a06-2969-464b-bae2-c6594f9c8155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.685757 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e8bf4a06-2969-464b-bae2-c6594f9c8155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.112084 Dec 18 20:56:08.688158 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1331/2644] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:08 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:56:08.700889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fbb1d634-7c86-453e-8294-81a859bc15ae tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef674c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:08.765575 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fbb1d634-7c86-453e-8294-81a859bc15ae tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.068899 Dec 18 20:56:08.766176 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1332/2645] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:08 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:08.832859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ffe026d-cbe8-46dc-8405-695634fea3f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:08.835297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8ffe026d-cbe8-46dc-8405-695634fea3f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:08.852285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ffe026d-cbe8-46dc-8405-695634fea3f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.852968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ffe026d-cbe8-46dc-8405-695634fea3f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.854003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ffe026d-cbe8-46dc-8405-695634fea3f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.854793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ffe026d-cbe8-46dc-8405-695634fea3f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.934808 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8ffe026d-cbe8-46dc-8405-695634fea3f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.106254 Dec 18 20:56:08.935828 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1333/2646] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:08 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:56:08.944859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:08.945925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:08.955496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.956263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:08.957535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:08.958140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:09.072655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:09.098602 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8b884f03-7d0b-47c7-b60d-5947ee98c57c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.822005 Dec 18 20:56:09.099716 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1314/2647] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:08 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:09.106319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:09.107010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:09.116801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:09.117454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:09.119085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:09.119619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:09.294430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:09.307908 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4fc537e0-59f5-46d9-853b-d07f7b2d8e10 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.370597 Dec 18 20:56:09.311940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1334/2648] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:08 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:09.536119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:09.553228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31f17e35-3aac-4941-9cbc-41142734dee8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 200 len: 1469 microversion: 2.1 time: 0.452022 Dec 18 20:56:09.565510 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1315/2649] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:09 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 1469 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:09.699274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1682d91f-ba7f-428e-86b8-b006c8a20a0a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:09.700799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1682d91f-ba7f-428e-86b8-b006c8a20a0a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:09.718666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-86e2a73e-11c5-4cbc-9186-6daf18321fdb req-bd0e144b-2902-4731-ac0f-e9baa483dab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490a83d0-be20-498a-8e6d-036b4f27f890", "name": "network-vif-deleted", "tag": "24ea0eab-019c-481e-a0e8-afff63a3a8c8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:09.721260 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:09.721260 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:09.730508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1682d91f-ba7f-428e-86b8-b006c8a20a0a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:09.732584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1682d91f-ba7f-428e-86b8-b006c8a20a0a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:09.733682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1682d91f-ba7f-428e-86b8-b006c8a20a0a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:09.736357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1682d91f-ba7f-428e-86b8-b006c8a20a0a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:09.746713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-86e2a73e-11c5-4cbc-9186-6daf18321fdb req-bd0e144b-2902-4731-ac0f-e9baa483dab7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:09.747453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-86e2a73e-11c5-4cbc-9186-6daf18321fdb req-bd0e144b-2902-4731-ac0f-e9baa483dab7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:09.784596 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-86e2a73e-11c5-4cbc-9186-6daf18321fdb req-bd0e144b-2902-4731-ac0f-e9baa483dab7 service nova] Creating event network-vif-deleted:24ea0eab-019c-481e-a0e8-afff63a3a8c8 for instance 490a83d0-be20-498a-8e6d-036b4f27f890 on nch1-master-1 Dec 18 20:56:09.802629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-86e2a73e-11c5-4cbc-9186-6daf18321fdb req-bd0e144b-2902-4731-ac0f-e9baa483dab7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087845 Dec 18 20:56:09.803825 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1316/2650] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:56:09.814870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-865c2ad0-adaa-4cc3-a000-78cd26e02031 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614abb80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:09.832538 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1682d91f-ba7f-428e-86b8-b006c8a20a0a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.137867 Dec 18 20:56:09.834167 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1335/2651] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:09 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:09.915556 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-865c2ad0-adaa-4cc3-a000-78cd26e02031 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.110263 Dec 18 20:56:09.917497 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1317/2652] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:09 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:09.947495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86e606dc-cc49-4eaa-8ec0-6527cdaf735f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:09.948886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86e606dc-cc49-4eaa-8ec0-6527cdaf735f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:09.968977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e606dc-cc49-4eaa-8ec0-6527cdaf735f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:09.969493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e606dc-cc49-4eaa-8ec0-6527cdaf735f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:09.970423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e606dc-cc49-4eaa-8ec0-6527cdaf735f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:09.970897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e606dc-cc49-4eaa-8ec0-6527cdaf735f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.048828 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86e606dc-cc49-4eaa-8ec0-6527cdaf735f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.105660 Dec 18 20:56:10.050066 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1336/2653] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:09 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:56:10.116587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:10.117327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:10.125935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.128045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.129105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.129562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.335573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:10.338980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:10.356875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.357309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.358099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.358572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.693872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:10.705675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3dd1d0a-954b-4ad3-bf40-bd7d4708ac63 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1658 microversion: 2.1 time: 0.592690 Dec 18 20:56:10.706540 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1318/2654] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:10 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1658 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:10.720465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:10.721309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 490a83d0-be20-498a-8e6d-036b4f27f890] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:10.729792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.730728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.735277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.737730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.763724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] HTTP exception thrown: Instance 490a83d0-be20-498a-8e6d-036b4f27f890 could not be found. Dec 18 20:56:10.764577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Returning 404 to user: Instance 490a83d0-be20-498a-8e6d-036b4f27f890 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:10.765631 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85a549fe-52bf-4bee-9bca-fbe43c8b956d tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890" status: 404 len: 111 microversion: 2.1 time: 0.057923 Dec 18 20:56:10.766382 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1319/2655] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:10 2021] GET /compute/v2.1/servers/490a83d0-be20-498a-8e6d-036b4f27f890 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:10.773891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-27ca27fa-ef46-4871-82b1-02a8d5558d37 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:10.780684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27ca27fa-ef46-4871-82b1-02a8d5558d37 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.781351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27ca27fa-ef46-4871-82b1-02a8d5558d37 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.816430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-27ca27fa-ef46-4871-82b1-02a8d5558d37 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Going to try to start instance {{(pid=140732) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 20:56:10.892018 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-27ca27fa-ef46-4871-82b1-02a8d5558d37 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.118203 Dec 18 20:56:10.892667 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1320/2656] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:10 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:10.899788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:10.900301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:10.900652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:10.911935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.912447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.913691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.916748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.916902 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d3ef0be6-423c-45e7-9583-6e5fb26f62c0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.591331 Dec 18 20:56:10.917884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1337/2657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:10 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:10.922797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51caec3f-b8fd-4ea3-8ee6-007116aa477f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:10.924011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51caec3f-b8fd-4ea3-8ee6-007116aa477f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:10.943756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51caec3f-b8fd-4ea3-8ee6-007116aa477f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.944202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51caec3f-b8fd-4ea3-8ee6-007116aa477f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.945114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51caec3f-b8fd-4ea3-8ee6-007116aa477f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:10.945561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51caec3f-b8fd-4ea3-8ee6-007116aa477f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:10.974759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:11.021244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51caec3f-b8fd-4ea3-8ee6-007116aa477f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.101880 Dec 18 20:56:11.027975 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1338/2658] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:10 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:11.039554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:11.040607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:11.059993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.060572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.061479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.061982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.179605 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-751756a1-c8ff-480f-bca3-5e029adb4290 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "DELETE /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 204 len: 0 microversion: 2.1 time: 0.283198 Dec 18 20:56:11.184579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1321/2659] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:10 2021] DELETE /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:11.196775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e0f4c57-5fd5-427e-811f-897779ba541a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71612f6b80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:11.268170 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e0f4c57-5fd5-427e-811f-897779ba541a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.079878 Dec 18 20:56:11.274790 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1322/2660] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:11 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:11.284667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c54025a3-a67d-4f15-a4e8-2b6e867c7e1e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:11.287761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c54025a3-a67d-4f15-a4e8-2b6e867c7e1e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:11.297323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54025a3-a67d-4f15-a4e8-2b6e867c7e1e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.297952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54025a3-a67d-4f15-a4e8-2b6e867c7e1e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.314706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54025a3-a67d-4f15-a4e8-2b6e867c7e1e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.317650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54025a3-a67d-4f15-a4e8-2b6e867c7e1e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.478196 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c54025a3-a67d-4f15-a4e8-2b6e867c7e1e tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.198248 Dec 18 20:56:11.478196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1323/2661] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:11 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:11.492869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:11.493626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:11.530903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.531747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.534234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.537177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.683737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:11.693221 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47b484e9-0b00-4699-8fc6-1037363aa7f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1667 microversion: 2.1 time: 0.663218 Dec 18 20:56:11.710229 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1339/2662] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:11 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1667 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:11.936010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:11.937437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:11.945169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.945946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.947106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:11.947863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:11.986716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:11.996377 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2902051f-6ad2-4427-8849-49ed3811bd0f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1534 microversion: 2.1 time: 0.518714 Dec 18 20:56:11.997418 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1324/2663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:11 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1534 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:12.040429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab619e31-3c22-407a-bec0-50bdfade1ac0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:12.041506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab619e31-3c22-407a-bec0-50bdfade1ac0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:12.049605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab619e31-3c22-407a-bec0-50bdfade1ac0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:12.050344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab619e31-3c22-407a-bec0-50bdfade1ac0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:12.051731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab619e31-3c22-407a-bec0-50bdfade1ac0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:12.053059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab619e31-3c22-407a-bec0-50bdfade1ac0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:12.111037 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab619e31-3c22-407a-bec0-50bdfade1ac0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.075752 Dec 18 20:56:12.113087 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1325/2664] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:12 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:56:12.291154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48379a3c-01ff-41b5-997c-e083d0efcdaf tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714f45a0d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:12.371932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:12.398836 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-371ed77c-2f23-4726-b5fb-3486ee7afdf5 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.466766 Dec 18 20:56:12.401396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1340/2665] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:11 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:12.516159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92ab203d-59c3-4903-bec8-45a5690fd3d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:12.517749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92ab203d-59c3-4903-bec8-45a5690fd3d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:12.537057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92ab203d-59c3-4903-bec8-45a5690fd3d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:12.539479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92ab203d-59c3-4903-bec8-45a5690fd3d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:12.544034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92ab203d-59c3-4903-bec8-45a5690fd3d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:12.544856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92ab203d-59c3-4903-bec8-45a5690fd3d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:12.601621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92ab203d-59c3-4903-bec8-45a5690fd3d8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.094312 Dec 18 20:56:12.602645 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1341/2666] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:12 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:12.658605 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48379a3c-01ff-41b5-997c-e083d0efcdaf tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1454 microversion: 2.1 time: 0.379572 Dec 18 20:56:12.665283 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1326/2667] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:12 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1454 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:12.731817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:12.747085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:12.762826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:12.768590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:12.774421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:12.775089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.017529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:13.017529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:13.026953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.028837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.028837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.028837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.168634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:13.188958 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-222c7975-3914-4810-bff3-58474e56738e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.466384 Dec 18 20:56:13.190411 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1342/2668] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:12 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:13.202638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9584775-84cb-403a-8461-2cfe1cf0b871 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:13.205578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9584775-84cb-403a-8461-2cfe1cf0b871 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:13.219590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9584775-84cb-403a-8461-2cfe1cf0b871 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.220463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9584775-84cb-403a-8461-2cfe1cf0b871 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.221944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9584775-84cb-403a-8461-2cfe1cf0b871 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.223104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9584775-84cb-403a-8461-2cfe1cf0b871 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.307891 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9584775-84cb-403a-8461-2cfe1cf0b871 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.115881 Dec 18 20:56:13.309520 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1343/2669] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:13 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:13.311673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:13.317151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:13.319150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:13.320034 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ac4149c-1142-4d07-b60b-5d50db4545ee tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 200 len: 1534 microversion: 2.1 time: 0.309088 Dec 18 20:56:13.320610 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1327/2670] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:13 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 1534 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:13.332219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.332856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.335582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.336352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.418481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:13.419434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:13.430610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.431448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.433131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.433783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.767186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:13.775048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6fb9869-30cc-4b91-a322-29d492c46ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.464021 Dec 18 20:56:13.775838 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1344/2671] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:13 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:13.808236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c0c9c4b-482a-47af-825a-9a2cfdb75130 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:13.809179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c0c9c4b-482a-47af-825a-9a2cfdb75130 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:13.811591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:13.818800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0c9c4b-482a-47af-825a-9a2cfdb75130 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.825866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0c9c4b-482a-47af-825a-9a2cfdb75130 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.826904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0c9c4b-482a-47af-825a-9a2cfdb75130 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.827360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0c9c4b-482a-47af-825a-9a2cfdb75130 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.828179 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3681d60b-e407-48d7-9eb1-1c397e218074 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.412287 Dec 18 20:56:13.839767 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1328/2672] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:13 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:13.845957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-261d7854-04e1-4d1c-adf1-a014f3d11876 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161358ee0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:13.891578 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c0c9c4b-482a-47af-825a-9a2cfdb75130 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.089406 Dec 18 20:56:13.897461 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1345/2673] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:13 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:13.904783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:13.905441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:13.915548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.915778 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-261d7854-04e1-4d1c-adf1-a014f3d11876 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1463 microversion: 2.1 time: 0.074232 Dec 18 20:56:13.916124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.918464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:13.918464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:13.923749 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1329/2674] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:13 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1463 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:13.931619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43b1457a-263e-4a6b-beba-f9407f8fda0e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716132ef70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:13.995642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Unlocking {{(pid=140731) unlock /opt/stack/nova/nova/compute/api.py:4653}} Dec 18 20:56:14.008058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-43b1457a-263e-4a6b-beba-f9407f8fda0e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 200 len: 1463 microversion: 2.1 time: 0.083165 Dec 18 20:56:14.011188 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1330/2675] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:13 2021] GET /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 1463 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:14.024202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:14.039185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:14.046215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:14.046702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:14.047509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:14.047950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:14.166015 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57699288-10c5-424f-ba10-b83c2cf61edc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.264692 Dec 18 20:56:14.170369 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1346/2676] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:13 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:14.187207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:14.188172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:14.201372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:14.202486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:14.203552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:14.204204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.005721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:15.020834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19cd4267-ab94-44bd-8398-7ac49c4df0d9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1467 microversion: 2.1 time: 1.000915 Dec 18 20:56:15.034165 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1331/2677] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:14 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1467 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:15.043623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ee5d884-8aba-4fc4-9a92-82a50f536103 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:15.046064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ee5d884-8aba-4fc4-9a92-82a50f536103 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:15.063805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ee5d884-8aba-4fc4-9a92-82a50f536103 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.065560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ee5d884-8aba-4fc4-9a92-82a50f536103 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.069031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ee5d884-8aba-4fc4-9a92-82a50f536103 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.070215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ee5d884-8aba-4fc4-9a92-82a50f536103 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.181908 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ee5d884-8aba-4fc4-9a92-82a50f536103 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.145253 Dec 18 20:56:15.184251 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1332/2678] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:15 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:15.196305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:15.199218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 784e8c5e-4c15-42ef-8cec-143c0b396585] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:15.215807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.220179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.222837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.224232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.266863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] HTTP exception thrown: Instance 784e8c5e-4c15-42ef-8cec-143c0b396585 could not be found. Dec 18 20:56:15.268972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Returning 404 to user: Instance 784e8c5e-4c15-42ef-8cec-143c0b396585 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:15.272989 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7d6b1b5a-dcfd-4ff5-aeae-c5b36e716569 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585" status: 404 len: 111 microversion: 2.1 time: 0.084725 Dec 18 20:56:15.274223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:15.277097 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1333/2679] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:15 2021] GET /compute/v2.1/servers/784e8c5e-4c15-42ef-8cec-143c0b396585 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:15.286620 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66fd45d1-8057-4acd-a277-f8e519429de0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 1.102140 Dec 18 20:56:15.287231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b7bbaf37-e729-4df0-97aa-19316e135f1d req-448a660c-e3e5-4c57-927e-a41df0c45145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e8c5e-4c15-42ef-8cec-143c0b396585", "name": "network-vif-deleted", "tag": "8c02c893-1629-4833-9998-e05787ad6250"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:15.289172 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:15.289172 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:15.291313 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1347/2680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:14 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:15.317496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:15.323775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:15.325451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b7bbaf37-e729-4df0-97aa-19316e135f1d req-448a660c-e3e5-4c57-927e-a41df0c45145 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.326122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b7bbaf37-e729-4df0-97aa-19316e135f1d req-448a660c-e3e5-4c57-927e-a41df0c45145 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.343493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.344356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.345602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.346441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.353859 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b7bbaf37-e729-4df0-97aa-19316e135f1d req-448a660c-e3e5-4c57-927e-a41df0c45145 service nova] Creating event network-vif-deleted:8c02c893-1629-4833-9998-e05787ad6250 for instance 784e8c5e-4c15-42ef-8cec-143c0b396585 on nch1-master-1 Dec 18 20:56:15.369417 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b7bbaf37-e729-4df0-97aa-19316e135f1d req-448a660c-e3e5-4c57-927e-a41df0c45145 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088768 Dec 18 20:56:15.370365 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1334/2681] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:15.385304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f84dfa01-1861-42e7-bf49-ddba9d48d5c9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:15.387578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f84dfa01-1861-42e7-bf49-ddba9d48d5c9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:15.401582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84dfa01-1861-42e7-bf49-ddba9d48d5c9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.406225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84dfa01-1861-42e7-bf49-ddba9d48d5c9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.407582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84dfa01-1861-42e7-bf49-ddba9d48d5c9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.409427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84dfa01-1861-42e7-bf49-ddba9d48d5c9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.473669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f84dfa01-1861-42e7-bf49-ddba9d48d5c9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.101305 Dec 18 20:56:15.475521 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1335/2682] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:15 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:15.490594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e12f0d0d-19d4-4709-8c29-20fa59249ce1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1121383264"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:15.492070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e12f0d0d-19d4-4709-8c29-20fa59249ce1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:15.516639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12f0d0d-19d4-4709-8c29-20fa59249ce1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.517106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12f0d0d-19d4-4709-8c29-20fa59249ce1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.518333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12f0d0d-19d4-4709-8c29-20fa59249ce1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.519002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12f0d0d-19d4-4709-8c29-20fa59249ce1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.765366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:15.777224 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6d7d595-c81f-48d5-a41e-3e087662b4ba tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1496 microversion: 2.1 time: 0.482861 Dec 18 20:56:15.779314 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1348/2683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:15 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1496 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:15.793296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:15.794481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:15.812186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.812903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.814183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:15.814869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:15.885083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:16.027161 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e12f0d0d-19d4-4709-8c29-20fa59249ce1 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "POST /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842/action" status: 202 len: 0 microversion: 2.1 time: 0.548345 Dec 18 20:56:16.028326 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1336/2684] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:15 2021] POST /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:56:16.038082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e034eac-cc9e-4c3e-9587-071cabe96220 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:16.040653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2e034eac-cc9e-4c3e-9587-071cabe96220 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:16.050055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e034eac-cc9e-4c3e-9587-071cabe96220 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.051040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e034eac-cc9e-4c3e-9587-071cabe96220 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.051900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e034eac-cc9e-4c3e-9587-071cabe96220 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.052219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e034eac-cc9e-4c3e-9587-071cabe96220 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.087411 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c431d852-0f9a-4652-830e-3f29ef1f693f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 204 len: 0 microversion: 2.1 time: 0.304054 Dec 18 20:56:16.089334 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1349/2685] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:15 2021] DELETE /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:16.105003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-14fadb35-eefb-4e7c-9138-1d9b8403648e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef71ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:16.182592 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2e034eac-cc9e-4c3e-9587-071cabe96220 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.151756 Dec 18 20:56:16.187892 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1337/2686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:16 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:16.200989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:16.201796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:16.215954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-14fadb35-eefb-4e7c-9138-1d9b8403648e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 200 len: 1455 microversion: 2.1 time: 0.121352 Dec 18 20:56:16.221445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.221915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.227221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.227400 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1350/2687] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:16 2021] GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:16.227740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.238975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:16.239766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:16.258611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.259073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.259891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.265606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.728329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:16.741831 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f1a959d-d7a9-45ce-9dbd-7a02697da7c8 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1468 microversion: 2.1 time: 0.550107 Dec 18 20:56:16.742700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1338/2688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:16 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1468 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:16.747921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-669e742b-5aa9-417a-a0d7-31a6ee791da6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:16.757989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-669e742b-5aa9-417a-a0d7-31a6ee791da6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:16.773335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-669e742b-5aa9-417a-a0d7-31a6ee791da6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.774176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-669e742b-5aa9-417a-a0d7-31a6ee791da6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.775208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-669e742b-5aa9-417a-a0d7-31a6ee791da6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.775664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-669e742b-5aa9-417a-a0d7-31a6ee791da6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.806013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:16.819324 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93423c58-fccf-45b0-8f5d-fd5c029ac244 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1676 microversion: 2.1 time: 0.589018 Dec 18 20:56:16.819965 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1351/2689] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:16 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1676 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:16.824863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8472c73c-e60d-47e0-9c43-9be34ece9ad8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:16.826579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8472c73c-e60d-47e0-9c43-9be34ece9ad8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:16.835337 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-669e742b-5aa9-417a-a0d7-31a6ee791da6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.091018 Dec 18 20:56:16.836472 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1339/2690] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:16 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:16.844130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:16.845326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:16.851654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-e60d-47e0-9c43-9be34ece9ad8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.853400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-e60d-47e0-9c43-9be34ece9ad8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.854919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-e60d-47e0-9c43-9be34ece9ad8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.857057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-e60d-47e0-9c43-9be34ece9ad8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.859034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.859501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.860475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:16.860929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:16.919229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8472c73c-e60d-47e0-9c43-9be34ece9ad8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.097747 Dec 18 20:56:16.920626 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1352/2691] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:16 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:17.234867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6c8202bd-196b-44fc-b198-27cd6b17fbda tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef0bc10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:17.257110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:17.277659 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b34d1e67-50e4-4a16-8c27-8580da4f900c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 200 len: 1473 microversion: 2.1 time: 0.439771 Dec 18 20:56:17.279063 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1340/2692] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:16 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 1473 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:17.302535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca52091a-c8ec-4cb3-8452-5485034c1305 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-314510338"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:17.304622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca52091a-c8ec-4cb3-8452-5485034c1305 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:17.317466 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6c8202bd-196b-44fc-b198-27cd6b17fbda tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 200 len: 1455 microversion: 2.1 time: 0.088522 Dec 18 20:56:17.318164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca52091a-c8ec-4cb3-8452-5485034c1305 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:17.318793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca52091a-c8ec-4cb3-8452-5485034c1305 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:17.319669 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1353/2693] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:17 2021] GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:17.325674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca52091a-c8ec-4cb3-8452-5485034c1305 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:17.326263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca52091a-c8ec-4cb3-8452-5485034c1305 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:17.664768 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca52091a-c8ec-4cb3-8452-5485034c1305 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d/action" status: 202 len: 0 microversion: 2.1 time: 0.371865 Dec 18 20:56:17.665730 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1341/2694] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:17 2021] POST /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:56:17.678103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e3419d4c-597c-4d9c-8ddb-ead70bea71fa tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ef2ad30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:17.762928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:17.763293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:17.764771 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e3419d4c-597c-4d9c-8ddb-ead70bea71fa tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62" status: 200 len: 1411 microversion: 2.1 time: 0.092529 Dec 18 20:56:17.770328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1354/2695] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:17 2021] GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62 => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:17.781799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:17.783453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:17.786068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:17.786724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:17.840350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:17.841087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:17.850808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:17.852440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:17.853795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:17.856618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.163852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:18.173818 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8d5f4e01-0822-4562-8ea9-bd12c0794f2f tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 200 len: 1468 microversion: 2.1 time: 0.416174 Dec 18 20:56:18.174920 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1342/2696] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:17 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 1468 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:18.182908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60b85a83-4207-4b96-b6d1-379cb8bc95ae tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:18.184736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60b85a83-4207-4b96-b6d1-379cb8bc95ae tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:18.199250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60b85a83-4207-4b96-b6d1-379cb8bc95ae tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.199826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60b85a83-4207-4b96-b6d1-379cb8bc95ae tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.201181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60b85a83-4207-4b96-b6d1-379cb8bc95ae tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.201632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60b85a83-4207-4b96-b6d1-379cb8bc95ae tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.224193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:18.233490 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39aa509d-3377-4b7e-85f4-5358b3cb1704 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1656 microversion: 2.1 time: 0.397098 Dec 18 20:56:18.234341 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1355/2697] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:17 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1656 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:18.251828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7c13662-51d6-4aa8-88ee-8da35e74a053 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:18.253112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7c13662-51d6-4aa8-88ee-8da35e74a053 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:18.260845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c13662-51d6-4aa8-88ee-8da35e74a053 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.261708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c13662-51d6-4aa8-88ee-8da35e74a053 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.262502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c13662-51d6-4aa8-88ee-8da35e74a053 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.263271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c13662-51d6-4aa8-88ee-8da35e74a053 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.316936 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60b85a83-4207-4b96-b6d1-379cb8bc95ae tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.138392 Dec 18 20:56:18.319097 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1343/2698] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:18 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:18.322828 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7c13662-51d6-4aa8-88ee-8da35e74a053 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.074592 Dec 18 20:56:18.327877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f5f65b2d-4d89-4922-badf-eb3eb4f8b536 req-50dd4ecc-f382-423b-a896-a2d6eeab913d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93280f-4987-4eea-b229-7cc365db43ff", "name": "network-vif-unplugged", "status": "completed", "tag": "2b8e5c57-7646-45bc-8bdf-d19b316188ed"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:18.329184 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1356/2699] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:18 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:18.330342 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:18.330342 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:18.336901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97206db7-37cb-4287-be32-5c1da11cbf71 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:18.338973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97206db7-37cb-4287-be32-5c1da11cbf71 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:18.349950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f5f65b2d-4d89-4922-badf-eb3eb4f8b536 req-50dd4ecc-f382-423b-a896-a2d6eeab913d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.354936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f5f65b2d-4d89-4922-badf-eb3eb4f8b536 req-50dd4ecc-f382-423b-a896-a2d6eeab913d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.363084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97206db7-37cb-4287-be32-5c1da11cbf71 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.363834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97206db7-37cb-4287-be32-5c1da11cbf71 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.365433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97206db7-37cb-4287-be32-5c1da11cbf71 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.366099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97206db7-37cb-4287-be32-5c1da11cbf71 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.369447 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f5f65b2d-4d89-4922-badf-eb3eb4f8b536 req-50dd4ecc-f382-423b-a896-a2d6eeab913d service nova] Creating event network-vif-unplugged:2b8e5c57-7646-45bc-8bdf-d19b316188ed for instance bd93280f-4987-4eea-b229-7cc365db43ff on nch1-master-1 Dec 18 20:56:18.376853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f5f65b2d-4d89-4922-badf-eb3eb4f8b536 req-50dd4ecc-f382-423b-a896-a2d6eeab913d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056237 Dec 18 20:56:18.377951 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1344/2700] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:18.384420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e8edb3c4-58c7-497c-9ffc-826678f21200 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613b2160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:18.455601 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e8edb3c4-58c7-497c-9ffc-826678f21200 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 200 len: 1455 microversion: 2.1 time: 0.076056 Dec 18 20:56:18.456898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1345/2701] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:18 2021] GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:18.464521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d3dc986c-e856-4675-b61d-ddba5567326e req-32c8f3a1-0353-4143-a340-c3a32af9ede2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfebec43-3354-4223-9f86-adc3ef6fb19d", "name": "network-vif-deleted", "tag": "b09fe15f-0b97-40bf-b218-e64ff9933df9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:18.467966 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:18.467966 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:18.486976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d3dc986c-e856-4675-b61d-ddba5567326e req-32c8f3a1-0353-4143-a340-c3a32af9ede2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.487933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d3dc986c-e856-4675-b61d-ddba5567326e req-32c8f3a1-0353-4143-a340-c3a32af9ede2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.498244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97206db7-37cb-4287-be32-5c1da11cbf71 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.167041 Dec 18 20:56:18.499289 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1357/2702] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:18 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:18.509320 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d3dc986c-e856-4675-b61d-ddba5567326e req-32c8f3a1-0353-4143-a340-c3a32af9ede2 service nova] Creating event network-vif-deleted:b09fe15f-0b97-40bf-b218-e64ff9933df9 for instance cfebec43-3354-4223-9f86-adc3ef6fb19d on nch1-master-1 Dec 18 20:56:18.510022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:18.513585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:18.517017 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d3dc986c-e856-4675-b61d-ddba5567326e req-32c8f3a1-0353-4143-a340-c3a32af9ede2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056659 Dec 18 20:56:18.518175 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1346/2703] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:18.532196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.532661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.548651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:18.549150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:18.779723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38c1ced3-456b-490a-aced-ec69e53f9931 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f716132e0d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:18.846209 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38c1ced3-456b-490a-aced-ec69e53f9931 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62" status: 200 len: 1411 microversion: 2.1 time: 0.071416 Dec 18 20:56:18.853836 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1347/2704] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:18 2021] GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:19.002227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:19.015788 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c445d7e-b013-48b7-b8de-129a70f639c9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1663 microversion: 2.1 time: 0.512199 Dec 18 20:56:19.016495 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1358/2705] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:18 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1663 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:19.193136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:19.194058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: cfebec43-3354-4223-9f86-adc3ef6fb19d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:19.201709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.202093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.202925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.203372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.217465 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] HTTP exception thrown: Instance cfebec43-3354-4223-9f86-adc3ef6fb19d could not be found. Dec 18 20:56:19.218199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Returning 404 to user: Instance cfebec43-3354-4223-9f86-adc3ef6fb19d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:19.219404 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70f76dbf-3e3e-4ba2-92a9-7a0b32302d47 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d" status: 404 len: 111 microversion: 2.1 time: 0.031698 Dec 18 20:56:19.220508 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1348/2706] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:19 2021] GET /compute/v2.1/servers/cfebec43-3354-4223-9f86-adc3ef6fb19d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:19.229992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:19.230847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:19.237196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.237898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.239933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.240746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.271955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:19.330096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25928f35-ce1f-4365-8ac3-7e9d29c3c1e8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:19.332303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25928f35-ce1f-4365-8ac3-7e9d29c3c1e8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:19.344872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25928f35-ce1f-4365-8ac3-7e9d29c3c1e8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.344872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25928f35-ce1f-4365-8ac3-7e9d29c3c1e8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.345913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25928f35-ce1f-4365-8ac3-7e9d29c3c1e8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.346343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25928f35-ce1f-4365-8ac3-7e9d29c3c1e8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.365615 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d37def17-0fb2-43fa-8f30-6f6a07c5ebd5 tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "DELETE /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 204 len: 0 microversion: 2.1 time: 0.138585 Dec 18 20:56:19.366494 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1359/2707] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:19 2021] DELETE /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:19.373422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7f5f7cbd-5ce2-459d-b0f3-3cf7f6784061 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:19.374552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7f5f7cbd-5ce2-459d-b0f3-3cf7f6784061 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:19.380946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cbd-5ce2-459d-b0f3-3cf7f6784061 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.381407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cbd-5ce2-459d-b0f3-3cf7f6784061 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.382214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cbd-5ce2-459d-b0f3-3cf7f6784061 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.382692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cbd-5ce2-459d-b0f3-3cf7f6784061 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.416923 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25928f35-ce1f-4365-8ac3-7e9d29c3c1e8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.091223 Dec 18 20:56:19.419759 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1349/2708] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:19 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:56:19.423316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:19.424023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:19.431549 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7f5f7cbd-5ce2-459d-b0f3-3cf7f6784061 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.063394 Dec 18 20:56:19.432514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.432813 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1360/2709] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:19 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:19.433291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.434107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:19.434584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:19.469479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d3f7c3b-a5fa-4c6e-97d6-03805a4a7610 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161341700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:19.515153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d3f7c3b-a5fa-4c6e-97d6-03805a4a7610 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 200 len: 1455 microversion: 2.1 time: 0.049824 Dec 18 20:56:19.515707 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1361/2710] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:19 2021] GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:19.863943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f35a674b-3119-4ee4-851a-4ba47f53f0f3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f7161346a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:19.914121 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f35a674b-3119-4ee4-851a-4ba47f53f0f3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62" status: 200 len: 1411 microversion: 2.1 time: 0.057231 Dec 18 20:56:19.915233 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1362/2711] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:19 2021] GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62 => generated 1411 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:20.035043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:20.035827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:20.046237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.046788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.047582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.048107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.099323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d32c08216a4035907c888a3c8cd70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15c3e2ec1194924bee37b0161adc237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:20.111588 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-73c98e03-a21f-424f-a1cb-6cc168ad8acb tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 200 len: 1468 microversion: 2.1 time: 0.692648 Dec 18 20:56:20.112535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1350/2712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:19 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 1468 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:20.324395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:20.339550 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-feb19af4-f583-46a9-9833-b73d0ffe295a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.309370 Dec 18 20:56:20.340142 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1363/2713] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:20 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:20.355719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:20.356325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:20.379817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.381103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.382137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.392428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.429510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-249aa344-390c-41ae-8630-d41d9e0b4a57 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:20.430659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-249aa344-390c-41ae-8630-d41d9e0b4a57 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:20.443461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249aa344-390c-41ae-8630-d41d9e0b4a57 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.471070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249aa344-390c-41ae-8630-d41d9e0b4a57 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.473396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249aa344-390c-41ae-8630-d41d9e0b4a57 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.474339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-249aa344-390c-41ae-8630-d41d9e0b4a57 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.532769 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-249aa344-390c-41ae-8630-d41d9e0b4a57 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.104413 Dec 18 20:56:20.536296 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1364/2714] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:20 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:56:20.555018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c3444ae-a21e-4056-ba69-a3ec857f3f5d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:20.560906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1c3444ae-a21e-4056-ba69-a3ec857f3f5d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:20.594932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c3444ae-a21e-4056-ba69-a3ec857f3f5d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.595860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c3444ae-a21e-4056-ba69-a3ec857f3f5d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.596980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c3444ae-a21e-4056-ba69-a3ec857f3f5d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:20.597592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c3444ae-a21e-4056-ba69-a3ec857f3f5d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:20.667335 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c3444ae-a21e-4056-ba69-a3ec857f3f5d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.125268 Dec 18 20:56:20.671641 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1365/2715] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:20 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:20.681498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fe87521-dd83-4503-bf38-d0fa22dadaa5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef1d700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:21.050877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:21.061917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d26beec3-6006-4d41-9f5a-2fcd9b88d3a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.707629 Dec 18 20:56:21.064110 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1351/2716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:20 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:21.074633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4371630c-c4ef-4fa9-b439-ecd087a662f7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714fa9eee0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:37.140615 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2fe87521-dd83-4503-bf38-d0fa22dadaa5 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 200 len: 1455 microversion: 2.1 time: 16.467689 Dec 18 20:56:37.144031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4371630c-c4ef-4fa9-b439-ecd087a662f7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62" status: 200 len: 1420 microversion: 2.1 time: 16.078659 Dec 18 20:56:37.144615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1352/2717] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:21 2021] GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62 => generated 1420 bytes in 16080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:37.147247 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1366/2718] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:20 2021] GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 1455 bytes in 16475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:37.157833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:37.167239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:37.176213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.179022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.180234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.180873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.365991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:37.377569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2960ab4-386f-4e59-b53c-1efefe7a3788 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.230402 Dec 18 20:56:37.382311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1353/2719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:37 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:37.383645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-90234a4a-ed1b-4e42-aafa-fa37414c928d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:37.385940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-90234a4a-ed1b-4e42-aafa-fa37414c928d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:37.394844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90234a4a-ed1b-4e42-aafa-fa37414c928d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.395602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90234a4a-ed1b-4e42-aafa-fa37414c928d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.396644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90234a4a-ed1b-4e42-aafa-fa37414c928d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.397492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90234a4a-ed1b-4e42-aafa-fa37414c928d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.462108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:37.463122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] [instance: 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:37.465135 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-90234a4a-ed1b-4e42-aafa-fa37414c928d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.084656 Dec 18 20:56:37.469414 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1354/2720] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:37 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:37.475514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa1587dd-54f8-4a4a-b6c0-102fc89da785 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:37.476870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa1587dd-54f8-4a4a-b6c0-102fc89da785 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:37.487859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa1587dd-54f8-4a4a-b6c0-102fc89da785 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.488990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa1587dd-54f8-4a4a-b6c0-102fc89da785 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.489955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa1587dd-54f8-4a4a-b6c0-102fc89da785 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.490604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa1587dd-54f8-4a4a-b6c0-102fc89da785 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.507156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.507610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.508538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.508992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.535410 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] HTTP exception thrown: Instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 could not be found. Dec 18 20:56:37.536957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] Returning 404 to user: Instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:37.538003 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e99e5645-6068-4713-99c9-b49e888e465e tempest-MigrationsAdminTest-1771596258 tempest-MigrationsAdminTest-1771596258-project] 10.222.0.13 "GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3" status: 404 len: 111 microversion: 2.1 time: 0.386416 Dec 18 20:56:37.549620 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1367/2721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:37 2021] GET /compute/v2.1/servers/26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 => generated 111 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:37.550816 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa1587dd-54f8-4a4a-b6c0-102fc89da785 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.082894 Dec 18 20:56:37.554689 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1355/2722] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:37 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:37.560967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-85efd6af-0097-4c70-8fe3-27270692a8e4 req-59b50237-567c-43c2-bd7d-caac36dce848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3", "name": "network-vif-deleted", "tag": "209a1be9-0f3f-4756-8361-ca32f4b7d826"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:37.562482 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:37.562482 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:37.568995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-65a1e9a8-908e-48d2-9763-09e036abc70e req-9e5841f6-068c-40f6-b62b-191aef04b8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f709f32-beb6-4558-8d64-0d56d0981842", "name": "network-vif-plugged", "status": "completed", "tag": "53d8cf94-d048-4858-b43d-3d641ffb86d5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:37.570742 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:37.570742 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:37.585884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-85efd6af-0097-4c70-8fe3-27270692a8e4 req-59b50237-567c-43c2-bd7d-caac36dce848 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.586361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-85efd6af-0097-4c70-8fe3-27270692a8e4 req-59b50237-567c-43c2-bd7d-caac36dce848 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.588077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-65a1e9a8-908e-48d2-9763-09e036abc70e req-9e5841f6-068c-40f6-b62b-191aef04b8c5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:37.591498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-65a1e9a8-908e-48d2-9763-09e036abc70e req-9e5841f6-068c-40f6-b62b-191aef04b8c5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:37.620273 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-85efd6af-0097-4c70-8fe3-27270692a8e4 req-59b50237-567c-43c2-bd7d-caac36dce848 service nova] Creating event network-vif-deleted:209a1be9-0f3f-4756-8361-ca32f4b7d826 for instance 26c3fa05-4a9c-4735-8a2d-e9ac1eb713a3 on nch2-master-1 Dec 18 20:56:37.624104 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-65a1e9a8-908e-48d2-9763-09e036abc70e req-9e5841f6-068c-40f6-b62b-191aef04b8c5 service nova] Creating event network-vif-plugged:53d8cf94-d048-4858-b43d-3d641ffb86d5 for instance 6f709f32-beb6-4558-8d64-0d56d0981842 on nch2-master-1 Dec 18 20:56:37.627673 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-85efd6af-0097-4c70-8fe3-27270692a8e4 req-59b50237-567c-43c2-bd7d-caac36dce848 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074427 Dec 18 20:56:37.630066 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1356/2723] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:37.641156 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-65a1e9a8-908e-48d2-9763-09e036abc70e req-9e5841f6-068c-40f6-b62b-191aef04b8c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080389 Dec 18 20:56:37.647040 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1368/2724] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:37.655666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ef73849-e5a9-47e8-9de3-e46aae7bc9a6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714eee89d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:37.843517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-164481222", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6debd13b-b209-4e15-a34d-3cefcc31c991"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:38.168214 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ef73849-e5a9-47e8-9de3-e46aae7bc9a6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62" status: 200 len: 1420 microversion: 2.1 time: 0.517173 Dec 18 20:56:38.168975 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1369/2725] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:37 2021] GET /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62 => generated 1420 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:38.176856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] validate_networks() for [('6debd13b-b209-4e15-a34d-3cefcc31c991', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:56:38.180436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:38.181165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:38.189679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.191014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:38.191839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.192837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:38.329354 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 20:56:38.329557 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 20:56:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Dec 18 20:56:38.452111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:38.464433 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f385d67c-ebe7-4764-b865-bb79fd6219b2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.288693 Dec 18 20:56:38.465197 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1370/2726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:38 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:38.482366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4180adc3-34b8-47d0-a8c3-3107bf36524a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716132ab80>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:38.575507 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4180adc3-34b8-47d0-a8c3-3107bf36524a tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 200 len: 1464 microversion: 2.1 time: 0.106323 Dec 18 20:56:38.577958 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1371/2727] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:38 2021] GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 1464 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:38.587037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4fcb014e-a571-41c4-aa6d-0a485ee7f0fe tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ef0b0d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:38.753018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:56:38.753527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:56:38.754099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:56:38.755139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:56:38.755628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:56:38.769269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.769933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:38.772003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.772466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:38.795788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Getting quotas for project c2aba7bee78744949dc3323cb4c7df55. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:56:38.802664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Getting quotas for user 4ceb4b626d5f479b9e28dd26702d9d1e and project c2aba7bee78744949dc3323cb4c7df55. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:56:38.820939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:56:38.823533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:56:38.882632 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c9ca8523-fd59-4a66-9844-7b17f8089fdd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.250922 Dec 18 20:56:38.883461 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1357/2728] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:56:37 2021] POST /compute/v2.1/servers => generated 383 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:56:38.889748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a9efc7e-703b-490b-b7e5-bfeee878c40c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:38.891013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3a9efc7e-703b-490b-b7e5-bfeee878c40c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:38.899638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9efc7e-703b-490b-b7e5-bfeee878c40c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.900386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9efc7e-703b-490b-b7e5-bfeee878c40c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:38.901291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9efc7e-703b-490b-b7e5-bfeee878c40c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.901814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9efc7e-703b-490b-b7e5-bfeee878c40c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:38.960221 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a9efc7e-703b-490b-b7e5-bfeee878c40c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.075154 Dec 18 20:56:38.966051 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1358/2729] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:38 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:38.972230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fc1fad97-3b90-428a-8710-2cb0807a18f4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:38.973681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fc1fad97-3b90-428a-8710-2cb0807a18f4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:38.981635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc1fad97-3b90-428a-8710-2cb0807a18f4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.982313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc1fad97-3b90-428a-8710-2cb0807a18f4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:38.983409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc1fad97-3b90-428a-8710-2cb0807a18f4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:38.983906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc1fad97-3b90-428a-8710-2cb0807a18f4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:39.038350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fc1fad97-3b90-428a-8710-2cb0807a18f4 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.070282 Dec 18 20:56:39.039384 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1359/2730] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:38 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:39.059172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb5545fe-36a2-49aa-88a6-171e0029012c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614edee0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:39.135494 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb5545fe-36a2-49aa-88a6-171e0029012c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 200 len: 1464 microversion: 2.1 time: 0.094530 Dec 18 20:56:39.136028 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1360/2731] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:39 2021] GET /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:39.143037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b0f0a7b1-6230-4ce7-864b-35e29e350ba9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:39.144154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b0f0a7b1-6230-4ce7-864b-35e29e350ba9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:39.218697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b0f0a7b1-6230-4ce7-864b-35e29e350ba9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:39.228266 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b0f0a7b1-6230-4ce7-864b-35e29e350ba9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1221 microversion: 2.1 time: 0.090640 Dec 18 20:56:39.229352 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1361/2732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:39 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:39.241493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:39.242495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:39.255065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:39.256035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:39.257276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:39.258037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:39.487664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:39.498434 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d1592d9-d2c6-4db7-9dad-d91fe3c85ce0 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 1467 microversion: 2.1 time: 0.267354 Dec 18 20:56:39.512106 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1362/2733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:39 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 1467 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:39.518966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-328023350", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6debd13b-b209-4e15-a34d-3cefcc31c991"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:39.554732 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4fcb014e-a571-41c4-aa6d-0a485ee7f0fe tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62" status: 204 len: 0 microversion: 2.1 time: 0.975079 Dec 18 20:56:39.555316 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1372/2734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:38 2021] DELETE /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:39.560059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2644abb-9da6-4b61-92cf-8d3dbd07b4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef0b1f0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:39.649642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] validate_networks() for [('6debd13b-b209-4e15-a34d-3cefcc31c991', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:56:39.736229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2644abb-9da6-4b61-92cf-8d3dbd07b4cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?changes-since=2021-12-18T20%3A54%3A57Z" status: 200 len: 2375 microversion: 2.1 time: 0.179804 Dec 18 20:56:39.736973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1373/2735] 10.222.0.13 () {58 vars in 1198 bytes} [Sat Dec 18 20:56:39 2021] GET /compute/v2.1/images?changes-since=2021-12-18T20%3A54%3A57Z => generated 2375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:39.751980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:39.752488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:39.759954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:39.760569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:39.771736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:39.772451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:39.817738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:39.918233 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5f02b543-0d91-490c-96dc-4429e2edff18 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 204 len: 0 microversion: 2.1 time: 0.179501 Dec 18 20:56:39.918799 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1374/2736] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:39 2021] DELETE /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:39.940469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-acf7359c-6879-4e44-b055-68d52809b799 req-2836994e-e925-4426-9f67-ec8aee71dd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9f6243-3663-449e-89e7-c1a511e9313d", "name": "network-vif-plugged", "status": "completed", "tag": "36011601-d6a5-4062-8c92-593078687bde"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:39.942099 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:39.942099 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:39.949964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-acf7359c-6879-4e44-b055-68d52809b799 req-2836994e-e925-4426-9f67-ec8aee71dd5a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:39.950767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-acf7359c-6879-4e44-b055-68d52809b799 req-2836994e-e925-4426-9f67-ec8aee71dd5a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:39.964851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-acf7359c-6879-4e44-b055-68d52809b799 req-2836994e-e925-4426-9f67-ec8aee71dd5a service nova] Creating event network-vif-plugged:36011601-d6a5-4062-8c92-593078687bde for instance bf9f6243-3663-449e-89e7-c1a511e9313d on nch2-master-1 Dec 18 20:56:39.970488 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-acf7359c-6879-4e44-b055-68d52809b799 req-2836994e-e925-4426-9f67-ec8aee71dd5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050044 Dec 18 20:56:39.971679 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1375/2737] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:39.978901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-605dafa4-8935-45e0-836f-761f492d1848 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef0b0d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:40.033794 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-605dafa4-8935-45e0-836f-761f492d1848 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1588834034" status: 200 len: 485 microversion: 2.1 time: 0.060156 Dec 18 20:56:40.034588 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1376/2738] 10.222.0.13 () {58 vars in 1230 bytes} [Sat Dec 18 20:56:39 2021] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1588834034 => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:40.044417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c1ae5083-b759-4b67-a09e-6576384e7fbe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:40.045550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c1ae5083-b759-4b67-a09e-6576384e7fbe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:40.056849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1ae5083-b759-4b67-a09e-6576384e7fbe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:40.057174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1ae5083-b759-4b67-a09e-6576384e7fbe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:40.060870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1ae5083-b759-4b67-a09e-6576384e7fbe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:40.068224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1ae5083-b759-4b67-a09e-6576384e7fbe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:40.150947 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c1ae5083-b759-4b67-a09e-6576384e7fbe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.114674 Dec 18 20:56:40.151710 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1377/2739] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:40 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:40.157141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a6434b6-9d85-4d36-9007-f2b1a89fc5c2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f7161308f70>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:40.163487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:56:40.163969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:56:40.164467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:56:40.164986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:56:40.165458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:56:40.176891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:40.177648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:40.178684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:40.179142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:40.202564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Getting quotas for project c2aba7bee78744949dc3323cb4c7df55. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:56:40.208456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Getting quotas for user 4ceb4b626d5f479b9e28dd26702d9d1e and project c2aba7bee78744949dc3323cb4c7df55. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:56:40.221253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:56:40.223731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:56:40.252810 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a6434b6-9d85-4d36-9007-f2b1a89fc5c2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?server=6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 958 microversion: 2.1 time: 0.099445 Dec 18 20:56:40.253692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1378/2740] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 20:56:40 2021] GET /compute/v2.1/images?server=6f709f32-beb6-4558-8d64-0d56d0981842 => generated 958 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:40.259168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-24c3a0d9-d2be-4e27-aac0-26ad2b1442a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:40.260855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-24c3a0d9-d2be-4e27-aac0-26ad2b1442a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:40.267572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c3a0d9-d2be-4e27-aac0-26ad2b1442a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:40.268210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c3a0d9-d2be-4e27-aac0-26ad2b1442a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:40.269222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c3a0d9-d2be-4e27-aac0-26ad2b1442a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:40.269812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c3a0d9-d2be-4e27-aac0-26ad2b1442a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:40.278139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-486ed7aa-1b27-4d1a-a43b-83b37dd0f978 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.764547 Dec 18 20:56:40.279695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1363/2741] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:56:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:56:40.286513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2073692533", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b4249639-6520-4b9d-908b-e792b10734b1"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:40.320246 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-24c3a0d9-d2be-4e27-aac0-26ad2b1442a9 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.064074 Dec 18 20:56:40.321386 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1379/2742] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:40 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:40.327782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-00bced9c-7ad3-41c1-aaad-8262642885bb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613080d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:40.370970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] validate_networks() for [('b4249639-6520-4b9d-908b-e792b10734b1', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:56:40.471297 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-00bced9c-7ad3-41c1-aaad-8262642885bb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 484 microversion: 2.1 time: 0.148002 Dec 18 20:56:40.472407 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1380/2743] 10.222.0.13 () {58 vars in 1316 bytes} [Sat Dec 18 20:56:40 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff => generated 484 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:40.478222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ead03797-f316-4a44-b7ef-7c97cb6410ca tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:40.479357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ead03797-f316-4a44-b7ef-7c97cb6410ca tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:40.572818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ead03797-f316-4a44-b7ef-7c97cb6410ca tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:40.581146 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ead03797-f316-4a44-b7ef-7c97cb6410ca tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1221 microversion: 2.1 time: 0.107323 Dec 18 20:56:40.583447 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1381/2744] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:40 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:40.593588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ff4bd71-e481-4706-bebc-235ead7c2d36 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71612def70>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:40.681161 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ff4bd71-e481-4706-bebc-235ead7c2d36 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 484 microversion: 2.1 time: 0.094912 Dec 18 20:56:40.684959 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1382/2745] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Dec 18 20:56:40 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff => generated 484 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:40.698416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-efab7731-8515-4016-8c59-09359bcfa2cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef7c670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:40.852873 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-efab7731-8515-4016-8c59-09359bcfa2cd tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.160318 Dec 18 20:56:40.853442 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1383/2746] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 20:56:40 2021] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:40.878193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bab88343-15c6-4b75-b5f6-8c0ee4346b24 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef6b040>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:40.986826 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bab88343-15c6-4b75-b5f6-8c0ee4346b24 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.115369 Dec 18 20:56:40.997675 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1384/2747] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 20:56:40 2021] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:41.007591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab432562-fdbc-4be2-8d42-eef73e2299a8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef1d790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:41.081993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:56:41.082690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:56:41.083491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:56:41.083950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:56:41.084462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:56:41.101783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab432562-fdbc-4be2-8d42-eef73e2299a8 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.101843 Dec 18 20:56:41.102404 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1385/2748] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:56:40 2021] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:41.113290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.115053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.116316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5bd9624d-42cc-4627-a831-b09793c1d2ce tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef1db80>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:41.118115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.119720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.177546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:56:41.188590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for user 216cd2c0d4b249e797990918152b4749 and project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:56:41.224544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:56:41.226785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:56:41.288972 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5bd9624d-42cc-4627-a831-b09793c1d2ce tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/detail?changes-since=2021-12-18T20%3A54%3A53Z" status: 200 len: 6334 microversion: 2.1 time: 0.176891 Dec 18 20:56:41.300948 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1386/2749] 10.222.0.13 () {58 vars in 1219 bytes} [Sat Dec 18 20:56:41 2021] GET /compute/v2.1/images/detail?changes-since=2021-12-18T20%3A54%3A53Z => generated 6334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:41.308091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f889445-ae58-4c3a-99fa-f3d749f3b22b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:41.309549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f889445-ae58-4c3a-99fa-f3d749f3b22b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:41.322113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f889445-ae58-4c3a-99fa-f3d749f3b22b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.323136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f889445-ae58-4c3a-99fa-f3d749f3b22b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.324173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f889445-ae58-4c3a-99fa-f3d749f3b22b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.324823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f889445-ae58-4c3a-99fa-f3d749f3b22b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.335777 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2b625eb-de80-41a3-8917-4fec739f68ad tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054931 Dec 18 20:56:41.337127 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1364/2750] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:56:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:56:41.347031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fc298010-0c47-4e2c-801b-8e2340d73c7b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614abaf0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:41.378356 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f889445-ae58-4c3a-99fa-f3d749f3b22b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.075434 Dec 18 20:56:41.379277 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1387/2751] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:41 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:41.401845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d44a243c-b34a-42a2-a18f-d889b21a9c4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:41.402951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d44a243c-b34a-42a2-a18f-d889b21a9c4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:41.419815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d44a243c-b34a-42a2-a18f-d889b21a9c4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.420277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d44a243c-b34a-42a2-a18f-d889b21a9c4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.421298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d44a243c-b34a-42a2-a18f-d889b21a9c4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.421747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d44a243c-b34a-42a2-a18f-d889b21a9c4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.499731 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d44a243c-b34a-42a2-a18f-d889b21a9c4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.119254 Dec 18 20:56:41.505641 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1388/2752] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:41 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:41.519291 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fc298010-0c47-4e2c-801b-8e2340d73c7b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1588834034" status: 200 len: 665 microversion: 2.1 time: 0.179230 Dec 18 20:56:41.522016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-049009ab-ccee-4102-8bbc-c84a936ba7be tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:41.524400 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1365/2753] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Dec 18 20:56:41 2021] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1588834034 => generated 665 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:41.531560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-049009ab-ccee-4102-8bbc-c84a936ba7be tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:41.539294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c04e323b-a4db-4857-a520-29ef9af00fd9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f716149eb80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:41.757965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-049009ab-ccee-4102-8bbc-c84a936ba7be tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:41.768522 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-049009ab-ccee-4102-8bbc-c84a936ba7be tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1208 microversion: 2.1 time: 0.261548 Dec 18 20:56:41.770851 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1389/2754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:41 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1208 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:41.778595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:41.779659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:41.788117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.788880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.790605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:41.791247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:41.938611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:41.947389 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-261cc957-6954-4fe0-83a8-f781210ccffe tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1273 microversion: 2.1 time: 0.173373 Dec 18 20:56:41.953986 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1390/2755] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:41 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:42.162339 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c04e323b-a4db-4857-a520-29ef9af00fd9 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1466 microversion: 2.1 time: 0.626974 Dec 18 20:56:42.171816 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1366/2756] 10.222.0.13 () {58 vars in 1337 bytes} [Sat Dec 18 20:56:41 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff => generated 1466 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:42.188638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-634da13b-97ec-40c8-8420-bfe8fabc7383 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71613a8430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:42.309074 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-634da13b-97ec-40c8-8420-bfe8fabc7383 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1466 microversion: 2.1 time: 0.133399 Dec 18 20:56:42.311080 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1367/2757] 10.222.0.13 () {58 vars in 1323 bytes} [Sat Dec 18 20:56:42 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Fbd93280f-4987-4eea-b229-7cc365db43ff => generated 1466 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:42.327308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5e717ca7-2a58-4694-bcda-e51eed46c3ee req-03e82d8b-56ec-4ce6-82fb-b4e538338eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f709f32-beb6-4558-8d64-0d56d0981842", "name": "network-vif-unplugged", "status": "completed", "tag": "53d8cf94-d048-4858-b43d-3d641ffb86d5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:42.332637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0b83900-feb3-47ef-a670-2b5edecf3f72 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Action: 'update', calling method: .version_select at 0x7f71612f0ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:42.334705 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:42.334705 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:42.340309 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:42.340309 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:42.354231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5e717ca7-2a58-4694-bcda-e51eed46c3ee req-03e82d8b-56ec-4ce6-82fb-b4e538338eaa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.354926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5e717ca7-2a58-4694-bcda-e51eed46c3ee req-03e82d8b-56ec-4ce6-82fb-b4e538338eaa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.378087 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5e717ca7-2a58-4694-bcda-e51eed46c3ee req-03e82d8b-56ec-4ce6-82fb-b4e538338eaa service nova] Creating event network-vif-unplugged:53d8cf94-d048-4858-b43d-3d641ffb86d5 for instance 6f709f32-beb6-4558-8d64-0d56d0981842 on nch2-master-1 Dec 18 20:56:42.406498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5e717ca7-2a58-4694-bcda-e51eed46c3ee req-03e82d8b-56ec-4ce6-82fb-b4e538338eaa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084937 Dec 18 20:56:42.407648 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1368/2758] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:42.413439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d1c70c7-ed05-4b0d-9c0f-c35754f04fe7 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614ab8b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:42.510780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b83900-feb3-47ef-a670-2b5edecf3f72 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.511519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b83900-feb3-47ef-a670-2b5edecf3f72 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.512933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b83900-feb3-47ef-a670-2b5edecf3f72 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.513918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b83900-feb3-47ef-a670-2b5edecf3f72 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.619886 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0b83900-feb3-47ef-a670-2b5edecf3f72 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079" status: 200 len: 148 microversion: 2.57 time: 0.662760 Dec 18 20:56:42.621029 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1391/2759] 10.222.0.13 () {62 vars in 1302 bytes} [Sat Dec 18 20:56:41 2021] PUT /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079 => generated 148 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:42.628685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03f237d9-8988-4e41-8614-1aaeb006eb3a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:42.630033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03f237d9-8988-4e41-8614-1aaeb006eb3a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:42.635961 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d1c70c7-ed05-4b0d-9c0f-c35754f04fe7 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.226976 Dec 18 20:56:42.636567 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1369/2760] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 20:56:42 2021] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:42.637658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03f237d9-8988-4e41-8614-1aaeb006eb3a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.638331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03f237d9-8988-4e41-8614-1aaeb006eb3a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.639314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03f237d9-8988-4e41-8614-1aaeb006eb3a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.640073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03f237d9-8988-4e41-8614-1aaeb006eb3a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.648141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f216419-4ed7-4af6-ae38-5793d633ae4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:42.649193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f216419-4ed7-4af6-ae38-5793d633ae4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:42.665283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f216419-4ed7-4af6-ae38-5793d633ae4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.665747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f216419-4ed7-4af6-ae38-5793d633ae4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.666615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f216419-4ed7-4af6-ae38-5793d633ae4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.667058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f216419-4ed7-4af6-ae38-5793d633ae4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.694700 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03f237d9-8988-4e41-8614-1aaeb006eb3a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.070752 Dec 18 20:56:42.695534 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1392/2761] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:42 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:42.705436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9106e400-d7b2-4949-9afb-d8883b13f16c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Calling method '.version_select at 0x7f714ef6b040>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:42.735608 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f216419-4ed7-4af6-ae38-5793d633ae4a tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.091060 Dec 18 20:56:42.736883 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1370/2762] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:42 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:42.768217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-477bf538-d50e-4142-a4c1-7d8b0694cf19 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614ab8b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:42.833625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9106e400-d7b2-4949-9afb-d8883b13f16c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.834237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9106e400-d7b2-4949-9afb-d8883b13f16c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.835196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9106e400-d7b2-4949-9afb-d8883b13f16c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.835977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9106e400-d7b2-4949-9afb-d8883b13f16c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.862363 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9106e400-d7b2-4949-9afb-d8883b13f16c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079/detail" status: 200 len: 463 microversion: 2.57 time: 0.165203 Dec 18 20:56:42.862992 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1393/2763] 10.222.0.13 () {60 vars in 1303 bytes} [Sat Dec 18 20:56:42 2021] GET /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079/detail => generated 463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:42.878942 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-477bf538-d50e-4142-a4c1-7d8b0694cf19 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.140619 Dec 18 20:56:42.879943 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1371/2764] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 20:56:42 2021] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:42.883669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:42.885576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:42.893846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c70ef52a-10e3-40da-9c08-bb9f14d240be tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614d7310>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:42.904043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.906966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.908350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.909250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.959521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c70ef52a-10e3-40da-9c08-bb9f14d240be tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3" status: 200 len: 784 microversion: 2.1 time: 0.069581 Dec 18 20:56:42.969856 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1372/2765] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:42 2021] GET /compute/v2.1/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3 => generated 784 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:42.976525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:42.977259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:42.984174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.984565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:42.985558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:42.986011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.009701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:43.023272 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa93f96a-1295-4d65-a978-d727b2b8efc7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1260 microversion: 2.1 time: 0.158195 Dec 18 20:56:43.024221 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1394/2766] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:42 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:43.056096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5e59319-819f-4010-861b-cb516b461b8f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714ef7cee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:43.147495 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5e59319-819f-4010-861b-cb516b461b8f tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.121872 Dec 18 20:56:43.148191 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1395/2767] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:56:43 2021] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:43.157811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Action: 'update', calling method: .version_select at 0x7f714eedc5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:43.159881 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:43.159881 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:43.177332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:43.192876 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d61e8648-a642-4489-bf15-b6b757ba5674 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1279 microversion: 2.1 time: 0.221635 Dec 18 20:56:43.195652 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1373/2768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:42 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:43.203756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1daac048-3c05-48f4-bd14-1fd8c63f505c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614d7ee0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:43.246699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.247288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.248287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.248836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.351887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.355204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.356409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.357169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.497722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1e41e81-8536-47fe-9f30-7dd8df4c683b tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079?user_id=027ef9dc651d414fa9087d6167e2f84a" status: 200 len: 148 microversion: 2.57 time: 0.346925 Dec 18 20:56:43.498493 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1396/2769] 10.222.0.13 () {62 vars in 1383 bytes} [Sat Dec 18 20:56:43 2021] PUT /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079?user_id=027ef9dc651d414fa9087d6167e2f84a => generated 148 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:43.503606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1c9b0b5d-ee19-4484-9919-da6e2a7ec0cb req-342d2bb8-fc6d-4e4c-a8c7-58a77e6ffb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9f6243-3663-449e-89e7-c1a511e9313d", "name": "network-vif-deleted", "tag": "36011601-d6a5-4062-8c92-593078687bde"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:43.521741 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:43.521741 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:43.536331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1c9b0b5d-ee19-4484-9919-da6e2a7ec0cb req-342d2bb8-fc6d-4e4c-a8c7-58a77e6ffb83 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.536786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1c9b0b5d-ee19-4484-9919-da6e2a7ec0cb req-342d2bb8-fc6d-4e4c-a8c7-58a77e6ffb83 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.551611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1c9b0b5d-ee19-4484-9919-da6e2a7ec0cb req-342d2bb8-fc6d-4e4c-a8c7-58a77e6ffb83 service nova] Creating event network-vif-deleted:36011601-d6a5-4062-8c92-593078687bde for instance bf9f6243-3663-449e-89e7-c1a511e9313d on nch2-master-1 Dec 18 20:56:43.568776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1c9b0b5d-ee19-4484-9919-da6e2a7ec0cb req-342d2bb8-fc6d-4e4c-a8c7-58a77e6ffb83 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068856 Dec 18 20:56:43.570293 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1397/2770] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:43.575374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21d241a1-9924-4941-b79d-b049aad87be4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Calling method '.version_select at 0x7f714ef0bc10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:43.728001 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21d241a1-9924-4941-b79d-b049aad87be4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079?user_id=027ef9dc651d414fa9087d6167e2f84a" status: 200 len: 190 microversion: 2.57 time: 0.156434 Dec 18 20:56:43.734032 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1398/2771] 10.222.0.13 () {60 vars in 1363 bytes} [Sat Dec 18 20:56:43 2021] GET /compute/v2.1/os-quota-sets/b8b76acc54bb48979644423c4aa71079?user_id=027ef9dc651d414fa9087d6167e2f84a => generated 190 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:43.740241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-84954a95-fbed-44ac-a180-f1cf8d50c7b1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:43.743848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-84954a95-fbed-44ac-a180-f1cf8d50c7b1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:43.756652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84954a95-fbed-44ac-a180-f1cf8d50c7b1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.757343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84954a95-fbed-44ac-a180-f1cf8d50c7b1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.759217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84954a95-fbed-44ac-a180-f1cf8d50c7b1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.760349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84954a95-fbed-44ac-a180-f1cf8d50c7b1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.839641 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-84954a95-fbed-44ac-a180-f1cf8d50c7b1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.102962 Dec 18 20:56:43.841433 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1399/2772] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:43 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:43.851040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-402f8c50-7fc5-4464-a9ed-52eab269fe0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:43.853621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-402f8c50-7fc5-4464-a9ed-52eab269fe0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:43.877638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402f8c50-7fc5-4464-a9ed-52eab269fe0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.879110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402f8c50-7fc5-4464-a9ed-52eab269fe0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:43.883754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402f8c50-7fc5-4464-a9ed-52eab269fe0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:43.884678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-402f8c50-7fc5-4464-a9ed-52eab269fe0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:44.001269 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-402f8c50-7fc5-4464-a9ed-52eab269fe0f tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.158231 Dec 18 20:56:44.006034 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1400/2773] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:43 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:44.016747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a3151a1d-f7c1-4762-8698-c4ce640d52c6 req-0a2f4bdc-8485-4d7a-b395-ed7be9a873fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fcab40-88c7-4902-a1b7-60f4caecbb80", "tag": "67829c42-153d-4545-a748-eb36ae44aa09"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:44.020833 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:44.020833 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:44.043434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a3151a1d-f7c1-4762-8698-c4ce640d52c6 req-0a2f4bdc-8485-4d7a-b395-ed7be9a873fc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:44.061121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a3151a1d-f7c1-4762-8698-c4ce640d52c6 req-0a2f4bdc-8485-4d7a-b395-ed7be9a873fc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:44.100241 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a3151a1d-f7c1-4762-8698-c4ce640d52c6 req-0a2f4bdc-8485-4d7a-b395-ed7be9a873fc service nova] Creating event network-changed:67829c42-153d-4545-a748-eb36ae44aa09 for instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 on nch1-master-1 Dec 18 20:56:44.112018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a3151a1d-f7c1-4762-8698-c4ce640d52c6 req-0a2f4bdc-8485-4d7a-b395-ed7be9a873fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106271 Dec 18 20:56:44.115522 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1401/2774] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:44.153048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:44.154024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:44.171520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:44.173883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:44.176066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:44.178970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:44.244751 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1daac048-3c05-48f4-bd14-1fd8c63f505c tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4" status: 204 len: 0 microversion: 2.1 time: 1.047823 Dec 18 20:56:44.245319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1374/2775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:43 2021] DELETE /compute/v2.1/images/6544a432-4e55-47e0-b263-72e6d5cd3ee4 => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:44.250065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:44.250877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:44.270537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:44.271000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:44.271873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:44.272253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:44.333100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:44.342453 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22e7f8ad-904e-4dd8-9d74-36e955dfb93f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1266 microversion: 2.1 time: 0.223611 Dec 18 20:56:44.343681 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1402/2776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:44 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:44.350957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7617a07b-d614-43bc-b4a3-2616e0fba832 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714eee89d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:45.065745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:45.085485 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-53f1ecb4-49c8-43ee-a94f-121c87626e6c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.838130 Dec 18 20:56:45.087934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1375/2777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:44 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:45.103511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3bbd5822-b61f-47c9-a4a1-01837b29c3f3 req-067e8bad-012a-46d4-999f-ce54628073c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9f6243-3663-449e-89e7-c1a511e9313d", "name": "network-vif-unplugged", "status": "completed", "tag": "36011601-d6a5-4062-8c92-593078687bde"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:45.105293 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:45.105293 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:45.114555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3bbd5822-b61f-47c9-a4a1-01837b29c3f3 req-067e8bad-012a-46d4-999f-ce54628073c7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.115381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3bbd5822-b61f-47c9-a4a1-01837b29c3f3 req-067e8bad-012a-46d4-999f-ce54628073c7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.130169 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3bbd5822-b61f-47c9-a4a1-01837b29c3f3 req-067e8bad-012a-46d4-999f-ce54628073c7 service nova] Creating event network-vif-unplugged:36011601-d6a5-4062-8c92-593078687bde for instance bf9f6243-3663-449e-89e7-c1a511e9313d on nch2-master-1 Dec 18 20:56:45.137058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3bbd5822-b61f-47c9-a4a1-01837b29c3f3 req-067e8bad-012a-46d4-999f-ce54628073c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037515 Dec 18 20:56:45.142081 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1376/2778] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:45.156591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b035b54e-673e-4aaf-8062-8e4bcef4b8fc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:45.160605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b035b54e-673e-4aaf-8062-8e4bcef4b8fc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:45.170676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b035b54e-673e-4aaf-8062-8e4bcef4b8fc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.171193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b035b54e-673e-4aaf-8062-8e4bcef4b8fc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.172260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b035b54e-673e-4aaf-8062-8e4bcef4b8fc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.172891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b035b54e-673e-4aaf-8062-8e4bcef4b8fc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.240218 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b035b54e-673e-4aaf-8062-8e4bcef4b8fc tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.096105 Dec 18 20:56:45.242450 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1377/2779] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:45 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:45.252159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-793a43a9-2791-4d09-b149-20aeac8378e1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:45.253189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-793a43a9-2791-4d09-b149-20aeac8378e1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:45.273015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-793a43a9-2791-4d09-b149-20aeac8378e1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.273541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-793a43a9-2791-4d09-b149-20aeac8378e1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.277497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-793a43a9-2791-4d09-b149-20aeac8378e1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.279602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-793a43a9-2791-4d09-b149-20aeac8378e1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.389997 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-793a43a9-2791-4d09-b149-20aeac8378e1 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.145864 Dec 18 20:56:45.390929 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1378/2780] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:45 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:45.401873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:45.403189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:45.413552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.414511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.415610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.416149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.458347 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7617a07b-d614-43bc-b4a3-2616e0fba832 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4" status: 204 len: 0 microversion: 2.1 time: 1.111363 Dec 18 20:56:45.459754 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1403/2781] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:44 2021] DELETE /compute/v2.1/images/f728a59a-0fc4-4e6e-968b-14e9e36535c4 => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:45.468515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f3f1f23-dee3-4d14-85d9-3ba062bbe1ea tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714eee8280>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:45.667205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:45.677543 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3722eae3-686e-4a14-a7e6-ee8b41427fe3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.284679 Dec 18 20:56:45.680492 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1379/2782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:45 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:45.790712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8774c6d9-d811-4020-a32f-603ad169a16f req-f06cd004-9782-4801-b255-ed4cec098381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b570c4b4-9fec-4af2-a087-0a30ca81794b", "tag": "319c512e-f64d-46a6-baf7-2b5a3d47c2b4"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:45.792170 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:45.792170 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:45.830413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8774c6d9-d811-4020-a32f-603ad169a16f req-f06cd004-9782-4801-b255-ed4cec098381 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:45.831128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8774c6d9-d811-4020-a32f-603ad169a16f req-f06cd004-9782-4801-b255-ed4cec098381 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:45.862307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8774c6d9-d811-4020-a32f-603ad169a16f req-f06cd004-9782-4801-b255-ed4cec098381 service nova] Creating event network-changed:319c512e-f64d-46a6-baf7-2b5a3d47c2b4 for instance b570c4b4-9fec-4af2-a087-0a30ca81794b on nch2-master-1 Dec 18 20:56:45.872747 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8774c6d9-d811-4020-a32f-603ad169a16f req-f06cd004-9782-4801-b255-ed4cec098381 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091566 Dec 18 20:56:45.873473 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1380/2783] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:56:46.105602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:46.106976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:46.113372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.114079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.115217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.115918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.252525 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1f3f1f23-dee3-4d14-85d9-3ba062bbe1ea tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6" status: 204 len: 0 microversion: 2.1 time: 0.788618 Dec 18 20:56:46.258647 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1404/2784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:45 2021] DELETE /compute/v2.1/images/4d38bd2b-ac39-4155-9926-bc6604780fa6 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:56:46.265998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9ae34a0-7701-4b56-9255-091a4bf33ff8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:46.267149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9ae34a0-7701-4b56-9255-091a4bf33ff8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:46.276371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9ae34a0-7701-4b56-9255-091a4bf33ff8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.277109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9ae34a0-7701-4b56-9255-091a4bf33ff8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.278144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9ae34a0-7701-4b56-9255-091a4bf33ff8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.278994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9ae34a0-7701-4b56-9255-091a4bf33ff8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.327492 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9ae34a0-7701-4b56-9255-091a4bf33ff8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.066342 Dec 18 20:56:46.328316 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1405/2785] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:46 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:46.334917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:46.335756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:46.342918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.343450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.344314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.344934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.358730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:46.370065 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74fbb0e4-f453-4b74-be87-d8d18b40131d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.269825 Dec 18 20:56:46.371410 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1381/2786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:46 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:46.381516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:46.414671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8865ffc-70c9-479e-934d-0163101994f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:46.418315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f8865ffc-70c9-479e-934d-0163101994f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:46.433698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8865ffc-70c9-479e-934d-0163101994f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.434995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8865ffc-70c9-479e-934d-0163101994f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.435930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8865ffc-70c9-479e-934d-0163101994f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.436484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8865ffc-70c9-479e-934d-0163101994f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.495918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8865ffc-70c9-479e-934d-0163101994f0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.093811 Dec 18 20:56:46.498950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1382/2787] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:46 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:46.516789 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6f1ea8b-45f1-4b8d-8dab-e55c06cd0b28 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 204 len: 0 microversion: 2.1 time: 0.185498 Dec 18 20:56:46.519207 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1406/2788] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:46 2021] DELETE /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:46.529708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:46.530555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:46.540102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.540703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.541665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.542115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.697896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1a97495a-5df9-40ae-9edb-75b22b4d2fbb req-c715b05c-4fa3-41df-8323-322f4f0035ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2a29f1-1645-4b4f-9ceb-cf156b8649f8", "tag": "15d300b1-0726-42ba-b558-7d300c39cec1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:46.699844 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:46.699844 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:46.712640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1a97495a-5df9-40ae-9edb-75b22b4d2fbb req-c715b05c-4fa3-41df-8323-322f4f0035ef service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.713610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1a97495a-5df9-40ae-9edb-75b22b4d2fbb req-c715b05c-4fa3-41df-8323-322f4f0035ef service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.728335 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1a97495a-5df9-40ae-9edb-75b22b4d2fbb req-c715b05c-4fa3-41df-8323-322f4f0035ef service nova] Creating event network-changed:15d300b1-0726-42ba-b558-7d300c39cec1 for instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 on nch2-master-1 Dec 18 20:56:46.733720 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1a97495a-5df9-40ae-9edb-75b22b4d2fbb req-c715b05c-4fa3-41df-8323-322f4f0035ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043595 Dec 18 20:56:46.735404 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1407/2789] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:56:46.741929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:46.742916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:46.749626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.750405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.752054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:46.752683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:46.772096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:46.787491 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6cd29b74-b4ec-4a49-8c6e-e1d51c664efe tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1473 microversion: 2.1 time: 0.260952 Dec 18 20:56:46.799671 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1383/2790] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:46 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:47.076847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:47.088128 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-051ad23c-c392-4fee-acca-8cee37ff7a41 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.351335 Dec 18 20:56:47.088784 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1408/2791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:46 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:47.340453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-141f223c-5a68-42ca-a6e3-004fc813107f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:47.341504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-141f223c-5a68-42ca-a6e3-004fc813107f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:47.350157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-141f223c-5a68-42ca-a6e3-004fc813107f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.350865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-141f223c-5a68-42ca-a6e3-004fc813107f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.351929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-141f223c-5a68-42ca-a6e3-004fc813107f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.352500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-141f223c-5a68-42ca-a6e3-004fc813107f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.388984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:47.389609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:47.397999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.398704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.399514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.399951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.411200 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-141f223c-5a68-42ca-a6e3-004fc813107f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.074087 Dec 18 20:56:47.412287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1384/2792] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:47 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:47.507793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88aeb9fa-c52e-4d8a-bc26-129ed6380939 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:47.508808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-88aeb9fa-c52e-4d8a-bc26-129ed6380939 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:47.527838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88aeb9fa-c52e-4d8a-bc26-129ed6380939 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.528379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88aeb9fa-c52e-4d8a-bc26-129ed6380939 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.529322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88aeb9fa-c52e-4d8a-bc26-129ed6380939 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.530463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88aeb9fa-c52e-4d8a-bc26-129ed6380939 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.561011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:47.570598 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40e7bcba-f2ba-4b44-bbe3-9ca97fa44d04 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.186917 Dec 18 20:56:47.572102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1409/2793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:47 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:47.590362 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88aeb9fa-c52e-4d8a-bc26-129ed6380939 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.086454 Dec 18 20:56:47.591070 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1385/2794] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:47 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:56:47.806361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:47.807199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:47.814367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.815000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.816185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:47.817240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:47.983981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:47.992673 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71c5b849-daac-4d57-823a-6a24edde1057 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1473 microversion: 2.1 time: 0.190208 Dec 18 20:56:47.994219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1410/2795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:47 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1473 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:48.106016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:48.107060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:48.114836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.115457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.116568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.116927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.256709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:48.264114 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-23673307-aee2-455d-a1a5-03dfe1938a53 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.162923 Dec 18 20:56:48.264678 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1386/2796] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:48 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:48.425787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-855bb164-2b59-4517-a998-4f717c7aebed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:48.427193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-855bb164-2b59-4517-a998-4f717c7aebed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:48.439258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-855bb164-2b59-4517-a998-4f717c7aebed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.444403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-855bb164-2b59-4517-a998-4f717c7aebed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.447417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-855bb164-2b59-4517-a998-4f717c7aebed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.448061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-855bb164-2b59-4517-a998-4f717c7aebed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.506918 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-855bb164-2b59-4517-a998-4f717c7aebed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.085884 Dec 18 20:56:48.507757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1411/2797] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:48 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:48.591236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:48.593969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:48.604824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.605694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56631e8b-9def-4108-a1ff-e78644e90e12 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:48.606567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.607392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-56631e8b-9def-4108-a1ff-e78644e90e12 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:48.607987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.608705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.624780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56631e8b-9def-4108-a1ff-e78644e90e12 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.625684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56631e8b-9def-4108-a1ff-e78644e90e12 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.626806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56631e8b-9def-4108-a1ff-e78644e90e12 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:48.629050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56631e8b-9def-4108-a1ff-e78644e90e12 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:48.718743 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56631e8b-9def-4108-a1ff-e78644e90e12 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.110956 Dec 18 20:56:48.718743 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1412/2798] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:48 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:56:49.007368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:49.012116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:49.013114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:49.022628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.023205 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f85b947-fc6d-4531-ad2c-63b56cef8ecf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.438406 Dec 18 20:56:49.023638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.023921 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1387/2799] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:48 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:49.024707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.026159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.297609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:49.309329 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3590033a-d09f-4715-97ea-14efa6f5d3b3 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 200 len: 1473 microversion: 2.1 time: 0.302025 Dec 18 20:56:49.310307 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1413/2800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:49 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:49.314973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:49.315658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:49.322003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.322728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.323882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.324479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.490851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8170f9f3-677c-4639-8085-4d6e21ab6038 req-8af91a87-6f13-4712-9cb6-c21e69192157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93280f-4987-4eea-b229-7cc365db43ff", "name": "network-vif-deleted", "tag": "2b8e5c57-7646-45bc-8bdf-d19b316188ed"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:49.493223 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:49.493223 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:56:49.501821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8170f9f3-677c-4639-8085-4d6e21ab6038 req-8af91a87-6f13-4712-9cb6-c21e69192157 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.501913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8170f9f3-677c-4639-8085-4d6e21ab6038 req-8af91a87-6f13-4712-9cb6-c21e69192157 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.514498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8170f9f3-677c-4639-8085-4d6e21ab6038 req-8af91a87-6f13-4712-9cb6-c21e69192157 service nova] Creating event network-vif-deleted:2b8e5c57-7646-45bc-8bdf-d19b316188ed for instance bd93280f-4987-4eea-b229-7cc365db43ff on nch1-master-1 Dec 18 20:56:49.515691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:49.520448 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8170f9f3-677c-4639-8085-4d6e21ab6038 req-8af91a87-6f13-4712-9cb6-c21e69192157 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250954 Dec 18 20:56:49.522042 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1388/2801] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:49.527555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1980f9bf-e6b4-4f0b-a853-c9cbf05d28eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:49.528005 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9315af0b-272d-452e-861d-906cefb78993 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.216588 Dec 18 20:56:49.528691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1980f9bf-e6b4-4f0b-a853-c9cbf05d28eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:49.530742 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1414/2802] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:49 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:49.535299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1980f9bf-e6b4-4f0b-a853-c9cbf05d28eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.536398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1980f9bf-e6b4-4f0b-a853-c9cbf05d28eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.537281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1980f9bf-e6b4-4f0b-a853-c9cbf05d28eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.537793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1980f9bf-e6b4-4f0b-a853-c9cbf05d28eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.592016 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1980f9bf-e6b4-4f0b-a853-c9cbf05d28eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.068100 Dec 18 20:56:49.598625 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1389/2803] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:49 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:49.721023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55ae0085-fdd0-4a2e-9c20-5fee1e7ac9dd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:49.722001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-55ae0085-fdd0-4a2e-9c20-5fee1e7ac9dd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:49.736968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55ae0085-fdd0-4a2e-9c20-5fee1e7ac9dd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.737443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55ae0085-fdd0-4a2e-9c20-5fee1e7ac9dd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.738304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55ae0085-fdd0-4a2e-9c20-5fee1e7ac9dd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:49.738774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55ae0085-fdd0-4a2e-9c20-5fee1e7ac9dd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:49.790078 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55ae0085-fdd0-4a2e-9c20-5fee1e7ac9dd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.072358 Dec 18 20:56:49.792090 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1415/2804] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:49 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:50.046019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:50.047115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:50.055682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.056215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.057097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.057618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.224609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:50.233056 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c12c9229-a018-40fd-8d99-3673d99b7842 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.195328 Dec 18 20:56:50.234218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1390/2805] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:50 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:50.312124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-64cb5360-3dee-4cb4-80c8-ed4541c8f433 req-22a2e9c1-ca27-4e0c-bc26-b8688158e813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fcab40-88c7-4902-a1b7-60f4caecbb80", "name": "network-vif-plugged", "status": "completed", "tag": "67829c42-153d-4545-a748-eb36ae44aa09"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:50.314314 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:50.314314 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:50.322907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-64cb5360-3dee-4cb4-80c8-ed4541c8f433 req-22a2e9c1-ca27-4e0c-bc26-b8688158e813 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.323758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-64cb5360-3dee-4cb4-80c8-ed4541c8f433 req-22a2e9c1-ca27-4e0c-bc26-b8688158e813 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.338991 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-64cb5360-3dee-4cb4-80c8-ed4541c8f433 req-22a2e9c1-ca27-4e0c-bc26-b8688158e813 service nova] Creating event network-vif-plugged:67829c42-153d-4545-a748-eb36ae44aa09 for instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 on nch1-master-1 Dec 18 20:56:50.346051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-64cb5360-3dee-4cb4-80c8-ed4541c8f433 req-22a2e9c1-ca27-4e0c-bc26-b8688158e813 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038038 Dec 18 20:56:50.347498 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1416/2806] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:50.351316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:50.354232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: bd93280f-4987-4eea-b229-7cc365db43ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:50.372934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.373597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.374519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.374998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.396801 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] HTTP exception thrown: Instance bd93280f-4987-4eea-b229-7cc365db43ff could not be found. Dec 18 20:56:50.397824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Returning 404 to user: Instance bd93280f-4987-4eea-b229-7cc365db43ff could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:50.399373 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b68f7c48-4ae5-4866-86ee-71319a2a7ecb tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff" status: 404 len: 111 microversion: 2.1 time: 0.067153 Dec 18 20:56:50.400120 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1391/2807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:50 2021] GET /compute/v2.1/servers/bd93280f-4987-4eea-b229-7cc365db43ff => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:50.409130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:50.409798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:50.418239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.418904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.419947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.420789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.449374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:56:50.549528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:50.550569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:50.553477 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9bb4fd42-f406-4800-baf9-82de4e3105d2 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 204 len: 0 microversion: 2.1 time: 0.148569 Dec 18 20:56:50.554182 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1417/2808] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:56:50 2021] DELETE /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:56:50.565987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:50.568817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:50.570375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.570839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.571655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.572091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.575817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.576543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.577501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.578529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.900102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:50.901650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:50.911108 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dfd28213-f2ab-4426-a350-1e43b77ec0c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.366022 Dec 18 20:56:50.913112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1392/2809] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:50 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:50.917268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9f83f062-e0da-4129-8642-7d1305673daa tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 1473 microversion: 2.1 time: 0.354025 Dec 18 20:56:50.919430 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1418/2810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:50 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 1473 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:50.920360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-55e66486-9d84-4328-9d18-1b25ecc10939 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:50.922007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-55e66486-9d84-4328-9d18-1b25ecc10939 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:50.930920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55e66486-9d84-4328-9d18-1b25ecc10939 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.931606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55e66486-9d84-4328-9d18-1b25ecc10939 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.931947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cfc0724e-cb22-4817-bed2-c38817288982 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:50.932793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55e66486-9d84-4328-9d18-1b25ecc10939 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.933175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cfc0724e-cb22-4817-bed2-c38817288982 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:50.933272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55e66486-9d84-4328-9d18-1b25ecc10939 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.941502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfc0724e-cb22-4817-bed2-c38817288982 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.942519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfc0724e-cb22-4817-bed2-c38817288982 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.943518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfc0724e-cb22-4817-bed2-c38817288982 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:50.944113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfc0724e-cb22-4817-bed2-c38817288982 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:50.993839 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cfc0724e-cb22-4817-bed2-c38817288982 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.072881 Dec 18 20:56:50.994619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1419/2811] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:50 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:51.020270 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-55e66486-9d84-4328-9d18-1b25ecc10939 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.105221 Dec 18 20:56:51.028530 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1393/2812] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:50 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:51.258839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:51.260046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:51.271473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:51.272114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:51.273089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:51.273689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:51.459511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:51.468559 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41431d12-0bca-44ac-9809-2035beb1babc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.220440 Dec 18 20:56:51.478094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1420/2813] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:51 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:51.948242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:51.949523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:51.950963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:51.953451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:51.969126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:51.970145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:51.971018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:51.972145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:51.974068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:51.976092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:51.978415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:51.979247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:52.257160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:52.275685 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c5ea54b-530a-464f-857a-09f0d433b64e tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 1473 microversion: 2.1 time: 0.337899 Dec 18 20:56:52.292951 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1394/2814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:51 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:52.297969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0398c967-3726-406c-b756-56f5d6b04447 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:52.298936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0398c967-3726-406c-b756-56f5d6b04447 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:52.323860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:52.335141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398c967-3726-406c-b756-56f5d6b04447 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:52.336501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398c967-3726-406c-b756-56f5d6b04447 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:52.339279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398c967-3726-406c-b756-56f5d6b04447 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:52.339891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398c967-3726-406c-b756-56f5d6b04447 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:52.343231 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0809448f-ca27-4d2f-9dfc-e631f6111504 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.406324 Dec 18 20:56:52.344337 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1421/2815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:51 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:52.351502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe4a6385-1dba-4e53-b34e-e411e914978b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:52.352913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe4a6385-1dba-4e53-b34e-e411e914978b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:52.361822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe4a6385-1dba-4e53-b34e-e411e914978b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:52.363200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe4a6385-1dba-4e53-b34e-e411e914978b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:52.364812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe4a6385-1dba-4e53-b34e-e411e914978b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:52.365588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe4a6385-1dba-4e53-b34e-e411e914978b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:52.422721 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0398c967-3726-406c-b756-56f5d6b04447 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.127766 Dec 18 20:56:52.425510 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe4a6385-1dba-4e53-b34e-e411e914978b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.079469 Dec 18 20:56:52.433544 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1422/2816] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:52 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:52.437843 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1395/2817] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:52 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:52.488298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:52.489521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:52.499003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:52.499825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:52.501176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:52.501864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:52.694836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:52.702617 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf985014-5601-4e81-8b32-bda331711635 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.220265 Dec 18 20:56:52.703870 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1423/2818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:52 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:53.187989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7f3bd7e-9434-4f64-be10-32ec008da3c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:53.189622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7f3bd7e-9434-4f64-be10-32ec008da3c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:53.205610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f3bd7e-9434-4f64-be10-32ec008da3c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.206316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f3bd7e-9434-4f64-be10-32ec008da3c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.207806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f3bd7e-9434-4f64-be10-32ec008da3c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.208395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f3bd7e-9434-4f64-be10-32ec008da3c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.314546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:53.315777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:53.322911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.323644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.324654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.324763 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7f3bd7e-9434-4f64-be10-32ec008da3c8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.151291 Dec 18 20:56:53.325429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.327228 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1396/2819] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:53 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:53.365539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:53.367895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:53.401102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.402290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.403568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.404173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.438897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b46b47b65699443083a47a2c8bab63cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3cfd30b80f46d798958d02e20cb5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:53.451426 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaedae0a-f340-491c-923b-61b14b76669b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 200 len: 1431 microversion: 2.1 time: 0.153160 Dec 18 20:56:53.452204 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1424/2820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:53 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 1431 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:53.464487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:53.474429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:53.487301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.488047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.489846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.491305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.644330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:53.654960 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d87ccb5e-ed72-4464-930e-12b2c70b9e8a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1673 microversion: 2.1 time: 0.297251 Dec 18 20:56:53.655566 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1397/2821] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:53 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1673 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:53.675944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa91cbd9-d47e-4a41-99d5-216864806cff tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:53.676941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa91cbd9-d47e-4a41-99d5-216864806cff tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:53.699524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa91cbd9-d47e-4a41-99d5-216864806cff tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.700241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa91cbd9-d47e-4a41-99d5-216864806cff tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.703752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa91cbd9-d47e-4a41-99d5-216864806cff tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.704469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa91cbd9-d47e-4a41-99d5-216864806cff tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.825835 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa91cbd9-d47e-4a41-99d5-216864806cff tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.152417 Dec 18 20:56:53.830704 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1398/2822] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:53 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:53.845070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9020b536-3195-404f-94d9-63d54b69d96d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:53.846868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9020b536-3195-404f-94d9-63d54b69d96d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:53.857290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9020b536-3195-404f-94d9-63d54b69d96d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.858129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9020b536-3195-404f-94d9-63d54b69d96d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.862932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:53.867791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9020b536-3195-404f-94d9-63d54b69d96d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.868262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9020b536-3195-404f-94d9-63d54b69d96d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.873745 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5775c81-0702-4f71-bdbd-680a6d853418 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.416795 Dec 18 20:56:53.874665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1425/2823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:53 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:53.881591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e106c7f6-8fff-4b0d-9c3d-6479e667f0be req-73909ad4-a04e-48e9-8b0e-b3dfdd683abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f709f32-beb6-4558-8d64-0d56d0981842", "name": "network-vif-deleted", "tag": "53d8cf94-d048-4858-b43d-3d641ffb86d5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:53.883859 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:53.883859 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:53.891067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e106c7f6-8fff-4b0d-9c3d-6479e667f0be req-73909ad4-a04e-48e9-8b0e-b3dfdd683abc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.891844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e106c7f6-8fff-4b0d-9c3d-6479e667f0be req-73909ad4-a04e-48e9-8b0e-b3dfdd683abc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.930770 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e106c7f6-8fff-4b0d-9c3d-6479e667f0be req-73909ad4-a04e-48e9-8b0e-b3dfdd683abc service nova] Creating event network-vif-deleted:53d8cf94-d048-4858-b43d-3d641ffb86d5 for instance 6f709f32-beb6-4558-8d64-0d56d0981842 on nch2-master-1 Dec 18 20:56:53.937675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9020b536-3195-404f-94d9-63d54b69d96d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.103258 Dec 18 20:56:53.943821 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e106c7f6-8fff-4b0d-9c3d-6479e667f0be req-73909ad4-a04e-48e9-8b0e-b3dfdd683abc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062005 Dec 18 20:56:53.943936 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1399/2824] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:53 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:53.945440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1426/2825] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:53.950096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:53.951396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:53.963462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.963960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:53.964827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:53.965284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:54.200858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:54.213997 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcc436bb-1f5a-4918-821e-ce5d7abbbdcf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.273444 Dec 18 20:56:54.217787 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1400/2826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:53 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:54.367829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7b5c85f8-5759-4497-925a-8cf3e8bc8710 req-667c3d23-4b10-476d-bdb6-66bded33f55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2a29f1-1645-4b4f-9ceb-cf156b8649f8", "name": "network-vif-plugged", "status": "completed", "tag": "15d300b1-0726-42ba-b558-7d300c39cec1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:54.370586 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:54.370586 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:54.402685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7b5c85f8-5759-4497-925a-8cf3e8bc8710 req-667c3d23-4b10-476d-bdb6-66bded33f55b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:54.403523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7b5c85f8-5759-4497-925a-8cf3e8bc8710 req-667c3d23-4b10-476d-bdb6-66bded33f55b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:54.417349 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7b5c85f8-5759-4497-925a-8cf3e8bc8710 req-667c3d23-4b10-476d-bdb6-66bded33f55b service nova] Creating event network-vif-plugged:15d300b1-0726-42ba-b558-7d300c39cec1 for instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 on nch2-master-1 Dec 18 20:56:54.429603 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7b5c85f8-5759-4497-925a-8cf3e8bc8710 req-667c3d23-4b10-476d-bdb6-66bded33f55b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073496 Dec 18 20:56:54.430538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1427/2827] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:54.469473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:54.470436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] [instance: 6f709f32-beb6-4558-8d64-0d56d0981842] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:54.483752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:54.485602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:54.486937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:54.487563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:54.508943 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] HTTP exception thrown: Instance 6f709f32-beb6-4558-8d64-0d56d0981842 could not be found. Dec 18 20:56:54.509969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Returning 404 to user: Instance 6f709f32-beb6-4558-8d64-0d56d0981842 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:56:54.511045 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65e7e656-7c0f-4354-b444-0ec77e72a934 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842" status: 404 len: 111 microversion: 2.1 time: 0.045619 Dec 18 20:56:54.512824 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1401/2828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:54 2021] GET /compute/v2.1/servers/6f709f32-beb6-4558-8d64-0d56d0981842 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:54.528430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98af2b6e-167d-4384-b220-e7464752d347 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f714eef40d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:54.672375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:54.673037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:54.687122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:54.688346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:54.689845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:54.690512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:54.956316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:54.965302 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1af53591-3b30-4709-bfed-d436052824fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1673 microversion: 2.1 time: 0.296680 Dec 18 20:56:54.982507 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1402/2829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:54 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1673 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:55.003284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a0143cfd-69b8-4fd8-81e9-fe8f986cf3d5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:55.005298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a0143cfd-69b8-4fd8-81e9-fe8f986cf3d5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:55.014544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0143cfd-69b8-4fd8-81e9-fe8f986cf3d5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.015353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0143cfd-69b8-4fd8-81e9-fe8f986cf3d5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.016510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0143cfd-69b8-4fd8-81e9-fe8f986cf3d5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.017347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0143cfd-69b8-4fd8-81e9-fe8f986cf3d5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.122865 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98af2b6e-167d-4384-b220-e7464752d347 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/images/422764cf-fded-41cc-93a7-e2349052fea8" status: 204 len: 0 microversion: 2.1 time: 0.604402 Dec 18 20:56:55.124887 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1428/2830] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:54 2021] DELETE /compute/v2.1/images/422764cf-fded-41cc-93a7-e2349052fea8 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:55.138145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:55.140417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:55.163523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.163984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.165075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.165779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.189888 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a0143cfd-69b8-4fd8-81e9-fe8f986cf3d5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.203863 Dec 18 20:56:55.191065 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1403/2831] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:54 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:55.200079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-539d6bc6-f985-4c4c-afb3-ec566ae23582 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:55.203045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-539d6bc6-f985-4c4c-afb3-ec566ae23582 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:55.223378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-539d6bc6-f985-4c4c-afb3-ec566ae23582 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.225338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-539d6bc6-f985-4c4c-afb3-ec566ae23582 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.228964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-539d6bc6-f985-4c4c-afb3-ec566ae23582 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.231926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-539d6bc6-f985-4c4c-afb3-ec566ae23582 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.315073 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-539d6bc6-f985-4c4c-afb3-ec566ae23582 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.121572 Dec 18 20:56:55.315685 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1404/2832] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:55 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:55.325048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bf25a15-d55c-4911-8e33-8c6dd97c271b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614ed790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:55.501650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:55.548085 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2068e301-fb96-4853-9696-5d159cc3d842 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1308 microversion: 2.1 time: 0.403291 Dec 18 20:56:55.548765 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1429/2833] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:55 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:55.566114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:55.573592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:55.584791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.585261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.588205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:55.588843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:55.826928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:55.836839 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b52337d-2aa0-4240-831e-eaec82ea48c4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.285248 Dec 18 20:56:55.837604 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1430/2834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:55 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:55.984955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:55.986177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:56.000140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.002129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.005925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.006795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.125752 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bf25a15-d55c-4911-8e33-8c6dd97c271b tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/images/b75d14c0-9a6d-4577-9014-8718e87df4b6" status: 204 len: 0 microversion: 2.1 time: 0.807493 Dec 18 20:56:56.128058 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1405/2835] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:55 2021] DELETE /compute/v2.1/images/b75d14c0-9a6d-4577-9014-8718e87df4b6 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:56.135660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-442592f4-37a8-442a-a5f1-5b22e5fd2d46 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] Calling method '.version_select at 0x7f71614eddc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:56.290992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:56.299947 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9a9601b-3245-47c5-a377-16f8acb67265 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.320887 Dec 18 20:56:56.317317 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1431/2836] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:55 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:56:56.335048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b7185f9-2313-4f9f-bd15-2f42a0054d7b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:56.338353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b7185f9-2313-4f9f-bd15-2f42a0054d7b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:56.363666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b7185f9-2313-4f9f-bd15-2f42a0054d7b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.364375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b7185f9-2313-4f9f-bd15-2f42a0054d7b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.365939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b7185f9-2313-4f9f-bd15-2f42a0054d7b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.366451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b7185f9-2313-4f9f-bd15-2f42a0054d7b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.413140 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b7185f9-2313-4f9f-bd15-2f42a0054d7b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.092340 Dec 18 20:56:56.419117 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1432/2837] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:56 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:56.424834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4da44dbb-4d60-45f7-be68-ed2f23fd6b39 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:56.426283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4da44dbb-4d60-45f7-be68-ed2f23fd6b39 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:56.436235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4da44dbb-4d60-45f7-be68-ed2f23fd6b39 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.436786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4da44dbb-4d60-45f7-be68-ed2f23fd6b39 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.437690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4da44dbb-4d60-45f7-be68-ed2f23fd6b39 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.438138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4da44dbb-4d60-45f7-be68-ed2f23fd6b39 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.490212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4da44dbb-4d60-45f7-be68-ed2f23fd6b39 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.068552 Dec 18 20:56:56.492440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1433/2838] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:56 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:56.498005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-cc4c9044-32c3-4adb-8183-2f10eefc114f req-1ff46693-0897-4b8a-a429-baaa3c365cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b570c4b4-9fec-4af2-a087-0a30ca81794b", "name": "network-vif-plugged", "status": "completed", "tag": "319c512e-f64d-46a6-baf7-2b5a3d47c2b4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:56.501882 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:56:56.501882 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:56:56.520718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cc4c9044-32c3-4adb-8183-2f10eefc114f req-1ff46693-0897-4b8a-a429-baaa3c365cbf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.521354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cc4c9044-32c3-4adb-8183-2f10eefc114f req-1ff46693-0897-4b8a-a429-baaa3c365cbf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.540302 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-cc4c9044-32c3-4adb-8183-2f10eefc114f req-1ff46693-0897-4b8a-a429-baaa3c365cbf service nova] Creating event network-vif-plugged:319c512e-f64d-46a6-baf7-2b5a3d47c2b4 for instance b570c4b4-9fec-4af2-a087-0a30ca81794b on nch2-master-1 Dec 18 20:56:56.547131 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-cc4c9044-32c3-4adb-8183-2f10eefc114f req-1ff46693-0897-4b8a-a429-baaa3c365cbf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052960 Dec 18 20:56:56.547925 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1434/2839] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:56:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:56:56.569984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:56.571014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:56.591541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.591984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.593198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.594218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.679018 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-442592f4-37a8-442a-a5f1-5b22e5fd2d46 tempest-ListImageFiltersTestJSON-1953545269 tempest-ListImageFiltersTestJSON-1953545269-project] 10.222.0.13 "DELETE /compute/v2.1/images/0bc417b0-01a1-4e1c-971e-235b42f50215" status: 204 len: 0 microversion: 2.1 time: 0.547036 Dec 18 20:56:56.679674 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1406/2840] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:56 2021] DELETE /compute/v2.1/images/0bc417b0-01a1-4e1c-971e-235b42f50215 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:56:56.855569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:56.856778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:56.859475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:56.868698 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d6525a5-daf2-4ebb-9977-72874130bb3a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1487 microversion: 2.1 time: 0.304221 Dec 18 20:56:56.879914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.881241 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1435/2841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:56 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1487 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:56.881483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.883517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.884226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.898004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:56.899460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:56.917597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.918184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.919076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:56.919529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:56.990546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lazy-loading 'flavor' on Instance uuid ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:56:57.241650 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9a3ea38-1fd4-4206-9ad5-873ebde1d40e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8/action" status: 202 len: 0 microversion: 2.1 time: 0.357048 Dec 18 20:56:57.242865 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1436/2842] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:56 2021] POST /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:57.252853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:57.253879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:57.269046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:57.269500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:57.270389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:57.274791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:57.312584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:57.322712 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c058738-35e0-4b08-895f-297ec92dcade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1321 microversion: 2.1 time: 0.472057 Dec 18 20:56:57.323961 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1407/2843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:56 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:57.425142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35b6a0f4-7f83-4c87-ad01-c7f3d05d9ce2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:57.427334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35b6a0f4-7f83-4c87-ad01-c7f3d05d9ce2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:57.438216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b6a0f4-7f83-4c87-ad01-c7f3d05d9ce2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:57.440992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b6a0f4-7f83-4c87-ad01-c7f3d05d9ce2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:57.442112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b6a0f4-7f83-4c87-ad01-c7f3d05d9ce2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:57.442764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b6a0f4-7f83-4c87-ad01-c7f3d05d9ce2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:57.511821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:57.530315 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07cb722d-3b7d-4158-9f75-156fb665e35c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1495 microversion: 2.1 time: 0.282983 Dec 18 20:56:57.532126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1437/2844] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:57 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1495 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:57.536016 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35b6a0f4-7f83-4c87-ad01-c7f3d05d9ce2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.112682 Dec 18 20:56:57.540140 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1408/2845] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:57 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:56:57.546972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6aa96c21-c76d-445a-a2a1-e20c0a9fb267 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:57.548719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6aa96c21-c76d-445a-a2a1-e20c0a9fb267 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:57.558279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aa96c21-c76d-445a-a2a1-e20c0a9fb267 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:57.559149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aa96c21-c76d-445a-a2a1-e20c0a9fb267 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:57.561064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aa96c21-c76d-445a-a2a1-e20c0a9fb267 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:57.562229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6aa96c21-c76d-445a-a2a1-e20c0a9fb267 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:57.629537 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6aa96c21-c76d-445a-a2a1-e20c0a9fb267 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.092869 Dec 18 20:56:57.630345 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1438/2846] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:57 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:58.342007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:58.343235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:58.355950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.357052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:58.358743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.359955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:58.555360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:58.557336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:58.570658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.571538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:58.573168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.574334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:58.717948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:58.749619 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-257bb161-c96e-4c60-b582-c514fdd35530 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1514 microversion: 2.1 time: 0.411376 Dec 18 20:56:58.773432 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1409/2847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:58 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:58.786174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2aa0ed01-2bcb-4edc-8c1d-154e3259c6fd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:58.790147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2aa0ed01-2bcb-4edc-8c1d-154e3259c6fd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:58.801455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2aa0ed01-2bcb-4edc-8c1d-154e3259c6fd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.802935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2aa0ed01-2bcb-4edc-8c1d-154e3259c6fd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:58.804766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2aa0ed01-2bcb-4edc-8c1d-154e3259c6fd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.810703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2aa0ed01-2bcb-4edc-8c1d-154e3259c6fd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:58.906083 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2aa0ed01-2bcb-4edc-8c1d-154e3259c6fd tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.127487 Dec 18 20:56:58.908727 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1410/2848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:58 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:56:58.932384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c4a19b43-af2b-44dc-b6c0-f2501947e26f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:58.936371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c4a19b43-af2b-44dc-b6c0-f2501947e26f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:58.947625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4a19b43-af2b-44dc-b6c0-f2501947e26f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.948484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4a19b43-af2b-44dc-b6c0-f2501947e26f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:58.949453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4a19b43-af2b-44dc-b6c0-f2501947e26f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:58.950406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4a19b43-af2b-44dc-b6c0-f2501947e26f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:59.063400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:56:59.065578 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c4a19b43-af2b-44dc-b6c0-f2501947e26f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.153215 Dec 18 20:56:59.071300 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1411/2849] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:56:58 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:56:59.079498 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dad6c472-3624-456a-a41d-dc5055fbb930 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 200 len: 1478 microversion: 2.1 time: 0.531435 Dec 18 20:56:59.089712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:59.091823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:59.097459 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1439/2850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:58 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 1478 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:56:59.111324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:59.112154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:59.114161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:59.114919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:59.151594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lazy-loading 'flavor' on Instance uuid b570c4b4-9fec-4af2-a087-0a30ca81794b {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:56:59.400433 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9da4478c-3a9b-4340-84dc-5ce28c1a6ff7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b/action" status: 200 len: 32 microversion: 2.1 time: 0.316593 Dec 18 20:56:59.407214 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1412/2851] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:59 2021] POST /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b/action => generated 32 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:56:59.428547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb24176e-4ea8-417b-9b09-1d7a5a4503bb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2147036809"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:59.431722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb24176e-4ea8-417b-9b09-1d7a5a4503bb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:59.442579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb24176e-4ea8-417b-9b09-1d7a5a4503bb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:59.444249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb24176e-4ea8-417b-9b09-1d7a5a4503bb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:59.446830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb24176e-4ea8-417b-9b09-1d7a5a4503bb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:59.448000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb24176e-4ea8-417b-9b09-1d7a5a4503bb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:59.489101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e399174-3edc-4b57-bef0-7bc87ee6f5ef tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Action: 'create', calling method: .version_select at 0x7f714ee5f550>, body: {"keypair": {"name": "tempest-keypair-1684945762"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:56:59.534324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1e399174-3edc-4b57-bef0-7bc87ee6f5ef tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:56:59.548431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1e399174-3edc-4b57-bef0-7bc87ee6f5ef tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:56:59.967375 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb24176e-4ea8-417b-9b09-1d7a5a4503bb tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8/action" status: 202 len: 0 microversion: 2.1 time: 0.556752 Dec 18 20:56:59.971589 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1413/2852] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:56:59 2021] POST /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:56:59.982588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:56:59.987591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:56:59.996615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:59.997633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:56:59.998887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:56:59.999670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:00.037022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1e399174-3edc-4b57-bef0-7bc87ee6f5ef tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:00.052226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1e399174-3edc-4b57-bef0-7bc87ee6f5ef tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:00.074182 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e399174-3edc-4b57-bef0-7bc87ee6f5ef tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.973142 Dec 18 20:57:00.081214 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1440/2853] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:56:59 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:00.091890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b383747-6aeb-4e9a-9c40-169be1e456c0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:00.093630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b383747-6aeb-4e9a-9c40-169be1e456c0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:00.102847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b383747-6aeb-4e9a-9c40-169be1e456c0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:00.103665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b383747-6aeb-4e9a-9c40-169be1e456c0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:00.104934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b383747-6aeb-4e9a-9c40-169be1e456c0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:00.105872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b383747-6aeb-4e9a-9c40-169be1e456c0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:00.167102 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b383747-6aeb-4e9a-9c40-169be1e456c0 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.083601 Dec 18 20:57:00.171331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1441/2854] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:00 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:57:00.179683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a67c7d2a-fd8a-41d4-a5e4-da9625fb1571 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ee86dc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:00.281229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a67c7d2a-fd8a-41d4-a5e4-da9625fb1571 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.111926 Dec 18 20:57:00.282140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1442/2855] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:00 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:00.289424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5bf560fb-1da2-4243-81a0-4d16eb94a190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:00.294655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5bf560fb-1da2-4243-81a0-4d16eb94a190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:00.312730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bf560fb-1da2-4243-81a0-4d16eb94a190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:00.313586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bf560fb-1da2-4243-81a0-4d16eb94a190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:00.315613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bf560fb-1da2-4243-81a0-4d16eb94a190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:00.316224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bf560fb-1da2-4243-81a0-4d16eb94a190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:00.426389 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5bf560fb-1da2-4243-81a0-4d16eb94a190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.138653 Dec 18 20:57:00.428288 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1443/2856] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:00 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:00.437173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5bba82b-874e-4ae9-b70d-fe502870725c tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714eef7a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:00.450450 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d5bba82b-874e-4ae9-b70d-fe502870725c tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1684945762" status: 200 len: 692 microversion: 2.1 time: 0.019352 Dec 18 20:57:00.451598 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1444/2857] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 20:57:00 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1684945762 => generated 692 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:00.462492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbc8801f-c25a-4ae8-846e-1679dd88a4a1 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714ef7c670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:00.498698 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bbc8801f-c25a-4ae8-846e-1679dd88a4a1 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684945762" status: 202 len: 0 microversion: 2.1 time: 0.040947 Dec 18 20:57:00.500027 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1445/2858] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 20:57:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684945762 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:00.515595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c42fc3a-57be-47f8-9555-401132fc88cb tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Action: 'create', calling method: .version_select at 0x7f71613525e0>, body: {"keypair": {"name": "tempest-keypair-838669028"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:00.545361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4c42fc3a-57be-47f8-9555-401132fc88cb tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:00.553128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4c42fc3a-57be-47f8-9555-401132fc88cb tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:00.852369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4c42fc3a-57be-47f8-9555-401132fc88cb tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:00.859249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-4c42fc3a-57be-47f8-9555-401132fc88cb tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:00.899132 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c42fc3a-57be-47f8-9555-401132fc88cb tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.387422 Dec 18 20:57:00.906696 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1446/2859] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:57:00 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:00.917155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45af3371-d251-4cab-a6a0-640e2f4e5927 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714ef25ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:00.954244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45af3371-d251-4cab-a6a0-640e2f4e5927 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838669028" status: 202 len: 0 microversion: 2.1 time: 0.046110 Dec 18 20:57:00.955542 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1447/2860] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 20:57:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838669028 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:00.979437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-305a226c-2895-41ba-9a3d-02eead826138 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Action: 'create', calling method: .version_select at 0x7f714ee6d790>, body: {"keypair": {"name": "tempest-keypair-1188809242", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:00.981663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:00.995632 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cc834284-2e4f-49f8-b29e-9720232d669f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 1.020409 Dec 18 20:57:00.998198 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1414/2861] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:56:59 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:01.013791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-305a226c-2895-41ba-9a3d-02eead826138 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:01.038537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-305a226c-2895-41ba-9a3d-02eead826138 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:01.078289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-305a226c-2895-41ba-9a3d-02eead826138 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.110395 Dec 18 20:57:01.079214 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1448/2862] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Dec 18 20:57:00 2021] POST /compute/v2.1/os-keypairs => generated 574 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:01.093788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ede08d98-d9fb-44c8-8f6d-967c34526832 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714f031c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:01.150930 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ede08d98-d9fb-44c8-8f6d-967c34526832 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188809242" status: 202 len: 0 microversion: 2.1 time: 0.064031 Dec 18 20:57:01.151852 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1415/2863] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 20:57:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188809242 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:01.172524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b21137b3-ec14-4152-9294-228d636890d6 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Action: 'create', calling method: .version_select at 0x7f714ee7df70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-730740816"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:01.183497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d884e49a-8dd5-425c-921c-1325230674f8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:01.185531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d884e49a-8dd5-425c-921c-1325230674f8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:01.193401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b21137b3-ec14-4152-9294-228d636890d6 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:01.199994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b21137b3-ec14-4152-9294-228d636890d6 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:01.240873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d884e49a-8dd5-425c-921c-1325230674f8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:01.243992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d884e49a-8dd5-425c-921c-1325230674f8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:01.245107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d884e49a-8dd5-425c-921c-1325230674f8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:01.248047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d884e49a-8dd5-425c-921c-1325230674f8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:01.323903 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d884e49a-8dd5-425c-921c-1325230674f8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.147727 Dec 18 20:57:01.329880 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1416/2864] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:01 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:57:01.337931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b83ebbe7-4663-41ce-a653-c119bbfd9005 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613a88b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:01.357617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b21137b3-ec14-4152-9294-228d636890d6 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:01.365132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b21137b3-ec14-4152-9294-228d636890d6 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:01.399050 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b21137b3-ec14-4152-9294-228d636890d6 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.239620 Dec 18 20:57:01.401094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1449/2865] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:57:01 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:01.406779 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b83ebbe7-4663-41ce-a653-c119bbfd9005 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.074439 Dec 18 20:57:01.408112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1417/2866] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:01 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:01.415277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d23b871-55ff-433b-82b8-e71e936bef58 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Action: 'create', calling method: .version_select at 0x7f714ef25ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1847979200"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:01.440533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ff1b610-2754-4f26-8e31-0738adba5b58 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:01.443076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ff1b610-2754-4f26-8e31-0738adba5b58 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:01.458006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ff1b610-2754-4f26-8e31-0738adba5b58 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:01.458917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ff1b610-2754-4f26-8e31-0738adba5b58 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:01.463295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ff1b610-2754-4f26-8e31-0738adba5b58 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:01.463820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ff1b610-2754-4f26-8e31-0738adba5b58 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:01.484258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7d23b871-55ff-433b-82b8-e71e936bef58 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:01.513693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7d23b871-55ff-433b-82b8-e71e936bef58 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:01.545912 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ff1b610-2754-4f26-8e31-0738adba5b58 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.110361 Dec 18 20:57:01.552532 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1418/2867] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:01 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:01.854188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7d23b871-55ff-433b-82b8-e71e936bef58 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:01.871662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-7d23b871-55ff-433b-82b8-e71e936bef58 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:01.909739 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d23b871-55ff-433b-82b8-e71e936bef58 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.502422 Dec 18 20:57:01.916989 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1450/2868] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:57:01 2021] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:01.932660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6fee3353-3ff8-4010-89f0-dd55996a1b5d tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Action: 'create', calling method: .version_select at 0x7f714eb5a9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-178380141"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:01.992511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6fee3353-3ff8-4010-89f0-dd55996a1b5d tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:02.002113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6fee3353-3ff8-4010-89f0-dd55996a1b5d tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:02.020143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:02.021080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:02.043161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:02.046140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:02.048495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:02.051545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:02.366576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6fee3353-3ff8-4010-89f0-dd55996a1b5d tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:02.399581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6fee3353-3ff8-4010-89f0-dd55996a1b5d tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Getting quotas for user 4042244ff3d24f1b891680a791f193a8 and project 1b12359736114d2eba905cf65df3d04e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:02.422832 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6fee3353-3ff8-4010-89f0-dd55996a1b5d tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.502658 Dec 18 20:57:02.423730 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1419/2869] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:57:01 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:02.433583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-297758b0-ea2f-4de4-ae96-c7a3b9a08ee2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:02.434879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-297758b0-ea2f-4de4-ae96-c7a3b9a08ee2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:02.439891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:02.461682 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1dd458c3-ffac-4c7b-b767-934743138c1f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.448900 Dec 18 20:57:02.462024 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1451/2870] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:02 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:02.468545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-297758b0-ea2f-4de4-ae96-c7a3b9a08ee2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:02.470018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-297758b0-ea2f-4de4-ae96-c7a3b9a08ee2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:02.472108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-297758b0-ea2f-4de4-ae96-c7a3b9a08ee2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:02.473793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-297758b0-ea2f-4de4-ae96-c7a3b9a08ee2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:02.476349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad02eef2-0f0e-4511-8d47-98711a10f58c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ee7adc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:02.581776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad02eef2-0f0e-4511-8d47-98711a10f58c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.118589 Dec 18 20:57:02.602113 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1452/2871] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:02 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:02.602793 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-297758b0-ea2f-4de4-ae96-c7a3b9a08ee2 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.169546 Dec 18 20:57:02.605760 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1420/2872] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:02 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:57:02.615969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70773658-8e0f-4680-a63e-7b783a7ad967 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714ee5f430>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:02.624332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74cc352a-3c45-43c0-b76d-3f67be304661 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:02.626638 ncdv-master-1 devstack@n-api.service[140731]: WARNING oslo_db.sqlalchemy.utils [None req-70773658-8e0f-4680-a63e-7b783a7ad967 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 18 20:57:02.627250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74cc352a-3c45-43c0-b76d-3f67be304661 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:02.643925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74cc352a-3c45-43c0-b76d-3f67be304661 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:02.645550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74cc352a-3c45-43c0-b76d-3f67be304661 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:02.649014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70773658-8e0f-4680-a63e-7b783a7ad967 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1674 microversion: 2.1 time: 0.043277 Dec 18 20:57:02.655199 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1453/2873] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:57:02 2021] GET /compute/v2.1/os-keypairs => generated 1674 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:02.658792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74cc352a-3c45-43c0-b76d-3f67be304661 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:02.659724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74cc352a-3c45-43c0-b76d-3f67be304661 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:02.666454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b72e2a0-015a-498f-b451-951bc13fd4db tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714eeb95e0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:02.700433 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b72e2a0-015a-498f-b451-951bc13fd4db tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-178380141" status: 202 len: 0 microversion: 2.1 time: 0.043445 Dec 18 20:57:02.704152 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1454/2874] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:57:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-178380141 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:02.710767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a2ea79e-05dd-4e17-b7b4-b1b344cb05a5 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714eee8940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:02.733384 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a2ea79e-05dd-4e17-b7b4-b1b344cb05a5 tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1847979200" status: 202 len: 0 microversion: 2.1 time: 0.027556 Dec 18 20:57:02.736951 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1455/2875] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Dec 18 20:57:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1847979200 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:02.744394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f3fd9b3-18fa-4b6e-b2bc-0a6738086c4e tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] Calling method '.version_select at 0x7f714ee5fa60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:02.768139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74cc352a-3c45-43c0-b76d-3f67be304661 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.160586 Dec 18 20:57:02.770870 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1421/2876] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:02 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:02.823002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1f3fd9b3-18fa-4b6e-b2bc-0a6738086c4e tempest-KeyPairsV2TestJSON-462348280 tempest-KeyPairsV2TestJSON-462348280-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-730740816" status: 202 len: 0 microversion: 2.1 time: 0.084118 Dec 18 20:57:02.824750 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1456/2877] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:57:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-730740816 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:57:03.480217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:03.481016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:03.509224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:03.509745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:03.518062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:03.518716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:03.611497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75770942-815f-4e09-9f0e-a1b10ff7b191 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714eef7f70>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:03.702697 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75770942-815f-4e09-9f0e-a1b10ff7b191 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.097429 Dec 18 20:57:03.713652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1457/2878] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:03 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:03.725889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26bf22da-a130-411a-a208-2beb648dcd1d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:03.732584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26bf22da-a130-411a-a208-2beb648dcd1d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:03.744423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26bf22da-a130-411a-a208-2beb648dcd1d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:03.745424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26bf22da-a130-411a-a208-2beb648dcd1d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:03.747667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26bf22da-a130-411a-a208-2beb648dcd1d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:03.748489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26bf22da-a130-411a-a208-2beb648dcd1d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:03.829515 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26bf22da-a130-411a-a208-2beb648dcd1d tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 32619 microversion: 2.1 time: 0.112820 Dec 18 20:57:03.834048 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1458/2879] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:03 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 32619 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:57:03.844614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8285b8a-8bf6-4c68-bada-1b17cee2cafb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:03.847119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8285b8a-8bf6-4c68-bada-1b17cee2cafb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:03.865716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8285b8a-8bf6-4c68-bada-1b17cee2cafb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:03.866491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8285b8a-8bf6-4c68-bada-1b17cee2cafb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:03.868184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8285b8a-8bf6-4c68-bada-1b17cee2cafb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:03.869375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8285b8a-8bf6-4c68-bada-1b17cee2cafb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:03.931022 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8285b8a-8bf6-4c68-bada-1b17cee2cafb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.094322 Dec 18 20:57:03.935466 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1459/2880] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:03 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:03.997509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:04.011629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44b050e3-40af-4107-875e-5ba7c857f9d3 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.536098 Dec 18 20:57:04.012267 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1422/2881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:03 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:04.724132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a731502-85e9-4184-8989-5272b403f680 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714eedca60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:04.846433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c85a0bfd-279d-477e-939c-f7e644b34fb8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:04.848736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c85a0bfd-279d-477e-939c-f7e644b34fb8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:04.887431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c85a0bfd-279d-477e-939c-f7e644b34fb8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:04.895946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c85a0bfd-279d-477e-939c-f7e644b34fb8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:04.896960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c85a0bfd-279d-477e-939c-f7e644b34fb8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:04.897416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c85a0bfd-279d-477e-939c-f7e644b34fb8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:04.914536 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a731502-85e9-4184-8989-5272b403f680 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.197303 Dec 18 20:57:04.922656 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1460/2882] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:04 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:04.963888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41ceb19a-1b1c-4549-b549-199855423190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:04.965061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-41ceb19a-1b1c-4549-b549-199855423190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:04.986549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41ceb19a-1b1c-4549-b549-199855423190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:04.987048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41ceb19a-1b1c-4549-b549-199855423190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:04.987852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41ceb19a-1b1c-4549-b549-199855423190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:04.999000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41ceb19a-1b1c-4549-b549-199855423190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:05.044966 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c85a0bfd-279d-477e-939c-f7e644b34fb8 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action" status: 200 len: 40776 microversion: 2.1 time: 0.203476 Dec 18 20:57:05.046725 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1423/2883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:04 2021] POST /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5/action => generated 40776 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:57:05.057693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:05.058530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:05.078172 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41ceb19a-1b1c-4549-b549-199855423190 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.134053 Dec 18 20:57:05.079831 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1461/2884] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:04 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:05.082070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:05.082686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:05.087434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:05.089522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:05.098493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:05.098856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:05.112689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:05.114432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:05.115328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:05.118143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:05.872274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:05.891569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c7a4f5b-580a-46ba-acfb-84265b0ba565 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.842386 Dec 18 20:57:05.897050 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1424/2885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:05 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:05.903605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:05.929165 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac9ec602-a519-48c2-aa46-4528ba8ac5e3 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1601 microversion: 2.1 time: 0.847553 Dec 18 20:57:05.934771 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1462/2886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:05 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1601 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:05.942523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1f0da963-bc64-4dc9-b070-af4aa9fda963 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71614edc10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:06.101283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbb8efca-b4d6-40de-9ef0-412aa5942a20 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:06.103819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bbb8efca-b4d6-40de-9ef0-412aa5942a20 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:06.133412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb8efca-b4d6-40de-9ef0-412aa5942a20 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:06.133868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb8efca-b4d6-40de-9ef0-412aa5942a20 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:06.138758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb8efca-b4d6-40de-9ef0-412aa5942a20 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:06.139908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb8efca-b4d6-40de-9ef0-412aa5942a20 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:06.222374 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bbb8efca-b4d6-40de-9ef0-412aa5942a20 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.125883 Dec 18 20:57:06.225418 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1463/2887] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:06 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:06.915861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:06.917064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:06.960836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:06.961680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:06.962744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:06.963360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:07.741632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:07.753485 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b128e4cc-daec-4dd3-b96b-a28a8857f397 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.842102 Dec 18 20:57:07.758811 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1464/2888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:06 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:07.782890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:07.803548 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:07.803548 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:57:07.810995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:07.815002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Searching by: {'deleted': False, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:57:07.834336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:07.835450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:07.837290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:07.845827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:07.934603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:57:08.036318 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8c3e37c2-76f5-4d5c-b2b3-f6066697c1ec tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.269045 Dec 18 20:57:08.045732 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1465/2889] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:57:07 2021] GET /compute/v2.1/servers => generated 344 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:08.056712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a1738bee-f948-4c03-898c-8d651d73deba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:08.061036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a1738bee-f948-4c03-898c-8d651d73deba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:08.079992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1738bee-f948-4c03-898c-8d651d73deba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:08.080681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1738bee-f948-4c03-898c-8d651d73deba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:08.082768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1738bee-f948-4c03-898c-8d651d73deba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:08.084967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1738bee-f948-4c03-898c-8d651d73deba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:08.244934 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a1738bee-f948-4c03-898c-8d651d73deba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.197536 Dec 18 20:57:08.257023 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1466/2890] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:08 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:08.271842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:08.279834 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:08.279834 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:57:08.283413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:08.286611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Searching by: {'deleted': False, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:57:08.304339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:08.308145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:08.310150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:08.311769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:08.405325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:57:08.572083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:08.593483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:08.596065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:09.161909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8493717d-e1a7-4911-bce8-51f8e95b6188 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.900066 Dec 18 20:57:09.162673 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1467/2891] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:57:08 2021] GET /compute/v2.1/servers/detail => generated 1604 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:09.171321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:09.172453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:09.200541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:09.204839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:09.205802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:09.206225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:09.475746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:09.484748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-648cbcad-6bb8-423a-918a-1f4675b87fae tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.317105 Dec 18 20:57:09.485339 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1468/2892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:09 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:09.505483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1dfefc20-0b7b-4478-998c-d20669af3fbe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:09.530014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1dfefc20-0b7b-4478-998c-d20669af3fbe tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043224 Dec 18 20:57:09.540699 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1469/2893] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:57:09 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:09.557415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cf29fe2-f78f-4c80-9380-24bb971ecec8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:09.558395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cf29fe2-f78f-4c80-9380-24bb971ecec8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:09.567499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf29fe2-f78f-4c80-9380-24bb971ecec8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:09.567958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf29fe2-f78f-4c80-9380-24bb971ecec8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:09.568775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf29fe2-f78f-4c80-9380-24bb971ecec8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:09.569216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf29fe2-f78f-4c80-9380-24bb971ecec8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:09.632290 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cf29fe2-f78f-4c80-9380-24bb971ecec8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.090167 Dec 18 20:57:09.632986 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1470/2894] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:09 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:10.245938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71a78351-aaad-42d2-8a2b-b464a77c91e4 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714ee380d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-852578562", "description": "tempest-description-629591517"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:10.674324 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71a78351-aaad-42d2-8a2b-b464a77c91e4 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.989812 Dec 18 20:57:10.676002 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1471/2895] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:57:09 2021] POST /compute/v2.1/os-security-groups => generated 254 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:10.680576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:10.682374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:10.699190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:10.700014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:10.701127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:10.701774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:10.773225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:57:10.782365 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1f0da963-bc64-4dc9-b070-af4aa9fda963 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 4.856699 Dec 18 20:57:10.787209 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1425/2896] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:05 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 4863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:10.797015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3243aa7b-1302-4bda-b04c-c551f35be3df req-29d4b94e-b7e3-45a8-bc7b-b1ec55a9e49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2a29f1-1645-4b4f-9ceb-cf156b8649f8", "name": "network-vif-plugged", "status": "completed", "tag": "15d300b1-0726-42ba-b558-7d300c39cec1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:10.804238 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:10.804238 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:57:10.832370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3243aa7b-1302-4bda-b04c-c551f35be3df req-29d4b94e-b7e3-45a8-bc7b-b1ec55a9e49e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:10.849491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3243aa7b-1302-4bda-b04c-c551f35be3df req-29d4b94e-b7e3-45a8-bc7b-b1ec55a9e49e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:10.880437 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3243aa7b-1302-4bda-b04c-c551f35be3df req-29d4b94e-b7e3-45a8-bc7b-b1ec55a9e49e service nova] Creating event network-vif-plugged:15d300b1-0726-42ba-b558-7d300c39cec1 for instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 on nch2-master-1 Dec 18 20:57:10.894932 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3243aa7b-1302-4bda-b04c-c551f35be3df req-29d4b94e-b7e3-45a8-bc7b-b1ec55a9e49e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105823 Dec 18 20:57:10.898492 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1426/2897] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:10.914495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:10.917722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:10.952006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:10.953160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:10.954455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:10.955166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:10.991048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a6dd975-80e3-410e-9042-cfee015c2511 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "DELETE /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 204 len: 0 microversion: 2.1 time: 0.313370 Dec 18 20:57:10.992484 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1472/2898] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:57:10 2021] DELETE /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:57:11.199822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:11.215120 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9975b73f-e8c2-4dc3-8e03-046b2316ffc4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.314393 Dec 18 20:57:11.215979 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1427/2899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:10 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:11.221567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a3cb1f2-c47f-4011-887e-c7de6f70b219 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714fa7bee0>, body: {"security_group_rule": {"parent_group_id": "5bd90dd9-99b8-4d88-9029-b1089b47df1a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:11.299575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-468cf4ba-2e9f-4d2f-8924-8fd3dc4a8694 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:11.300694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-468cf4ba-2e9f-4d2f-8924-8fd3dc4a8694 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:11.312763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-468cf4ba-2e9f-4d2f-8924-8fd3dc4a8694 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:11.314912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-468cf4ba-2e9f-4d2f-8924-8fd3dc4a8694 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:11.315902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-468cf4ba-2e9f-4d2f-8924-8fd3dc4a8694 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:11.326010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-468cf4ba-2e9f-4d2f-8924-8fd3dc4a8694 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:11.407767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-468cf4ba-2e9f-4d2f-8924-8fd3dc4a8694 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.413396 Dec 18 20:57:11.414528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1473/2900] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:10 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:11.426424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:11.431744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:11.460394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:11.463105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:11.480292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:11.480801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:11.513956 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a3cb1f2-c47f-4011-887e-c7de6f70b219 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.296520 Dec 18 20:57:11.514653 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1428/2901] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:11 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:11.530837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31992929-3bde-4738-93fe-b0e53d5e490b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f716150c160>, body: {"security_group_rule": {"parent_group_id": "5bd90dd9-99b8-4d88-9029-b1089b47df1a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:11.782023 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-31992929-3bde-4738-93fe-b0e53d5e490b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: This rule already exists in group 5bd90dd9-99b8-4d88-9029-b1089b47df1a Dec 18 20:57:11.788972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31992929-3bde-4738-93fe-b0e53d5e490b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 400 to user: This rule already exists in group 5bd90dd9-99b8-4d88-9029-b1089b47df1a {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:11.789891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31992929-3bde-4738-93fe-b0e53d5e490b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.265297 Dec 18 20:57:11.791821 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1429/2902] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:11 2021] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:57:11.856317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7577121c-fcc6-4732-8070-f264b8eb88e7 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Calling method '.version_select at 0x7f714ebaf5e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:11.965529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:11.976584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-02940248-9297-4c22-b155-95a2dd43a7ba tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1607 microversion: 2.1 time: 0.559870 Dec 18 20:57:12.001549 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1474/2903] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:11 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1607 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:12.037966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8202847d-8c12-4945-93db-998556996e55 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ee9ea60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:12.169939 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8202847d-8c12-4945-93db-998556996e55 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.166930 Dec 18 20:57:12.184253 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1475/2904] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:12 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:12.240685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:12.241632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:12.258640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:12.259409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:12.260409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:12.269542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:12.522872 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7577121c-fcc6-4732-8070-f264b8eb88e7 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/0261d9ac-823f-4313-af2b-a309b2a166fe" status: 202 len: 0 microversion: 2.1 time: 0.670659 Dec 18 20:57:12.523478 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1430/2905] 10.222.0.13 () {58 vars in 1286 bytes} [Sat Dec 18 20:57:11 2021] DELETE /compute/v2.1/os-security-group-rules/0261d9ac-823f-4313-af2b-a309b2a166fe => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:57:12.533796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fecbbd29-fc2c-4590-940f-f2abf3ac76ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:12.535913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fecbbd29-fc2c-4590-940f-f2abf3ac76ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:12.549817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fecbbd29-fc2c-4590-940f-f2abf3ac76ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:12.551989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fecbbd29-fc2c-4590-940f-f2abf3ac76ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:12.554071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fecbbd29-fc2c-4590-940f-f2abf3ac76ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:12.556552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fecbbd29-fc2c-4590-940f-f2abf3ac76ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:12.680047 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fecbbd29-fc2c-4590-940f-f2abf3ac76ab tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.154656 Dec 18 20:57:12.686774 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1431/2906] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:12 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:12.698189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7708bb0c-3a05-4d3c-b30e-f4868d12a5ac tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f71614ed790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1073927610", "description": "tempest-description-516022256"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:12.787245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:12.803547 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e8fb7a0-e126-4533-96e9-106d85e358a4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.565013 Dec 18 20:57:12.817285 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1476/2907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:12 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:13.003049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:13.004614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:13.020681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:13.022596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:13.024650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:13.025654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:13.101668 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7708bb0c-3a05-4d3c-b30e-f4868d12a5ac tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.412635 Dec 18 20:57:13.104384 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1432/2908] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:57:12 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:13.117089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3786b00-9fee-45fa-a5a6-d484c21dce95 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714f7175e0>, body: {"security_group_rule": {"parent_group_id": "60605e45-3da0-434c-afb9-0be9172813ed", "ip_protocol": "tcp", "from_port": 1629395569, "to_port": 22}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:13.471700 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-a3786b00-9fee-45fa-a5a6-d484c21dce95 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: Invalid port range 1629395569:22. Former value cannot be greater than the later Dec 18 20:57:13.472943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3786b00-9fee-45fa-a5a6-d484c21dce95 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 400 to user: Invalid port range 1629395569:22. Former value cannot be greater than the later {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:13.473795 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3786b00-9fee-45fa-a5a6-d484c21dce95 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.362745 Dec 18 20:57:13.476496 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1433/2909] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:13 2021] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:57:13.485579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-001b9ed5-c4e5-4fff-aa05-b34b6cdd55df tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ebaff70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:13.589781 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-001b9ed5-c4e5-4fff-aa05-b34b6cdd55df tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.112206 Dec 18 20:57:13.590395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1434/2910] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:13 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:13.601690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ca24004-6850-454f-b300-abe0e0a35f7f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f71614e0040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-666507553", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:13.619156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1ca24004-6850-454f-b300-abe0e0a35f7f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: Security group id should be uuid Dec 18 20:57:13.619843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ca24004-6850-454f-b300-abe0e0a35f7f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 400 to user: Security group id should be uuid {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:13.620733 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ca24004-6850-454f-b300-abe0e0a35f7f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.029421 Dec 18 20:57:13.631830 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1435/2911] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:13 2021] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:13.643131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f95ac1ed-0475-4ac0-a80d-de0789f680ee tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714f6e4940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2066056477", "description": "tempest-description-933920471"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:13.676842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:13.692372 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5f37a40a-069c-405f-978a-4bc8cededfb5 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1607 microversion: 2.1 time: 0.693694 Dec 18 20:57:13.695973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1477/2912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:12 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1607 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:13.741318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9309badc-9491-4774-a15c-e264b4252f90 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:13.742830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9309badc-9491-4774-a15c-e264b4252f90 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:13.778920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9309badc-9491-4774-a15c-e264b4252f90 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:13.781619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9309badc-9491-4774-a15c-e264b4252f90 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:13.784050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9309badc-9491-4774-a15c-e264b4252f90 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:13.787182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9309badc-9491-4774-a15c-e264b4252f90 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:13.908088 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9309badc-9491-4774-a15c-e264b4252f90 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.200058 Dec 18 20:57:13.919040 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1478/2913] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:13 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:13.942214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:13.942972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:13.969793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:13.972655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:13.987469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:13.994112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:14.161604 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f95ac1ed-0475-4ac0-a80d-de0789f680ee tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.528629 Dec 18 20:57:14.169980 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1436/2914] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:57:13 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:14.174897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-afdbc27a-f2e0-48b2-87d4-bc1560a25c1f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714f9bbdc0>, body: {"security_group_rule": {"parent_group_id": "eca9baa0-6bba-4bd6-afd4-bbdbb7f526dc", "ip_protocol": "tempest-999-200216647", "from_port": 22, "to_port": 22}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:14.302490 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-afdbc27a-f2e0-48b2-87d4-bc1560a25c1f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: Invalid IP protocol tempest-999-200216647. Dec 18 20:57:14.303453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-afdbc27a-f2e0-48b2-87d4-bc1560a25c1f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 400 to user: Invalid IP protocol tempest-999-200216647. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:14.304711 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-afdbc27a-f2e0-48b2-87d4-bc1560a25c1f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.133491 Dec 18 20:57:14.305502 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1437/2915] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:14 2021] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:14.326141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28521356-01dd-4b83-9c69-c00cd9352467 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714f6e45e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1658879683", "description": "tempest-description-1847971615"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:14.538574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:14.632246 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eac07e03-b1dc-48fd-9d27-05dc6fb725d0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.684937 Dec 18 20:57:14.642986 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1479/2916] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:13 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:14.655236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4603bfbb-4900-441b-b096-990db4fcd7c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714fe60af0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:14.783734 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4603bfbb-4900-441b-b096-990db4fcd7c3 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.131479 Dec 18 20:57:14.784332 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1480/2917] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:14 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:14.802652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:14.805339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:14.830795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:14.831267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:14.834896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:14.835741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:15.227542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28521356-01dd-4b83-9c69-c00cd9352467 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.913931 Dec 18 20:57:15.228232 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1438/2918] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:57:14 2021] POST /compute/v2.1/os-security-groups => generated 256 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:15.235771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-244b2143-702d-42e4-ade6-a2bc500d0971 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:15.237136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-244b2143-702d-42e4-ade6-a2bc500d0971 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:15.270643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-244b2143-702d-42e4-ade6-a2bc500d0971 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:15.275944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-244b2143-702d-42e4-ade6-a2bc500d0971 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:15.281203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-244b2143-702d-42e4-ade6-a2bc500d0971 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:15.292238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-244b2143-702d-42e4-ade6-a2bc500d0971 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:15.520891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-244b2143-702d-42e4-ade6-a2bc500d0971 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.291072 Dec 18 20:57:15.534213 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1439/2919] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:15 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:15.574495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-63b163da-b88b-4ffa-9178-e0c0f6c0b69a tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f7161343820>, body: {"security_group_rule": {"parent_group_id": "9d87c1ed-bbe3-43ea-832b-a7ab32f27bc7", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:16.031103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:16.041537 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25937ba9-b646-4b26-a872-6c966a185b1b tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1540 microversion: 2.1 time: 1.255412 Dec 18 20:57:16.053329 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1481/2920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:14 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1540 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:16.065304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:16.067207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:16.079393 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-63b163da-b88b-4ffa-9178-e0c0f6c0b69a tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Dec 18 20:57:16.080552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-63b163da-b88b-4ffa-9178-e0c0f6c0b69a tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:16.081595 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-63b163da-b88b-4ffa-9178-e0c0f6c0b69a tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.545753 Dec 18 20:57:16.082377 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1440/2921] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:15 2021] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 547 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:57:16.087269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:16.092080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bfe8b6df-7943-4db9-a053-46a8f386b98d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714f031670>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:16.092577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:16.093587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:16.095556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:16.177964 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bfe8b6df-7943-4db9-a053-46a8f386b98d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.094385 Dec 18 20:57:16.193463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1441/2922] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:16 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:16.197667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f42ffe77-0331-42b0-8c95-59c81566ae9f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714eb64a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2123795140", "description": "tempest-description-128822407"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:16.523631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:16.542701 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a495270-9f7a-4cbc-b555-65fd50950a52 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.489872 Dec 18 20:57:16.543496 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1482/2923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:16 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:16.560131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e7f943d7-5f43-412c-81a1-84052e63edd8 req-f156272f-fdcd-4736-b254-b2f5bbda3c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c911e5-ab47-4315-b264-1c7ab04c57a5", "name": "network-vif-deleted", "tag": "b60f4815-ec88-4e24-968e-a604b4771eb4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:16.566261 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:16.566261 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:57:16.591840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e7f943d7-5f43-412c-81a1-84052e63edd8 req-f156272f-fdcd-4736-b254-b2f5bbda3c0f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:16.592301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e7f943d7-5f43-412c-81a1-84052e63edd8 req-f156272f-fdcd-4736-b254-b2f5bbda3c0f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:16.614712 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e7f943d7-5f43-412c-81a1-84052e63edd8 req-f156272f-fdcd-4736-b254-b2f5bbda3c0f service nova] Creating event network-vif-deleted:b60f4815-ec88-4e24-968e-a604b4771eb4 for instance 57c911e5-ab47-4315-b264-1c7ab04c57a5 on nch2-master-1 Dec 18 20:57:16.625630 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e7f943d7-5f43-412c-81a1-84052e63edd8 req-f156272f-fdcd-4736-b254-b2f5bbda3c0f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080638 Dec 18 20:57:16.629069 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1483/2924] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:16.651097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aaae5d51-516d-4a78-bbe7-d8a70254bce3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:16.663959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aaae5d51-516d-4a78-bbe7-d8a70254bce3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:16.679917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aaae5d51-516d-4a78-bbe7-d8a70254bce3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:16.680766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aaae5d51-516d-4a78-bbe7-d8a70254bce3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:16.681935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aaae5d51-516d-4a78-bbe7-d8a70254bce3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:16.682610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aaae5d51-516d-4a78-bbe7-d8a70254bce3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:16.810748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aaae5d51-516d-4a78-bbe7-d8a70254bce3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.170766 Dec 18 20:57:16.813533 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1484/2925] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:16 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:16.970088 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f42ffe77-0331-42b0-8c95-59c81566ae9f tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.782900 Dec 18 20:57:16.971234 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1442/2926] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:57:16 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:16.984392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8493cd4-dfc3-4053-9846-89f2eb74d76b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714eebed30>, body: {"security_group_rule": {"parent_group_id": "1e4d1971-305e-4477-8fa4-64be20542b30", "ip_protocol": "tcp", "from_port": 22, "to_port": 982522795}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:17.071251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:17.071988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:17.102890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:17.109040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:17.109040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:17.109040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:17.211548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:17.212231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:17.214810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lazy-loading 'fault' on Instance uuid 57c911e5-ab47-4315-b264-1c7ab04c57a5 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:57:17.226870 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f8493cd4-dfc3-4053-9846-89f2eb74d76b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: Invalid port range 22:982522795. Valid TCP ports should be between 1-65535 Dec 18 20:57:17.228947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8493cd4-dfc3-4053-9846-89f2eb74d76b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 400 to user: Invalid port range 22:982522795. Valid TCP ports should be between 1-65535 {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:17.230472 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8493cd4-dfc3-4053-9846-89f2eb74d76b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.252389 Dec 18 20:57:17.253790 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1485/2927] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:16 2021] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:57:17.266005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43c273ba-8368-4790-b901-d18230581e19 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ee793a0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:17.330026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee5b92caab2431f97702541033df654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd6d0e0ed74857b4b6265fdacc68cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:17.350819 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac660a13-b465-4736-be73-52614cf26e28 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 200 len: 1257 microversion: 2.1 time: 0.282320 Dec 18 20:57:17.355040 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1443/2928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:17 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 1257 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:17.368157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f48fe701-1b58-4ad6-af7f-9ab232bd9a7d tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Action: 'create', calling method: .version_select at 0x7f714f031dc0>, body: {"security_group_rule": {"parent_group_id": "c1b2d195-520c-484e-aae3-dd1f382d6ced", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:17.406289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43c273ba-8368-4790-b901-d18230581e19 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.150739 Dec 18 20:57:17.411055 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1486/2929] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:17 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:17.430246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-f48fe701-1b58-4ad6-af7f-9ab232bd9a7d tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1b2d195-520c-484e-aae3-dd1f382d6ced does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:57:17.431026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-f48fe701-1b58-4ad6-af7f-9ab232bd9a7d tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Neutron security group c1b2d195-520c-484e-aae3-dd1f382d6ced not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:57:17.431663 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f48fe701-1b58-4ad6-af7f-9ab232bd9a7d tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: Security group c1b2d195-520c-484e-aae3-dd1f382d6ced does not exist Dec 18 20:57:17.431663 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-e312c553-7581-4fde-b3ad-4b073812371e'] Dec 18 20:57:17.432485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f48fe701-1b58-4ad6-af7f-9ab232bd9a7d tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 404 to user: Security group c1b2d195-520c-484e-aae3-dd1f382d6ced does not exist Dec 18 20:57:17.432485 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-e312c553-7581-4fde-b3ad-4b073812371e'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:17.434624 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f48fe701-1b58-4ad6-af7f-9ab232bd9a7d tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.077307 Dec 18 20:57:17.435389 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1444/2930] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:57:17 2021] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:57:17.456385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4daa6dc2-6f53-4b4c-ae5e-60a6591f3131 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Calling method '.version_select at 0x7f714edd7e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:17.505726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-4daa6dc2-6f53-4b4c-ae5e-60a6591f3131 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 29ea532d-7ed8-4274-b7bc-19c23268b02e does not exist", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:57:17.507813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-4daa6dc2-6f53-4b4c-ae5e-60a6591f3131 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Neutron security group rule 29ea532d-7ed8-4274-b7bc-19c23268b02e not found {{(pid=140731) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Dec 18 20:57:17.510641 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4daa6dc2-6f53-4b4c-ae5e-60a6591f3131 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] HTTP exception thrown: Security group rule 29ea532d-7ed8-4274-b7bc-19c23268b02e does not exist Dec 18 20:57:17.510641 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-45eab9e5-a091-4cb4-ab1f-9377dc1007ae'] Dec 18 20:57:17.524924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4daa6dc2-6f53-4b4c-ae5e-60a6591f3131 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Returning 404 to user: Security group rule 29ea532d-7ed8-4274-b7bc-19c23268b02e does not exist Dec 18 20:57:17.524924 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-45eab9e5-a091-4cb4-ab1f-9377dc1007ae'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:17.524924 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4daa6dc2-6f53-4b4c-ae5e-60a6591f3131 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/29ea532d-7ed8-4274-b7bc-19c23268b02e" status: 404 len: 199 microversion: 2.1 time: 0.070426 Dec 18 20:57:17.529673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e307041-be4e-493a-b3cb-d8a9884a78d4 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Calling method '.version_select at 0x7f714eb5adc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:17.531508 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1487/2931] 10.222.0.13 () {58 vars in 1286 bytes} [Sat Dec 18 20:57:17 2021] DELETE /compute/v2.1/os-security-group-rules/29ea532d-7ed8-4274-b7bc-19c23268b02e => generated 199 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:57:17.564922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:17.566558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:17.584126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:17.587075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:17.588359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:17.591117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:18.087039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:18.114062 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7757bb3-1a0c-4cee-9321-86678b7cb15a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.552104 Dec 18 20:57:18.116495 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1488/2932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:17 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:18.147127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5f1a36f-778c-4d96-8ad2-86a878829f1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:18.157835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5f1a36f-778c-4d96-8ad2-86a878829f1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:18.196197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e307041-be4e-493a-b3cb-d8a9884a78d4 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/1e4d1971-305e-4477-8fa4-64be20542b30" status: 202 len: 0 microversion: 2.1 time: 0.671202 Dec 18 20:57:18.208803 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1445/2933] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:57:17 2021] DELETE /compute/v2.1/os-security-groups/1e4d1971-305e-4477-8fa4-64be20542b30 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:18.215635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5f1a36f-778c-4d96-8ad2-86a878829f1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:18.219100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5f1a36f-778c-4d96-8ad2-86a878829f1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:18.220014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5f1a36f-778c-4d96-8ad2-86a878829f1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:18.221818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1904bf9-4d31-4b10-87e0-b2ab5a6215a6 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Calling method '.version_select at 0x7f71613103a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:18.229226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5f1a36f-778c-4d96-8ad2-86a878829f1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:18.560413 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5f1a36f-778c-4d96-8ad2-86a878829f1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.428390 Dec 18 20:57:18.565365 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1489/2934] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:18 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:18.588959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:18.590945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] [instance: 57c911e5-ab47-4315-b264-1c7ab04c57a5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:18.639603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:18.641475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:18.645924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:18.646935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:18.711434 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] HTTP exception thrown: Instance 57c911e5-ab47-4315-b264-1c7ab04c57a5 could not be found. Dec 18 20:57:18.721894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Returning 404 to user: Instance 57c911e5-ab47-4315-b264-1c7ab04c57a5 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:18.730110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11b0f1c2-ccf7-4fdf-99b1-6e5c7e81f793 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5" status: 404 len: 111 microversion: 2.1 time: 0.156668 Dec 18 20:57:18.733256 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1490/2935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:18 2021] GET /compute/v2.1/servers/57c911e5-ab47-4315-b264-1c7ab04c57a5 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:57:18.770660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6c9a791-6b72-4214-930d-e2cbb9ba895d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f7161346ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:18.913898 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6c9a791-6b72-4214-930d-e2cbb9ba895d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1438 microversion: 2.1 time: 0.170359 Dec 18 20:57:18.918845 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1491/2936] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:18 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1438 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:18.935246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c3f06057-1619-42df-b2ee-cf6909064900 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] Calling method '.version_select at 0x7f7161346c10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:19.000656 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c3f06057-1619-42df-b2ee-cf6909064900 tempest-ServersTestBootFromVolume-1992682790 tempest-ServersTestBootFromVolume-1992682790-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-405209443" status: 202 len: 0 microversion: 2.1 time: 0.080360 Dec 18 20:57:19.009664 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1492/2937] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 20:57:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-405209443 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:19.102684 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1904bf9-4d31-4b10-87e0-b2ab5a6215a6 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/9d87c1ed-bbe3-43ea-832b-a7ab32f27bc7" status: 202 len: 0 microversion: 2.1 time: 0.887387 Dec 18 20:57:19.103587 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1446/2938] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:57:18 2021] DELETE /compute/v2.1/os-security-groups/9d87c1ed-bbe3-43ea-832b-a7ab32f27bc7 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:19.111541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-02261ed1-07c0-4a1a-b9dc-b9acdae91a35 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Calling method '.version_select at 0x7f714ef4a670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:19.133223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:19.134056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:19.165099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:19.165099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:19.171823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:19.174124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:19.849069 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-02261ed1-07c0-4a1a-b9dc-b9acdae91a35 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/eca9baa0-6bba-4bd6-afd4-bbdbb7f526dc" status: 202 len: 0 microversion: 2.1 time: 0.741197 Dec 18 20:57:19.850210 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1493/2939] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:57:19 2021] DELETE /compute/v2.1/os-security-groups/eca9baa0-6bba-4bd6-afd4-bbdbb7f526dc => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:19.855247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f128a3d2-46dc-4806-b4d7-a304fd62fe6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:19.856427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f128a3d2-46dc-4806-b4d7-a304fd62fe6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:19.870029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f128a3d2-46dc-4806-b4d7-a304fd62fe6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:19.870919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f128a3d2-46dc-4806-b4d7-a304fd62fe6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:19.883430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f128a3d2-46dc-4806-b4d7-a304fd62fe6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:19.884194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f128a3d2-46dc-4806-b4d7-a304fd62fe6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:19.965030 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f128a3d2-46dc-4806-b4d7-a304fd62fe6a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.110723 Dec 18 20:57:19.966078 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1494/2940] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:19 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:19.972721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:19.978468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd8073d8-979a-430e-9a3d-f8bd77a7e605 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Calling method '.version_select at 0x7f714ef4aca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:19.980355 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4608139e-c6f7-4aa8-9cac-89f5d4fc7ad2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.851943 Dec 18 20:57:19.980949 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1447/2941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:19 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:19.999177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2f272a7-6a32-44a6-80af-69995cec61e2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f716138de50>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:20.554344 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd8073d8-979a-430e-9a3d-f8bd77a7e605 tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/60605e45-3da0-434c-afb9-0be9172813ed" status: 202 len: 0 microversion: 2.1 time: 0.585581 Dec 18 20:57:20.555043 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1495/2942] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:57:19 2021] DELETE /compute/v2.1/os-security-groups/60605e45-3da0-434c-afb9-0be9172813ed => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:20.563043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-80cfcf6d-c896-454b-941a-1645989b1a1b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] Calling method '.version_select at 0x7f714ee795e0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:21.057345 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-80cfcf6d-c896-454b-941a-1645989b1a1b tempest-SecurityGroupRulesNegativeTestJSON-1782930987 tempest-SecurityGroupRulesNegativeTestJSON-1782930987-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/5bd90dd9-99b8-4d88-9029-b1089b47df1a" status: 202 len: 0 microversion: 2.1 time: 0.498044 Dec 18 20:57:21.058854 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1496/2943] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:57:20 2021] DELETE /compute/v2.1/os-security-groups/5bd90dd9-99b8-4d88-9029-b1089b47df1a => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:21.063716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-15134b34-351c-467f-88f1-394d52e5641a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:21.070220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-15134b34-351c-467f-88f1-394d52e5641a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:21.081197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15134b34-351c-467f-88f1-394d52e5641a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:21.083796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15134b34-351c-467f-88f1-394d52e5641a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:21.085071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15134b34-351c-467f-88f1-394d52e5641a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:21.085737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15134b34-351c-467f-88f1-394d52e5641a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:21.159921 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-15134b34-351c-467f-88f1-394d52e5641a tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.099529 Dec 18 20:57:21.161463 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1497/2944] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:21 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:21.168674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:21.179291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:21.193250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:21.194290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:21.196193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:21.196861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:21.752618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:21.760416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb390f42-d01b-47f1-b5cf-fa74550ae1d5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.597486 Dec 18 20:57:21.762879 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1498/2945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:21 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:22.172206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d639ad5d-72b0-4993-96f8-017000c44207 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:22.177448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d639ad5d-72b0-4993-96f8-017000c44207 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:22.188087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d639ad5d-72b0-4993-96f8-017000c44207 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:22.188554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d639ad5d-72b0-4993-96f8-017000c44207 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:22.189640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d639ad5d-72b0-4993-96f8-017000c44207 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:22.190096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d639ad5d-72b0-4993-96f8-017000c44207 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:22.247724 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d639ad5d-72b0-4993-96f8-017000c44207 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.079029 Dec 18 20:57:22.248958 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1499/2946] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:22 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:57:22.780050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:22.781830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:22.806296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:22.811807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:22.817986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:22.826380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:23.497142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:23.513270 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f187c406-7bdb-40b0-908f-83d45de32a3a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.737156 Dec 18 20:57:23.519751 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1500/2947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:22 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:23.530493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd007ed0-68f1-4cb8-b997-4d98b6fd5c07 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:23.531801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd007ed0-68f1-4cb8-b997-4d98b6fd5c07 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:23.546210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd007ed0-68f1-4cb8-b997-4d98b6fd5c07 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:23.548655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd007ed0-68f1-4cb8-b997-4d98b6fd5c07 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:23.594675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd007ed0-68f1-4cb8-b997-4d98b6fd5c07 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:23.599768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd007ed0-68f1-4cb8-b997-4d98b6fd5c07 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:23.729357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd007ed0-68f1-4cb8-b997-4d98b6fd5c07 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.207723 Dec 18 20:57:23.730383 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1501/2948] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:23 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:24.537896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:24.538903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:24.554846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:24.555311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:24.564263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:24.565293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:25.033891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:25.046162 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b31e8b9-50f9-4878-bcdc-30c3f8559113 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.510979 Dec 18 20:57:25.048544 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1502/2949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:24 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:25.065649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-65feb004-813b-4189-a2aa-4db1358cd6c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:25.073555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-65feb004-813b-4189-a2aa-4db1358cd6c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:25.087192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65feb004-813b-4189-a2aa-4db1358cd6c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:25.087927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65feb004-813b-4189-a2aa-4db1358cd6c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:25.088915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65feb004-813b-4189-a2aa-4db1358cd6c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:25.089511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65feb004-813b-4189-a2aa-4db1358cd6c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:25.216349 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-65feb004-813b-4189-a2aa-4db1358cd6c1 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.166250 Dec 18 20:57:25.217308 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1503/2950] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:25 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:26.067958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:26.069843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:26.096315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:26.098662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:26.099783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:26.101543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:27.023353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:27.037447 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4b2dbfb5-c8b9-4f01-a6a4-79bf8169e7f5 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.976772 Dec 18 20:57:27.040521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1504/2951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:26 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:27.053026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cb55601-2b05-442b-8b8d-ab8ac0b63c50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:27.054763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cb55601-2b05-442b-8b8d-ab8ac0b63c50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:27.070363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cb55601-2b05-442b-8b8d-ab8ac0b63c50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:27.071570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cb55601-2b05-442b-8b8d-ab8ac0b63c50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:27.075264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cb55601-2b05-442b-8b8d-ab8ac0b63c50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:27.075999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cb55601-2b05-442b-8b8d-ab8ac0b63c50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:27.168439 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cb55601-2b05-442b-8b8d-ab8ac0b63c50 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.126473 Dec 18 20:57:27.169216 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1505/2952] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:27 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:28.057370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:28.058391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:28.070860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:28.073730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:28.083491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:28.084253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:28.242596 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2f272a7-6a32-44a6-80af-69995cec61e2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1447 microversion: 2.1 time: 8.255456 Dec 18 20:57:28.244349 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1448/2953] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:19 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1447 bytes in 8259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:28.255376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ff0463d-b3c5-4b36-8978-8af0c55944ee tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:28.264387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ff0463d-b3c5-4b36-8978-8af0c55944ee tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:28.274066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ff0463d-b3c5-4b36-8978-8af0c55944ee tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:28.275148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ff0463d-b3c5-4b36-8978-8af0c55944ee tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:28.276324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ff0463d-b3c5-4b36-8978-8af0c55944ee tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:28.276883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ff0463d-b3c5-4b36-8978-8af0c55944ee tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:28.343855 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ff0463d-b3c5-4b36-8978-8af0c55944ee tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.098206 Dec 18 20:57:28.345342 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1449/2954] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:28 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:28.354991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a16a6dae-25cc-4e29-bb27-1fa04aa72eff tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714f031dc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:28.452158 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a16a6dae-25cc-4e29-bb27-1fa04aa72eff tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 200 len: 1447 microversion: 2.1 time: 0.105201 Dec 18 20:57:28.452950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1450/2955] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:28 2021] GET /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:28.471309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ddba0c9-b617-4de9-bc16-6d1ad6458ac0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ebaf820>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:28.626628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:28.636389 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d6e60d6-c00c-4963-9147-4e20a779ae8b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1520 microversion: 2.1 time: 0.581543 Dec 18 20:57:28.636999 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1506/2956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:28 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:29.355864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12172653-0133-4c40-9c77-879f550228f4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:29.357341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-12172653-0133-4c40-9c77-879f550228f4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:29.379840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12172653-0133-4c40-9c77-879f550228f4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:29.389957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12172653-0133-4c40-9c77-879f550228f4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:29.391243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12172653-0133-4c40-9c77-879f550228f4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:29.391915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12172653-0133-4c40-9c77-879f550228f4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:29.464418 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12172653-0133-4c40-9c77-879f550228f4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.112090 Dec 18 20:57:29.469798 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1507/2957] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:29 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:57:29.488439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:29.492344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:29.507595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:29.510620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:29.511707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:29.512363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:29.963802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:29.975017 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-be091e6f-6d3d-4b83-8d2a-4825a6bff3f9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.498721 Dec 18 20:57:29.975606 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1508/2958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:29 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:30.004300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:30.027174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:30.048464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.048926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.049752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.056515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.158331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ddba0c9-b617-4de9-bc16-6d1ad6458ac0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 204 len: 0 microversion: 2.1 time: 1.683527 Dec 18 20:57:30.160141 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1451/2959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:28 2021] DELETE /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 0 bytes in 1699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:57:30.173479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:30.176317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:30.191691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.192337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.193451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.194143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.636416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:30.654514 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-214206ed-3b1e-4aeb-b461-8a2745700451 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1500 microversion: 2.1 time: 0.671901 Dec 18 20:57:30.655624 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1509/2960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:29 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1500 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:30.679144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:30.679895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:30.680361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:30.701907 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b78fc2ea-0957-4f5d-981a-41a89af9a539 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.533133 Dec 18 20:57:30.702956 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1452/2961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:30 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:30.717315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.717315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.717315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.717315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.752807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3c54bfa-edb3-4776-8627-531904adac1d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:30.764043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3c54bfa-edb3-4776-8627-531904adac1d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:30.789402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c54bfa-edb3-4776-8627-531904adac1d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.793006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c54bfa-edb3-4776-8627-531904adac1d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.796648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c54bfa-edb3-4776-8627-531904adac1d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.799955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c54bfa-edb3-4776-8627-531904adac1d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.826387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:57:30.940835 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3c54bfa-edb3-4776-8627-531904adac1d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.219566 Dec 18 20:57:30.949581 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1453/2962] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:30 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:30.963046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:30.967968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:30.986463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.989152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:30.993835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:30.995265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:31.121688 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e32cf9c-dc00-45d0-936e-ea633dda8ed6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 204 len: 0 microversion: 2.1 time: 0.463455 Dec 18 20:57:31.122942 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1510/2963] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:57:30 2021] DELETE /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:57:31.152954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-626540727", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b682fe11-354f-40ac-961b-a0ccac207599"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:31.280285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] validate_networks() for [('b682fe11-354f-40ac-961b-a0ccac207599', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:57:31.332651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:31.350855 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ffb0f949-00ad-4cab-a2f4-65fe50d1d6f7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1515 microversion: 2.1 time: 0.398489 Dec 18 20:57:31.361211 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1454/2964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:30 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:31.376763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1788732049", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b4249639-6520-4b9d-908b-e792b10734b1"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:31.515099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] validate_networks() for [('b4249639-6520-4b9d-908b-e792b10734b1', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:57:33.144834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:57:33.145362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:57:33.145935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:57:33.146586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:57:33.147569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:57:33.161218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:33.169357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:33.172940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:33.176372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:33.243485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:33.255741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for user ebd83848fe8d4e7284291660eb51da51 and project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:33.292369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:57:33.318400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:57:33.457971 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dadce232-e41e-4a56-bd6a-48b5628db840 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.332258 Dec 18 20:57:33.464043 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1511/2965] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:57:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:57:33.511894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e68e352-7d42-4bd8-86ad-e810ff2f787e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:33.518409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e68e352-7d42-4bd8-86ad-e810ff2f787e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: 24e97c22-e348-4552-94f4-ec5f6cc5bc57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:33.579128 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-6e68e352-7d42-4bd8-86ad-e810ff2f787e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Instance 24e97c22-e348-4552-94f4-ec5f6cc5bc57 could not be found. Dec 18 20:57:33.580775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e68e352-7d42-4bd8-86ad-e810ff2f787e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 404 to user: Instance 24e97c22-e348-4552-94f4-ec5f6cc5bc57 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:33.587309 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e68e352-7d42-4bd8-86ad-e810ff2f787e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/24e97c22-e348-4552-94f4-ec5f6cc5bc57/action" status: 404 len: 111 microversion: 2.1 time: 0.119613 Dec 18 20:57:33.589921 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1512/2966] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:33 2021] POST /compute/v2.1/servers/24e97c22-e348-4552-94f4-ec5f6cc5bc57/action => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:57:33.622560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-350da5d1-c244-4b6b-8e78-87792ce5192b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:33.630345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-350da5d1-c244-4b6b-8e78-87792ce5192b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:33.680090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-350da5d1-c244-4b6b-8e78-87792ce5192b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:33.681806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-350da5d1-c244-4b6b-8e78-87792ce5192b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:33.685590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-350da5d1-c244-4b6b-8e78-87792ce5192b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:33.687159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-350da5d1-c244-4b6b-8e78-87792ce5192b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:33.717654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:57:33.732896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:57:33.738685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:57:33.739423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:57:33.740200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:57:33.776040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:33.776538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:33.777441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:33.779691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:33.805914 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-350da5d1-c244-4b6b-8e78-87792ce5192b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.205997 Dec 18 20:57:33.817664 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1513/2967] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:33 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:33.843207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:33.861482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Getting quotas for user 216cd2c0d4b249e797990918152b4749 and project 8d45c473a485472791e742964660e7e9. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:33.900436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:57:33.904342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:57:34.016159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2ebd973-5642-4970-a5b5-0f5250733222 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.652483 Dec 18 20:57:34.019386 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1455/2968] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:57:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 2657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:57:34.029541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-062cde26-9d07-4e0e-84a0-b46481866726 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:34.031885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-062cde26-9d07-4e0e-84a0-b46481866726 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:34.184996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-062cde26-9d07-4e0e-84a0-b46481866726 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:34.193829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-062cde26-9d07-4e0e-84a0-b46481866726 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1214 microversion: 2.1 time: 0.172333 Dec 18 20:57:34.201373 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1456/2969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:34 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:34.210565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93ce176a-d5eb-490e-87a0-92a73f140607 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:34.220489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-93ce176a-d5eb-490e-87a0-92a73f140607 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:34.253433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93ce176a-d5eb-490e-87a0-92a73f140607 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:34.254105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93ce176a-d5eb-490e-87a0-92a73f140607 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:34.256857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93ce176a-d5eb-490e-87a0-92a73f140607 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:34.257902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93ce176a-d5eb-490e-87a0-92a73f140607 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:34.455055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3a43b259-ccba-4550-9596-91cb03fd81f6 req-c8b2bfe5-ff1c-435c-8cd0-1098e10a0aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2a29f1-1645-4b4f-9ceb-cf156b8649f8", "name": "network-vif-unplugged", "status": "completed", "tag": "15d300b1-0726-42ba-b558-7d300c39cec1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:34.459310 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:34.459310 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:57:34.482103 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-93ce176a-d5eb-490e-87a0-92a73f140607 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action" status: 202 len: 0 microversion: 2.1 time: 0.275857 Dec 18 20:57:34.488752 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1457/2970] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:34 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:34.508127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3a43b259-ccba-4550-9596-91cb03fd81f6 req-c8b2bfe5-ff1c-435c-8cd0-1098e10a0aca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:34.509614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3a43b259-ccba-4550-9596-91cb03fd81f6 req-c8b2bfe5-ff1c-435c-8cd0-1098e10a0aca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:34.517515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0fd0955-511f-451f-ace0-77f395ea3332 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:34.525005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0fd0955-511f-451f-ace0-77f395ea3332 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:34.577402 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3a43b259-ccba-4550-9596-91cb03fd81f6 req-c8b2bfe5-ff1c-435c-8cd0-1098e10a0aca service nova] Creating event network-vif-unplugged:15d300b1-0726-42ba-b558-7d300c39cec1 for instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 on nch2-master-1 Dec 18 20:57:34.598016 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3a43b259-ccba-4550-9596-91cb03fd81f6 req-c8b2bfe5-ff1c-435c-8cd0-1098e10a0aca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.776924 Dec 18 20:57:34.610227 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1514/2971] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:34.649973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:34.653779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:34.673713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:34.676162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:34.677330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:34.678928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:35.265537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0fd0955-511f-451f-ace0-77f395ea3332 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:35.282152 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0fd0955-511f-451f-ace0-77f395ea3332 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1208 microversion: 2.1 time: 0.791832 Dec 18 20:57:35.282822 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1458/2972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:34 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1208 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:35.298704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b685953d-90a8-4345-ac12-a5e38e5ba28e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:35.303784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b685953d-90a8-4345-ac12-a5e38e5ba28e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:35.335990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b685953d-90a8-4345-ac12-a5e38e5ba28e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:35.339591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b685953d-90a8-4345-ac12-a5e38e5ba28e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:35.342889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b685953d-90a8-4345-ac12-a5e38e5ba28e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:35.346075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b685953d-90a8-4345-ac12-a5e38e5ba28e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:35.430048 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b685953d-90a8-4345-ac12-a5e38e5ba28e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.145841 Dec 18 20:57:35.431599 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1459/2973] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:35 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:35.436913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:35.441552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:35.456649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:35.462621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:35.463572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:35.467615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:35.736230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:35.745369 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5d3941fb-5057-40b9-a234-c85d4bce31fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1218 microversion: 2.1 time: 0.312273 Dec 18 20:57:35.767715 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1460/2974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:35 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1218 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:35.774393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f28e7b3a-675f-49d4-9157-efa582194d18 req-76e61956-9ba9-4bf8-b5a3-1a26e7d13e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2a29f1-1645-4b4f-9ceb-cf156b8649f8", "name": "network-vif-deleted", "tag": "15d300b1-0726-42ba-b558-7d300c39cec1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:35.776315 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:35.776315 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:57:35.795961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f28e7b3a-675f-49d4-9157-efa582194d18 req-76e61956-9ba9-4bf8-b5a3-1a26e7d13e41 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:35.800007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f28e7b3a-675f-49d4-9157-efa582194d18 req-76e61956-9ba9-4bf8-b5a3-1a26e7d13e41 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:35.864209 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f28e7b3a-675f-49d4-9157-efa582194d18 req-76e61956-9ba9-4bf8-b5a3-1a26e7d13e41 service nova] Creating event network-vif-deleted:15d300b1-0726-42ba-b558-7d300c39cec1 for instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 on nch2-master-1 Dec 18 20:57:35.896685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:35.909564 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f28e7b3a-675f-49d4-9157-efa582194d18 req-76e61956-9ba9-4bf8-b5a3-1a26e7d13e41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124106 Dec 18 20:57:35.910873 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1461/2975] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:35.915538 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32674265-bf85-4f91-b01b-77c66579d39b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1520 microversion: 2.1 time: 1.291893 Dec 18 20:57:35.916191 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1515/2976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:34 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1520 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:36.302035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:36.303092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:36.322796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.323794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:36.327334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.331249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:36.442446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f523fb84-c03f-442f-8c43-8ea75633bfb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:36.443585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f523fb84-c03f-442f-8c43-8ea75633bfb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:36.463310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f523fb84-c03f-442f-8c43-8ea75633bfb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.463813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f523fb84-c03f-442f-8c43-8ea75633bfb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:36.464692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f523fb84-c03f-442f-8c43-8ea75633bfb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.465229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f523fb84-c03f-442f-8c43-8ea75633bfb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:36.587446 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f523fb84-c03f-442f-8c43-8ea75633bfb6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.149102 Dec 18 20:57:36.588853 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1516/2977] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:36 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:36.665440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:36.683792 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f7ff6ab-a4eb-4aca-b079-1053ad6de3b0 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1204 microversion: 2.1 time: 0.386520 Dec 18 20:57:36.686714 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1462/2978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:36 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1204 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:36.774446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:36.775970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:36.788325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.792619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:36.795117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.795789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:36.934047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:36.935227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:36.966221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.971461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:36.973758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:36.983941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.246702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:38.271823 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8cd25dd8-a060-4459-a2b4-5da706cb145b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1210 microversion: 2.1 time: 1.500379 Dec 18 20:57:38.274538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1517/2979] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:36 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1210 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:38.298932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48a1e66c-23bf-4d42-ad01-7b1c8e8a9d99 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:38.301388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48a1e66c-23bf-4d42-ad01-7b1c8e8a9d99 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:38.313402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a1e66c-23bf-4d42-ad01-7b1c8e8a9d99 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.314335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a1e66c-23bf-4d42-ad01-7b1c8e8a9d99 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.317031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a1e66c-23bf-4d42-ad01-7b1c8e8a9d99 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.318463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48a1e66c-23bf-4d42-ad01-7b1c8e8a9d99 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.384454 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48a1e66c-23bf-4d42-ad01-7b1c8e8a9d99 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.107226 Dec 18 20:57:38.388357 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1518/2980] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:38 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:38.408262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:38.411078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:38.425559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.432264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.433316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:38.434658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.434658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.453029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6e7ad63-7d29-4716-b87e-fcc16b9f9f8a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1500 microversion: 2.1 time: 1.520373 Dec 18 20:57:38.453948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1463/2981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:36 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1500 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:38.478355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:38.483638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:38.495464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.497172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.498832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.499526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.557790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lazy-loading 'flavor' on Instance uuid f6fcab40-88c7-4902-a1b7-60f4caecbb80 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:57:38.587393 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Cannot 'rescue' instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 while it is in vm_state paused Dec 18 20:57:38.590576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 409 to user: Cannot 'rescue' instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 while it is in vm_state paused {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:57:38.594533 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a982d5e4-01d0-4f32-9e68-15baac2f1c95 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action" status: 409 len: 144 microversion: 2.1 time: 0.123178 Dec 18 20:57:38.599083 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1464/2982] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:38 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action => generated 144 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 18 20:57:38.618024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97f263e8-215a-48b8-a3ff-fda055e76022 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:38.621233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97f263e8-215a-48b8-a3ff-fda055e76022 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:38.622732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:38.664074 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb2c3905-671e-419c-84a5-bf0061e01d23 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1266 microversion: 2.1 time: 0.272389 Dec 18 20:57:38.664678 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1519/2983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:38 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:38.687181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97f263e8-215a-48b8-a3ff-fda055e76022 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.688188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97f263e8-215a-48b8-a3ff-fda055e76022 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.694792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97f263e8-215a-48b8-a3ff-fda055e76022 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.696536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97f263e8-215a-48b8-a3ff-fda055e76022 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.892470 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97f263e8-215a-48b8-a3ff-fda055e76022 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action" status: 202 len: 0 microversion: 2.1 time: 0.289484 Dec 18 20:57:38.897073 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1465/2984] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:38 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:38.902109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:38.902847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:38.915728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.918243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:38.924160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:38.924982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:39.291720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:39.292996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:39.303186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:39.307072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:39.307627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:39.308790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:39.508745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:39.516428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:39.516958 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09949e11-d0eb-4994-b5b5-314b5685b7bf tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1272 microversion: 2.1 time: 0.229396 Dec 18 20:57:39.519664 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1466/2985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:39 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:39.527890 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-36806689-5382-4461-9a41-26add883856b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1507 microversion: 2.1 time: 0.628168 Dec 18 20:57:39.528657 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1520/2986] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:38 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:39.537674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d4ff8ab-5a5e-4647-8cc4-5786cd45da74 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:39.539588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4d4ff8ab-5a5e-4647-8cc4-5786cd45da74 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:39.559740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ff8ab-5a5e-4647-8cc4-5786cd45da74 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:39.560201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ff8ab-5a5e-4647-8cc4-5786cd45da74 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:39.566090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ff8ab-5a5e-4647-8cc4-5786cd45da74 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:39.566578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d4ff8ab-5a5e-4647-8cc4-5786cd45da74 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:39.664889 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d4ff8ab-5a5e-4647-8cc4-5786cd45da74 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.134094 Dec 18 20:57:39.666541 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1521/2987] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:39 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:39.693670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:39.706574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:39.745489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:39.746072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:39.746965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:39.747409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:39.955358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:39.969086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c316fdf8-73b9-4f05-a55f-a8b1bcf88ef6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1266 microversion: 2.1 time: 0.286902 Dec 18 20:57:39.970058 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1522/2988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:39 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:40.294695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d72e7d7f-526c-45dc-a04b-c90ea3b0f80c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'create', calling method: .version_select at 0x7f7161392b80>, body: {"keypair": {"name": "tempest-keypair-157002417"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:40.319919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d72e7d7f-526c-45dc-a04b-c90ea3b0f80c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for project 2ab34e83092a4610b03af4bfa353fb09. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:40.330977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d72e7d7f-526c-45dc-a04b-c90ea3b0f80c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for user fba996171cc148a5b0fe75a937f59055 and project 2ab34e83092a4610b03af4bfa353fb09. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:40.534777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:40.535539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:40.560991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:40.561457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:40.562301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:40.568272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:40.675355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d72e7d7f-526c-45dc-a04b-c90ea3b0f80c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for project 2ab34e83092a4610b03af4bfa353fb09. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:40.685999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d72e7d7f-526c-45dc-a04b-c90ea3b0f80c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for user fba996171cc148a5b0fe75a937f59055 and project 2ab34e83092a4610b03af4bfa353fb09. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:40.717601 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d72e7d7f-526c-45dc-a04b-c90ea3b0f80c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.196651 Dec 18 20:57:40.719038 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1467/2989] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:57:39 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:40.724790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:40.725693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:40.734886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:40.736352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:40.737536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:40.738199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:40.755917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:40.765079 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a544fbf9-40e2-4d2f-8392-30bec473f727 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1272 microversion: 2.1 time: 0.235672 Dec 18 20:57:40.771668 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1523/2990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:40 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:40.789298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d26e7b31-0e15-404d-9efa-4fe1263ff8ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:40.792893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d26e7b31-0e15-404d-9efa-4fe1263ff8ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:40.820647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d26e7b31-0e15-404d-9efa-4fe1263ff8ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:40.821112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d26e7b31-0e15-404d-9efa-4fe1263ff8ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:40.824875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d26e7b31-0e15-404d-9efa-4fe1263ff8ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:40.834728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d26e7b31-0e15-404d-9efa-4fe1263ff8ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:40.988953 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d26e7b31-0e15-404d-9efa-4fe1263ff8ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.213354 Dec 18 20:57:40.989973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1524/2991] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:40 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:41.002059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:41.003762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:41.024702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:41.025606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:41.027060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:41.027713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:41.604644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:41.612657 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38cedc0c-ef5c-4f46-a610-4e681afb5577 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1515 microversion: 2.1 time: 0.892272 Dec 18 20:57:41.619451 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1468/2992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:40 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1515 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:41.791961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:41.793046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:41.796353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:41.806651 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21fa6901-b93b-4a0f-a55d-a0216480cb5f tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.814931 Dec 18 20:57:41.833084 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1525/2993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:40 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:41.833233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:41.837574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:41.838736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:41.839572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:42.002473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba4c0172-fef2-4a53-8abe-bc9757b24726 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:42.004502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba4c0172-fef2-4a53-8abe-bc9757b24726 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:42.022667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4c0172-fef2-4a53-8abe-bc9757b24726 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:42.025161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4c0172-fef2-4a53-8abe-bc9757b24726 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:42.026077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4c0172-fef2-4a53-8abe-bc9757b24726 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:42.026552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4c0172-fef2-4a53-8abe-bc9757b24726 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:42.175363 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba4c0172-fef2-4a53-8abe-bc9757b24726 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.177192 Dec 18 20:57:42.192353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1526/2994] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:41 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:57:42.279160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:42.296397 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35529bae-8a0f-46d0-92d5-de0221dfbd08 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 0.500556 Dec 18 20:57:42.297076 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1469/2995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:41 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:42.829260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:42.830582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:42.843239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:42.855049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:42.856254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:42.856865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.201900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e1a1997-059b-4380-bc8a-48d906dd4833 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:43.203164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e1a1997-059b-4380-bc8a-48d906dd4833 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:43.229516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e1a1997-059b-4380-bc8a-48d906dd4833 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.230308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e1a1997-059b-4380-bc8a-48d906dd4833 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.231321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e1a1997-059b-4380-bc8a-48d906dd4833 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.233434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e1a1997-059b-4380-bc8a-48d906dd4833 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.367066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:43.372563 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e1a1997-059b-4380-bc8a-48d906dd4833 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.174811 Dec 18 20:57:43.381550 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97aeff1f-6801-4771-a74a-72563a3f5d09 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.556206 Dec 18 20:57:43.381766 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1470/2996] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:43 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:43.392964 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1527/2997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:42 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:43.398713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:43.399588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:43.407414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.408346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.410516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.411317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.632031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:43.632937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:43.661708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.662147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.666490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.670865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.740046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lazy-loading 'flavor' on Instance uuid f6fcab40-88c7-4902-a1b7-60f4caecbb80 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:57:43.849378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:43.859885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-711cb49c-9ff1-4cd9-a4e1-f6e6272dd234 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 0.474899 Dec 18 20:57:43.861256 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1471/2998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:43 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:43.922297 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-05b6d1e9-0cfb-4609-9888-a18e495d31cd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action" status: 200 len: 32 microversion: 2.1 time: 0.294611 Dec 18 20:57:43.923970 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1528/2999] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:43 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:57:43.936279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:43.937642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:43.948511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.954674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:43.957307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:43.957996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:44.394758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-648ed521-396e-4ac5-b437-b06f8b2158ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:44.396096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-648ed521-396e-4ac5-b437-b06f8b2158ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:44.404103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:44.414003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648ed521-396e-4ac5-b437-b06f8b2158ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:44.418787 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ff7e1ff3-c316-4adf-8266-15b70891b4af tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.484854 Dec 18 20:57:44.421534 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1472/3000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:43 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:44.427287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648ed521-396e-4ac5-b437-b06f8b2158ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:44.427781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:44.428634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648ed521-396e-4ac5-b437-b06f8b2158ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:44.429429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-648ed521-396e-4ac5-b437-b06f8b2158ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:44.446631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:44.479518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:44.481237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:44.485104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:44.492933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:44.519913 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-648ed521-396e-4ac5-b437-b06f8b2158ea tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.111032 Dec 18 20:57:44.522460 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1529/3001] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:44 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:44.887261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:44.888144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:44.905842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:44.907473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:44.910128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:44.912631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:45.256854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:45.277830 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-06915aca-de21-42f6-b70a-4734208c94f6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.853562 Dec 18 20:57:45.291593 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1473/3002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:44 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:45.634035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:45.643866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0588ba7c-0dd3-4e6f-a0cf-abc2db9101a1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 0.762652 Dec 18 20:57:45.647381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1530/3003] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:44 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:45.666126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:45.667006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:45.687396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:45.687858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:45.688672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:45.689113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:45.856514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-577756155", "imageRef": "a58fd4f7-24ea-45d7-b3ff-d7650301fac3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7bd317e2-46c6-4f03-a5b1-bf11d8fa277a"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:45.953100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] validate_networks() for [('7bd317e2-46c6-4f03-a5b1-bf11d8fa277a', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:57:46.572848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:46.584160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c5e4f28-1f94-44bc-960b-fe7a2f1a1efc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.932667 Dec 18 20:57:46.588440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1531/3004] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:45 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:46.597609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f16d78a-fc8f-4aad-bbf6-f356eb8a2ac5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:46.600969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f16d78a-fc8f-4aad-bbf6-f356eb8a2ac5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:46.613452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f16d78a-fc8f-4aad-bbf6-f356eb8a2ac5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:46.618633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f16d78a-fc8f-4aad-bbf6-f356eb8a2ac5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:46.619765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f16d78a-fc8f-4aad-bbf6-f356eb8a2ac5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:46.621851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f16d78a-fc8f-4aad-bbf6-f356eb8a2ac5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:46.731627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f16d78a-fc8f-4aad-bbf6-f356eb8a2ac5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.141275 Dec 18 20:57:46.733772 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1532/3005] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:46 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:46.742037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:46.743276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:46.769953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:46.771272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:46.772309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:46.773470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.152925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:47.167952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e06dae6a-d6aa-4d5c-b21f-a55c3bf98d4c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.432321 Dec 18 20:57:47.168553 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1533/3006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:46 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:47.184236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e7b10b52-c9bf-4553-9545-b4946c24b16c req-545539da-eaff-40ad-b70e-fcbb6a4498dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cde937-d836-4d8a-8568-4e686b8ca4f2", "tag": "07ac6499-0831-47d9-9072-52d994281360"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:47.187443 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:47.187443 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:57:47.209336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:57:47.209849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:57:47.210419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e7b10b52-c9bf-4553-9545-b4946c24b16c req-545539da-eaff-40ad-b70e-fcbb6a4498dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.210562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:57:47.211085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:57:47.211619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:57:47.220082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e7b10b52-c9bf-4553-9545-b4946c24b16c req-545539da-eaff-40ad-b70e-fcbb6a4498dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.240057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.240709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.244342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.245224 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e7b10b52-c9bf-4553-9545-b4946c24b16c req-545539da-eaff-40ad-b70e-fcbb6a4498dd service nova] Creating event network-changed:07ac6499-0831-47d9-9072-52d994281360 for instance 16cde937-d836-4d8a-8568-4e686b8ca4f2 on nch1-master-1 Dec 18 20:57:47.245643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.273565 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e7b10b52-c9bf-4553-9545-b4946c24b16c req-545539da-eaff-40ad-b70e-fcbb6a4498dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103282 Dec 18 20:57:47.279763 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1534/3007] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:47.304916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:47.305955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:47.310325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Getting quotas for project 3f69c5059282455ca98cc9bff0fe1c94. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:47.322096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Getting quotas for user baaead8443a7492db118aa577386a88b and project 3f69c5059282455ca98cc9bff0fe1c94. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:47.323221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.323891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.327390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.328168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.352398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:57:47.355888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a58fd4f7-24ea-45d7-b3ff-d7650301fac3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:57:47.447126 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e519eddb-3554-4e0f-820d-7938d309a73c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066348 Dec 18 20:57:47.453195 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1474/3008] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:57:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 20:57:47.460099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf18898b-cd15-40a8-afc4-3ab3a005e7c2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:47.461026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bf18898b-cd15-40a8-afc4-3ab3a005e7c2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:47.565845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bf18898b-cd15-40a8-afc4-3ab3a005e7c2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:47.580285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bf18898b-cd15-40a8-afc4-3ab3a005e7c2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1221 microversion: 2.1 time: 0.125077 Dec 18 20:57:47.581984 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1475/3009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:47 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:47.604527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:47.605381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:47.615354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.616383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.618969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.620381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.826228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:47.837454 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-17c43693-e04d-490d-8d68-4030673cd2b9 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 0.554050 Dec 18 20:57:47.839185 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1535/3010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:47 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:47.851423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32ed0ea3-3e78-4c4c-bb0a-97e85ab24a65 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:47.852850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-32ed0ea3-3e78-4c4c-bb0a-97e85ab24a65 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:47.868766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32ed0ea3-3e78-4c4c-bb0a-97e85ab24a65 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.869436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32ed0ea3-3e78-4c4c-bb0a-97e85ab24a65 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.871167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32ed0ea3-3e78-4c4c-bb0a-97e85ab24a65 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:47.878730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32ed0ea3-3e78-4c4c-bb0a-97e85ab24a65 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:47.966930 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32ed0ea3-3e78-4c4c-bb0a-97e85ab24a65 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.126179 Dec 18 20:57:47.973328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1536/3011] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:47 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:48.087961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:48.101715 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11bef3cd-ef81-4b53-971f-5969cb8751da tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.500717 Dec 18 20:57:48.103348 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1476/3012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:47 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:48.187466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:48.188200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:48.196421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:48.196421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:48.197029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:48.197629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:48.600412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:48.602460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:48.636738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:48.649023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-09a06ac1-7e9c-400d-a743-5707876eae5c tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.465834 Dec 18 20:57:48.649615 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1537/3013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:48 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:48.655873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:48.656535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:48.662715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:48.663561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:48.831833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1754721888", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4fb93bf9-eaf5-48bb-b453-d6d452bdaa6c"}], "security_groups": [{"name": "tempest-securitygroup--1363989750"}], "key_name": "tempest-keypair-157002417", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:49.247502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:49.258046 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13a78652-1e78-4f24-8866-f09486b199b2 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1273 microversion: 2.1 time: 0.662137 Dec 18 20:57:49.258896 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1477/3014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:48 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1273 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:49.285541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:49.286874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:49.295447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:49.299295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:49.302102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:49.302751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:49.551846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] validate_networks() for [('4fb93bf9-eaf5-48bb-b453-d6d452bdaa6c', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:57:50.427000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:50.434895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aee3feb5-ddeb-47f2-9762-6f9255b737dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 1.164730 Dec 18 20:57:50.435554 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1478/3015] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:49 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:50.462880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d252d89-3b87-47f3-940c-9e316fa6441d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:50.491880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d252d89-3b87-47f3-940c-9e316fa6441d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:50.505646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d252d89-3b87-47f3-940c-9e316fa6441d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:50.506171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d252d89-3b87-47f3-940c-9e316fa6441d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:50.508827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d252d89-3b87-47f3-940c-9e316fa6441d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:50.512520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d252d89-3b87-47f3-940c-9e316fa6441d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:50.618044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d252d89-3b87-47f3-940c-9e316fa6441d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.158806 Dec 18 20:57:50.618859 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1479/3016] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:50 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:50.624218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:50.626570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:50.646052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:50.646544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:50.654511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:50.655230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.468172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for project 2ab34e83092a4610b03af4bfa353fb09. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:51.481097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for user fba996171cc148a5b0fe75a937f59055 and project 2ab34e83092a4610b03af4bfa353fb09. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:51.482290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:51.496113 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f81bc9e9-04c2-487e-83b8-fb173624b68a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.871431 Dec 18 20:57:51.497328 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1480/3017] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:50 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:51.511796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-058b191d-c39b-483a-84df-3ff7a6c003d0 req-ef4fa6b0-1d1d-4730-9e5d-685685e37697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367d7e2b-daf1-4ac1-996b-6cc729824d5c", "tag": "a80bf93f-ecf4-4003-a592-419a48827f6c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:51.518174 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:51.518174 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:57:51.521548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:57:51.522634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:57:51.523673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:57:51.524724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:57:51.526937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:57:51.542607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-058b191d-c39b-483a-84df-3ff7a6c003d0 req-ef4fa6b0-1d1d-4730-9e5d-685685e37697 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:51.544708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-058b191d-c39b-483a-84df-3ff7a6c003d0 req-ef4fa6b0-1d1d-4730-9e5d-685685e37697 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.560941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:51.563876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.566556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:51.567286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.574461 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-058b191d-c39b-483a-84df-3ff7a6c003d0 req-ef4fa6b0-1d1d-4730-9e5d-685685e37697 service nova] Creating event network-changed:a80bf93f-ecf4-4003-a592-419a48827f6c for instance 367d7e2b-daf1-4ac1-996b-6cc729824d5c on nch1-master-1 Dec 18 20:57:51.583424 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-058b191d-c39b-483a-84df-3ff7a6c003d0 req-ef4fa6b0-1d1d-4730-9e5d-685685e37697 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084586 Dec 18 20:57:51.588215 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1481/3018] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:51.600224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:51.601129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:51.620129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:51.621272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.625822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:51.626417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.636440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for project 2ab34e83092a4610b03af4bfa353fb09. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:51.652505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Getting quotas for user fba996171cc148a5b0fe75a937f59055 and project 2ab34e83092a4610b03af4bfa353fb09. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:51.685464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:57:51.692640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:57:51.818831 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-feb9faf8-c768-4e57-8cc5-2737252f61b4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.006626 Dec 18 20:57:51.824038 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1538/3019] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:57:48 2021] POST /compute/v2.1/servers => generated 409 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 20:57:51.839995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:51.840636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:51.877242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:51.877770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.880007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:51.884424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:51.923438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:51.938610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1bc356a-576f-4047-9e3a-5a02aef77bc2 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.348663 Dec 18 20:57:51.941769 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1482/3020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:51 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:52.173089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:52.208422 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-64348cc8-a93c-4e18-aa73-3e2ac545e608 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.383103 Dec 18 20:57:52.223927 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1539/3021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:51 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:52.232848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2f6a12d-7eb2-414a-870d-f824b595fcc4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'create', calling method: .version_select at 0x7f714f9bba60>, body: {"keypair": {"name": "tempest-keypair-243282819"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:52.239074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:52.239772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:52.276313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:52.276680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:52.277683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:52.281109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:52.284323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a2f6a12d-7eb2-414a-870d-f824b595fcc4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for project 09cf6435c2a148c6998dd3b1d301da96. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:52.307663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a2f6a12d-7eb2-414a-870d-f824b595fcc4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for user 3166e271ba6f418d9c71cd661ef23226 and project 09cf6435c2a148c6998dd3b1d301da96. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:52.616060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:52.625081 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2fb6d68a-17c7-41d0-9367-ef9ba1904a73 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 0.408545 Dec 18 20:57:52.628642 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1540/3022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:52 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:52.634067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53b3d96a-a7f9-4006-9ef7-45ad22f612ed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:52.635268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53b3d96a-a7f9-4006-9ef7-45ad22f612ed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:52.651377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b3d96a-a7f9-4006-9ef7-45ad22f612ed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:52.653313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b3d96a-a7f9-4006-9ef7-45ad22f612ed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:52.660202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b3d96a-a7f9-4006-9ef7-45ad22f612ed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:52.660855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b3d96a-a7f9-4006-9ef7-45ad22f612ed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:52.754068 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53b3d96a-a7f9-4006-9ef7-45ad22f612ed tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.122478 Dec 18 20:57:52.754827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1541/3023] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:52 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:52.768957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a7fa33b-3208-417b-82c6-82c052dea70c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:52.772307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a7fa33b-3208-417b-82c6-82c052dea70c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:52.923699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a2f6a12d-7eb2-414a-870d-f824b595fcc4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for project 09cf6435c2a148c6998dd3b1d301da96. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:57:52.941929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a2f6a12d-7eb2-414a-870d-f824b595fcc4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for user 3166e271ba6f418d9c71cd661ef23226 and project 09cf6435c2a148c6998dd3b1d301da96. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:57:52.969239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a7fa33b-3208-417b-82c6-82c052dea70c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:52.978949 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a7fa33b-3208-417b-82c6-82c052dea70c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1277 microversion: 2.1 time: 0.222777 Dec 18 20:57:52.996901 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1542/3024] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:52 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:53.002163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:53.008528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:53.010083 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2f6a12d-7eb2-414a-870d-f824b595fcc4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.066966 Dec 18 20:57:53.014148 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1483/3025] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:57:51 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:53.040649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:53.041977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:53.046780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:53.051098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:53.063469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:53.064540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:53.086549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:53.091865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:53.103410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:53.104566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:53.704973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:53.715196 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4adc0a3b-241e-4c53-9c1d-d87539dd824e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.716862 Dec 18 20:57:53.715797 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1543/3026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:52 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:53.735021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:53.735643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:53.764920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:53.765730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:53.767174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:53.768263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.050419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:54.071758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29ac8330-7585-4bc4-9808-413dbd2da474 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 1.044957 Dec 18 20:57:54.072716 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1484/3027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:53 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:54.085298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:54.086156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:54.093602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.099441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.100468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.102527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.304987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:54.318607 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff19838f-bba1-45a0-8032-f38a9d310bec tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.601160 Dec 18 20:57:54.334412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1544/3028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:53 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:54.349531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46d400f2-8fdf-40b5-bdf3-f339bad91660 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:54.351857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46d400f2-8fdf-40b5-bdf3-f339bad91660 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:54.368969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46d400f2-8fdf-40b5-bdf3-f339bad91660 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.369329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46d400f2-8fdf-40b5-bdf3-f339bad91660 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.373497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46d400f2-8fdf-40b5-bdf3-f339bad91660 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.376096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46d400f2-8fdf-40b5-bdf3-f339bad91660 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.466765 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46d400f2-8fdf-40b5-bdf3-f339bad91660 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.131480 Dec 18 20:57:54.467820 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1545/3029] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:54 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:54.475635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:54.477026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:54.493974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.495807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.498407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.499658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.788170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:54.806712 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9c70a89-5a52-4e81-854a-2b189745390b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1335 microversion: 2.1 time: 0.336183 Dec 18 20:57:54.809776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1546/3030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:54 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1335 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:54.829702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-58a6d56f-6010-4dc5-bf9e-27fc22479758 req-e6a8ee1d-8e27-4d53-8bdf-722f2e72cf5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0767c760-b97d-4335-9e04-aea2214c110a", "tag": "edd02058-579e-40a1-b93e-f4c46ed1137b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:54.831371 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:54.831371 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:57:54.859769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-58a6d56f-6010-4dc5-bf9e-27fc22479758 req-e6a8ee1d-8e27-4d53-8bdf-722f2e72cf5a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.860259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-58a6d56f-6010-4dc5-bf9e-27fc22479758 req-e6a8ee1d-8e27-4d53-8bdf-722f2e72cf5a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.892879 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-58a6d56f-6010-4dc5-bf9e-27fc22479758 req-e6a8ee1d-8e27-4d53-8bdf-722f2e72cf5a service nova] Creating event network-changed:edd02058-579e-40a1-b93e-f4c46ed1137b for instance 0767c760-b97d-4335-9e04-aea2214c110a on nch2-master-1 Dec 18 20:57:54.905400 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-58a6d56f-6010-4dc5-bf9e-27fc22479758 req-e6a8ee1d-8e27-4d53-8bdf-722f2e72cf5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081989 Dec 18 20:57:54.909153 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1547/3031] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:54.922571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:54.925592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:54.938093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.943331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:54.945993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:54.954695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.070019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:55.079634 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5aafaa0d-8134-4034-a896-dd080009a9ce tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 1.005674 Dec 18 20:57:55.092428 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1485/3032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:54 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:55.100096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:55.101168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:55.108997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:55.109932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.111085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:55.112887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.659885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:55.679992 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-074d9225-de4c-4d92-a6b2-b13ee7dac0aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.769492 Dec 18 20:57:55.681644 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1548/3033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:54 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:55.716915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:55.717562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:55.725418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:55.734726 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-989da443-20ea-4b2b-b11a-bd5168a34675 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.640173 Dec 18 20:57:55.736244 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1486/3034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:55 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:55.749385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-73aad64a-c6c9-4c7b-8a3b-fa248d7c95f1 req-4b5e563f-dfc2-4e3c-9749-429dc90fb8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cde937-d836-4d8a-8568-4e686b8ca4f2", "name": "network-vif-plugged", "status": "completed", "tag": "07ac6499-0831-47d9-9072-52d994281360"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:55.754180 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:55.754180 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:57:55.781168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-73aad64a-c6c9-4c7b-8a3b-fa248d7c95f1 req-4b5e563f-dfc2-4e3c-9749-429dc90fb8cd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:55.782888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-73aad64a-c6c9-4c7b-8a3b-fa248d7c95f1 req-4b5e563f-dfc2-4e3c-9749-429dc90fb8cd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.802569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:55.804390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.067s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.805283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:55.805737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.815834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-73aad64a-c6c9-4c7b-8a3b-fa248d7c95f1 req-4b5e563f-dfc2-4e3c-9749-429dc90fb8cd service nova] Creating event network-vif-plugged:07ac6499-0831-47d9-9072-52d994281360 for instance 16cde937-d836-4d8a-8568-4e686b8ca4f2 on nch1-master-1 Dec 18 20:57:55.828389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-73aad64a-c6c9-4c7b-8a3b-fa248d7c95f1 req-4b5e563f-dfc2-4e3c-9749-429dc90fb8cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088645 Dec 18 20:57:55.831283 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1487/3035] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:55.849273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b6836f23-b29a-443d-9868-e119bb0e1fa0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:55.852115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b6836f23-b29a-443d-9868-e119bb0e1fa0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:55.876539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6836f23-b29a-443d-9868-e119bb0e1fa0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:55.883286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6836f23-b29a-443d-9868-e119bb0e1fa0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.887109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6836f23-b29a-443d-9868-e119bb0e1fa0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:55.887748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6836f23-b29a-443d-9868-e119bb0e1fa0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:55.993102 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b6836f23-b29a-443d-9868-e119bb0e1fa0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.157015 Dec 18 20:57:55.994645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1488/3036] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:55 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:56.010001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:56.010749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:56.026606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.026987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:56.027802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.028243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:56.195200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:56.211908 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-654305fa-d8d8-4fa9-9082-b9502d5f7f55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1335 microversion: 2.1 time: 0.213002 Dec 18 20:57:56.212749 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1489/3037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:55 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1335 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:56.225061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:56.230619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:56.247587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.248766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:56.249553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.250680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:56.627959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:56.650695 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-194f8746-8d43-4931-88f0-0e6e976f4f9c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.958591 Dec 18 20:57:56.651816 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1549/3038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:55 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:56.705337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:56.717266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:56.751877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.754715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:56.758729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.761757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:56.900694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:56.911034 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66b61a1e-814e-413d-8471-0f9a5a188b69 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1314 microversion: 2.1 time: 0.696181 Dec 18 20:57:56.913732 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1490/3039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:56 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:56.924859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:56.926993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:56.950943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.951982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:56.955475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:56.956298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:57.603685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:57.619001 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59016123-ea9f-405f-a098-a1e5fba48cb7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.924465 Dec 18 20:57:57.626065 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1550/3040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:56 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:57:57.636846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39dcdb5a-b603-4929-91d1-d0def8115538 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:57.638600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39dcdb5a-b603-4929-91d1-d0def8115538 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:57.649276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39dcdb5a-b603-4929-91d1-d0def8115538 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:57.650747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39dcdb5a-b603-4929-91d1-d0def8115538 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:57.651946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39dcdb5a-b603-4929-91d1-d0def8115538 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:57.653407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39dcdb5a-b603-4929-91d1-d0def8115538 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:57.774594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39dcdb5a-b603-4929-91d1-d0def8115538 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.144290 Dec 18 20:57:57.776177 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1551/3041] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:57 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:57.781325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:57.785125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:57.786493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:57.797097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:57.798114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:57.800796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:57.801736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:57.812463 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b225abf-74ba-4fc2-b5c4-08b90ff7aa6a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.896665 Dec 18 20:57:57.816655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1491/3042] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:56 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:57.843842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:57.845549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:57.863959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:57.868679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:57.871662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:57.876369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:58.720226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:58.727994 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57cd7c87-92e6-4ede-92f4-53d8b33d4ec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.949275 Dec 18 20:57:58.728563 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1552/3043] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:57 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:58.732953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-88a94011-9ab9-4098-a31b-c8d94f746c6a req-cc66a6db-a24e-42c5-9cd5-f2f116fe0af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367d7e2b-daf1-4ac1-996b-6cc729824d5c", "name": "network-vif-plugged", "status": "completed", "tag": "a80bf93f-ecf4-4003-a592-419a48827f6c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:58.734478 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:57:58.734478 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:57:58.744759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-88a94011-9ab9-4098-a31b-c8d94f746c6a req-cc66a6db-a24e-42c5-9cd5-f2f116fe0af5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:58.745203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-88a94011-9ab9-4098-a31b-c8d94f746c6a req-cc66a6db-a24e-42c5-9cd5-f2f116fe0af5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:58.756963 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-88a94011-9ab9-4098-a31b-c8d94f746c6a req-cc66a6db-a24e-42c5-9cd5-f2f116fe0af5 service nova] Creating event network-vif-plugged:a80bf93f-ecf4-4003-a592-419a48827f6c for instance 367d7e2b-daf1-4ac1-996b-6cc729824d5c on nch1-master-1 Dec 18 20:57:58.757768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:58.767879 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-88a94011-9ab9-4098-a31b-c8d94f746c6a req-cc66a6db-a24e-42c5-9cd5-f2f116fe0af5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038038 Dec 18 20:57:58.768859 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1553/3044] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:57:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:57:58.772726 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab3ef306-1d24-4abe-913d-2fa785ed6e00 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.953256 Dec 18 20:57:58.774396 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1492/3045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:57 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:58.779653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:58.780080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:58.781375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:58.785550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:58.792650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:58.799060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:58.799060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:58.799060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:58.800061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:58.800061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:58.803596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:58.804326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:59.396327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:59.414849 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e4190a6d-585d-4e41-a3e5-d8886a93c827 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.638513 Dec 18 20:57:59.416585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1493/3046] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:58 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:59.425606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b647a40f-1a1a-407f-8e83-044c4b54a3ff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:59.427535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b647a40f-1a1a-407f-8e83-044c4b54a3ff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:59.462987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:57:59.482674 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1bd23841-409e-4c78-a634-5898ddfc1854 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1500 microversion: 2.1 time: 0.703203 Dec 18 20:57:59.482932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b647a40f-1a1a-407f-8e83-044c4b54a3ff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:59.483027 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1554/3047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:58 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1500 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:57:59.483106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b647a40f-1a1a-407f-8e83-044c4b54a3ff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:59.483106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b647a40f-1a1a-407f-8e83-044c4b54a3ff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:59.483106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b647a40f-1a1a-407f-8e83-044c4b54a3ff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:59.483467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:57:59.484079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:59.499858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:59.503989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:59.504667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:59.505231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:59.573077 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b647a40f-1a1a-407f-8e83-044c4b54a3ff tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.153724 Dec 18 20:57:59.574034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1494/3048] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:57:59 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:57:59.579317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:57:59.584238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:57:59.591349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:59.592045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:59.593012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:57:59.593605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:57:59.999358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:00.010268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e2d873a-c3a5-4825-b29d-ca30a2147c86 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1308 microversion: 2.1 time: 0.533820 Dec 18 20:58:00.013652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1555/3049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:57:59 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:00.025405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:00.028984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:00.038030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:00.055649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:00.057253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:00.059592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:00.060059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.network.security_group_api [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Removing security group da16a825-3f99-459a-b2c2-e94d5a92771c from port 07ac6499-0831-47d9-9072-52d994281360 Dec 18 20:58:00.567693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:00.576639 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4aaac21d-f0b3-4336-bbeb-66381531dec0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.561419 Dec 18 20:58:00.579025 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1556/3050] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:00 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:00.591258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:00.592457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:00.605230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:00.607280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:00.609034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:00.610743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:00.883462 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-170ecf4f-311a-4250-adec-69f042994b47 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2/action" status: 202 len: 0 microversion: 2.1 time: 1.308031 Dec 18 20:58:00.884277 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1495/3051] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:57:59 2021] POST /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:00.891245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1982635429", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3eb4717b-66be-4294-a87d-4258f6da14d8"}], "security_groups": [{"name": "tempest-securitygroup--970717789"}], "key_name": "tempest-keypair-243282819", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:00.936489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:00.945901 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ec2a2aab-03d8-4976-bbb7-473146f19564 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.364345 Dec 18 20:58:00.956289 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1557/3052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:00 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:00.956524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:00.957244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:00.972478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:00.975663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:00.977128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:00.977814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:01.247196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:01.252143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] validate_networks() for [('3eb4717b-66be-4294-a87d-4258f6da14d8', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:58:01.264451 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20a51851-6728-4a48-b2a6-eff82fb1afbf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.316102 Dec 18 20:58:01.265041 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1558/3053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:00 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:01.344497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d14cae3a-0e41-4ece-9613-e104312dae9b req-803edf2e-6da6-4518-86d3-e40866bde43c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198e9dd2-01b2-4119-9848-b5c9db0cb7ca", "tag": "fea449d4-dbd8-44cd-99aa-d486449cf15d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:01.347199 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:01.347199 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:01.355842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d14cae3a-0e41-4ece-9613-e104312dae9b req-803edf2e-6da6-4518-86d3-e40866bde43c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:01.356516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d14cae3a-0e41-4ece-9613-e104312dae9b req-803edf2e-6da6-4518-86d3-e40866bde43c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:01.369620 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d14cae3a-0e41-4ece-9613-e104312dae9b req-803edf2e-6da6-4518-86d3-e40866bde43c service nova] Creating event network-changed:fea449d4-dbd8-44cd-99aa-d486449cf15d for instance 198e9dd2-01b2-4119-9848-b5c9db0cb7ca on nch2-master-1 Dec 18 20:58:01.378193 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d14cae3a-0e41-4ece-9613-e104312dae9b req-803edf2e-6da6-4518-86d3-e40866bde43c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111739 Dec 18 20:58:01.379423 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1559/3054] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:01.384960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-acca59be-e484-46d1-9b7a-6a9d268ab309 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:01.386283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-acca59be-e484-46d1-9b7a-6a9d268ab309 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:01.397537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acca59be-e484-46d1-9b7a-6a9d268ab309 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:01.398620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acca59be-e484-46d1-9b7a-6a9d268ab309 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:01.399627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acca59be-e484-46d1-9b7a-6a9d268ab309 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:01.400223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acca59be-e484-46d1-9b7a-6a9d268ab309 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:01.469859 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-acca59be-e484-46d1-9b7a-6a9d268ab309 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.088572 Dec 18 20:58:01.472375 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1560/3055] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:01 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:01.491023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:01.493932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:01.504170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:01.505001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:01.505788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:01.506231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:01.712663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:01.731400 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2085b981-4a94-4db4-aa1f-8ab5a94a13f8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1458 microversion: 2.1 time: 0.254985 Dec 18 20:58:01.732444 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1561/3056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:01 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1458 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:01.740080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:01.741074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:01.758887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:01.759739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:01.762072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:01.762590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.097062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for project 09cf6435c2a148c6998dd3b1d301da96. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:58:02.103138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:02.110969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for user 3166e271ba6f418d9c71cd661ef23226 and project 09cf6435c2a148c6998dd3b1d301da96. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:58:02.114832 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6158b45b-ed63-472b-9552-1b22faa6c2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1488 microversion: 2.1 time: 0.381175 Dec 18 20:58:02.115701 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1562/3057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:01 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1488 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:02.120008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:02.123909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.132407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.142168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.143253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.144989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.147637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:58:02.149085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:58:02.154839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:58:02.158940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:58:02.161985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:58:02.183186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.183987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.185148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.186095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.225909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for project 09cf6435c2a148c6998dd3b1d301da96. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:58:02.233200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Getting quotas for user 3166e271ba6f418d9c71cd661ef23226 and project 09cf6435c2a148c6998dd3b1d301da96. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:58:02.246918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:58:02.249999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:58:02.308799 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-130f78cb-7c9c-47e7-9f59-7a354fbf5195 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.423340 Dec 18 20:58:02.309871 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1496/3058] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:58:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:58:02.312308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:02.315136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:02.316461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.321416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2cf2da78-8e76-4636-a81e-6d7fca943357 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.204967 Dec 18 20:58:02.323385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.323839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.324814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.325399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.334188 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1563/3059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:02 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:02.339739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:02.340455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.347912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.348472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.349360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.349936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.563200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:02.572864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:02.575534 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f0a59f71-2981-4876-89e2-8b3c069d523e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.263866 Dec 18 20:58:02.579667 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1497/3060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:02 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:02.582554 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1fe37110-ed2c-4730-88b0-6d9c5bc1588f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.247090 Dec 18 20:58:02.583240 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1564/3061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:02 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:02.586326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9bdd0c57-8c0f-4f5a-9581-ef36bca3b88e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-724328172"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:02.588261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9bdd0c57-8c0f-4f5a-9581-ef36bca3b88e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.604445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:02.605362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.607616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9bdd0c57-8c0f-4f5a-9581-ef36bca3b88e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.607979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9bdd0c57-8c0f-4f5a-9581-ef36bca3b88e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.608803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9bdd0c57-8c0f-4f5a-9581-ef36bca3b88e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.609247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9bdd0c57-8c0f-4f5a-9581-ef36bca3b88e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.614745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.615385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.616470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.617128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.825817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:02.835415 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c5645d3-3cbc-447b-ad7b-7f79e7123bba tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.235722 Dec 18 20:58:02.842649 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1565/3062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:02 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:02.849263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:02.849885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.856099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.856560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.857558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.858012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.933499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:02.947844 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab16e6cf-81b6-447a-8134-a9b27ac823a9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1273 microversion: 2.1 time: 0.103359 Dec 18 20:58:02.948689 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1566/3063] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:02 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:02.952627 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9bdd0c57-8c0f-4f5a-9581-ef36bca3b88e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "POST /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c/action" status: 202 len: 0 microversion: 2.1 time: 0.370476 Dec 18 20:58:02.953508 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1498/3064] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:02 2021] POST /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:58:02.959995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:02.961474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.964590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-884f06bc-c2da-47cc-b64c-f6670a081155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:02.965466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-884f06bc-c2da-47cc-b64c-f6670a081155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:02.972547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.973297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.973414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-884f06bc-c2da-47cc-b64c-f6670a081155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.973824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-884f06bc-c2da-47cc-b64c-f6670a081155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.974683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-884f06bc-c2da-47cc-b64c-f6670a081155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.975015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:02.975121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-884f06bc-c2da-47cc-b64c-f6670a081155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:02.975757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:03.043502 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-884f06bc-c2da-47cc-b64c-f6670a081155 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.084220 Dec 18 20:58:03.048031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1567/3065] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:02 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:03.058622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-edbbd827-e12a-46a7-9ca8-361f67db171d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714ef4a670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:03.124247 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-edbbd827-e12a-46a7-9ca8-361f67db171d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12" status: 200 len: 1411 microversion: 2.1 time: 0.074433 Dec 18 20:58:03.124823 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1568/3066] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:03 2021] GET /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:03.139277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac5db138-f4fb-499f-becf-be65edd60094 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714edd7a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:03.222214 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac5db138-f4fb-499f-becf-be65edd60094 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12" status: 200 len: 1411 microversion: 2.1 time: 0.089447 Dec 18 20:58:03.222827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1569/3067] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:03 2021] GET /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:03.235182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-edb4285a-9620-4da6-a336-dcc2b205f9d7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613b98b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:03.341969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:03.354431 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0498c17f-2f70-4ac6-9775-8c79540d87e0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.399219 Dec 18 20:58:03.373718 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1499/3068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:02 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:03.375571 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-edb4285a-9620-4da6-a336-dcc2b205f9d7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12" status: 204 len: 0 microversion: 2.1 time: 0.145239 Dec 18 20:58:03.378619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1570/3069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:03 2021] DELETE /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:58:03.381417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:03.382371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:03.391449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa1ec254-d051-4650-a019-a1f6b933e2b4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613b9700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:03.401798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:03.402320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:03.403226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:03.403721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:03.418919 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-fa1ec254-d051-4650-a019-a1f6b933e2b4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Image not found. Dec 18 20:58:03.419553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa1ec254-d051-4650-a019-a1f6b933e2b4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:03.420595 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa1ec254-d051-4650-a019-a1f6b933e2b4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12" status: 404 len: 62 microversion: 2.1 time: 0.037636 Dec 18 20:58:03.425085 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1571/3070] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:03 2021] GET /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:03.430891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-015d2df3-470c-4378-90a4-6ce72d145c73 req-c5cb5c40-7f26-4d1f-b6a4-4a2c2cfed361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cde937-d836-4d8a-8568-4e686b8ca4f2", "tag": "07ac6499-0831-47d9-9072-52d994281360"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:03.434565 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:03.434565 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:03.443927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-015d2df3-470c-4378-90a4-6ce72d145c73 req-c5cb5c40-7f26-4d1f-b6a4-4a2c2cfed361 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:03.444308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-015d2df3-470c-4378-90a4-6ce72d145c73 req-c5cb5c40-7f26-4d1f-b6a4-4a2c2cfed361 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:03.455703 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-015d2df3-470c-4378-90a4-6ce72d145c73 req-c5cb5c40-7f26-4d1f-b6a4-4a2c2cfed361 service nova] Creating event network-changed:07ac6499-0831-47d9-9072-52d994281360 for instance 16cde937-d836-4d8a-8568-4e686b8ca4f2 on nch1-master-1 Dec 18 20:58:03.461149 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-015d2df3-470c-4378-90a4-6ce72d145c73 req-c5cb5c40-7f26-4d1f-b6a4-4a2c2cfed361 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034468 Dec 18 20:58:03.462238 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1572/3071] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:03.467731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:03.468466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:03.475004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:03.475466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:03.476275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:03.476723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:03.965004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:03.980443 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f232c2a-9bd6-420d-bc16-a5bd1e72bc69 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.605454 Dec 18 20:58:03.981046 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1500/3072] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:03 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:03.986060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1456011741", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "b682fe11-354f-40ac-961b-a0ccac207599"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:04.075892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] validate_networks() for [('b682fe11-354f-40ac-961b-a0ccac207599', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:58:04.253643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:04.267420 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0f273891-c34b-4031-8642-68fc25c50294 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1500 microversion: 2.1 time: 0.803422 Dec 18 20:58:04.269102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1573/3073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:03 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1500 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:04.280224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:04.282726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:04.291870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.292713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:04.294236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.294936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:04.606562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:04.615965 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-539665a0-6779-4794-a00a-0f1ee5033193 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.344721 Dec 18 20:58:04.616781 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1574/3074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:04 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:04.621425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:04.622126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:04.628711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.629256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:04.630132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.630691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:04.862572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:58:04.863099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:58:04.863452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:58:04.863851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:58:04.864273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:58:04.873480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.873920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:04.875026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.875491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:04.898934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:58:04.904470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Getting quotas for user ebd83848fe8d4e7284291660eb51da51 and project 69de37deec2a49ff9eaad9cbb7c48f31. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:58:04.911692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:04.920698 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82fc65d3-74ad-4916-a255-49e320c77c50 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1501 microversion: 2.1 time: 0.302576 Dec 18 20:58:04.921473 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1575/3075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:04 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:04.923699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:58:04.926847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:58:04.930800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:04.931565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:04.938104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.938719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:04.939645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:04.941086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.017197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-20e2b749-b8e9-4af7-8c37-355978a9816d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034555 Dec 18 20:58:05.022682 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1501/3076] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:58:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:58:05.023843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50837b72-38c9-4ea2-94e2-58dd8cd4ad26 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:05.026420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50837b72-38c9-4ea2-94e2-58dd8cd4ad26 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.033618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50837b72-38c9-4ea2-94e2-58dd8cd4ad26 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.034110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50837b72-38c9-4ea2-94e2-58dd8cd4ad26 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.034913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50837b72-38c9-4ea2-94e2-58dd8cd4ad26 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.035353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50837b72-38c9-4ea2-94e2-58dd8cd4ad26 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.099530 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50837b72-38c9-4ea2-94e2-58dd8cd4ad26 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.079643 Dec 18 20:58:05.101872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1502/3077] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:05 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:05.110694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40750169-3a96-4904-a7e2-ed473ccd50cd"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:05.114028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.114425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:05.124970 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb222256-38f4-4514-bb49-68ec4710cfa0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.202339 Dec 18 20:58:05.130758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.132365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.133185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.133631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.136293 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1576/3078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:04 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:05.144937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:05.145648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.164948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.167961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.171431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.172083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.188146 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Cannot 'attach_volume' instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 while it is in vm_state rescued Dec 18 20:58:05.190955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 409 to user: Cannot 'attach_volume' instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 while it is in vm_state rescued {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:05.195233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1f6353d-920c-45f5-9cb5-a20e35f5b92d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088346 Dec 18 20:58:05.195859 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1503/3079] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 20:58:05 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:05.205426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-067582df-f6ee-4087-b90a-31f22507ef5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:05.206006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-067582df-f6ee-4087-b90a-31f22507ef5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.317465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-067582df-f6ee-4087-b90a-31f22507ef5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:05.328029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-067582df-f6ee-4087-b90a-31f22507ef5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1215 microversion: 2.1 time: 0.130730 Dec 18 20:58:05.329032 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1504/3080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:05 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:05.334736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6d40b02-3ef5-4305-b6b0-eb26f16d3d4e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:05.336458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f6d40b02-3ef5-4305-b6b0-eb26f16d3d4e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.348793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d40b02-3ef5-4305-b6b0-eb26f16d3d4e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.349626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d40b02-3ef5-4305-b6b0-eb26f16d3d4e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.350656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d40b02-3ef5-4305-b6b0-eb26f16d3d4e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.354593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d40b02-3ef5-4305-b6b0-eb26f16d3d4e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.431060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:05.440738 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-62e8983e-1573-4c31-8286-fdc1dfeca6fd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.302830 Dec 18 20:58:05.461358 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f6d40b02-3ef5-4305-b6b0-eb26f16d3d4e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action" status: 202 len: 0 microversion: 2.1 time: 0.130405 Dec 18 20:58:05.462717 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1505/3081] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:05 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:05.465583 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1577/3082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:05 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:05.469175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:05.470058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.476888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:05.478071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.478824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.479746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.480106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.480879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.488042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.488507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.492911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.493370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.701312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:05.710720 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66e38582-6ff4-4ac5-9ac5-6156157d9899 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1506 microversion: 2.1 time: 0.246658 Dec 18 20:58:05.723796 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1506/3083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:05 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:05.729700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:05.734700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:05.748229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.748787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.749660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:05.750164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:05.867033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:05.876739 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d593d0f0-4a78-415b-a0f4-adb43d9a115a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1509 microversion: 2.1 time: 0.409711 Dec 18 20:58:05.889653 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1578/3084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:05 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:06.003403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:06.014232 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d55af151-cb52-48f8-a364-3f6fdd4d617f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.287002 Dec 18 20:58:06.014853 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1507/3085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:05 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:06.115663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cd84866e-9312-410f-8131-8e427790adb2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:06.117692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cd84866e-9312-410f-8131-8e427790adb2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:06.125636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd84866e-9312-410f-8131-8e427790adb2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.126337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd84866e-9312-410f-8131-8e427790adb2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.127803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd84866e-9312-410f-8131-8e427790adb2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.128394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd84866e-9312-410f-8131-8e427790adb2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.143640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:06.144269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:06.152233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.152692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.153526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.153964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.249972 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cd84866e-9312-410f-8131-8e427790adb2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.140173 Dec 18 20:58:06.250676 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1579/3086] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:06 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:06.316793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:06.326714 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89cd2d10-f67f-4f1f-8ff5-fba86576acb9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.187549 Dec 18 20:58:06.327512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1508/3087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:06 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:06.349028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:06.350080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:06.357958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.358657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.360177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.360809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.465202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:06.465835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:06.474149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.487522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.489590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.493641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.579638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:06.593309 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81bb5f02-e48b-4a65-b8f2-ee43a28d1ff6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1275 microversion: 2.1 time: 0.249580 Dec 18 20:58:06.603552 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1580/3088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:06 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1275 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:06.730550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:06.731728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:06.742047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.742909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.744023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:06.744696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:06.943911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:06.956677 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09e12f08-d3ac-437d-a81d-cec7dfa89af2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.492920 Dec 18 20:58:06.957294 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1509/3089] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:06 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:06.979578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-402d4e3d-7fc0-4ca6-885f-9fbf20b2a989 req-8d6857fa-22cb-4f25-871a-26cd19d22567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3cf0f4-2856-469d-9f26-86f473b11818", "tag": "b4996ca0-f713-420d-9ffb-a367ca1896f7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:06.988099 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:06.988099 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:07.023767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-402d4e3d-7fc0-4ca6-885f-9fbf20b2a989 req-8d6857fa-22cb-4f25-871a-26cd19d22567 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.024421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-402d4e3d-7fc0-4ca6-885f-9fbf20b2a989 req-8d6857fa-22cb-4f25-871a-26cd19d22567 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.053230 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-402d4e3d-7fc0-4ca6-885f-9fbf20b2a989 req-8d6857fa-22cb-4f25-871a-26cd19d22567 service nova] Creating event network-changed:b4996ca0-f713-420d-9ffb-a367ca1896f7 for instance ec3cf0f4-2856-469d-9f26-86f473b11818 on nch1-master-1 Dec 18 20:58:07.061327 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-402d4e3d-7fc0-4ca6-885f-9fbf20b2a989 req-8d6857fa-22cb-4f25-871a-26cd19d22567 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090945 Dec 18 20:58:07.062314 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1510/3090] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:07.079043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:07.102190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:07.110823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.112197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.113201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.113754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.254321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:07.263212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c08359e7-5cf1-4028-8726-8b245938b17e tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1488 microversion: 2.1 time: 0.536933 Dec 18 20:58:07.276405 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1581/3091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:06 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1488 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:07.281410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:07.284316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:07.310458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.311703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.313441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.314040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.411002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:07.420356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0769914-44d6-43ff-a82e-784e723fd1be tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1509 microversion: 2.1 time: 0.356478 Dec 18 20:58:07.420958 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1511/3092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:07 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:07.426845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-583a55e3-c48b-47c1-860e-345c4e1ce603 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:07.428041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-583a55e3-c48b-47c1-860e-345c4e1ce603 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:07.454025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-583a55e3-c48b-47c1-860e-345c4e1ce603 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.454880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-583a55e3-c48b-47c1-860e-345c4e1ce603 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.455991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-583a55e3-c48b-47c1-860e-345c4e1ce603 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.456610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-583a55e3-c48b-47c1-860e-345c4e1ce603 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.522554 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-583a55e3-c48b-47c1-860e-345c4e1ce603 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.100052 Dec 18 20:58:07.523779 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1512/3093] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:07 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:07.532093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:07.532691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:07.555923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.556482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.557359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.557867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.587729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:58:07.615643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:07.624200 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-921ea4a6-6e2e-4bc1-911c-884acd6eebb4 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.346339 Dec 18 20:58:07.634434 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1582/3094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:07 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:07.640080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:07.640986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:07.649661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.650503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.651919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.652559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.749692 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0922b46e-0f72-407d-aee0-6f81ac4473a4 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 204 len: 0 microversion: 2.1 time: 0.224332 Dec 18 20:58:07.750565 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1513/3095] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:07 2021] DELETE /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:58:07.756020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:07.756965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:07.763297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.763933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.764909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:07.765345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:07.929546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:07.938728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-942fd9c0-f5cf-4187-a5f1-337f4272a84e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.302229 Dec 18 20:58:07.940417 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1583/3096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:07 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:07.952404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ec5dade1-7642-4213-abaa-5e520ab1f1c7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f714fb950d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:07.993376 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ec5dade1-7642-4213-abaa-5e520ab1f1c7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Image not found. Dec 18 20:58:07.995045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ec5dade1-7642-4213-abaa-5e520ab1f1c7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:07.996255 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ec5dade1-7642-4213-abaa-5e520ab1f1c7 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12" status: 404 len: 62 microversion: 2.1 time: 0.054328 Dec 18 20:58:07.997289 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1584/3097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:07 2021] DELETE /compute/v2.1/images/557280df-b959-49de-912a-cbeaf7b01c12 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:08.007583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:08.009897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:08.020689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:08.022393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.023296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.024586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.025381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.030453 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1a00139-bed6-445a-bcaf-fd664a81fdc6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.278389 Dec 18 20:58:08.034990 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1514/3098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:07 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:08.039732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:08.040242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:08.048932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.049447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.054995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.056658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.110167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:58:08.167624 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.compute.api [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Instance is already in deleting state, ignoring this request Dec 18 20:58:08.168598 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0a8ae89b-a707-444a-a20b-0df813cdc281 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 204 len: 0 microversion: 2.1 time: 0.132368 Dec 18 20:58:08.169731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1515/3099] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:08 2021] DELETE /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:58:08.181406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:08.182045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:08.189461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.190843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.192381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.192838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.359137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:08.374990 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-31c6f722-fc61-4aeb-96e2-02ae64199fa3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.375552 Dec 18 20:58:08.376423 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1585/3100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:07 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:08.448692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:08.454246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:08.466273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.467174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.468202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.469140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.560737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:08.569762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5d6de226-ddac-4883-a761-d3662728c715 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1494 microversion: 2.1 time: 0.394040 Dec 18 20:58:08.570502 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1516/3101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:08 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1494 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:08.575605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-add5b225-27e9-47c5-8efd-34a74aab75ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:08.576764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-add5b225-27e9-47c5-8efd-34a74aab75ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:08.583904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-add5b225-27e9-47c5-8efd-34a74aab75ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.584753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-add5b225-27e9-47c5-8efd-34a74aab75ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.585699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-add5b225-27e9-47c5-8efd-34a74aab75ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.586288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-add5b225-27e9-47c5-8efd-34a74aab75ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.638453 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-add5b225-27e9-47c5-8efd-34a74aab75ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.066329 Dec 18 20:58:08.639568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1517/3102] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:08 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:08.645753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:08.646727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:08.653849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.654596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.655708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.656399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.696349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:08.704535 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e25d134-7346-4778-8731-7b26406dc633 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1509 microversion: 2.1 time: 0.263931 Dec 18 20:58:08.705916 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1586/3103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:08 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:08.914535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:08.930348 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e15b209-27b2-4ca7-b622-fc066db6627f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.289014 Dec 18 20:58:08.943094 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1518/3104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:08 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:08.945102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-82f98a9e-2e4e-4d06-b719-2f1fc3aa6784 req-02ab7d4f-c750-4d4e-8a2c-86d3d5d205ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367d7e2b-daf1-4ac1-996b-6cc729824d5c", "name": "network-vif-plugged", "status": "completed", "tag": "a80bf93f-ecf4-4003-a592-419a48827f6c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:08.946417 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:08.946417 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:08.960062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:08.962320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:08.963105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-82f98a9e-2e4e-4d06-b719-2f1fc3aa6784 req-02ab7d4f-c750-4d4e-8a2c-86d3d5d205ca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.963560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-82f98a9e-2e4e-4d06-b719-2f1fc3aa6784 req-02ab7d4f-c750-4d4e-8a2c-86d3d5d205ca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.976281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.977259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.978580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:08.979268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:08.993512 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-82f98a9e-2e4e-4d06-b719-2f1fc3aa6784 req-02ab7d4f-c750-4d4e-8a2c-86d3d5d205ca service nova] Creating event network-vif-plugged:a80bf93f-ecf4-4003-a592-419a48827f6c for instance 367d7e2b-daf1-4ac1-996b-6cc729824d5c on nch1-master-1 Dec 18 20:58:09.004610 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-82f98a9e-2e4e-4d06-b719-2f1fc3aa6784 req-02ab7d4f-c750-4d4e-8a2c-86d3d5d205ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064592 Dec 18 20:58:09.005218 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1587/3105] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:09.050847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:09.051919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:09.068856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.070637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.072946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.074245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.404634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:09.413256 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67199379-aa86-49f7-8ad1-a6dbd050dcd6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.459351 Dec 18 20:58:09.423114 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1519/3106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:08 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:09.428546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-00b400b0-7fbc-4910-969a-e80f43f0b000 req-1c0e47a8-31c1-44a0-8a79-a183683b7a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79dfce29-5bdc-4127-9942-6377d7b7bc7e", "tag": "2ec8fed1-1707-4075-bc28-f12d86c90468"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:09.438365 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:09.438365 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:09.447688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-00b400b0-7fbc-4910-969a-e80f43f0b000 req-1c0e47a8-31c1-44a0-8a79-a183683b7a94 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.448143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-00b400b0-7fbc-4910-969a-e80f43f0b000 req-1c0e47a8-31c1-44a0-8a79-a183683b7a94 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.476621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-00b400b0-7fbc-4910-969a-e80f43f0b000 req-1c0e47a8-31c1-44a0-8a79-a183683b7a94 service nova] Creating event network-changed:2ec8fed1-1707-4075-bc28-f12d86c90468 for instance 79dfce29-5bdc-4127-9942-6377d7b7bc7e on nch2-master-1 Dec 18 20:58:09.481742 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-00b400b0-7fbc-4910-969a-e80f43f0b000 req-1c0e47a8-31c1-44a0-8a79-a183683b7a94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056659 Dec 18 20:58:09.484908 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1520/3107] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:09.487244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:09.493135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:09.497495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:09.510106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.512471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.513314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.513759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.516348 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-991f776f-495b-429f-abd7-e673dc48c07d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.464600 Dec 18 20:58:09.517809 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1588/3108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:09 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:09.590206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:09.591265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:09.599851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.600882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.602080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.602780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.869259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:09.878910 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cdc86b2a-8d77-49ff-871b-c45f297419d4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.392431 Dec 18 20:58:09.879613 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1521/3109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:09 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:09.885407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-796d0ea2-4ec8-4279-9167-9dcece017372 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:09.886471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-796d0ea2-4ec8-4279-9167-9dcece017372 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:09.895249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-796d0ea2-4ec8-4279-9167-9dcece017372 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.895934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-796d0ea2-4ec8-4279-9167-9dcece017372 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.897179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-796d0ea2-4ec8-4279-9167-9dcece017372 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.897740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-796d0ea2-4ec8-4279-9167-9dcece017372 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.952939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-796d0ea2-4ec8-4279-9167-9dcece017372 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.071773 Dec 18 20:58:09.954204 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1522/3110] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:09 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:09.960183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:09.960913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:09.963403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216cd2c0d4b249e797990918152b4749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45c473a485472791e742964660e7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:09.968673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.969133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.969934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:09.971428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:09.975295 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a179e360-88ac-45ca-b42b-609c808e5e64 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 200 len: 1494 microversion: 2.1 time: 0.390930 Dec 18 20:58:09.977193 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1589/3111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:09 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 1494 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:09.989654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:09.990299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:10.000066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:10.000871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:10.001830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:10.003815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:10.327069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:10.342684 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4e8a7687-faf2-4905-b8b5-ffc942daaf6e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1515 microversion: 2.1 time: 0.386896 Dec 18 20:58:10.343865 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1523/3112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:09 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1515 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:10.349642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-75c36a30-7857-490c-b470-0b028e7ddbc6 req-b6e605f1-d37c-4be9-8d35-4d68cf4b3841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367d7e2b-daf1-4ac1-996b-6cc729824d5c", "name": "network-vif-deleted", "tag": "a80bf93f-ecf4-4003-a592-419a48827f6c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:10.351401 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:10.351401 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:10.368959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-75c36a30-7857-490c-b470-0b028e7ddbc6 req-b6e605f1-d37c-4be9-8d35-4d68cf4b3841 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:10.369256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-75c36a30-7857-490c-b470-0b028e7ddbc6 req-b6e605f1-d37c-4be9-8d35-4d68cf4b3841 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:10.381073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:10.394583 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e26d8211-d8c6-4469-81d1-5531fcb565a0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.417070 Dec 18 20:58:10.399240 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1590/3113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:09 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:10.402037 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-75c36a30-7857-490c-b470-0b028e7ddbc6 req-b6e605f1-d37c-4be9-8d35-4d68cf4b3841 service nova] Creating event network-vif-deleted:a80bf93f-ecf4-4003-a592-419a48827f6c for instance 367d7e2b-daf1-4ac1-996b-6cc729824d5c on nch1-master-1 Dec 18 20:58:10.411291 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-75c36a30-7857-490c-b470-0b028e7ddbc6 req-b6e605f1-d37c-4be9-8d35-4d68cf4b3841 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065970 Dec 18 20:58:10.413084 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1524/3114] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:10.440528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:10.441208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:10.448981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:10.449468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:10.450326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:10.450840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:10.536581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:10.537808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:10.551143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:10.556472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:10.557399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:10.558558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:10.998223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:11.008611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9933f2e2-17b7-4ffd-b2b2-b0aa6fa27ba2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.572112 Dec 18 20:58:11.009336 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1591/3115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:10 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:11.023400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.024104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.031635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.032391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.033596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.034099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.468394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:11.477236 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2ee3739-2ef9-4598-9940-eb49e1886ddd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.947860 Dec 18 20:58:11.477828 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1525/3116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:10 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:11.482522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f604107-5f09-49da-83a5-bf3140ac3620 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:11.483798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f604107-5f09-49da-83a5-bf3140ac3620 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.490809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f604107-5f09-49da-83a5-bf3140ac3620 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.491314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f604107-5f09-49da-83a5-bf3140ac3620 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.492261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f604107-5f09-49da-83a5-bf3140ac3620 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.492707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f604107-5f09-49da-83a5-bf3140ac3620 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.540995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f604107-5f09-49da-83a5-bf3140ac3620 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.061328 Dec 18 20:58:11.541917 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1526/3117] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:11 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:11.546969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.547736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 367d7e2b-daf1-4ac1-996b-6cc729824d5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.555384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.555840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.556641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.557082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.571579 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Instance 367d7e2b-daf1-4ac1-996b-6cc729824d5c could not be found. Dec 18 20:58:11.572173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Instance 367d7e2b-daf1-4ac1-996b-6cc729824d5c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.573002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3344ca7-fa00-4eee-9029-d9aae4ab16c6 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c" status: 404 len: 111 microversion: 2.1 time: 0.030217 Dec 18 20:58:11.573570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1527/3118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] GET /compute/v2.1/servers/367d7e2b-daf1-4ac1-996b-6cc729824d5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:11.579892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5b39e87d-7c9f-4387-9566-db19ce2a6fbf req-039b7115-250f-4431-acdf-dcddeb35d5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0767c760-b97d-4335-9e04-aea2214c110a", "name": "network-vif-plugged", "status": "completed", "tag": "edd02058-579e-40a1-b93e-f4c46ed1137b"}, {"server_uuid": "198e9dd2-01b2-4119-9848-b5c9db0cb7ca", "name": "network-vif-plugged", "status": "completed", "tag": "fea449d4-dbd8-44cd-99aa-d486449cf15d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:11.582063 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:11.582063 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:11.589981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5b39e87d-7c9f-4387-9566-db19ce2a6fbf req-039b7115-250f-4431-acdf-dcddeb35d5c0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.590480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5b39e87d-7c9f-4387-9566-db19ce2a6fbf req-039b7115-250f-4431-acdf-dcddeb35d5c0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.604117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5b39e87d-7c9f-4387-9566-db19ce2a6fbf req-039b7115-250f-4431-acdf-dcddeb35d5c0 service nova] Creating event network-vif-plugged:edd02058-579e-40a1-b93e-f4c46ed1137b for instance 0767c760-b97d-4335-9e04-aea2214c110a on nch2-master-1 Dec 18 20:58:11.604664 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5b39e87d-7c9f-4387-9566-db19ce2a6fbf req-039b7115-250f-4431-acdf-dcddeb35d5c0 service nova] Creating event network-vif-plugged:fea449d4-dbd8-44cd-99aa-d486449cf15d for instance 198e9dd2-01b2-4119-9848-b5c9db0cb7ca on nch2-master-1 Dec 18 20:58:11.611058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5b39e87d-7c9f-4387-9566-db19ce2a6fbf req-039b7115-250f-4431-acdf-dcddeb35d5c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036396 Dec 18 20:58:11.611700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1528/3119] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:11 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:11.616782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.617486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.623700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.624279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.624891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.625325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.653176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:11.671722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7e734c90-65c7-413d-be86-7f79c8368032 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.661325 Dec 18 20:58:11.681966 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1592/3120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:11.687051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cffe41de-0676-4649-9abb-30a753cb891a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613b91f0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.749609 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-cffe41de-0676-4649-9abb-30a753cb891a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Image not found. Dec 18 20:58:11.750505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cffe41de-0676-4649-9abb-30a753cb891a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.752074 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cffe41de-0676-4649-9abb-30a753cb891a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f" status: 404 len: 62 microversion: 2.1 time: 0.068479 Dec 18 20:58:11.752839 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1593/3121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] DELETE /compute/v2.1/images/0cc5130d-321b-4a2a-beb0-e7bbb84d993f => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:11.761580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.762287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.770587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.771166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.772353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.772881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.787649 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 could not be found. Dec 18 20:58:11.788317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.789364 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b33b1f41-f6e0-400c-8c08-b4e38b25a05b tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 404 len: 111 microversion: 2.1 time: 0.032115 Dec 18 20:58:11.790094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1594/3122] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:11 2021] DELETE /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:58:11.798276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.799068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: ed2a29f1-1645-4b4f-9ceb-cf156b8649f8] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.805186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.805771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.806801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.807314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.822950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 could not be found. Dec 18 20:58:11.823628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Instance ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.824533 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5401410b-2987-4f95-9b6c-69cdea3a780a tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8" status: 404 len: 111 microversion: 2.1 time: 0.029823 Dec 18 20:58:11.825153 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1595/3123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] GET /compute/v2.1/servers/ed2a29f1-1645-4b4f-9ceb-cf156b8649f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:11.833351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-990b88fd-1b2a-4d70-82ac-94eacfa219ff tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f71613b9d30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.854728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-990b88fd-1b2a-4d70-82ac-94eacfa219ff tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Image not found. Dec 18 20:58:11.855321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-990b88fd-1b2a-4d70-82ac-94eacfa219ff tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.856167 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-990b88fd-1b2a-4d70-82ac-94eacfa219ff tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62" status: 404 len: 62 microversion: 2.1 time: 0.026871 Dec 18 20:58:11.856729 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1596/3124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] DELETE /compute/v2.1/images/941d5f87-1ced-48d9-b3c2-193194028c62 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:11.856999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:11.864395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.864697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60670fb3-b52f-4c89-9a0d-231643cab001 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.251898 Dec 18 20:58:11.864882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.865263 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1529/3125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:11.871594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.872073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.872831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.873270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.885950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Instance bf9f6243-3663-449e-89e7-c1a511e9313d could not be found. Dec 18 20:58:11.887009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Instance bf9f6243-3663-449e-89e7-c1a511e9313d could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.887354 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-346a339b-a498-4edb-b478-cd650ee7e1bc tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 404 len: 111 microversion: 2.1 time: 0.026828 Dec 18 20:58:11.887874 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1597/3126] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:11 2021] DELETE /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:11.895901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.896505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: bf9f6243-3663-449e-89e7-c1a511e9313d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.902662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.903128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.903914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.904347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.920252 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Instance bf9f6243-3663-449e-89e7-c1a511e9313d could not be found. Dec 18 20:58:11.920818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Instance bf9f6243-3663-449e-89e7-c1a511e9313d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.921634 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af439881-b108-47c5-8770-c5258d1336f1 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d" status: 404 len: 111 microversion: 2.1 time: 0.029863 Dec 18 20:58:11.922163 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1530/3127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] GET /compute/v2.1/servers/bf9f6243-3663-449e-89e7-c1a511e9313d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:11.930059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87cf2be4-4151-44fb-9f62-4d90797bda39 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '.version_select at 0x7f716134daf0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.932858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.933456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.939783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.940488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.941267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.941704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.951664 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-87cf2be4-4151-44fb-9f62-4d90797bda39 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Image not found. Dec 18 20:58:11.952265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87cf2be4-4151-44fb-9f62-4d90797bda39 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.953133 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87cf2be4-4151-44fb-9f62-4d90797bda39 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7" status: 404 len: 62 microversion: 2.1 time: 0.026751 Dec 18 20:58:11.953826 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1598/3128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] DELETE /compute/v2.1/images/8c7c63e0-28d0-441c-8e22-3b4cb18233f7 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:11.962188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:11.962798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:11.969718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.970179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.971570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:11.972020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:11.987020 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Instance 89fffd39-f05f-4540-8067-b4528d22357a could not be found. Dec 18 20:58:11.987653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Instance 89fffd39-f05f-4540-8067-b4528d22357a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:11.988497 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee64ba4a-bc27-4dfd-8b53-31ef16eeb2c9 tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 404 len: 111 microversion: 2.1 time: 0.030253 Dec 18 20:58:11.989053 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1599/3129] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:11 2021] DELETE /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:58:12.001273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:12.001273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] [instance: 89fffd39-f05f-4540-8067-b4528d22357a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:12.004522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.004976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.005809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.006295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.023574 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] HTTP exception thrown: Instance 89fffd39-f05f-4540-8067-b4528d22357a could not be found. Dec 18 20:58:12.024161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] Returning 404 to user: Instance 89fffd39-f05f-4540-8067-b4528d22357a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:12.024982 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3de9f243-31fe-44f6-955a-cf4a9edb9b3d tempest-ImagesTestJSON-907948640 tempest-ImagesTestJSON-907948640-project] 10.222.0.13 "GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a" status: 404 len: 111 microversion: 2.1 time: 0.031961 Dec 18 20:58:12.028762 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1600/3130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] GET /compute/v2.1/servers/89fffd39-f05f-4540-8067-b4528d22357a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:58:12.032852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:12.033688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:12.039886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.040404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.041233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.041662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.167152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:12.175484 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ce74a58-d344-43c9-9d12-81ef4c7943f1 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1515 microversion: 2.1 time: 0.246029 Dec 18 20:58:12.176105 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1531/3131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:11 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:12.193166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:12.194277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:12.202500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.203329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.204158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.204600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.340801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:12.357048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d68d6622-a031-4299-afdf-65ec4293cbb4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.329592 Dec 18 20:58:12.359391 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1601/3132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:12 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:12.498623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:12.499717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:12.517266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.517730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.519547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.520584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.585555 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ea8d6c6-1878-4c62-bdf3-bead62cf7521 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396924 Dec 18 20:58:12.596728 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1532/3133] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 20:58:12 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:58:12.613717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2267c225-a18b-4741-a1af-1e414421a0ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:12.614851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2267c225-a18b-4741-a1af-1e414421a0ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:12.624026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2267c225-a18b-4741-a1af-1e414421a0ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.624829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2267c225-a18b-4741-a1af-1e414421a0ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.625797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2267c225-a18b-4741-a1af-1e414421a0ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.628088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2267c225-a18b-4741-a1af-1e414421a0ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.702516 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2267c225-a18b-4741-a1af-1e414421a0ac tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.103098 Dec 18 20:58:12.703537 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1533/3134] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:12 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:12.714863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:12.722859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:12.731549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.732125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.733117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.733733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.795932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:12.803619 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b5b211c-c582-4ce2-9a89-744b7e83fd2f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.310309 Dec 18 20:58:12.804192 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1602/3135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:12 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:12.881283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:12.883079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:12.889488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.889947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.890781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:12.891229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:12.966853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:12.979182 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74d35019-ffcd-44d9-a3e8-a5afdcc42924 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1403 microversion: 2.1 time: 0.272873 Dec 18 20:58:12.988855 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1534/3136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:12 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1403 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:13.096851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:13.105294 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e20aec8-0c45-4750-80d4-6e1c0e288103 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1321 microversion: 2.1 time: 0.228145 Dec 18 20:58:13.106423 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1603/3137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:12 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:13.376861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:13.378306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:13.385071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:13.385641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:13.386741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:13.387275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:13.577324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:13.586008 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13ac412f-0a61-489d-8d87-a176017cc440 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.213415 Dec 18 20:58:13.586807 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1535/3138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:13 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:13.627738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-eaf56c87-486d-453c-95ce-06d1e5e172ea req-d183b6f6-57e9-46df-aa01-13d6d67c6cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3cf0f4-2856-469d-9f26-86f473b11818", "name": "network-vif-plugged", "status": "completed", "tag": "b4996ca0-f713-420d-9ffb-a367ca1896f7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:13.629363 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:13.629363 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:13.639422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-eaf56c87-486d-453c-95ce-06d1e5e172ea req-d183b6f6-57e9-46df-aa01-13d6d67c6cfb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:13.640087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-eaf56c87-486d-453c-95ce-06d1e5e172ea req-d183b6f6-57e9-46df-aa01-13d6d67c6cfb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:13.653055 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-eaf56c87-486d-453c-95ce-06d1e5e172ea req-d183b6f6-57e9-46df-aa01-13d6d67c6cfb service nova] Creating event network-vif-plugged:b4996ca0-f713-420d-9ffb-a367ca1896f7 for instance ec3cf0f4-2856-469d-9f26-86f473b11818 on nch1-master-1 Dec 18 20:58:13.658880 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-eaf56c87-486d-453c-95ce-06d1e5e172ea req-d183b6f6-57e9-46df-aa01-13d6d67c6cfb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Dec 18 20:58:13.663070 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1604/3139] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:13.715155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-446fc6f8-198e-4891-ae8a-d215b915994f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:13.716377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-446fc6f8-198e-4891-ae8a-d215b915994f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:13.724586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446fc6f8-198e-4891-ae8a-d215b915994f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:13.725216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446fc6f8-198e-4891-ae8a-d215b915994f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:13.726131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446fc6f8-198e-4891-ae8a-d215b915994f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:13.726695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446fc6f8-198e-4891-ae8a-d215b915994f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:13.798669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-446fc6f8-198e-4891-ae8a-d215b915994f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.086884 Dec 18 20:58:13.800631 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1536/3140] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:13 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:13.827610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:13.830836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:13.838738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:13.839643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:13.840679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:13.841382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:13.997964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:14.000386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:14.003789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:14.008292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.009098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.010207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.010687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.014389 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8aabafa2-78d5-49ac-9d3c-5ed68c8b2a86 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.194727 Dec 18 20:58:14.015589 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1605/3141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:13 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:14.123630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:14.125100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:14.132573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.133211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.134446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.135853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.177469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:14.184907 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a8015e4e-943b-4469-8deb-5f9ec62ecde6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1591 microversion: 2.1 time: 0.191093 Dec 18 20:58:14.185472 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1537/3142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:13 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1591 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:14.303792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:14.312120 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-454ac869-393b-4397-b896-96d102fe816e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1506 microversion: 2.1 time: 0.192302 Dec 18 20:58:14.313378 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1606/3143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:14 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:14.319140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-582fc766-2127-46e1-9814-2f2d3736e4d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:14.320168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-582fc766-2127-46e1-9814-2f2d3736e4d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:14.326637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-582fc766-2127-46e1-9814-2f2d3736e4d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.327615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-582fc766-2127-46e1-9814-2f2d3736e4d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.328689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-582fc766-2127-46e1-9814-2f2d3736e4d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.329333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-582fc766-2127-46e1-9814-2f2d3736e4d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.332162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2120215414", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:14.390647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:58:14.485094 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-582fc766-2127-46e1-9814-2f2d3736e4d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170206 Dec 18 20:58:14.486799 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1607/3144] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:58:14 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:14.605086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:14.605969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:14.616821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.617266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.618074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.618559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.688154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:58:14.688730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:58:14.690267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:58:14.691123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:58:14.691775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:58:14.718651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.721325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.722422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.723139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.781821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Getting quotas for project a4275f97662f4f3b8eed66d55e5f050b. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:58:14.805286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Getting quotas for user 932b394322e2458baa8e8057ca4a9c6a and project a4275f97662f4f3b8eed66d55e5f050b. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:58:14.828788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:58:14.833843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:58:14.892526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:14.900783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8bf639fc-265f-4420-bf5b-290660ce2dc2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1394 microversion: 2.1 time: 0.300875 Dec 18 20:58:14.910700 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1608/3145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:14 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1394 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:14.916196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c543024-cbfb-42c3-aa18-46a3420d98b7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:14.917596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c543024-cbfb-42c3-aa18-46a3420d98b7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:14.919660 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7676ed1b-6ce2-4153-a159-77b8c79838ad tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727288 Dec 18 20:58:14.924417 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1538/3146] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:58:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:58:14.929293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c543024-cbfb-42c3-aa18-46a3420d98b7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.931346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c543024-cbfb-42c3-aa18-46a3420d98b7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:14.934059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c62cdb13-81c9-411e-9b45-7363fab90291 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:14.934902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c62cdb13-81c9-411e-9b45-7363fab90291 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:14.935438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c543024-cbfb-42c3-aa18-46a3420d98b7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:14.936273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c543024-cbfb-42c3-aa18-46a3420d98b7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:15.023182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c62cdb13-81c9-411e-9b45-7363fab90291 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:15.030791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c62cdb13-81c9-411e-9b45-7363fab90291 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1217 microversion: 2.1 time: 0.103892 Dec 18 20:58:15.034125 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1539/3147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:14 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:15.044131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:15.044972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:15.046038 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c543024-cbfb-42c3-aa18-46a3420d98b7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.133965 Dec 18 20:58:15.047257 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1609/3148] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:14 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:15.064370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:15.066862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:15.067890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:15.072062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:15.374034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:15.384861 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-431466d4-12de-4348-bbf8-8c138c95b770 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.349338 Dec 18 20:58:15.386287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1540/3149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:15 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:15.840365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf1d4940-f9d1-4269-9074-fc6e57149201 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88cfbe27-4f06-4df2-b679-ca48269e92dd"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:15.842614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf1d4940-f9d1-4269-9074-fc6e57149201 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:15.850406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1d4940-f9d1-4269-9074-fc6e57149201 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:15.850859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1d4940-f9d1-4269-9074-fc6e57149201 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:15.851650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1d4940-f9d1-4269-9074-fc6e57149201 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:15.852084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1d4940-f9d1-4269-9074-fc6e57149201 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:15.917261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:15.917983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:15.926018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:15.926500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:15.927285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:15.927884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.102032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:16.114730 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82a6d5f4-0b1f-49c5-8b76-a4fd1e8df8b1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1574 microversion: 2.1 time: 0.201236 Dec 18 20:58:16.115314 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1541/3150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:15 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:16.122916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:16.125463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:16.146679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.147139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.148002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.148448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.149114 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf1d4940-f9d1-4269-9074-fc6e57149201 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "POST /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310549 Dec 18 20:58:16.149745 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1610/3151] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 20:58:15 2021] POST /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:58:16.161042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:16.161931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:16.168597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.169344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.170420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.171078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.189092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lazy-loading 'flavor' on Instance uuid f6fcab40-88c7-4902-a1b7-60f4caecbb80 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:58:16.296835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:16.308169 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6d2510e-3ad8-4d6f-ac77-6c0c77e20bf3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1269 microversion: 2.1 time: 0.151445 Dec 18 20:58:16.309268 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1611/3152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:16 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:16.318524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1199e71e-7bd9-41d7-b92f-b4ef5cc1c438 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:16.320164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1199e71e-7bd9-41d7-b92f-b4ef5cc1c438 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:16.351085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1199e71e-7bd9-41d7-b92f-b4ef5cc1c438 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.353033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1199e71e-7bd9-41d7-b92f-b4ef5cc1c438 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.353851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1199e71e-7bd9-41d7-b92f-b4ef5cc1c438 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.354805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1199e71e-7bd9-41d7-b92f-b4ef5cc1c438 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.446346 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1199e71e-7bd9-41d7-b92f-b4ef5cc1c438 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.135250 Dec 18 20:58:16.447017 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1612/3153] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:16 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:16.465674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e883833b-5420-40b5-84d5-804becaec56f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:16.469377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e883833b-5420-40b5-84d5-804becaec56f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:16.493375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e883833b-5420-40b5-84d5-804becaec56f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.494485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e883833b-5420-40b5-84d5-804becaec56f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.496558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e883833b-5420-40b5-84d5-804becaec56f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.497013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e883833b-5420-40b5-84d5-804becaec56f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.525187 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac62679d-d411-410a-9dbf-d12355cd1c8d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action" status: 200 len: 32 microversion: 2.1 time: 0.404450 Dec 18 20:58:16.528726 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1542/3154] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:16 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:16.546106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-64dc893f-bebe-44c6-9ae5-8cfa12cdc00e req-e3a34571-f799-4c63-9d66-1a866d9a6462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198e9dd2-01b2-4119-9848-b5c9db0cb7ca", "tag": "fea449d4-dbd8-44cd-99aa-d486449cf15d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:16.550028 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:16.550028 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:16.582468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-64dc893f-bebe-44c6-9ae5-8cfa12cdc00e req-e3a34571-f799-4c63-9d66-1a866d9a6462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.582985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-64dc893f-bebe-44c6-9ae5-8cfa12cdc00e req-e3a34571-f799-4c63-9d66-1a866d9a6462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.608837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e883833b-5420-40b5-84d5-804becaec56f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.156129 Dec 18 20:58:16.613041 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1613/3155] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:16 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:16.619533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fc1792b-5d89-43cb-b278-77088ccd9d18 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:16.620124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8fc1792b-5d89-43cb-b278-77088ccd9d18 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:16.624755 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-64dc893f-bebe-44c6-9ae5-8cfa12cdc00e req-e3a34571-f799-4c63-9d66-1a866d9a6462 service nova] Creating event network-changed:fea449d4-dbd8-44cd-99aa-d486449cf15d for instance 198e9dd2-01b2-4119-9848-b5c9db0cb7ca on nch2-master-1 Dec 18 20:58:16.633354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc1792b-5d89-43cb-b278-77088ccd9d18 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.633818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc1792b-5d89-43cb-b278-77088ccd9d18 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.638782 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-64dc893f-bebe-44c6-9ae5-8cfa12cdc00e req-e3a34571-f799-4c63-9d66-1a866d9a6462 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104993 Dec 18 20:58:16.639825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc1792b-5d89-43cb-b278-77088ccd9d18 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.640017 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1543/3156] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:16.640297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fc1792b-5d89-43cb-b278-77088ccd9d18 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.653980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:16.656036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:16.676985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.680775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.682228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:16.685297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:16.982755 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fc1792b-5d89-43cb-b278-77088ccd9d18 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.368347 Dec 18 20:58:16.986306 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1614/3157] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 20:58:16 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/os-interface => generated 284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:16.992414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:16.993240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:16.999718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.006537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.010750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.011377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.346710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:17.354404 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13c18255-9b3b-4a11-86b3-7f81c65aea91 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.708603 Dec 18 20:58:17.367031 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1544/3158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:16 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:17.373690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0b8202f1-1ccb-43cb-b22e-df56ba1f8a87 req-e799a4ea-7403-4c72-8426-e28a9ce3fd47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dfce29-5bdc-4127-9942-6377d7b7bc7e", "name": "network-vif-plugged", "status": "completed", "tag": "2ec8fed1-1707-4075-bc28-f12d86c90468"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:17.375608 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:17.375608 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:17.385520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0b8202f1-1ccb-43cb-b22e-df56ba1f8a87 req-e799a4ea-7403-4c72-8426-e28a9ce3fd47 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.396613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0b8202f1-1ccb-43cb-b22e-df56ba1f8a87 req-e799a4ea-7403-4c72-8426-e28a9ce3fd47 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.415321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0b8202f1-1ccb-43cb-b22e-df56ba1f8a87 req-e799a4ea-7403-4c72-8426-e28a9ce3fd47 service nova] Creating event network-vif-plugged:2ec8fed1-1707-4075-bc28-f12d86c90468 for instance 79dfce29-5bdc-4127-9942-6377d7b7bc7e on nch2-master-1 Dec 18 20:58:17.420792 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0b8202f1-1ccb-43cb-b22e-df56ba1f8a87 req-e799a4ea-7403-4c72-8426-e28a9ce3fd47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052515 Dec 18 20:58:17.421404 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1545/3159] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:17.426864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:17.427564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:17.435431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.435882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.436964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.437410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.487764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:17.508755 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7437215-ac87-4bdb-93c5-c4b2e71390fd tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.523808 Dec 18 20:58:17.519846 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1615/3160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:16 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:17.519846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d57c0efe-28b8-418b-b03b-7f42ddd8bde9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:17.519846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d57c0efe-28b8-418b-b03b-7f42ddd8bde9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:17.526519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d57c0efe-28b8-418b-b03b-7f42ddd8bde9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.527382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d57c0efe-28b8-418b-b03b-7f42ddd8bde9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.529177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d57c0efe-28b8-418b-b03b-7f42ddd8bde9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.529738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d57c0efe-28b8-418b-b03b-7f42ddd8bde9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.589868 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d57c0efe-28b8-418b-b03b-7f42ddd8bde9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.077082 Dec 18 20:58:17.595455 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1616/3161] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:17 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:17.602300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:17.615878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52f19f19-b64d-4dfc-b53c-01bbef92bb68 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1275 microversion: 2.1 time: 0.192209 Dec 18 20:58:17.616741 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1546/3162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:17 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:17.622985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bcc6a919-f29b-4770-a231-88b03fb1f445 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:17.624957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bcc6a919-f29b-4770-a231-88b03fb1f445 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:17.652063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcc6a919-f29b-4770-a231-88b03fb1f445 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.652535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcc6a919-f29b-4770-a231-88b03fb1f445 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.653356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcc6a919-f29b-4770-a231-88b03fb1f445 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:17.653804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcc6a919-f29b-4770-a231-88b03fb1f445 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:17.795641 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bcc6a919-f29b-4770-a231-88b03fb1f445 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.177649 Dec 18 20:58:17.799963 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1617/3163] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:17 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:58:18.378091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:18.378885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:18.395219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.395950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.397092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.397671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.528124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:18.528824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:18.537452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.537903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.539004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.539613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.586970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:18.596013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c17697f-53a2-47a2-b82b-6d3152b32811 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1315 microversion: 2.1 time: 0.225645 Dec 18 20:58:18.598780 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1547/3164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:18 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:18.604534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-be453499-1796-4039-af24-3acb65d38dd6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:18.605501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-be453499-1796-4039-af24-3acb65d38dd6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:18.613614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be453499-1796-4039-af24-3acb65d38dd6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.614145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be453499-1796-4039-af24-3acb65d38dd6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.616210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be453499-1796-4039-af24-3acb65d38dd6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.616664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be453499-1796-4039-af24-3acb65d38dd6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.674937 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-be453499-1796-4039-af24-3acb65d38dd6 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.073194 Dec 18 20:58:18.681342 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1548/3165] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:18 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:18.688408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:18.689115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:18.697905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.698392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.699194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.699629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.703285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:18.722089 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ad0dd13-f6ad-4043-848b-597bf63fa07f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.197949 Dec 18 20:58:18.732159 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1618/3166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:18 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:18.772743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:18.781819 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dfce8644-6f1d-4483-8132-bd818c149354 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1275 microversion: 2.1 time: 0.099125 Dec 18 20:58:18.782811 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1549/3167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:18 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:18.808130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e07a685-bd98-4cbe-be38-2a9f0a7c78f3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:18.809872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e07a685-bd98-4cbe-be38-2a9f0a7c78f3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:18.820366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e07a685-bd98-4cbe-be38-2a9f0a7c78f3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.820906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e07a685-bd98-4cbe-be38-2a9f0a7c78f3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.821864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e07a685-bd98-4cbe-be38-2a9f0a7c78f3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:18.822347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e07a685-bd98-4cbe-be38-2a9f0a7c78f3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:18.860368 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e07a685-bd98-4cbe-be38-2a9f0a7c78f3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.056614 Dec 18 20:58:18.863570 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1619/3168] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:18 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:19.244323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ea0dc39-ae1e-4b50-92d3-e718fc1a5fd3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:19.245274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4ea0dc39-ae1e-4b50-92d3-e718fc1a5fd3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:19.246131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-de6b6d97-00c1-491e-951d-65ece47171d5 req-0de4987e-3506-432c-b33c-9aabc1632779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3cf0f4-2856-469d-9f26-86f473b11818", "tag": "b4996ca0-f713-420d-9ffb-a367ca1896f7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:19.247858 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:19.247858 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:19.253023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ea0dc39-ae1e-4b50-92d3-e718fc1a5fd3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.253635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ea0dc39-ae1e-4b50-92d3-e718fc1a5fd3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.254530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ea0dc39-ae1e-4b50-92d3-e718fc1a5fd3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.254975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ea0dc39-ae1e-4b50-92d3-e718fc1a5fd3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.265470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-de6b6d97-00c1-491e-951d-65ece47171d5 req-0de4987e-3506-432c-b33c-9aabc1632779 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.266472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-de6b6d97-00c1-491e-951d-65ece47171d5 req-0de4987e-3506-432c-b33c-9aabc1632779 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.304698 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-de6b6d97-00c1-491e-951d-65ece47171d5 req-0de4987e-3506-432c-b33c-9aabc1632779 service nova] Creating event network-changed:b4996ca0-f713-420d-9ffb-a367ca1896f7 for instance ec3cf0f4-2856-469d-9f26-86f473b11818 on nch1-master-1 Dec 18 20:58:19.320097 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ea0dc39-ae1e-4b50-92d3-e718fc1a5fd3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.086496 Dec 18 20:58:19.322601 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-de6b6d97-00c1-491e-951d-65ece47171d5 req-0de4987e-3506-432c-b33c-9aabc1632779 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081126 Dec 18 20:58:19.323476 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1620/3169] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:19.324008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1550/3170] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:19 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:19.615371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:19.616073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:19.620208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6822fa2c-a3cf-4286-8346-4d539b02278f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:19.621292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6822fa2c-a3cf-4286-8346-4d539b02278f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:19.629031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.629493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.630325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.630589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6822fa2c-a3cf-4286-8346-4d539b02278f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.630766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.631742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6822fa2c-a3cf-4286-8346-4d539b02278f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.632720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6822fa2c-a3cf-4286-8346-4d539b02278f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.633319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6822fa2c-a3cf-4286-8346-4d539b02278f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.676289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6822fa2c-a3cf-4286-8346-4d539b02278f tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071084 Dec 18 20:58:19.682685 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1621/3171] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:58:19 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:19.688314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:19.689718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:19.697869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.698640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.699598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.700970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.800183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lazy-loading 'services' on Instance uuid 0767c760-b97d-4335-9e04-aea2214c110a {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:58:19.824100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:19.839571 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eea7bade-7578-4ea6-b696-1eb9c653bc05 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1501 microversion: 2.1 time: 0.228313 Dec 18 20:58:19.851298 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1551/3172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:19 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:19.866484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e51991d-c478-44bf-b8ee-941a021c3515 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:19.866919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2e51991d-c478-44bf-b8ee-941a021c3515 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:19.875242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e51991d-c478-44bf-b8ee-941a021c3515 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.875806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e51991d-c478-44bf-b8ee-941a021c3515 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.877743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e51991d-c478-44bf-b8ee-941a021c3515 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.878652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e51991d-c478-44bf-b8ee-941a021c3515 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.895239 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ef57559e-20b2-4098-970f-37ee046938aa tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments/88cfbe27-4f06-4df2-b679-ca48269e92dd" status: 202 len: 0 microversion: 2.1 time: 0.210291 Dec 18 20:58:19.895962 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1622/3173] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 20:58:19 2021] DELETE /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments/88cfbe27-4f06-4df2-b679-ca48269e92dd => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:19.906458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:19.907420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:19.916432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.917027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.917979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.918790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.947594 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2e51991d-c478-44bf-b8ee-941a021c3515 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.093045 Dec 18 20:58:19.950371 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1552/3174] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:19 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:19.961795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:19.965334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:19.978988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.979441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:19.980243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:19.980680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.208116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:20.230680 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-128e6d22-4c13-45a6-aaac-b18f482110fe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.275819 Dec 18 20:58:20.231312 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1553/3175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:19 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:20.232983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:20.240394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8677050b-b40c-453f-a090-b3c9bde50990 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:20.241224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8677050b-b40c-453f-a090-b3c9bde50990 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:20.247744 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5f907b85-22c0-47b8-96c2-9ced9418c39d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.346605 Dec 18 20:58:20.252148 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1623/3176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:19 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:20.252981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8677050b-b40c-453f-a090-b3c9bde50990 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.253539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8677050b-b40c-453f-a090-b3c9bde50990 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.254798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8677050b-b40c-453f-a090-b3c9bde50990 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.255472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8677050b-b40c-453f-a090-b3c9bde50990 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.258980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6914c42-0bc6-49fd-b32d-9370d33dd137 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:20.260311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6914c42-0bc6-49fd-b32d-9370d33dd137 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:20.267770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6914c42-0bc6-49fd-b32d-9370d33dd137 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.268972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6914c42-0bc6-49fd-b32d-9370d33dd137 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.269950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6914c42-0bc6-49fd-b32d-9370d33dd137 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.270621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6914c42-0bc6-49fd-b32d-9370d33dd137 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.332007 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6914c42-0bc6-49fd-b32d-9370d33dd137 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077902 Dec 18 20:58:20.333084 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1624/3177] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:20 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:20.339349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-495864f9-33fc-48a8-aabe-e6177453c8e0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:20.340698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-495864f9-33fc-48a8-aabe-e6177453c8e0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:20.353665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495864f9-33fc-48a8-aabe-e6177453c8e0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.355164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495864f9-33fc-48a8-aabe-e6177453c8e0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.356044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495864f9-33fc-48a8-aabe-e6177453c8e0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.356514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495864f9-33fc-48a8-aabe-e6177453c8e0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.379823 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8677050b-b40c-453f-a090-b3c9bde50990 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e/action" status: 202 len: 0 microversion: 2.1 time: 0.145852 Dec 18 20:58:20.381510 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1554/3178] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:20 2021] POST /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:20.407106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:20.407865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:20.416749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.417411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.421973 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-495864f9-33fc-48a8-aabe-e6177453c8e0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.086809 Dec 18 20:58:20.422987 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1625/3179] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:20 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:20.424623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.425336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.647273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:20.659182 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bd468115-03d4-4af3-8ba8-2102cdb8f797 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1506 microversion: 2.1 time: 0.272435 Dec 18 20:58:20.667362 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1555/3180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:20 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:20.962721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b650c52-d108-48f3-a234-3706a0d07c06 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:20.964187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b650c52-d108-48f3-a234-3706a0d07c06 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:20.976880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b650c52-d108-48f3-a234-3706a0d07c06 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.977335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b650c52-d108-48f3-a234-3706a0d07c06 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:20.978157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b650c52-d108-48f3-a234-3706a0d07c06 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:20.978651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b650c52-d108-48f3-a234-3706a0d07c06 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.043934 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b650c52-d108-48f3-a234-3706a0d07c06 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.083928 Dec 18 20:58:21.050933 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1626/3181] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:20 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:21.107268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fde9700c-9bee-411e-a335-65b842820185 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:21.108190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fde9700c-9bee-411e-a335-65b842820185 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.115510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fde9700c-9bee-411e-a335-65b842820185 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.116074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fde9700c-9bee-411e-a335-65b842820185 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.117057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fde9700c-9bee-411e-a335-65b842820185 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.117804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fde9700c-9bee-411e-a335-65b842820185 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.152454 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fde9700c-9bee-411e-a335-65b842820185 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048850 Dec 18 20:58:21.153500 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1556/3182] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:58:21 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:21.241461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6c65df0-72a4-431c-a8c0-40df5047bc8e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:21.242922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6c65df0-72a4-431c-a8c0-40df5047bc8e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.248701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:21.249347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.262417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.263136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.264122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.267993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c65df0-72a4-431c-a8c0-40df5047bc8e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.268868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.271940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c65df0-72a4-431c-a8c0-40df5047bc8e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.272890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c65df0-72a4-431c-a8c0-40df5047bc8e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.275451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c65df0-72a4-431c-a8c0-40df5047bc8e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.338075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6c65df0-72a4-431c-a8c0-40df5047bc8e tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101652 Dec 18 20:58:21.339675 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1627/3183] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:58:21 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:21.348724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:21.349648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.355627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.356095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.356897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.357366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.497857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:21.506325 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2cf1c24-e7b0-4f41-bd1a-eb5a4cf06170 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.261749 Dec 18 20:58:21.507220 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1557/3184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:21 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:21.512257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2b52696-52d5-4fb7-954a-9c4372e8f6b0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:21.513171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2b52696-52d5-4fb7-954a-9c4372e8f6b0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.519657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2b52696-52d5-4fb7-954a-9c4372e8f6b0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.520502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2b52696-52d5-4fb7-954a-9c4372e8f6b0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.521308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2b52696-52d5-4fb7-954a-9c4372e8f6b0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.521890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2b52696-52d5-4fb7-954a-9c4372e8f6b0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.562535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2b52696-52d5-4fb7-954a-9c4372e8f6b0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.053726 Dec 18 20:58:21.563177 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1558/3185] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:21 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:21.563562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:21.569274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-82d826ea-8b53-411a-aa5c-bf810a4d449b req-cf81bec9-6903-44f5-83cf-41e44ae6f5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479eeab2-5ceb-4408-b0a1-4d5eca0abc0e", "tag": "8de86d40-0ffe-4a89-ae60-fdfa7a44d805"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:21.570767 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:21.570767 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:21.572440 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81e32fb6-9bc5-4346-a7eb-d1f20be2dfd6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.231520 Dec 18 20:58:21.573042 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1628/3186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:21 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:21.577337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:21.577833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.582858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-82d826ea-8b53-411a-aa5c-bf810a4d449b req-cf81bec9-6903-44f5-83cf-41e44ae6f5ab service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.583437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-82d826ea-8b53-411a-aa5c-bf810a4d449b req-cf81bec9-6903-44f5-83cf-41e44ae6f5ab service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.583811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.584267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.585064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.585516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.594698 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-82d826ea-8b53-411a-aa5c-bf810a4d449b req-cf81bec9-6903-44f5-83cf-41e44ae6f5ab service nova] Creating event network-changed:8de86d40-0ffe-4a89-ae60-fdfa7a44d805 for instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e on nch1-master-1 Dec 18 20:58:21.599746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-82d826ea-8b53-411a-aa5c-bf810a4d449b req-cf81bec9-6903-44f5-83cf-41e44ae6f5ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035014 Dec 18 20:58:21.600663 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1559/3187] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:21.605643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7147500-91c9-474e-aeb6-89f6177b70d1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:21.606670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7147500-91c9-474e-aeb6-89f6177b70d1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.609816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:58:21.613555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7147500-91c9-474e-aeb6-89f6177b70d1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.614017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7147500-91c9-474e-aeb6-89f6177b70d1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.614873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7147500-91c9-474e-aeb6-89f6177b70d1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.615265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7147500-91c9-474e-aeb6-89f6177b70d1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.658787 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7147500-91c9-474e-aeb6-89f6177b70d1 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.056752 Dec 18 20:58:21.662134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1560/3188] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:21 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:21.684562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:21.685087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.693227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.693679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.694593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.694930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.708468 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-445d6217-6e81-47d8-a815-b15364297d29 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 204 len: 0 microversion: 2.1 time: 0.134191 Dec 18 20:58:21.709316 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1629/3189] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:21 2021] DELETE /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:58:21.718166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:21.718947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.726484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.726959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.727880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.728322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.907712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:21.915248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:21.916044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-474d02a0-6a14-4a65-bfec-73bb1cc2587a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1486 microversion: 2.1 time: 0.235856 Dec 18 20:58:21.927751 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1561/3190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:21 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1486 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:21.927929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-174460eb-23c4-4445-8e4c-4733cd96ad47 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1512 microversion: 2.1 time: 0.209006 Dec 18 20:58:21.927929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1630/3191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:21 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:21.932706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:21.933276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:21.939204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.939654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.940686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:21.941119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:21.965402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lazy-loading 'flavor' on Instance uuid 79dfce29-5bdc-4127-9942-6377d7b7bc7e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:58:22.068035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70cf7078-7b6c-4392-9742-356f74ab19f8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:22.069581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70cf7078-7b6c-4392-9742-356f74ab19f8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:22.080479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70cf7078-7b6c-4392-9742-356f74ab19f8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.085518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70cf7078-7b6c-4392-9742-356f74ab19f8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.086812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70cf7078-7b6c-4392-9742-356f74ab19f8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.087239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70cf7078-7b6c-4392-9742-356f74ab19f8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.146453 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70cf7078-7b6c-4392-9742-356f74ab19f8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.087592 Dec 18 20:58:22.152270 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1631/3192] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:22 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:22.248098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da982db0-0414-45a6-8354-12419e78048f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e/action" status: 202 len: 0 microversion: 2.1 time: 0.318363 Dec 18 20:58:22.250294 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1562/3193] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:21 2021] POST /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:58:22.257424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:22.258270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:22.266070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.266739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.268411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.268997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.426790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:22.435977 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d11df55d-a421-47e9-ba76-14583ab216e4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1492 microversion: 2.1 time: 0.182568 Dec 18 20:58:22.436588 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1632/3194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:22 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1492 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:22.525782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:22.526491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:22.533329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.533791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.534619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.535060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.573928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e21fa996-c563-4b47-a921-271f102e73b2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:22.574888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e21fa996-c563-4b47-a921-271f102e73b2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:22.581938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e21fa996-c563-4b47-a921-271f102e73b2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.582427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e21fa996-c563-4b47-a921-271f102e73b2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.583233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e21fa996-c563-4b47-a921-271f102e73b2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.583917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e21fa996-c563-4b47-a921-271f102e73b2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.621769 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e21fa996-c563-4b47-a921-271f102e73b2 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.051303 Dec 18 20:58:22.624782 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1633/3195] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:22 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:58:22.627868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:22.628556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:22.635380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.635829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.636639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.637208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.670690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:22.678341 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9cdd9abf-ccbb-4eed-97df-03c7d17782c6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.158334 Dec 18 20:58:22.678867 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1563/3196] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:22 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:22.683581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-14b05578-3445-49ea-8cdc-35001beac68a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:22.684546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-14b05578-3445-49ea-8cdc-35001beac68a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:22.691418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14b05578-3445-49ea-8cdc-35001beac68a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.691869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14b05578-3445-49ea-8cdc-35001beac68a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.692660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14b05578-3445-49ea-8cdc-35001beac68a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.693098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14b05578-3445-49ea-8cdc-35001beac68a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.741482 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-14b05578-3445-49ea-8cdc-35001beac68a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.061022 Dec 18 20:58:22.742058 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1564/3197] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:22 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:22.774128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:22.781967 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a7a91af-ea8a-41a6-ba6d-80b7eeb14155 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.158265 Dec 18 20:58:22.782564 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1634/3198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:22 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:22.942120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:22.942773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:22.949944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.950425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:22.951232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:22.951668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.084690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:23.092087 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f608b02-06f0-4b5c-8e86-57afc54c3377 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1512 microversion: 2.1 time: 0.155108 Dec 18 20:58:23.092884 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1565/3199] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:22 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:23.159453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7113c7ef-be8d-4925-86b6-b11ac9e1b6ba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:23.160413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7113c7ef-be8d-4925-86b6-b11ac9e1b6ba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:23.168087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7113c7ef-be8d-4925-86b6-b11ac9e1b6ba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.168538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7113c7ef-be8d-4925-86b6-b11ac9e1b6ba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.169313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7113c7ef-be8d-4925-86b6-b11ac9e1b6ba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.169752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7113c7ef-be8d-4925-86b6-b11ac9e1b6ba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.213696 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7113c7ef-be8d-4925-86b6-b11ac9e1b6ba tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.057847 Dec 18 20:58:23.214269 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1635/3200] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:23 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:23.452645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:23.453204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:23.460614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.461356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.462025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.462478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.601199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:23.610215 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-02314f8e-e596-4a3d-b233-9798b39402aa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1513 microversion: 2.1 time: 0.161197 Dec 18 20:58:23.611302 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1566/3201] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:23 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:23.632841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-759055c8-19c1-4499-a63b-184c953d4cc0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:23.634056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-759055c8-19c1-4499-a63b-184c953d4cc0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:23.641259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759055c8-19c1-4499-a63b-184c953d4cc0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.641974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759055c8-19c1-4499-a63b-184c953d4cc0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.643413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759055c8-19c1-4499-a63b-184c953d4cc0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.643954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-759055c8-19c1-4499-a63b-184c953d4cc0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.691401 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-759055c8-19c1-4499-a63b-184c953d4cc0 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.060446 Dec 18 20:58:23.693200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1636/3202] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:23 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:23.694824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:23.695967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:23.703483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.719457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.722738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.723329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.756357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a5d2bd5-d170-4e56-bec1-c979abe11d50 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:23.757517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a5d2bd5-d170-4e56-bec1-c979abe11d50 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:23.766219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a5d2bd5-d170-4e56-bec1-c979abe11d50 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.767012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a5d2bd5-d170-4e56-bec1-c979abe11d50 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.768495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a5d2bd5-d170-4e56-bec1-c979abe11d50 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.769090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a5d2bd5-d170-4e56-bec1-c979abe11d50 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.835738 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a5d2bd5-d170-4e56-bec1-c979abe11d50 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.084733 Dec 18 20:58:23.836943 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1637/3203] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:23 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:23.844521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-fd57e62b-8204-4e95-a401-29eb2219bb2d req-66cbc12f-b401-4309-870d-6807fa8a9b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0767c760-b97d-4335-9e04-aea2214c110a", "name": "network-vif-deleted", "tag": "edd02058-579e-40a1-b93e-f4c46ed1137b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:23.847750 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:23.847750 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:23.862435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fd57e62b-8204-4e95-a401-29eb2219bb2d req-66cbc12f-b401-4309-870d-6807fa8a9b2a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.866583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fd57e62b-8204-4e95-a401-29eb2219bb2d req-66cbc12f-b401-4309-870d-6807fa8a9b2a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.880937 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-fd57e62b-8204-4e95-a401-29eb2219bb2d req-66cbc12f-b401-4309-870d-6807fa8a9b2a service nova] Creating event network-vif-deleted:edd02058-579e-40a1-b93e-f4c46ed1137b for instance 0767c760-b97d-4335-9e04-aea2214c110a on nch2-master-1 Dec 18 20:58:23.886953 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-fd57e62b-8204-4e95-a401-29eb2219bb2d req-66cbc12f-b401-4309-870d-6807fa8a9b2a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048225 Dec 18 20:58:23.887774 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1638/3204] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:23.894107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:23.894874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:23.901305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.901817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.902650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:23.903088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:23.943249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:23.953157 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d5f6e754-4e5d-4a98-b6c9-c19325cc4ad6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.261982 Dec 18 20:58:23.954006 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1567/3205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:23 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:24.100331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:24.108622 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae582063-6b06-4515-a766-cd2bbaa327d2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.219613 Dec 18 20:58:24.109004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:24.109201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1639/3206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:23 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:24.109687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:24.116591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.117044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.117841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.118421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.151257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.151718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.152176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lazy-loading 'fault' on Instance uuid 0767c760-b97d-4335-9e04-aea2214c110a {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:58:24.192861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaead8443a7492db118aa577386a88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69c5059282455ca98cc9bff0fe1c94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:24.200011 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3404e85d-7e0c-40e1-a559-009c53b2279c tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 200 len: 1307 microversion: 2.1 time: 0.094853 Dec 18 20:58:24.200668 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1568/3207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:24 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:24.225871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-15a46534-79bd-4b06-8186-3e2cf1fdcd54 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:24.226903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-15a46534-79bd-4b06-8186-3e2cf1fdcd54 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:24.233799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15a46534-79bd-4b06-8186-3e2cf1fdcd54 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.234422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15a46534-79bd-4b06-8186-3e2cf1fdcd54 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.235042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15a46534-79bd-4b06-8186-3e2cf1fdcd54 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.235641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15a46534-79bd-4b06-8186-3e2cf1fdcd54 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.286825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-15a46534-79bd-4b06-8186-3e2cf1fdcd54 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.065200 Dec 18 20:58:24.287678 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1640/3208] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:24 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:24.628200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:24.628935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:24.638276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.639554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.641115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.642090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.706448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c0c72f25-5518-454b-8c90-6b89d4279b86 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:24.710573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c0c72f25-5518-454b-8c90-6b89d4279b86 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:24.733962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0c72f25-5518-454b-8c90-6b89d4279b86 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.734471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0c72f25-5518-454b-8c90-6b89d4279b86 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.735626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0c72f25-5518-454b-8c90-6b89d4279b86 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.736639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0c72f25-5518-454b-8c90-6b89d4279b86 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.790440 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c0c72f25-5518-454b-8c90-6b89d4279b86 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.088403 Dec 18 20:58:24.791370 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1641/3209] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:24 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:24.848548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7aee541c-e211-4704-9a13-a3a4405bfac7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:24.849818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7aee541c-e211-4704-9a13-a3a4405bfac7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:24.858473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aee541c-e211-4704-9a13-a3a4405bfac7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.858655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aee541c-e211-4704-9a13-a3a4405bfac7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.859527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aee541c-e211-4704-9a13-a3a4405bfac7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.860647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aee541c-e211-4704-9a13-a3a4405bfac7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.864191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:24.874291 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed73c1ab-4fb3-4680-adce-677ed76e865d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.250483 Dec 18 20:58:24.877831 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1569/3210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:24 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:24.918246 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7aee541c-e211-4704-9a13-a3a4405bfac7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.073959 Dec 18 20:58:24.918443 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1642/3211] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:24 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:58:24.973174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:24.974227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:24.982327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.983082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:24.984273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:24.984941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.126690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:25.127453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:25.145528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.145992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.146847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.147292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.195681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:25.203117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85064284-ce54-402d-969b-f5f54cd64199 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.236495 Dec 18 20:58:25.203711 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1570/3212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:24 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:25.223959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:25.227508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:25.239319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.240044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.243542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.244154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.276857 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] HTTP exception thrown: Instance 0767c760-b97d-4335-9e04-aea2214c110a could not be found. Dec 18 20:58:25.280930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Returning 404 to user: Instance 0767c760-b97d-4335-9e04-aea2214c110a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:25.282138 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f0f560fa-8c6a-4a92-b7a4-12b7350351bb tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 404 len: 111 microversion: 2.1 time: 0.066437 Dec 18 20:58:25.284615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1571/3213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:25 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:58:25.319122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef15383c-d202-42ec-b217-ccaa1453aac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:25.320537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef15383c-d202-42ec-b217-ccaa1453aac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:25.340695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15383c-d202-42ec-b217-ccaa1453aac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.341155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15383c-d202-42ec-b217-ccaa1453aac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.341965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15383c-d202-42ec-b217-ccaa1453aac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.342434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15383c-d202-42ec-b217-ccaa1453aac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.342927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:25.353703 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bcf28b8d-9838-4021-8a88-12f974c0a6fb tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.231944 Dec 18 20:58:25.355209 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1643/3214] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:25 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:25.443049 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef15383c-d202-42ec-b217-ccaa1453aac3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.141126 Dec 18 20:58:25.444225 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1572/3215] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:25 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:25.802397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06b961ec-f434-420b-ac99-c2d30041494f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:25.803700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06b961ec-f434-420b-ac99-c2d30041494f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:25.822550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06b961ec-f434-420b-ac99-c2d30041494f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.823239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06b961ec-f434-420b-ac99-c2d30041494f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.824318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06b961ec-f434-420b-ac99-c2d30041494f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.826530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06b961ec-f434-420b-ac99-c2d30041494f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.883231 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06b961ec-f434-420b-ac99-c2d30041494f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.084265 Dec 18 20:58:25.886026 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1644/3216] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:25 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:25.896862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:25.897716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:25.906522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.906958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.920685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.921157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.933381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-37782309-2ede-41bb-9ab5-81e849601dfa tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:25.934590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-37782309-2ede-41bb-9ab5-81e849601dfa tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:25.959425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37782309-2ede-41bb-9ab5-81e849601dfa tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.960707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37782309-2ede-41bb-9ab5-81e849601dfa tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:25.961529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37782309-2ede-41bb-9ab5-81e849601dfa tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:25.968928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37782309-2ede-41bb-9ab5-81e849601dfa tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.069496 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-37782309-2ede-41bb-9ab5-81e849601dfa tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.143760 Dec 18 20:58:26.071827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1645/3217] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:25 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:58:26.157706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:26.167536 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-622fb2eb-3733-4ffe-80f8-223a537ca3dd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.275564 Dec 18 20:58:26.168121 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1573/3218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:25 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:26.221726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:26.224643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:26.237100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.237551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.238402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.248706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.373960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:26.375299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:26.392236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.393327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.394642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.395204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.527868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:26.542847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-764a09cf-dfa5-4be9-a657-0d1e54c4a784 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.326173 Dec 18 20:58:26.555843 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1646/3219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:26 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:26.571148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-043fbf4c-1616-4c00-871c-07bc8c9e87ad tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:26.579484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-043fbf4c-1616-4c00-871c-07bc8c9e87ad tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:26.592661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043fbf4c-1616-4c00-871c-07bc8c9e87ad tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.599489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043fbf4c-1616-4c00-871c-07bc8c9e87ad tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.600523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043fbf4c-1616-4c00-871c-07bc8c9e87ad tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.602858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043fbf4c-1616-4c00-871c-07bc8c9e87ad tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.697818 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-043fbf4c-1616-4c00-871c-07bc8c9e87ad tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.139649 Dec 18 20:58:26.705336 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1647/3220] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:26 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:26.806548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:26.823438 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0506b904-95fd-44d8-95a7-1a6fd599f485 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.454092 Dec 18 20:58:26.825573 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1574/3221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:26 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:26.896851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ec0188e4-cd95-48d7-b332-0996e34d5f46 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:26.898151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ec0188e4-cd95-48d7-b332-0996e34d5f46 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:26.911301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0188e4-cd95-48d7-b332-0996e34d5f46 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.913775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0188e4-cd95-48d7-b332-0996e34d5f46 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.915440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0188e4-cd95-48d7-b332-0996e34d5f46 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.916711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec0188e4-cd95-48d7-b332-0996e34d5f46 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.917087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3d903a57-a2b2-49a5-ac3b-67947e0b02a7 req-088ea526-f44e-410f-9dc4-6d4cd621d1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dfce29-5bdc-4127-9942-6377d7b7bc7e", "name": "network-vif-plugged", "status": "completed", "tag": "2ec8fed1-1707-4075-bc28-f12d86c90468"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:26.919253 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:26.919253 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:26.929341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3d903a57-a2b2-49a5-ac3b-67947e0b02a7 req-088ea526-f44e-410f-9dc4-6d4cd621d1cf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:26.930094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3d903a57-a2b2-49a5-ac3b-67947e0b02a7 req-088ea526-f44e-410f-9dc4-6d4cd621d1cf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:26.947475 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3d903a57-a2b2-49a5-ac3b-67947e0b02a7 req-088ea526-f44e-410f-9dc4-6d4cd621d1cf service nova] Creating event network-vif-plugged:2ec8fed1-1707-4075-bc28-f12d86c90468 for instance 79dfce29-5bdc-4127-9942-6377d7b7bc7e on nch2-master-1 Dec 18 20:58:26.960931 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3d903a57-a2b2-49a5-ac3b-67947e0b02a7 req-088ea526-f44e-410f-9dc4-6d4cd621d1cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049007 Dec 18 20:58:26.964742 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1575/3222] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:26.996152 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ec0188e4-cd95-48d7-b332-0996e34d5f46 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 14 microversion: 2.1 time: 0.103903 Dec 18 20:58:26.999419 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1648/3223] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:26 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:27.081572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-139eb7d6-d594-4cb8-a25b-dbe2d5e97ab5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:27.083258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-139eb7d6-d594-4cb8-a25b-dbe2d5e97ab5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:27.092247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139eb7d6-d594-4cb8-a25b-dbe2d5e97ab5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.092933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139eb7d6-d594-4cb8-a25b-dbe2d5e97ab5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.094042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139eb7d6-d594-4cb8-a25b-dbe2d5e97ab5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.094913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139eb7d6-d594-4cb8-a25b-dbe2d5e97ab5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.154418 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-139eb7d6-d594-4cb8-a25b-dbe2d5e97ab5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.077049 Dec 18 20:58:27.158572 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1576/3224] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:27 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:27.185380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:27.186102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:27.201461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.201903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.204724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.204841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.393917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:27.413942 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3d5619f-40a9-4ffe-bbe0-b5ae4b40b80d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.232225 Dec 18 20:58:27.425692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1649/3225] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:27 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:27.572257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:27.573020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:27.580759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.581447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.582278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.582715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.720714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4e9afb2-1974-47ca-8be7-6a4fadce534e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:27.721994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f4e9afb2-1974-47ca-8be7-6a4fadce534e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:27.732090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4e9afb2-1974-47ca-8be7-6a4fadce534e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.732890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4e9afb2-1974-47ca-8be7-6a4fadce534e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.733878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4e9afb2-1974-47ca-8be7-6a4fadce534e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.734699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4e9afb2-1974-47ca-8be7-6a4fadce534e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.745158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:27.756164 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f1ee27f-542a-4924-a7d8-563ea5a57510 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.187904 Dec 18 20:58:27.756831 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1577/3226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:27 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:27.785235 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4e9afb2-1974-47ca-8be7-6a4fadce534e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.075871 Dec 18 20:58:27.787798 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1650/3227] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:27 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:27.856929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:27.857651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:27.865200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.865742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.866796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.867440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.951991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:27.952787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:27.961108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.961780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.962785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:27.963374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:27.983345 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] HTTP exception thrown: Instance 0767c760-b97d-4335-9e04-aea2214c110a could not be found. Dec 18 20:58:27.983971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Returning 404 to user: Instance 0767c760-b97d-4335-9e04-aea2214c110a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:27.984847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4efdebe2-5086-481f-a690-a86e96e76cf0 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 404 len: 111 microversion: 2.1 time: 0.037319 Dec 18 20:58:27.985684 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1651/3228] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:27 2021] DELETE /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:58:27.995137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:27.996063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] [instance: 0767c760-b97d-4335-9e04-aea2214c110a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:28.007784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.008341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.009181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.009586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.059986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:28.070121 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] HTTP exception thrown: Instance 0767c760-b97d-4335-9e04-aea2214c110a could not be found. Dec 18 20:58:28.070121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] Returning 404 to user: Instance 0767c760-b97d-4335-9e04-aea2214c110a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:28.070760 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e656f725-b0b5-483a-b58c-cead918f71c5 tempest-AttachSCSIVolumeTestJSON-250543757 tempest-AttachSCSIVolumeTestJSON-250543757-project] 10.222.0.13 "GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a" status: 404 len: 111 microversion: 2.1 time: 0.080544 Dec 18 20:58:28.074351 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1652/3229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:27 2021] GET /compute/v2.1/servers/0767c760-b97d-4335-9e04-aea2214c110a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:58:28.074499 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-167d9bdf-8250-4df7-8567-7596680ea62d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.221072 Dec 18 20:58:28.074499 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1578/3230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:27 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:28.087044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9329844-ef31-416f-9266-0436d5cb70a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:28.088071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9329844-ef31-416f-9266-0436d5cb70a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:28.101252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9329844-ef31-416f-9266-0436d5cb70a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.101715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9329844-ef31-416f-9266-0436d5cb70a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.102564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9329844-ef31-416f-9266-0436d5cb70a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.103016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9329844-ef31-416f-9266-0436d5cb70a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.163037 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9329844-ef31-416f-9266-0436d5cb70a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 8204 microversion: 2.1 time: 0.086473 Dec 18 20:58:28.164295 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1653/3231] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:28 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 8204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:28.171242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3e194190-b99f-4d28-bc03-7deb63ad809a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:28.172490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3e194190-b99f-4d28-bc03-7deb63ad809a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:28.179574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e194190-b99f-4d28-bc03-7deb63ad809a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.180066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e194190-b99f-4d28-bc03-7deb63ad809a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.180898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e194190-b99f-4d28-bc03-7deb63ad809a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.181365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e194190-b99f-4d28-bc03-7deb63ad809a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.246237 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3e194190-b99f-4d28-bc03-7deb63ad809a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 14 microversion: 2.1 time: 0.082291 Dec 18 20:58:28.249034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1579/3232] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:28 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 20:58:28.436658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:28.438046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:28.446013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.446741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.449119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.449736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.685994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:28.696145 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b253190-819f-4f07-aec5-fb0a10d8f9a8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.266806 Dec 18 20:58:28.697062 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1654/3233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:28 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:28.775199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:28.776186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:28.786097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.790765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.791914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.797061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-64cf4aea-3edc-4c43-8eb6-daa21c6275f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:28.798735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-64cf4aea-3edc-4c43-8eb6-daa21c6275f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:28.803997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.809891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64cf4aea-3edc-4c43-8eb6-daa21c6275f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.815230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64cf4aea-3edc-4c43-8eb6-daa21c6275f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.816237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64cf4aea-3edc-4c43-8eb6-daa21c6275f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:28.816830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64cf4aea-3edc-4c43-8eb6-daa21c6275f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:28.894120 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-64cf4aea-3edc-4c43-8eb6-daa21c6275f2 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.100390 Dec 18 20:58:28.895819 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1655/3234] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:28 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:28.993302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-89258a3e-fd1a-4931-83f4-59217bff42ff req-27d17a12-f98e-424c-ab22-db95424815a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479eeab2-5ceb-4408-b0a1-4d5eca0abc0e", "name": "network-vif-plugged", "status": "completed", "tag": "8de86d40-0ffe-4a89-ae60-fdfa7a44d805"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:28.995024 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:28.995024 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:29.014034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-89258a3e-fd1a-4931-83f4-59217bff42ff req-27d17a12-f98e-424c-ab22-db95424815a4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.014496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-89258a3e-fd1a-4931-83f4-59217bff42ff req-27d17a12-f98e-424c-ab22-db95424815a4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.021087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:29.043464 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-89258a3e-fd1a-4931-83f4-59217bff42ff req-27d17a12-f98e-424c-ab22-db95424815a4 service nova] Creating event network-vif-plugged:8de86d40-0ffe-4a89-ae60-fdfa7a44d805 for instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e on nch1-master-1 Dec 18 20:58:29.043464 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-89258a3e-fd1a-4931-83f4-59217bff42ff req-27d17a12-f98e-424c-ab22-db95424815a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058401 Dec 18 20:58:29.050953 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1656/3235] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:29.061669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3af606c8-1cb9-47ea-9335-c8c30eecdd94 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.290415 Dec 18 20:58:29.062211 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1580/3236] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:28 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:29.095816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:29.096521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:29.105270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.106355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.107116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.107560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.176324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-daae6b27-82fd-43c2-8818-d945fbf2c346 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:29.178750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-daae6b27-82fd-43c2-8818-d945fbf2c346 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:29.203833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daae6b27-82fd-43c2-8818-d945fbf2c346 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.205537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daae6b27-82fd-43c2-8818-d945fbf2c346 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.207824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daae6b27-82fd-43c2-8818-d945fbf2c346 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.209794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daae6b27-82fd-43c2-8818-d945fbf2c346 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.300948 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-daae6b27-82fd-43c2-8818-d945fbf2c346 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 16398 microversion: 2.1 time: 0.129874 Dec 18 20:58:29.302521 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1581/3237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:29 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 16398 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:29.309845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c057bee8-72dc-45a0-85b6-42d86defa65f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:29.313658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c057bee8-72dc-45a0-85b6-42d86defa65f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:29.325661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:29.332816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c057bee8-72dc-45a0-85b6-42d86defa65f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.333958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c057bee8-72dc-45a0-85b6-42d86defa65f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.334804 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-49bcf035-b694-4963-90a9-1f8f6a66d2e2 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.243778 Dec 18 20:58:29.344068 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1657/3238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:29 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:29.347720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c057bee8-72dc-45a0-85b6-42d86defa65f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.349411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c057bee8-72dc-45a0-85b6-42d86defa65f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.577893 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c057bee8-72dc-45a0-85b6-42d86defa65f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 8206 microversion: 2.1 time: 0.273666 Dec 18 20:58:29.579063 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1582/3239] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:29 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 8206 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:29.713602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:29.714229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:29.732646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.733378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.734333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.734993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.910173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a98d4787-8dd2-4493-b9fe-b46af29afd4b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:29.912963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a98d4787-8dd2-4493-b9fe-b46af29afd4b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:29.926594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a98d4787-8dd2-4493-b9fe-b46af29afd4b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.927406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a98d4787-8dd2-4493-b9fe-b46af29afd4b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:29.929031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a98d4787-8dd2-4493-b9fe-b46af29afd4b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:29.929688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a98d4787-8dd2-4493-b9fe-b46af29afd4b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.033563 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a98d4787-8dd2-4493-b9fe-b46af29afd4b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.128235 Dec 18 20:58:30.039368 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1583/3240] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:29 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:30.072249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:30.080923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:30.081627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:30.087351 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53e0705a-47f2-466e-bb97-8ba83a5db2cd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.375734 Dec 18 20:58:30.092895 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1658/3241] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:29 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:30.100363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.105011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.106070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.106565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.312516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c0aa488a-2d86-48c8-b479-c1367436f1e1 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:30.313681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c0aa488a-2d86-48c8-b479-c1367436f1e1 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:30.323301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0aa488a-2d86-48c8-b479-c1367436f1e1 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.326674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0aa488a-2d86-48c8-b479-c1367436f1e1 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.328494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0aa488a-2d86-48c8-b479-c1367436f1e1 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.329094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0aa488a-2d86-48c8-b479-c1367436f1e1 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.359472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:30.367502 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-409b33b9-05bb-4d01-8720-f74dbf426a3a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1317 microversion: 2.1 time: 0.290777 Dec 18 20:58:30.367855 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1584/3242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:30 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:30.385014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:30.386280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:30.397124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c0aa488a-2d86-48c8-b479-c1367436f1e1 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 16398 microversion: 2.1 time: 0.087984 Dec 18 20:58:30.402108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.404630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.408294 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1659/3243] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:30 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 16398 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:30.411006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.411888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.593224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e862ad3-35ec-456a-ab70-6116354319be tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:30.594533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e862ad3-35ec-456a-ab70-6116354319be tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:30.606680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e862ad3-35ec-456a-ab70-6116354319be tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.609689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e862ad3-35ec-456a-ab70-6116354319be tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.613770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e862ad3-35ec-456a-ab70-6116354319be tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:30.614971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e862ad3-35ec-456a-ab70-6116354319be tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:30.769596 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e862ad3-35ec-456a-ab70-6116354319be tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 16392 microversion: 2.1 time: 0.182469 Dec 18 20:58:30.773276 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1660/3244] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:30 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 16392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:30.788718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:30.805588 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-12f2b0b0-cfae-4778-9d9d-acd126d69ccf tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.436654 Dec 18 20:58:30.808487 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1585/3245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:30 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:31.051210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-768f8853-0afe-4542-892c-b827534e0534 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:31.052794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-768f8853-0afe-4542-892c-b827534e0534 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:31.067761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-768f8853-0afe-4542-892c-b827534e0534 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.069741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-768f8853-0afe-4542-892c-b827534e0534 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.071737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-768f8853-0afe-4542-892c-b827534e0534 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.076654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-768f8853-0afe-4542-892c-b827534e0534 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.107105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:31.108405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:31.122491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.123084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.124011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.127578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.175017 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-768f8853-0afe-4542-892c-b827534e0534 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.128910 Dec 18 20:58:31.176256 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1661/3246] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:31 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:31.327937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:31.335964 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5774512c-a193-46af-a20c-f60d2a7002f4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.232602 Dec 18 20:58:31.343579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1586/3247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:31 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:31.384866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:31.385865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:31.396454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.402176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.403381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.404047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.418663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a0083c0-c2d1-4e5a-a3cc-01cc82aacdcf tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:31.420138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a0083c0-c2d1-4e5a-a3cc-01cc82aacdcf tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:31.442963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a0083c0-c2d1-4e5a-a3cc-01cc82aacdcf tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.446135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a0083c0-c2d1-4e5a-a3cc-01cc82aacdcf tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.446984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a0083c0-c2d1-4e5a-a3cc-01cc82aacdcf tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.447572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a0083c0-c2d1-4e5a-a3cc-01cc82aacdcf tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.541858 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a0083c0-c2d1-4e5a-a3cc-01cc82aacdcf tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 16398 microversion: 2.1 time: 0.130169 Dec 18 20:58:31.543228 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1587/3248] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:31 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 16398 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:31.783334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fe4c28a-d133-4c87-8ea9-561d382c190a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:31.785749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fe4c28a-d133-4c87-8ea9-561d382c190a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:31.811361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fe4c28a-d133-4c87-8ea9-561d382c190a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.812087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fe4c28a-d133-4c87-8ea9-561d382c190a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.813053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fe4c28a-d133-4c87-8ea9-561d382c190a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.813640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fe4c28a-d133-4c87-8ea9-561d382c190a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.847575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:31.857906 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a8430f39-45ad-4dd7-b868-165be26f0ec7 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1467 microversion: 2.1 time: 0.477058 Dec 18 20:58:31.860133 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1662/3249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:31 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1467 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:31.874442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:31.875491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:31.888408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.889162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.890154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.893395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.920342 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fe4c28a-d133-4c87-8ea9-561d382c190a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 16392 microversion: 2.1 time: 0.141838 Dec 18 20:58:31.921020 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1588/3250] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:31 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 16392 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:31.933036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-376485073", "metadata": {"image_type": "test"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:31.935950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:31.952323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.955314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:31.957490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:31.957949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.014872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Getting quotas for project a4275f97662f4f3b8eed66d55e5f050b. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:58:32.022477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Getting quotas for user 932b394322e2458baa8e8057ca4a9c6a and project a4275f97662f4f3b8eed66d55e5f050b. Resources: dict_keys(['metadata_items']) {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:58:32.368180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:32.387689 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-859ac18e-1c92-42ab-b82f-354a5db24653 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.524094 Dec 18 20:58:32.390833 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1663/3251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:31 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:32.403982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f841bb91-b45a-4189-85ac-fa0bec3aeff9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:32.406313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f841bb91-b45a-4189-85ac-fa0bec3aeff9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:32.434765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f841bb91-b45a-4189-85ac-fa0bec3aeff9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.435850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f841bb91-b45a-4189-85ac-fa0bec3aeff9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.436878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f841bb91-b45a-4189-85ac-fa0bec3aeff9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.442871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f841bb91-b45a-4189-85ac-fa0bec3aeff9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.506145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-159aa93e-d901-43f3-847e-9b8700c8f217 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "POST /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e/action" status: 202 len: 0 microversion: 2.1 time: 0.583701 Dec 18 20:58:32.511057 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1589/3252] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:31 2021] POST /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:58:32.523336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:32.524331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:32.540323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.540699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.541936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.542640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.567094 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f841bb91-b45a-4189-85ac-fa0bec3aeff9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.165259 Dec 18 20:58:32.567823 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1664/3253] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:32 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:32.583494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53783974-1d5b-4cfd-b2a8-2f3688b3b345 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f715c16c3a0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:32.701606 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53783974-1d5b-4cfd-b2a8-2f3688b3b345 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.127632 Dec 18 20:58:32.710552 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1665/3254] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:32 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:32.721682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b5db5cb-f9f0-428d-81f9-7d28e97a1e2a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:32.728583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b5db5cb-f9f0-428d-81f9-7d28e97a1e2a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:32.740788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b5db5cb-f9f0-428d-81f9-7d28e97a1e2a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.742591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b5db5cb-f9f0-428d-81f9-7d28e97a1e2a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.758031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b5db5cb-f9f0-428d-81f9-7d28e97a1e2a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.758908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b5db5cb-f9f0-428d-81f9-7d28e97a1e2a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.848442 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b5db5cb-f9f0-428d-81f9-7d28e97a1e2a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 16398 microversion: 2.1 time: 0.134470 Dec 18 20:58:32.852197 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1666/3255] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:32 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 16398 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:32.933813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22019aab-3c7d-4e84-9306-37d9bf647f46 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:32.936651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22019aab-3c7d-4e84-9306-37d9bf647f46 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:32.952244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22019aab-3c7d-4e84-9306-37d9bf647f46 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.953021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22019aab-3c7d-4e84-9306-37d9bf647f46 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:32.954123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22019aab-3c7d-4e84-9306-37d9bf647f46 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:32.955671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22019aab-3c7d-4e84-9306-37d9bf647f46 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:33.021084 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22019aab-3c7d-4e84-9306-37d9bf647f46 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 16392 microversion: 2.1 time: 0.090951 Dec 18 20:58:33.025337 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1667/3256] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:32 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 16392 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:33.043792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:33.052475 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-889149d0-b3ac-4aea-98b2-cb9457998107 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.539913 Dec 18 20:58:33.053098 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1590/3257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:32 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:33.418023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:33.420061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:33.466586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:33.467303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:33.475740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:33.476367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:33.579402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-278fd94e-f07c-492a-a85c-d8ce603b2765 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:33.580921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-278fd94e-f07c-492a-a85c-d8ce603b2765 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:33.596300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-278fd94e-f07c-492a-a85c-d8ce603b2765 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:33.606591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-278fd94e-f07c-492a-a85c-d8ce603b2765 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:33.607793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-278fd94e-f07c-492a-a85c-d8ce603b2765 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:33.608465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-278fd94e-f07c-492a-a85c-d8ce603b2765 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:33.769794 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-278fd94e-f07c-492a-a85c-d8ce603b2765 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.194421 Dec 18 20:58:33.774406 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1591/3258] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:33 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:58:33.789929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02147fd8-8c28-42b2-8767-86db819b6a00 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fb323a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:33.874119 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-02147fd8-8c28-42b2-8767-86db819b6a00 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.096865 Dec 18 20:58:33.881171 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1592/3259] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:33 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:33.886016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bab96566-2fc6-44b6-8a32-bbf66f13d956 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:33.887175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bab96566-2fc6-44b6-8a32-bbf66f13d956 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:33.896435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bab96566-2fc6-44b6-8a32-bbf66f13d956 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:33.897087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bab96566-2fc6-44b6-8a32-bbf66f13d956 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:33.898134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bab96566-2fc6-44b6-8a32-bbf66f13d956 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:33.898887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bab96566-2fc6-44b6-8a32-bbf66f13d956 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:33.903536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:33.922712 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-69d6af36-1e5d-4e27-ab25-786571dc1b0c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.517241 Dec 18 20:58:33.923965 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1668/3260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:33 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:33.956399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bab96566-2fc6-44b6-8a32-bbf66f13d956 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 24570 microversion: 2.1 time: 0.073670 Dec 18 20:58:33.957555 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1593/3261] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:33 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:34.038868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-839f58b6-ef31-45f6-ba72-08e68a7935e3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:34.041129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-839f58b6-ef31-45f6-ba72-08e68a7935e3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:34.055220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-839f58b6-ef31-45f6-ba72-08e68a7935e3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.056011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-839f58b6-ef31-45f6-ba72-08e68a7935e3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.056991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-839f58b6-ef31-45f6-ba72-08e68a7935e3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.057588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-839f58b6-ef31-45f6-ba72-08e68a7935e3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.071832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:34.073627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:34.090666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.092743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.096266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.098865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.164306 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-839f58b6-ef31-45f6-ba72-08e68a7935e3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 16392 microversion: 2.1 time: 0.134789 Dec 18 20:58:34.165751 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1669/3262] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:34 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 16392 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:34.789675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbbd21fc-20d3-4215-b34e-239c1bbe0379 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:34.790707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bbbd21fc-20d3-4215-b34e-239c1bbe0379 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:34.800694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbbd21fc-20d3-4215-b34e-239c1bbe0379 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.801158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbbd21fc-20d3-4215-b34e-239c1bbe0379 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.801964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbbd21fc-20d3-4215-b34e-239c1bbe0379 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.802447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbbd21fc-20d3-4215-b34e-239c1bbe0379 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.883832 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bbbd21fc-20d3-4215-b34e-239c1bbe0379 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.098014 Dec 18 20:58:34.888124 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1670/3263] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:34 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:58:34.901089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:34.911770 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19245be2-1381-4257-8b81-e5010ba8dd35 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.845368 Dec 18 20:58:34.912124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6fa4e1a6-5653-4068-9000-9b1fe538e75f tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f715c7bfb80>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:34.924182 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1594/3264] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:34 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:34.945073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:34.945740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:34.972329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.976472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.979195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:34.986952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:34.996496 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6fa4e1a6-5653-4068-9000-9b1fe538e75f tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.103590 Dec 18 20:58:34.998100 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1671/3265] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:34 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:35.003764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6223f65b-73d3-490c-8107-dc791d0acccb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:35.007407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6223f65b-73d3-490c-8107-dc791d0acccb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:35.015514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6223f65b-73d3-490c-8107-dc791d0acccb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.017093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6223f65b-73d3-490c-8107-dc791d0acccb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:35.018087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6223f65b-73d3-490c-8107-dc791d0acccb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.018991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6223f65b-73d3-490c-8107-dc791d0acccb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:35.070023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6223f65b-73d3-490c-8107-dc791d0acccb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 24570 microversion: 2.1 time: 0.068546 Dec 18 20:58:35.082565 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1672/3266] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:34 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:35.178198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a93d9f56-ff47-4ba0-a7e3-51479292c113 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:35.180238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a93d9f56-ff47-4ba0-a7e3-51479292c113 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:35.190983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a93d9f56-ff47-4ba0-a7e3-51479292c113 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.191889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a93d9f56-ff47-4ba0-a7e3-51479292c113 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:35.192934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a93d9f56-ff47-4ba0-a7e3-51479292c113 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.193606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a93d9f56-ff47-4ba0-a7e3-51479292c113 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:35.264236 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a93d9f56-ff47-4ba0-a7e3-51479292c113 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 16392 microversion: 2.1 time: 0.091473 Dec 18 20:58:35.284501 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1673/3267] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:35 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 16392 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:35.309583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:35.318140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1f2aa3b-0232-4662-89d6-5215caaede7f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1567 microversion: 2.1 time: 0.382161 Dec 18 20:58:35.324070 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1595/3268] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:34 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1567 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:35.903977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d53a70c-5723-4c64-b460-a3e4f399bc64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:35.906724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7d53a70c-5723-4c64-b460-a3e4f399bc64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:35.928750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d53a70c-5723-4c64-b460-a3e4f399bc64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.929545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d53a70c-5723-4c64-b460-a3e4f399bc64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:35.930596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d53a70c-5723-4c64-b460-a3e4f399bc64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.932920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d53a70c-5723-4c64-b460-a3e4f399bc64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:35.933766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:35.934684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:35.973735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.977752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:35.979151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:35.984194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:36.024345 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d53a70c-5723-4c64-b460-a3e4f399bc64 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.128284 Dec 18 20:58:36.025908 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1674/3269] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:35 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:36.039188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e08e9d3-8e16-4b8e-8249-65c9fd3da7f4 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fc049d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:36.156981 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e08e9d3-8e16-4b8e-8249-65c9fd3da7f4 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.129531 Dec 18 20:58:36.158341 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1675/3270] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:36 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:36.447170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:36.486562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-367933630", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "63a5a373-b325-4f98-9f70-cf4f99f22802"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:36.498882 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3707b956-8bab-4d1a-b345-4ae58ba895f2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.568956 Dec 18 20:58:36.501939 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1596/3271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:35 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:36.521245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45764465-9420-4c74-9230-4c3f30eaa541 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:36.523828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45764465-9420-4c74-9230-4c3f30eaa541 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:36.539599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45764465-9420-4c74-9230-4c3f30eaa541 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:36.543352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45764465-9420-4c74-9230-4c3f30eaa541 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:36.545223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45764465-9420-4c74-9230-4c3f30eaa541 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:36.546286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45764465-9420-4c74-9230-4c3f30eaa541 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:36.639012 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45764465-9420-4c74-9230-4c3f30eaa541 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 24570 microversion: 2.1 time: 0.125870 Dec 18 20:58:36.646170 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1597/3272] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:36 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 24570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:36.669269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24368951-f24e-4621-8503-0e96ebf21313 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:36.671289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-24368951-f24e-4621-8503-0e96ebf21313 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:36.726940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24368951-f24e-4621-8503-0e96ebf21313 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:36.727295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24368951-f24e-4621-8503-0e96ebf21313 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:36.731808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24368951-f24e-4621-8503-0e96ebf21313 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:36.743276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24368951-f24e-4621-8503-0e96ebf21313 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:36.834015 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24368951-f24e-4621-8503-0e96ebf21313 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 16392 microversion: 2.1 time: 0.179276 Dec 18 20:58:36.838781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1598/3273] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:36 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 16392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:36.850395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:36.853562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:36.870476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:36.873387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:36.875660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:36.879408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:37.195668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:37.210055 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f358c500-4ec7-4965-ac45-96fa654cfade tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1547 microversion: 2.1 time: 0.368413 Dec 18 20:58:37.213032 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1599/3274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:36 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1547 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:37.221205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-353e59aa-1b7f-4cae-a55d-592a65968d6c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:37.222128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-353e59aa-1b7f-4cae-a55d-592a65968d6c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:37.241757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353e59aa-1b7f-4cae-a55d-592a65968d6c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:37.242221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353e59aa-1b7f-4cae-a55d-592a65968d6c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:37.243061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353e59aa-1b7f-4cae-a55d-592a65968d6c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:37.248106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353e59aa-1b7f-4cae-a55d-592a65968d6c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:37.344826 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-353e59aa-1b7f-4cae-a55d-592a65968d6c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.130189 Dec 18 20:58:37.350312 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1600/3275] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:37 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:37.355057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2dc28397-dfd1-4d90-ab16-9f58d264a803 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714ee95ca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:41.308711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] validate_networks() for [('63a5a373-b325-4f98-9f70-cf4f99f22802', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:58:41.332892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2dc28397-dfd1-4d90-ab16-9f58d264a803 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 3.981746 Dec 18 20:58:41.338343 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1601/3276] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:37 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 3983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:41.338343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:41.338982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:41.358112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:41.358597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:41.359415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:41.359854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:41.513883 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Cannot 'detach_volume' instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 while it is in vm_state rescued Dec 18 20:58:41.515011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 409 to user: Cannot 'detach_volume' instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 while it is in vm_state rescued {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:41.516002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcdf0016-3002-41b9-bb9d-687f0b2ebf5a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments/78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e" status: 409 len: 152 microversion: 2.1 time: 0.181358 Dec 18 20:58:41.516759 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1602/3277] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 20:58:41 2021] DELETE /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments/78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e => generated 152 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:41.521685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:41.522676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:41.530694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:41.531326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:41.536062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:41.536857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:41.895707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:41.907076 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f28c5c3-449b-4fef-853a-66916e63c4a6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.389083 Dec 18 20:58:41.908378 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1603/3278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:41 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:41.913147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-048b5223-2230-49c5-953e-73623e351993 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:41.914144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-048b5223-2230-49c5-953e-73623e351993 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:41.933026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-048b5223-2230-49c5-953e-73623e351993 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:41.935476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-048b5223-2230-49c5-953e-73623e351993 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:41.936753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-048b5223-2230-49c5-953e-73623e351993 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:41.938163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-048b5223-2230-49c5-953e-73623e351993 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:41.971645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:58:41.972217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:58:41.972711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:58:41.973214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:58:41.973732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:58:42.007819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.008274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.017703 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-048b5223-2230-49c5-953e-73623e351993 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 24570 microversion: 2.1 time: 0.106613 Dec 18 20:58:42.018898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1604/3279] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:41 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 24570 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:42.019584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.022157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.026397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-900f6ae8-bee0-4f12-888c-c1b7a8333c5d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:42.028143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-900f6ae8-bee0-4f12-888c-c1b7a8333c5d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:42.038617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-900f6ae8-bee0-4f12-888c-c1b7a8333c5d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.039408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-900f6ae8-bee0-4f12-888c-c1b7a8333c5d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.040663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-900f6ae8-bee0-4f12-888c-c1b7a8333c5d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.041312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-900f6ae8-bee0-4f12-888c-c1b7a8333c5d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.088273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Getting quotas for project d9d01d8c1cbb46e0a9666c225937d2e0. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:58:42.099180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Getting quotas for user 27421f4afc3a4c1596fc19399e1616a8 and project d9d01d8c1cbb46e0a9666c225937d2e0. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:58:42.134325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:58:42.138072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:58:42.144380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-900f6ae8-bee0-4f12-888c-c1b7a8333c5d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.123448 Dec 18 20:58:42.145768 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1605/3280] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:42 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:42.160033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e98bca87-ea4b-4267-b353-dff7ddb1906f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:42.165053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e98bca87-ea4b-4267-b353-dff7ddb1906f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:42.177461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e98bca87-ea4b-4267-b353-dff7ddb1906f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.178881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e98bca87-ea4b-4267-b353-dff7ddb1906f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.180333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e98bca87-ea4b-4267-b353-dff7ddb1906f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.181321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e98bca87-ea4b-4267-b353-dff7ddb1906f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.246358 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ef2e1190-03d0-4053-9a90-55f38cf74b62 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.086692 Dec 18 20:58:42.248982 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1676/3281] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:58:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 6090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:58:42.256020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3c589c26-fb32-42aa-b097-74e7d88b0df0 req-5809e2a7-54e3-48d1-9e14-20e59bb42833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479eeab2-5ceb-4408-b0a1-4d5eca0abc0e", "name": "network-vif-plugged", "status": "completed", "tag": "8de86d40-0ffe-4a89-ae60-fdfa7a44d805"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:42.263658 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:42.263658 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:42.287179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3c589c26-fb32-42aa-b097-74e7d88b0df0 req-5809e2a7-54e3-48d1-9e14-20e59bb42833 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.287377 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e98bca87-ea4b-4267-b353-dff7ddb1906f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.139592 Dec 18 20:58:42.288042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3c589c26-fb32-42aa-b097-74e7d88b0df0 req-5809e2a7-54e3-48d1-9e14-20e59bb42833 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.289033 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1606/3282] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:42 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:42.311512 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3c589c26-fb32-42aa-b097-74e7d88b0df0 req-5809e2a7-54e3-48d1-9e14-20e59bb42833 service nova] Creating event network-vif-plugged:8de86d40-0ffe-4a89-ae60-fdfa7a44d805 for instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e on nch1-master-1 Dec 18 20:58:42.318474 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3c589c26-fb32-42aa-b097-74e7d88b0df0 req-5809e2a7-54e3-48d1-9e14-20e59bb42833 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068130 Dec 18 20:58:42.319628 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1677/3283] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:42.325188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6053e25e-115e-4583-a07e-5883a3b70a12 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:42.325897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6053e25e-115e-4583-a07e-5883a3b70a12 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:42.345846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d362b48-a9dd-4c28-bcfb-c60c04639aad tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:42.346667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2d362b48-a9dd-4c28-bcfb-c60c04639aad tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:42.366442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d362b48-a9dd-4c28-bcfb-c60c04639aad tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.367127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d362b48-a9dd-4c28-bcfb-c60c04639aad tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.371006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d362b48-a9dd-4c28-bcfb-c60c04639aad tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.371641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d362b48-a9dd-4c28-bcfb-c60c04639aad tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.413186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6053e25e-115e-4583-a07e-5883a3b70a12 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:42.420169 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6053e25e-115e-4583-a07e-5883a3b70a12 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1214 microversion: 2.1 time: 0.098801 Dec 18 20:58:42.420744 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1678/3284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:42 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:42.435414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41c58736-fd7c-4dfd-9a62-acd11a0c8877 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f715c4954c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:42.492225 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d362b48-a9dd-4c28-bcfb-c60c04639aad tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action" status: 202 len: 0 microversion: 2.1 time: 0.201597 Dec 18 20:58:42.498036 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1607/3285] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:42 2021] POST /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:42.515553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:42.520431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:42.531877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.535737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.537544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.537693 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41c58736-fd7c-4dfd-9a62-acd11a0c8877 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.113929 Dec 18 20:58:42.539269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.539460 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1679/3286] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:42 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:42.750273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:42.764486 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9df7830c-b83c-470d-8df3-f7f2250d6c7b tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1555 microversion: 2.1 time: 0.261004 Dec 18 20:58:42.765681 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1608/3287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:42 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1555 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:42.928087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:42.929083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:42.937212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.937918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:42.939895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:42.940883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.029853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-87707cca-3c55-46fc-82e1-fccf36ad36e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:43.031199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-87707cca-3c55-46fc-82e1-fccf36ad36e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:43.046659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87707cca-3c55-46fc-82e1-fccf36ad36e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.047826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87707cca-3c55-46fc-82e1-fccf36ad36e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.051721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87707cca-3c55-46fc-82e1-fccf36ad36e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.052399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87707cca-3c55-46fc-82e1-fccf36ad36e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.107574 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-87707cca-3c55-46fc-82e1-fccf36ad36e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 24570 microversion: 2.1 time: 0.081367 Dec 18 20:58:43.109769 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1609/3288] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:43 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 24570 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:43.159161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11ccc0e6-358d-4454-a576-d75681c86106 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:43.162983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11ccc0e6-358d-4454-a576-d75681c86106 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:43.184484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:43.188331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11ccc0e6-358d-4454-a576-d75681c86106 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.191510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11ccc0e6-358d-4454-a576-d75681c86106 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.194334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11ccc0e6-358d-4454-a576-d75681c86106 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.195233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11ccc0e6-358d-4454-a576-d75681c86106 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.199357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ae505ea-7d85-4f2e-89c4-9e7bc4da1ec5 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1505 microversion: 2.1 time: 0.278742 Dec 18 20:58:43.202793 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1680/3289] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:42 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:43.301927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5430e388-b46c-4a23-823c-7f9aa9a35c67 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:43.303347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5430e388-b46c-4a23-823c-7f9aa9a35c67 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:43.312573 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11ccc0e6-358d-4454-a576-d75681c86106 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.159086 Dec 18 20:58:43.314372 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1610/3290] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:43 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:43.315624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5430e388-b46c-4a23-823c-7f9aa9a35c67 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.318154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5430e388-b46c-4a23-823c-7f9aa9a35c67 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.319049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5430e388-b46c-4a23-823c-7f9aa9a35c67 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.320206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5430e388-b46c-4a23-823c-7f9aa9a35c67 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.427730 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5430e388-b46c-4a23-823c-7f9aa9a35c67 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.130047 Dec 18 20:58:43.430889 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1681/3291] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:43 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:43.440945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:43.441692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:43.461470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.462048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.463352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.463802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.551140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-85a59b60-6565-4532-a844-27f86a838922 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714f5cb670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:43.581392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:43.592170 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abb86706-a654-4d4c-9c05-d847749d0835 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1266 microversion: 2.1 time: 0.156415 Dec 18 20:58:43.593776 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1611/3292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:43 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:43.605920 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-85a59b60-6565-4532-a844-27f86a838922 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.059495 Dec 18 20:58:43.606952 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1682/3293] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:43 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:43.785250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:43.786069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:43.798691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.801859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:43.803223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:43.803842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.103777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:44.115717 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c9361d03-363e-4a52-be41-ec37dbcd48dc tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1555 microversion: 2.1 time: 0.334328 Dec 18 20:58:44.125286 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1612/3294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:43 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1555 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:44.126155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a183ff0c-5ddb-49cb-8862-bd89b6cf245e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:44.126813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a183ff0c-5ddb-49cb-8862-bd89b6cf245e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:44.141478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a183ff0c-5ddb-49cb-8862-bd89b6cf245e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.142428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a183ff0c-5ddb-49cb-8862-bd89b6cf245e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.143239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a183ff0c-5ddb-49cb-8862-bd89b6cf245e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.143676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a183ff0c-5ddb-49cb-8862-bd89b6cf245e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.190766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a183ff0c-5ddb-49cb-8862-bd89b6cf245e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 24570 microversion: 2.1 time: 0.073899 Dec 18 20:58:44.192463 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1683/3295] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:44 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 24570 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:44.220653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:44.221363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:44.233628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.237522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.238511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.238959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.325663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c727ca5-8fac-4e7a-8494-d8cf28138820 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:44.327443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c727ca5-8fac-4e7a-8494-d8cf28138820 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:44.336672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c727ca5-8fac-4e7a-8494-d8cf28138820 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.337507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c727ca5-8fac-4e7a-8494-d8cf28138820 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.338666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c727ca5-8fac-4e7a-8494-d8cf28138820 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.339332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c727ca5-8fac-4e7a-8494-d8cf28138820 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.421368 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c727ca5-8fac-4e7a-8494-d8cf28138820 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.099478 Dec 18 20:58:44.421994 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1684/3296] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:44 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:44.432234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:44.444714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1582f34-498a-4c10-a2f6-9bd0907d00af tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:44.449331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4648d065-0a07-4dd9-a043-ff2c2dac5fc3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1505 microversion: 2.1 time: 0.233675 Dec 18 20:58:44.458936 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1613/3297] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:44 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:44.459573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1582f34-498a-4c10-a2f6-9bd0907d00af tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:44.462322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1582f34-498a-4c10-a2f6-9bd0907d00af tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.463070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1582f34-498a-4c10-a2f6-9bd0907d00af tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.464857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1582f34-498a-4c10-a2f6-9bd0907d00af tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.464857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1582f34-498a-4c10-a2f6-9bd0907d00af tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.513040 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1582f34-498a-4c10-a2f6-9bd0907d00af tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.074745 Dec 18 20:58:44.517512 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1685/3298] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:44 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:44.610331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:44.611043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:44.619721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8908554e-b4a2-42de-b467-1f28e21eb8c1 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fd82af0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:44.634765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.635471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.636490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:44.637147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:44.724251 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8908554e-b4a2-42de-b467-1f28e21eb8c1 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.108539 Dec 18 20:58:44.725122 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1686/3299] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:44 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:44.744937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:44.756702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d929d9c3-dbcf-401e-867c-8e9a9b4e6f86 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1272 microversion: 2.1 time: 0.150149 Dec 18 20:58:44.758106 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1614/3300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:44 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:45.155383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:45.156815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:45.179247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.181321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.182903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.184103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.207274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07718706-4e2a-411d-a602-18f3918a1aec tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:45.209063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07718706-4e2a-411d-a602-18f3918a1aec tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:45.228557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07718706-4e2a-411d-a602-18f3918a1aec tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.229689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07718706-4e2a-411d-a602-18f3918a1aec tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.230961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07718706-4e2a-411d-a602-18f3918a1aec tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.231787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07718706-4e2a-411d-a602-18f3918a1aec tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.316978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07718706-4e2a-411d-a602-18f3918a1aec tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 24570 microversion: 2.1 time: 0.115739 Dec 18 20:58:45.319240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1615/3301] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:45 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 24570 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:45.434274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-592ca7cb-bf8b-4b58-8db2-b2d0afe130ab tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:45.435297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-592ca7cb-bf8b-4b58-8db2-b2d0afe130ab tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:45.450410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-592ca7cb-bf8b-4b58-8db2-b2d0afe130ab tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.450979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-592ca7cb-bf8b-4b58-8db2-b2d0afe130ab tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.452939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-592ca7cb-bf8b-4b58-8db2-b2d0afe130ab tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.455441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-592ca7cb-bf8b-4b58-8db2-b2d0afe130ab tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.599354 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-592ca7cb-bf8b-4b58-8db2-b2d0afe130ab tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.150895 Dec 18 20:58:45.602783 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1616/3302] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:45 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:45.605467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:45.606184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:45.626814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.627294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.628137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.628587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.847220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:45.858891 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ddcfe086-9e1a-4f16-ace7-10550d02c17e tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1555 microversion: 2.1 time: 0.728765 Dec 18 20:58:45.861696 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1687/3303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:45 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1555 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:45.874910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4be720af-d910-4812-8b35-84cc4ed048e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:45.877791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4be720af-d910-4812-8b35-84cc4ed048e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:45.897665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be720af-d910-4812-8b35-84cc4ed048e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.901980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be720af-d910-4812-8b35-84cc4ed048e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.909702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be720af-d910-4812-8b35-84cc4ed048e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:45.910509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be720af-d910-4812-8b35-84cc4ed048e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:45.987837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4be720af-d910-4812-8b35-84cc4ed048e9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.124292 Dec 18 20:58:45.988448 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1688/3304] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:45 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:45.998172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cdf5e9fb-51c2-4edf-93c3-a15aa9233ee1 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fbe7940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:46.010124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:46.023280 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef1b6c62-5f9b-4296-8b5a-184eecf6eff3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 200 len: 1508 microversion: 2.1 time: 0.421484 Dec 18 20:58:46.026704 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1617/3305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:45 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:46.033789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:46.044920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:46.057623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.058187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.060656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.064460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.103522 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cdf5e9fb-51c2-4edf-93c3-a15aa9233ee1 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.113469 Dec 18 20:58:46.105629 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1689/3306] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:45 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:46.111080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:46.120756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:46.133399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.134119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.135246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.138031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.496096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:46.504671 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2918bfc8-e73f-48f2-8138-95e257886c6f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.397591 Dec 18 20:58:46.506175 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1690/3307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:46 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:46.511101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c10a0ff1-1113-4deb-b1ea-fddb6901cbc4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:46.515386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c10a0ff1-1113-4deb-b1ea-fddb6901cbc4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:46.537790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c10a0ff1-1113-4deb-b1ea-fddb6901cbc4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.538201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c10a0ff1-1113-4deb-b1ea-fddb6901cbc4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.550631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c10a0ff1-1113-4deb-b1ea-fddb6901cbc4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.551284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c10a0ff1-1113-4deb-b1ea-fddb6901cbc4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.586633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:46.596653 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4dedba7f-a308-46a1-b8c5-166d99d83403 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1314 microversion: 2.1 time: 0.567928 Dec 18 20:58:46.600346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1618/3308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:46 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:46.608633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:46.609257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:46.635584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c10a0ff1-1113-4deb-b1ea-fddb6901cbc4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.127845 Dec 18 20:58:46.640024 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1691/3309] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:46 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:46.641524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db63d519-1490-4f74-a2a5-61b550a0f3b4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:46.643961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.644425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.645230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.645375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db63d519-1490-4f74-a2a5-61b550a0f3b4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:46.652055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.672986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db63d519-1490-4f74-a2a5-61b550a0f3b4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.673730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db63d519-1490-4f74-a2a5-61b550a0f3b4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.674754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db63d519-1490-4f74-a2a5-61b550a0f3b4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.675353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db63d519-1490-4f74-a2a5-61b550a0f3b4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.799152 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db63d519-1490-4f74-a2a5-61b550a0f3b4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.161323 Dec 18 20:58:46.802564 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1692/3310] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:46 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:46.841642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-91a1accd-38c4-44fb-bd75-393436763919 req-3401d16f-449a-402c-b18e-b82de726dca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dfce29-5bdc-4127-9942-6377d7b7bc7e", "name": "network-vif-unplugged", "status": "completed", "tag": "2ec8fed1-1707-4075-bc28-f12d86c90468"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:46.843386 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:46.843386 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:46.878684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-91a1accd-38c4-44fb-bd75-393436763919 req-3401d16f-449a-402c-b18e-b82de726dca2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.882132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-91a1accd-38c4-44fb-bd75-393436763919 req-3401d16f-449a-402c-b18e-b82de726dca2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.917922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.compute.server_external_events [req-91a1accd-38c4-44fb-bd75-393436763919 req-3401d16f-449a-402c-b18e-b82de726dca2 service nova] Unable to find a host for instance 79dfce29-5bdc-4127-9942-6377d7b7bc7e. Dropping event network-vif-unplugged {{(pid=140731) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 18 20:58:46.919176 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-91a1accd-38c4-44fb-bd75-393436763919 req-3401d16f-449a-402c-b18e-b82de726dca2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.082408 Dec 18 20:58:46.923424 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1693/3311] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:46 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 18 20:58:46.929348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:46.935002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:46.954979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.957372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:46.958832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:46.960882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.286645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:47.295590 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9db0472b-dc40-404d-8997-48c10579d611 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.692780 Dec 18 20:58:47.296729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1619/3312] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:46 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:47.302007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bee12d36-97a0-4a1b-ab64-b37f6edb5616 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:47.305296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bee12d36-97a0-4a1b-ab64-b37f6edb5616 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:47.320029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee12d36-97a0-4a1b-ab64-b37f6edb5616 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.320682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee12d36-97a0-4a1b-ab64-b37f6edb5616 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.321487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee12d36-97a0-4a1b-ab64-b37f6edb5616 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.321929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee12d36-97a0-4a1b-ab64-b37f6edb5616 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.380904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:47.410000 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bee12d36-97a0-4a1b-ab64-b37f6edb5616 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.111644 Dec 18 20:58:47.411368 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1620/3313] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:47 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:47.412279 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf33334c-b04d-4e62-b82d-bfef933347e9 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1561 microversion: 2.1 time: 0.470739 Dec 18 20:58:47.424644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e3480a20-f584-4b98-b588-fad738c692dc req-6060b956-156d-419b-bb98-59f968b7a184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d410d2ca-b30b-47d1-a7f5-72a2f1940a28", "tag": "7a02115a-9983-4c01-949f-bb313b22b679"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:47.424644 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:47.424644 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:47.425792 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1694/3314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:46 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1561 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:47.431234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ddedcae4-16eb-4640-a214-adb399cf1c12 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fbd8160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:47.439069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e3480a20-f584-4b98-b588-fad738c692dc req-6060b956-156d-419b-bb98-59f968b7a184 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.457464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e3480a20-f584-4b98-b588-fad738c692dc req-6060b956-156d-419b-bb98-59f968b7a184 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.492969 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e3480a20-f584-4b98-b588-fad738c692dc req-6060b956-156d-419b-bb98-59f968b7a184 service nova] Creating event network-changed:7a02115a-9983-4c01-949f-bb313b22b679 for instance d410d2ca-b30b-47d1-a7f5-72a2f1940a28 on nch2-master-1 Dec 18 20:58:47.504483 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e3480a20-f584-4b98-b588-fad738c692dc req-6060b956-156d-419b-bb98-59f968b7a184 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091337 Dec 18 20:58:47.511824 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1621/3315] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:47.517090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcb674fb-8ec7-475a-85ad-d217d5ba3bdb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:47.541818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcb674fb-8ec7-475a-85ad-d217d5ba3bdb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.542676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcb674fb-8ec7-475a-85ad-d217d5ba3bdb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.572082 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ddedcae4-16eb-4640-a214-adb399cf1c12 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.144890 Dec 18 20:58:47.573930 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1695/3316] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:47 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:47.580576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:47.581245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:47.599491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.600215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.601200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.604795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.640269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bcb674fb-8ec7-475a-85ad-d217d5ba3bdb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Going to try to stop instance {{(pid=140732) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 20:58:47.784756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcb674fb-8ec7-475a-85ad-d217d5ba3bdb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.269038 Dec 18 20:58:47.789338 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1622/3317] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:47 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:47.811315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:47.812399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:47.845909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lazy-loading 'services' on Instance uuid f6fcab40-88c7-4902-a1b7-60f4caecbb80 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:58:47.847549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.848285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.849314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:47.849972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:47.974157 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48952a6c-212a-4733-ab59-41190f5705ac tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments/78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e" status: 202 len: 0 microversion: 2.1 time: 0.398682 Dec 18 20:58:47.979016 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1696/3318] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 20:58:47 2021] DELETE /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments/78a2ade0-d35d-4737-a6ce-c8fb33ea5e2e => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:47.995143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5c588b4-86ac-4e03-9777-cf9cd5730c44 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:47.996888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5c588b4-86ac-4e03-9777-cf9cd5730c44 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:48.012425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5c588b4-86ac-4e03-9777-cf9cd5730c44 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.016638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5c588b4-86ac-4e03-9777-cf9cd5730c44 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:48.021837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5c588b4-86ac-4e03-9777-cf9cd5730c44 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.022682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5c588b4-86ac-4e03-9777-cf9cd5730c44 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:48.093871 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5c588b4-86ac-4e03-9777-cf9cd5730c44 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.113024 Dec 18 20:58:48.113454 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1697/3319] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:47 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:48.126067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:48.126817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:48.162109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.162603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:48.163423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.163874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:48.835030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:48.845262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58a72ce4-1f9e-416e-8369-35ede548aa0f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1314 microversion: 2.1 time: 1.053874 Dec 18 20:58:48.846594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1623/3320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:47 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:48.852272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-10be9f26-a120-4ac2-ad6a-10297911fac5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:48.853529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-10be9f26-a120-4ac2-ad6a-10297911fac5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:48.863096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10be9f26-a120-4ac2-ad6a-10297911fac5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.863633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10be9f26-a120-4ac2-ad6a-10297911fac5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:48.864818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10be9f26-a120-4ac2-ad6a-10297911fac5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.865934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10be9f26-a120-4ac2-ad6a-10297911fac5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:48.933706 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-10be9f26-a120-4ac2-ad6a-10297911fac5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.085372 Dec 18 20:58:48.936108 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1624/3321] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:48 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:48.946824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-299dc283-2f2d-403c-a0c9-6cc762fbf1d8 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:48.948121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-299dc283-2f2d-403c-a0c9-6cc762fbf1d8 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:48.963761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-299dc283-2f2d-403c-a0c9-6cc762fbf1d8 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.964854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-299dc283-2f2d-403c-a0c9-6cc762fbf1d8 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:48.966049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-299dc283-2f2d-403c-a0c9-6cc762fbf1d8 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:48.966531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-299dc283-2f2d-403c-a0c9-6cc762fbf1d8 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.011489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:49.019978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-299dc283-2f2d-403c-a0c9-6cc762fbf1d8 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082380 Dec 18 20:58:49.020941 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1625/3322] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:58:48 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:49.026048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8929662b-2e86-4638-9219-e9c6b857674d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:49.027006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8929662b-2e86-4638-9219-e9c6b857674d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:49.032943 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-afb6eb7d-245f-4568-b673-ecd773358b42 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.917526 Dec 18 20:58:49.033536 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1698/3323] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:48 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:49.037897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74509fd1-ec59-4cba-b547-976afd95cd02 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fcb04c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:49.038435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8929662b-2e86-4638-9219-e9c6b857674d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.039567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8929662b-2e86-4638-9219-e9c6b857674d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.040407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8929662b-2e86-4638-9219-e9c6b857674d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.041034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8929662b-2e86-4638-9219-e9c6b857674d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.098691 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8929662b-2e86-4638-9219-e9c6b857674d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.072922 Dec 18 20:58:49.102981 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1626/3324] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:49 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:49.114700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8bdb2214-2133-4811-bee3-2f2a569326d5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:49.115943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8bdb2214-2133-4811-bee3-2f2a569326d5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:49.132616 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74509fd1-ec59-4cba-b547-976afd95cd02 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.098019 Dec 18 20:58:49.133377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1699/3325] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:49 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:49.139321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bdb2214-2133-4811-bee3-2f2a569326d5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.139779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bdb2214-2133-4811-bee3-2f2a569326d5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.140594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bdb2214-2133-4811-bee3-2f2a569326d5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.141045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bdb2214-2133-4811-bee3-2f2a569326d5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.222485 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8bdb2214-2133-4811-bee3-2f2a569326d5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.116677 Dec 18 20:58:49.224043 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1627/3326] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:49 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:49.867758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:49.868728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:49.876900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.877636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.879248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.879886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.948075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d01f7c82-cda1-4df8-93d5-a873c7976481 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:49.949734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d01f7c82-cda1-4df8-93d5-a873c7976481 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:49.963370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01f7c82-cda1-4df8-93d5-a873c7976481 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.964836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01f7c82-cda1-4df8-93d5-a873c7976481 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:49.965924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01f7c82-cda1-4df8-93d5-a873c7976481 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:49.966401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01f7c82-cda1-4df8-93d5-a873c7976481 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.047750 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d01f7c82-cda1-4df8-93d5-a873c7976481 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.102664 Dec 18 20:58:50.053017 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1628/3327] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:49 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:58:50.058554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f62d1052-74ad-4b7f-a6a4-0c41a45ae439 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:50.061194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f62d1052-74ad-4b7f-a6a4-0c41a45ae439 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:50.074666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f62d1052-74ad-4b7f-a6a4-0c41a45ae439 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.076989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f62d1052-74ad-4b7f-a6a4-0c41a45ae439 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.079779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f62d1052-74ad-4b7f-a6a4-0c41a45ae439 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.081976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f62d1052-74ad-4b7f-a6a4-0c41a45ae439 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.119020 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f62d1052-74ad-4b7f-a6a4-0c41a45ae439 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064559 Dec 18 20:58:50.125022 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1629/3328] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 20:58:50 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:58:50.130725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:50.131703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:50.142319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.143018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.144028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.144632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.174423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:50.187268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-264b2811-2658-4e69-b974-b9cf41695cb6 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1314 microversion: 2.1 time: 0.328249 Dec 18 20:58:50.187852 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1700/3329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:49 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:50.193031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5bde5d11-9c0f-4fb8-8509-282416deace8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:50.202629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5bde5d11-9c0f-4fb8-8509-282416deace8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:50.222577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bde5d11-9c0f-4fb8-8509-282416deace8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.226354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bde5d11-9c0f-4fb8-8509-282416deace8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.227373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bde5d11-9c0f-4fb8-8509-282416deace8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.231037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bde5d11-9c0f-4fb8-8509-282416deace8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.306951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5bde5d11-9c0f-4fb8-8509-282416deace8 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.117322 Dec 18 20:58:50.307907 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1701/3330] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:50 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:50.313253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0828a288-650c-4275-89cb-46bf3bbca0b2 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fff29d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:50.376863 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0828a288-650c-4275-89cb-46bf3bbca0b2 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.067035 Dec 18 20:58:50.380685 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1702/3331] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:50 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:50.388135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:50.389215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:50.400245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.400959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.402047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.402698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.431626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Cannot 'reboot' instance b570c4b4-9fec-4af2-a087-0a30ca81794b while it is in vm_state rescued Dec 18 20:58:50.432528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 409 to user: Cannot 'reboot' instance b570c4b4-9fec-4af2-a087-0a30ca81794b while it is in vm_state rescued {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:50.433552 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d17b5c0-0bea-40eb-8ee0-b3f3d7677269 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b/action" status: 409 len: 145 microversion: 2.1 time: 0.051928 Dec 18 20:58:50.434344 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1703/3332] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:50 2021] POST /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:50.441121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-565d4267-282f-4297-9416-9875c513d64a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:50.443832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-565d4267-282f-4297-9416-9875c513d64a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:50.452591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565d4267-282f-4297-9416-9875c513d64a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.454745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565d4267-282f-4297-9416-9875c513d64a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.455847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565d4267-282f-4297-9416-9875c513d64a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.456522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565d4267-282f-4297-9416-9875c513d64a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.481192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:50.496215 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81a1f862-4334-4524-8f5b-46be1a5dbefe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.369497 Dec 18 20:58:50.497071 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1630/3333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:50 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:50.514338 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-565d4267-282f-4297-9416-9875c513d64a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.078472 Dec 18 20:58:50.514891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:50.519688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:50.521666 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1704/3334] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:50 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:50.534528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.535000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.535815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:50.536264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:50.592030 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Cannot 'rebuild' instance b570c4b4-9fec-4af2-a087-0a30ca81794b while it is in vm_state rescued Dec 18 20:58:50.592646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 409 to user: Cannot 'rebuild' instance b570c4b4-9fec-4af2-a087-0a30ca81794b while it is in vm_state rescued {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:50.593506 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-848d22c6-bf6e-440c-9347-db2fb7e103aa tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "POST /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b/action" status: 409 len: 146 microversion: 2.1 time: 0.082511 Dec 18 20:58:50.600237 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1631/3335] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:50 2021] POST /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b/action => generated 146 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:51.059928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7dfc4267-7877-47e1-a4e6-8cd49b24f342 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:51.060954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7dfc4267-7877-47e1-a4e6-8cd49b24f342 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:51.081784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfc4267-7877-47e1-a4e6-8cd49b24f342 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.084521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfc4267-7877-47e1-a4e6-8cd49b24f342 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.088564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfc4267-7877-47e1-a4e6-8cd49b24f342 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.089302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfc4267-7877-47e1-a4e6-8cd49b24f342 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.170717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7dfc4267-7877-47e1-a4e6-8cd49b24f342 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.114911 Dec 18 20:58:51.171670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1705/3336] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:51 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:51.205265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:51.207006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:51.222070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.222851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.224246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.228234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.328220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0e543c9-1438-4e59-b7c0-74506bbde583 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:51.330751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0e543c9-1438-4e59-b7c0-74506bbde583 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:51.354970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0e543c9-1438-4e59-b7c0-74506bbde583 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.355742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0e543c9-1438-4e59-b7c0-74506bbde583 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.356903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0e543c9-1438-4e59-b7c0-74506bbde583 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.357652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0e543c9-1438-4e59-b7c0-74506bbde583 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.463094 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0e543c9-1438-4e59-b7c0-74506bbde583 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.143787 Dec 18 20:58:51.469475 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1706/3337] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:51 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:51.491908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7df19cf-7027-4d4f-8abe-7099a46b1bbd tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fde4af0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:51.573565 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7df19cf-7027-4d4f-8abe-7099a46b1bbd tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1423 microversion: 2.1 time: 0.100653 Dec 18 20:58:51.574081 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1707/3338] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:51 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:51.584505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:51.585689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:51.598237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.598739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.599566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.600013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.915015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:51.923829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4740cb8a-1ebf-4f3d-b582-5faf0ca5dc97 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1314 microversion: 2.1 time: 0.722961 Dec 18 20:58:51.924417 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1632/3339] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:51 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:51.928841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6ecfac6-84cb-4583-b059-d9c7ffd938a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:51.929758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c6ecfac6-84cb-4583-b059-d9c7ffd938a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:51.949344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6ecfac6-84cb-4583-b059-d9c7ffd938a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.950040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6ecfac6-84cb-4583-b059-d9c7ffd938a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:51.951028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6ecfac6-84cb-4583-b059-d9c7ffd938a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:51.951621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6ecfac6-84cb-4583-b059-d9c7ffd938a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:52.017541 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c6ecfac6-84cb-4583-b059-d9c7ffd938a3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.091331 Dec 18 20:58:52.021405 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1633/3340] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:51 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:52.103388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:52.113408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ab16d63-4bb2-4666-acc3-89b11d3f63e8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.532274 Dec 18 20:58:52.126583 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1708/3341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:51 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:52.186420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-892fdddd-3071-4f68-a0c9-a7a52be3dc24 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:52.187457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-892fdddd-3071-4f68-a0c9-a7a52be3dc24 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:52.205305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892fdddd-3071-4f68-a0c9-a7a52be3dc24 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:52.205958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892fdddd-3071-4f68-a0c9-a7a52be3dc24 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:52.207098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892fdddd-3071-4f68-a0c9-a7a52be3dc24 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:52.207550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-892fdddd-3071-4f68-a0c9-a7a52be3dc24 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:52.382077 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-892fdddd-3071-4f68-a0c9-a7a52be3dc24 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 24564 microversion: 2.1 time: 0.202098 Dec 18 20:58:52.387275 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1634/3342] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:52 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 24564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:52.485219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d954205e-5598-4ac4-bf1b-22cd7636293b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:52.488044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d954205e-5598-4ac4-bf1b-22cd7636293b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:52.497250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d954205e-5598-4ac4-bf1b-22cd7636293b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:52.497921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d954205e-5598-4ac4-bf1b-22cd7636293b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:52.499192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d954205e-5598-4ac4-bf1b-22cd7636293b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:52.499789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d954205e-5598-4ac4-bf1b-22cd7636293b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:52.592035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-608c8c50-962f-4428-8a7f-396bbbccd256 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714ef15ee0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:52.599592 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d954205e-5598-4ac4-bf1b-22cd7636293b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.121101 Dec 18 20:58:52.604951 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1709/3343] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:52 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:52.680764 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-608c8c50-962f-4428-8a7f-396bbbccd256 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1432 microversion: 2.1 time: 0.097904 Dec 18 20:58:52.693616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b6e47bc-2512-4d80-9fcb-ab9ec3272f44 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fea9790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:52.698437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1635/3344] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:52 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1432 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:52.784423 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b6e47bc-2512-4d80-9fcb-ab9ec3272f44 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 200 len: 1432 microversion: 2.1 time: 0.094939 Dec 18 20:58:52.785345 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1710/3345] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:52 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 1432 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:52.796894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:52.798415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:52.805352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:52.805885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:52.807653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:52.808254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:52.882823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28821c3b-bac3-4623-a2a2-935ffa89a3f2 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Action: 'create', calling method: .version_select at 0x7f714ef11ca0>, body: {"pool": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:53.105884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:53.114486 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a36c1706-4f39-45c0-8cf5-83d70a73a1ea tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1467 microversion: 2.1 time: 0.321515 Dec 18 20:58:53.116489 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1711/3346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:52 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1467 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:53.121024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:53.122401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:53.130635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.131240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.132202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.132856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.349564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:53.357383 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e35eca4-030c-4f2d-9031-94a5f84dc314 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1314 microversion: 2.1 time: 0.239798 Dec 18 20:58:53.358113 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1712/3347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:53 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:53.366232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8338f367-2323-4797-962a-445b6d538a79 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:53.367593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8338f367-2323-4797-962a-445b6d538a79 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:53.375679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8338f367-2323-4797-962a-445b6d538a79 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.376279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8338f367-2323-4797-962a-445b6d538a79 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.377204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8338f367-2323-4797-962a-445b6d538a79 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.377650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8338f367-2323-4797-962a-445b6d538a79 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.421587 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8338f367-2323-4797-962a-445b6d538a79 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.061936 Dec 18 20:58:53.422377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1713/3348] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:53 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:53.428526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:53.429256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:53.436599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.437070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.437943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.438524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.468662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:58:53.567362 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39a57c2b-d9c5-4bc9-aa09-8c123fe88b68 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 204 len: 0 microversion: 2.1 time: 0.142894 Dec 18 20:58:53.572522 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1714/3349] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:53 2021] DELETE /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:58:53.577846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:53.578591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:53.588030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.588592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.589483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.590024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.785947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:53.793663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13464b85-93c9-4b77-94ff-5cbfc8e77943 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.219820 Dec 18 20:58:53.794271 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1715/3350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:53 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:53.801412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0a61947-941b-45ca-9590-e41a0eccace0 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714ff84430>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:53.854099 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0a61947-941b-45ca-9590-e41a0eccace0 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3" status: 200 len: 784 microversion: 2.1 time: 0.058456 Dec 18 20:58:53.854692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1716/3351] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:53 2021] GET /compute/v2.1/images/394b3891-80f2-44c9-a9aa-56fe23a5acb3 => generated 784 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:53.861344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a6a5630e-e65a-4728-9507-d36dad702d7d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:53.863060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6a5630e-e65a-4728-9507-d36dad702d7d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:53.869290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6a5630e-e65a-4728-9507-d36dad702d7d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.869953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6a5630e-e65a-4728-9507-d36dad702d7d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.870797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6a5630e-e65a-4728-9507-d36dad702d7d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.871246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6a5630e-e65a-4728-9507-d36dad702d7d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.937361 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a6a5630e-e65a-4728-9507-d36dad702d7d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.080003 Dec 18 20:58:53.938034 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1717/3352] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:53 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:53.943468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:53.944166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:53.951124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.951580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:53.952374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:53.952816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:54.202383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:54.210774 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2f0a949b-3833-422b-a8d9-88fd2541151c tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1506 microversion: 2.1 time: 0.271149 Dec 18 20:58:54.211621 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1718/3353] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:53 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:54.216272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d91515e6-5500-45c6-9881-4cbce27c649e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:54.217368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d91515e6-5500-45c6-9881-4cbce27c649e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:54.224536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d91515e6-5500-45c6-9881-4cbce27c649e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:54.224987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d91515e6-5500-45c6-9881-4cbce27c649e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:54.225773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d91515e6-5500-45c6-9881-4cbce27c649e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:54.226211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d91515e6-5500-45c6-9881-4cbce27c649e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:54.275569 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d91515e6-5500-45c6-9881-4cbce27c649e tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.062546 Dec 18 20:58:54.276252 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1719/3354] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:54 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:54.281038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70f3dd90-1eb0-48ef-9b74-a3c53355c0eb tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:54.294786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70f3dd90-1eb0-48ef-9b74-a3c53355c0eb tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017240 Dec 18 20:58:54.295361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1720/3355] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:58:54 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:54.306377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f2798df2-81f1-498b-8f4d-e94531141b2e tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f715c45c310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:54.916679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f2798df2-81f1-498b-8f4d-e94531141b2e tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "DELETE /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 204 len: 0 microversion: 2.1 time: 0.613683 Dec 18 20:58:54.917882 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1721/3356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:54 2021] DELETE /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:58:54.926220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:54.927401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:54.934514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:54.935252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:54.936247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:54.936683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:54.962939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28821c3b-bac3-4623-a2a2-935ffa89a3f2 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.263440 Dec 18 20:58:54.963665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1636/3357] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:58:52 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:54.969345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-506ccea9-9482-42e2-9082-2cb45852eb53 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:54.971768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-506ccea9-9482-42e2-9082-2cb45852eb53 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:54.978704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-506ccea9-9482-42e2-9082-2cb45852eb53 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:54.979085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-506ccea9-9482-42e2-9082-2cb45852eb53 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:54.979900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-506ccea9-9482-42e2-9082-2cb45852eb53 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:54.980554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-506ccea9-9482-42e2-9082-2cb45852eb53 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.024954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-506ccea9-9482-42e2-9082-2cb45852eb53 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.059552 Dec 18 20:58:55.028988 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1637/3358] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:54 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:55.031013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:55.031713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:55.043859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.044321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.045295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.045739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.105910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:55.113575 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f67165f2-0c8b-4cb1-9167-3173c1f12c71 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1314 microversion: 2.1 time: 0.194481 Dec 18 20:58:55.114337 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1722/3359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:54 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:55.118973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7f05c5bd-aef9-4680-926c-704d8ae7128c req-b494ac2f-81fe-486e-8754-2971f5e1830b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d410d2ca-b30b-47d1-a7f5-72a2f1940a28", "name": "network-vif-plugged", "status": "completed", "tag": "7a02115a-9983-4c01-949f-bb313b22b679"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:55.120739 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:55.120739 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:58:55.128503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7f05c5bd-aef9-4680-926c-704d8ae7128c req-b494ac2f-81fe-486e-8754-2971f5e1830b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.128901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7f05c5bd-aef9-4680-926c-704d8ae7128c req-b494ac2f-81fe-486e-8754-2971f5e1830b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.140523 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7f05c5bd-aef9-4680-926c-704d8ae7128c req-b494ac2f-81fe-486e-8754-2971f5e1830b service nova] Creating event network-vif-plugged:7a02115a-9983-4c01-949f-bb313b22b679 for instance d410d2ca-b30b-47d1-a7f5-72a2f1940a28 on nch2-master-1 Dec 18 20:58:55.145831 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7f05c5bd-aef9-4680-926c-704d8ae7128c req-b494ac2f-81fe-486e-8754-2971f5e1830b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030228 Dec 18 20:58:55.146462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1723/3360] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:55.152188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ee7138b-ecad-44e2-b65e-313c425698bf tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fde4ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:55.173561 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1ee7138b-ecad-44e2-b65e-313c425698bf tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] HTTP exception thrown: Image not found. Dec 18 20:58:55.174167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ee7138b-ecad-44e2-b65e-313c425698bf tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:55.175288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ee7138b-ecad-44e2-b65e-313c425698bf tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 404 len: 62 microversion: 2.1 time: 0.027616 Dec 18 20:58:55.176009 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1724/3361] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:55 2021] GET /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:58:55.180640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3184834a-9e8b-4a1a-8754-56599fcf6714 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:55.181878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3184834a-9e8b-4a1a-8754-56599fcf6714 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:55.189505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3184834a-9e8b-4a1a-8754-56599fcf6714 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.190462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3184834a-9e8b-4a1a-8754-56599fcf6714 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.191262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3184834a-9e8b-4a1a-8754-56599fcf6714 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.191707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3184834a-9e8b-4a1a-8754-56599fcf6714 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.237427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3184834a-9e8b-4a1a-8754-56599fcf6714 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.059926 Dec 18 20:58:55.242037 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1725/3362] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:55 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:55.243310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:55.247509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a411afcb-630a-43db-a33a-9ceca3e5d42f tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Action: 'create', calling method: .version_select at 0x7f714fde4790>, body: {"pool": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:55.255100 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b23b534d-048f-4b0c-9e40-2e51c92fcf29 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.227677 Dec 18 20:58:55.255888 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1638/3363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:55 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:55.262605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4bf8cd41-96bc-4de6-a9c3-981eb7d6716c tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1016992128"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:55.264396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4bf8cd41-96bc-4de6-a9c3-981eb7d6716c tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:55.282597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bf8cd41-96bc-4de6-a9c3-981eb7d6716c tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.283586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bf8cd41-96bc-4de6-a9c3-981eb7d6716c tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.284562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bf8cd41-96bc-4de6-a9c3-981eb7d6716c tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.285165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bf8cd41-96bc-4de6-a9c3-981eb7d6716c tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.596042 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4bf8cd41-96bc-4de6-a9c3-981eb7d6716c tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "POST /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e/action" status: 202 len: 0 microversion: 2.1 time: 0.336473 Dec 18 20:58:55.596689 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1639/3364] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:55 2021] POST /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:58:55.603207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:55.604107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:55.611084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.611903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.613165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.613713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.858058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:55.868842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-683ce065-8e5b-40d1-8ac0-d865801bf237 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1506 microversion: 2.1 time: 0.269802 Dec 18 20:58:55.869467 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1640/3365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:55 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:55.878285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-444a2273-d819-4d49-80b2-d89c38a77327 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:55.885979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-444a2273-d819-4d49-80b2-d89c38a77327 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:55.892306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-444a2273-d819-4d49-80b2-d89c38a77327 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.893000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-444a2273-d819-4d49-80b2-d89c38a77327 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.894009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-444a2273-d819-4d49-80b2-d89c38a77327 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:55.894488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-444a2273-d819-4d49-80b2-d89c38a77327 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:55.947204 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-444a2273-d819-4d49-80b2-d89c38a77327 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.075089 Dec 18 20:58:55.948665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1641/3366] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:55 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:55.954530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a757661b-1684-46ed-97ea-fcd7de827ebe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714f8bb790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:56.018245 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a757661b-1684-46ed-97ea-fcd7de827ebe tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.068190 Dec 18 20:58:56.024164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1642/3367] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:55 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:56.037375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcec4c76-3130-4ccc-a8e3-a92ab2b2ec8c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:56.039004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bcec4c76-3130-4ccc-a8e3-a92ab2b2ec8c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:56.048993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcec4c76-3130-4ccc-a8e3-a92ab2b2ec8c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.049945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcec4c76-3130-4ccc-a8e3-a92ab2b2ec8c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.051576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcec4c76-3130-4ccc-a8e3-a92ab2b2ec8c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.052223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcec4c76-3130-4ccc-a8e3-a92ab2b2ec8c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.111008 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcec4c76-3130-4ccc-a8e3-a92ab2b2ec8c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.076842 Dec 18 20:58:56.112389 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1643/3368] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:56 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:56.132982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:56.134603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:56.145496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.150711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.151735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.152203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.445240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:56.471678 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3dc5215-ce7c-4322-929e-a9befa31cfe8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1314 microversion: 2.1 time: 0.344167 Dec 18 20:58:56.481844 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1644/3369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:56 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:56.487958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-87c107d1-757a-460d-a399-ac55570518b5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:56.489141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-87c107d1-757a-460d-a399-ac55570518b5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:56.501729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87c107d1-757a-460d-a399-ac55570518b5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.508391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87c107d1-757a-460d-a399-ac55570518b5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.509707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87c107d1-757a-460d-a399-ac55570518b5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.510562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87c107d1-757a-460d-a399-ac55570518b5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.588165 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-87c107d1-757a-460d-a399-ac55570518b5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.104773 Dec 18 20:58:56.589904 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1645/3370] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:56 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:56.598453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:56.601384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:56.612459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.613072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.614127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.615309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.929026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:56.940765 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-adcd8af2-9c7d-4653-a8ec-0ab7fb2e89bd tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.348182 Dec 18 20:58:56.951988 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1646/3371] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:56 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:56.957096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-77a147ed-2fbf-4df1-9bbd-6288d975e9af req-a64231f4-210d-4159-a192-955bf5ba86ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b570c4b4-9fec-4af2-a087-0a30ca81794b", "name": "network-vif-deleted", "tag": "319c512e-f64d-46a6-baf7-2b5a3d47c2b4"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:56.959641 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:56.959641 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:56.967833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-77a147ed-2fbf-4df1-9bbd-6288d975e9af req-a64231f4-210d-4159-a192-955bf5ba86ec service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:56.968513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-77a147ed-2fbf-4df1-9bbd-6288d975e9af req-a64231f4-210d-4159-a192-955bf5ba86ec service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:56.983218 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-77a147ed-2fbf-4df1-9bbd-6288d975e9af req-a64231f4-210d-4159-a192-955bf5ba86ec service nova] Creating event network-vif-deleted:319c512e-f64d-46a6-baf7-2b5a3d47c2b4 for instance b570c4b4-9fec-4af2-a087-0a30ca81794b on nch2-master-1 Dec 18 20:58:56.989976 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-77a147ed-2fbf-4df1-9bbd-6288d975e9af req-a64231f4-210d-4159-a192-955bf5ba86ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036492 Dec 18 20:58:56.990852 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1647/3372] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:56.996182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:56.996892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:57.003683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.004090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.004897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.005342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.015521 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a411afcb-630a-43db-a33a-9ceca3e5d42f tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.772050 Dec 18 20:58:57.016427 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1726/3373] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:58:55 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:57.022829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac5ad914-1936-4897-8005-9f8c6b78906c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:57.024431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ac5ad914-1936-4897-8005-9f8c6b78906c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:57.032728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac5ad914-1936-4897-8005-9f8c6b78906c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.033637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac5ad914-1936-4897-8005-9f8c6b78906c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.034550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac5ad914-1936-4897-8005-9f8c6b78906c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.035027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac5ad914-1936-4897-8005-9f8c6b78906c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.041611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.042136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.042573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lazy-loading 'fault' on Instance uuid b570c4b4-9fec-4af2-a087-0a30ca81794b {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:58:57.084493 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac5ad914-1936-4897-8005-9f8c6b78906c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.066559 Dec 18 20:58:57.085039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:57.085374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1727/3374] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:57 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:57.092809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-123aecee-bdce-480f-bc62-1838b46d8df2 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Action: 'create', calling method: .version_select at 0x7f714f67f5e0>, body: {"pool": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:57.093448 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-535f8982-e9dd-4265-a504-6109090bf8b6 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 200 len: 1311 microversion: 2.1 time: 0.101626 Dec 18 20:58:57.094039 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1648/3375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:56 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:57.099792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8da60e81-1a05-4857-a6bd-a40211645024 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714f585940>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:57.148814 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8da60e81-1a05-4857-a6bd-a40211645024 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.053030 Dec 18 20:58:57.154812 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1649/3376] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:57 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:57.168729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5902601a-c6ef-41f1-adca-e785083f636b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:57.170005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5902601a-c6ef-41f1-adca-e785083f636b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:57.177141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5902601a-c6ef-41f1-adca-e785083f636b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.177828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5902601a-c6ef-41f1-adca-e785083f636b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.178836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5902601a-c6ef-41f1-adca-e785083f636b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.179276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5902601a-c6ef-41f1-adca-e785083f636b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.230141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5902601a-c6ef-41f1-adca-e785083f636b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.066012 Dec 18 20:58:57.236024 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1650/3377] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:57 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:57.249755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-920c4e84-b2c1-41a6-91ac-4eaf3ff338d5 req-51fd3d92-3758-4319-8f7c-7fe18f976b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479eeab2-5ceb-4408-b0a1-4d5eca0abc0e", "name": "network-vif-unplugged", "status": "completed", "tag": "8de86d40-0ffe-4a89-ae60-fdfa7a44d805"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:57.251353 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:58:57.251353 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:58:57.265238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-920c4e84-b2c1-41a6-91ac-4eaf3ff338d5 req-51fd3d92-3758-4319-8f7c-7fe18f976b3e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.265976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-920c4e84-b2c1-41a6-91ac-4eaf3ff338d5 req-51fd3d92-3758-4319-8f7c-7fe18f976b3e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.282774 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-920c4e84-b2c1-41a6-91ac-4eaf3ff338d5 req-51fd3d92-3758-4319-8f7c-7fe18f976b3e service nova] Creating event network-vif-unplugged:8de86d40-0ffe-4a89-ae60-fdfa7a44d805 for instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e on nch1-master-1 Dec 18 20:58:57.289178 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-920c4e84-b2c1-41a6-91ac-4eaf3ff338d5 req-51fd3d92-3758-4319-8f7c-7fe18f976b3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051671 Dec 18 20:58:57.293837 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1651/3378] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:58:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:57.489383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:57.493387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:57.501141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.501591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.502444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.503055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.757463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:57.765480 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0a1906c-a2db-47b7-afaa-04ab8d1dcc6f tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1501 microversion: 2.1 time: 0.280423 Dec 18 20:58:57.766062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1652/3379] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:57 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:57.777479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-534d46d4-cb32-4a48-b58e-1d73981806db tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:57.777479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-534d46d4-cb32-4a48-b58e-1d73981806db tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:57.778164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534d46d4-cb32-4a48-b58e-1d73981806db tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.778651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534d46d4-cb32-4a48-b58e-1d73981806db tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.779436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534d46d4-cb32-4a48-b58e-1d73981806db tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.779869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534d46d4-cb32-4a48-b58e-1d73981806db tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.822447 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-534d46d4-cb32-4a48-b58e-1d73981806db tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.054422 Dec 18 20:58:57.823117 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1653/3380] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:57 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:57.831240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:57.832011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:57.839257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.839767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:57.841264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:57.841264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.046791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:58.054771 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-872e10c1-e72d-48c1-a419-243892eecf7b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1501 microversion: 2.1 time: 0.230233 Dec 18 20:58:58.055609 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1654/3381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:57 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:58.059995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:58.060593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.067108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.067866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.068682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.069122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.271730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:58.280908 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-821eed65-a9c5-403f-bf0b-f649272b49a2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.224259 Dec 18 20:58:58.290499 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1655/3382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:58 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:58.298932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:58.299508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.305547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.306052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.307180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.307628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.331381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lazy-loading 'flavor' on Instance uuid d410d2ca-b30b-47d1-a7f5-72a2f1940a28 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:58:58.402499 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-948a4ffa-e170-4279-8ff4-6fe3a09f2d15 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action" status: 202 len: 0 microversion: 2.1 time: 0.110632 Dec 18 20:58:58.406037 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1656/3383] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:58 2021] POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:58.408260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1282236d-5c8f-47d2-a3bb-08bbb88e4e94 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:58.409274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1282236d-5c8f-47d2-a3bb-08bbb88e4e94 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.415500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1282236d-5c8f-47d2-a3bb-08bbb88e4e94 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.416152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1282236d-5c8f-47d2-a3bb-08bbb88e4e94 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.416759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1282236d-5c8f-47d2-a3bb-08bbb88e4e94 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.417366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1282236d-5c8f-47d2-a3bb-08bbb88e4e94 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.475163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1282236d-5c8f-47d2-a3bb-08bbb88e4e94 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.070561 Dec 18 20:58:58.476080 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1657/3384] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:58 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:58.480975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:58.481612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: b570c4b4-9fec-4af2-a087-0a30ca81794b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.489770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.490269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.491103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.491540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.506518 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Instance b570c4b4-9fec-4af2-a087-0a30ca81794b could not be found. Dec 18 20:58:58.507103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 404 to user: Instance b570c4b4-9fec-4af2-a087-0a30ca81794b could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:58:58.507924 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a4b35e4-4a9f-41dc-aa06-d57bbc980c5d tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b" status: 404 len: 111 microversion: 2.1 time: 0.030894 Dec 18 20:58:58.508468 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1658/3385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:58 2021] GET /compute/v2.1/servers/b570c4b4-9fec-4af2-a087-0a30ca81794b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:58.512689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3fb5b74a-906d-4d26-b2e2-19ca24b1dc11 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714ee910d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:58.537658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-123aecee-bdce-480f-bc62-1838b46d8df2 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.450720 Dec 18 20:58:58.543781 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1728/3386] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:58:57 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:58:58.543781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba6647d6-99ae-47a3-b60a-18e63508a9ad tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:58.544702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba6647d6-99ae-47a3-b60a-18e63508a9ad tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.552166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6647d6-99ae-47a3-b60a-18e63508a9ad tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.552641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6647d6-99ae-47a3-b60a-18e63508a9ad tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.553463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6647d6-99ae-47a3-b60a-18e63508a9ad tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.553901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6647d6-99ae-47a3-b60a-18e63508a9ad tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.557211 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3fb5b74a-906d-4d26-b2e2-19ca24b1dc11 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.047737 Dec 18 20:58:58.560071 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1659/3387] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:58 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:58.565777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:58.566475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.574492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.574899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.575816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.576262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.599310 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba6647d6-99ae-47a3-b60a-18e63508a9ad tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.059640 Dec 18 20:58:58.602382 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1729/3388] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:58 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:58.607766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:58.608690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.616540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.617008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.617808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.618306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.644794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:58:58.715461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:58.731725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4445a4ae-ff7e-4ead-b267-ab231689faf0 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 204 len: 0 microversion: 2.1 time: 0.127288 Dec 18 20:58:58.732506 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1730/3389] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:58:58 2021] DELETE /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:58:58.739823 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-955ad4f4-89c9-4e6f-99fe-98b8f75cca66 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1509 microversion: 2.1 time: 0.178594 Dec 18 20:58:58.743288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b48a130-b3f3-42ba-a440-79290e2cede4 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Action: 'create', calling method: .version_select at 0x7f715c45c0d0>, body: {"pool": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:58.753346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1660/3390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:58 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:58.758163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:58.758806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.765631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.766086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.768146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.768475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.961381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:58.970464 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2bae18fd-d190-4695-a1d7-78c9d5ce1799 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.215260 Dec 18 20:58:58.971259 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1661/3391] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:58 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:58.984777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5604774c-a097-4305-a513-6753f7f240d2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:58.985730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5604774c-a097-4305-a513-6753f7f240d2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:58.991677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5604774c-a097-4305-a513-6753f7f240d2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.992135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5604774c-a097-4305-a513-6753f7f240d2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:58.992926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5604774c-a097-4305-a513-6753f7f240d2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:58.993384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5604774c-a097-4305-a513-6753f7f240d2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.041315 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5604774c-a097-4305-a513-6753f7f240d2 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.059586 Dec 18 20:58:59.042344 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1662/3392] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:58 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:59.297675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:59.298459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:59.305714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.306177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.307005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.307456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.755464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:58:59.764005 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2c6f717-9063-4efc-96be-904f55ebe93c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.470373 Dec 18 20:58:59.773549 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1663/3393] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:59 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:58:59.773549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-76b5731a-4e1e-423a-ac4c-259bb2e9477d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:59.773549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-76b5731a-4e1e-423a-ac4c-259bb2e9477d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:59.776700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76b5731a-4e1e-423a-ac4c-259bb2e9477d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.777193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76b5731a-4e1e-423a-ac4c-259bb2e9477d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.778415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76b5731a-4e1e-423a-ac4c-259bb2e9477d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.778531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76b5731a-4e1e-423a-ac4c-259bb2e9477d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.827931 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-76b5731a-4e1e-423a-ac4c-259bb2e9477d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.062119 Dec 18 20:58:59.832044 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1664/3394] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:58:59 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:58:59.833559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f28bbb6-f1aa-49fd-af29-599930068766 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714eec1dc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:59.889234 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f28bbb6-f1aa-49fd-af29-599930068766 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.059469 Dec 18 20:58:59.889798 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1665/3395] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:59 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:58:59.894728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-684f6b74-cc40-4c72-9a0a-1cd6139ac3eb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:58:59.895730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-684f6b74-cc40-4c72-9a0a-1cd6139ac3eb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:59.901887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684f6b74-cc40-4c72-9a0a-1cd6139ac3eb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.902369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684f6b74-cc40-4c72-9a0a-1cd6139ac3eb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.903157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684f6b74-cc40-4c72-9a0a-1cd6139ac3eb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.903613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-684f6b74-cc40-4c72-9a0a-1cd6139ac3eb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.948330 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-684f6b74-cc40-4c72-9a0a-1cd6139ac3eb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.056996 Dec 18 20:58:59.949723 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1666/3396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:58:59 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:58:59.956268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:58:59.956961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:58:59.965913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.966444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:58:59.967297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:58:59.967779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.241459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:00.249808 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6798ee34-294b-44ff-9fe3-c8f6d51b7ba4 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1492 microversion: 2.1 time: 0.299226 Dec 18 20:59:00.251470 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1667/3397] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:58:59 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1492 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:00.260034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:00.260759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:00.268246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.268775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.269649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.270185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.346123 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b48a130-b3f3-42ba-a440-79290e2cede4 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.611895 Dec 18 20:59:00.353558 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1731/3398] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 20:58:58 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:00.358971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8348204-dae7-4b93-9274-a9eec6f08210 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:00.361447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8348204-dae7-4b93-9274-a9eec6f08210 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:00.370376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8348204-dae7-4b93-9274-a9eec6f08210 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.371120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8348204-dae7-4b93-9274-a9eec6f08210 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.372152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8348204-dae7-4b93-9274-a9eec6f08210 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.372848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8348204-dae7-4b93-9274-a9eec6f08210 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.426913 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8348204-dae7-4b93-9274-a9eec6f08210 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.071227 Dec 18 20:59:00.427531 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1732/3399] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:00 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:00.432715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d66fe541-a674-49b4-8849-1c4d0f04784b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:00.433336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d66fe541-a674-49b4-8849-1c4d0f04784b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:00.440895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66fe541-a674-49b4-8849-1c4d0f04784b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.441342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66fe541-a674-49b4-8849-1c4d0f04784b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.442346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66fe541-a674-49b4-8849-1c4d0f04784b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.442961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d66fe541-a674-49b4-8849-1c4d0f04784b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.449697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:00.459366 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b03d2b0-8652-4b37-92a7-df3d572ec0b4 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.206631 Dec 18 20:59:00.460914 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1668/3400] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:00 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:00.467075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c1cb800b-d800-4a84-a44a-bbfeb065a1af tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Calling method '.version_select at 0x7f714ef11160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:00.556017 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d66fe541-a674-49b4-8849-1c4d0f04784b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action" status: 202 len: 0 microversion: 2.1 time: 0.126839 Dec 18 20:59:00.562671 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1733/3401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:00 2021] POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:00.579224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:00.580292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:00.594132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.595294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.596395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.597054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.844400 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c1cb800b-d800-4a84-a44a-bbfeb065a1af tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/b5bef4f9-a46f-451c-a3b0-7c0551057d47" status: 200 len: 141 microversion: 2.1 time: 0.382093 Dec 18 20:59:00.845246 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1669/3402] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 20:59:00 2021] GET /compute/v2.1/os-floating-ips/b5bef4f9-a46f-451c-a3b0-7c0551057d47 => generated 141 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:00.849761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:00.850970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:00.865941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.866786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.867847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.869786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.892698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:00.903652 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-509a2549-3a29-475e-af2e-ed3a189142ae tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1498 microversion: 2.1 time: 0.336006 Dec 18 20:59:00.916099 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1734/3403] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:00 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1498 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:00.923567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-749c2212-c3b6-4d5d-912e-b14871f5dafe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:00.924881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-749c2212-c3b6-4d5d-912e-b14871f5dafe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:00.935489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749c2212-c3b6-4d5d-912e-b14871f5dafe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.936605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749c2212-c3b6-4d5d-912e-b14871f5dafe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:00.938914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749c2212-c3b6-4d5d-912e-b14871f5dafe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:00.939386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749c2212-c3b6-4d5d-912e-b14871f5dafe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.013660 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-749c2212-c3b6-4d5d-912e-b14871f5dafe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.094063 Dec 18 20:59:01.021391 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1735/3404] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:00 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:01.035822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ecfd4c5-bf0a-46f4-b67e-c211c42c447a tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Calling method '.version_select at 0x7f714fcfb700>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:01.135812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:01.144258 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-811c1fae-30db-49e1-a4bc-7ae8123ee3f7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.297745 Dec 18 20:59:01.147054 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1670/3405] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:00 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:01.161262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-488eb76e-0fe4-4516-8c6c-d4051d1d7e8d tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714fbad700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:01.239488 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-488eb76e-0fe4-4516-8c6c-d4051d1d7e8d tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.086199 Dec 18 20:59:01.249271 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1671/3406] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:01 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:01.255104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5a472636-df9b-4922-a09c-905a0bdf5743 req-1181f303-9d15-467a-8fcf-cda176c1e97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479eeab2-5ceb-4408-b0a1-4d5eca0abc0e", "name": "network-vif-plugged", "status": "completed", "tag": "8de86d40-0ffe-4a89-ae60-fdfa7a44d805"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:01.256950 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:01.256950 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:01.264558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5a472636-df9b-4922-a09c-905a0bdf5743 req-1181f303-9d15-467a-8fcf-cda176c1e97c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.265022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5a472636-df9b-4922-a09c-905a0bdf5743 req-1181f303-9d15-467a-8fcf-cda176c1e97c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.283395 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5a472636-df9b-4922-a09c-905a0bdf5743 req-1181f303-9d15-467a-8fcf-cda176c1e97c service nova] Creating event network-vif-plugged:8de86d40-0ffe-4a89-ae60-fdfa7a44d805 for instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e on nch1-master-1 Dec 18 20:59:01.291907 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5a472636-df9b-4922-a09c-905a0bdf5743 req-1181f303-9d15-467a-8fcf-cda176c1e97c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041086 Dec 18 20:59:01.299456 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1672/3407] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:01.316235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9dc8f28f-e2e8-43d1-8179-2a625e409646 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:01.318314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9dc8f28f-e2e8-43d1-8179-2a625e409646 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:01.328527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dc8f28f-e2e8-43d1-8179-2a625e409646 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.329401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dc8f28f-e2e8-43d1-8179-2a625e409646 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.330534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dc8f28f-e2e8-43d1-8179-2a625e409646 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.330996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dc8f28f-e2e8-43d1-8179-2a625e409646 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.377788 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9dc8f28f-e2e8-43d1-8179-2a625e409646 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.076568 Dec 18 20:59:01.381558 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1673/3408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:01 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:01.440055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab6e53fe-f9be-491b-95db-f97c8c3931a5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:01.441350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab6e53fe-f9be-491b-95db-f97c8c3931a5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:01.449006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab6e53fe-f9be-491b-95db-f97c8c3931a5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.449440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab6e53fe-f9be-491b-95db-f97c8c3931a5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.450453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab6e53fe-f9be-491b-95db-f97c8c3931a5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.451158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab6e53fe-f9be-491b-95db-f97c8c3931a5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.499126 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab6e53fe-f9be-491b-95db-f97c8c3931a5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.063693 Dec 18 20:59:01.504090 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1674/3409] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:01 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:01.519146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:01.519850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:01.537595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.538069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.538924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.539367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.756352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:01.764375 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5c443e6c-0d4d-4c59-9a15-e5d951e636d7 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.259163 Dec 18 20:59:01.765143 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1675/3410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:01 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:01.920963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:01.924329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:01.937871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.939113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:01.941088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:01.944125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.259594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:02.269479 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ddb2f8ea-1ab6-4dff-b4e2-659638ee0c2b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1498 microversion: 2.1 time: 0.352304 Dec 18 20:59:02.270325 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1676/3411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:01 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1498 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:02.275210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ecfd4c5-bf0a-46f4-b67e-c211c42c447a tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/b5bef4f9-a46f-451c-a3b0-7c0551057d47" status: 202 len: 0 microversion: 2.1 time: 1.251912 Dec 18 20:59:02.281273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6ba4fe0-c623-4bc4-8d2e-6fe748c318fe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:02.283945 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1736/3412] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:59:01 2021] DELETE /compute/v2.1/os-floating-ips/b5bef4f9-a46f-451c-a3b0-7c0551057d47 => generated 0 bytes in 1260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:02.287101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6ba4fe0-c623-4bc4-8d2e-6fe748c318fe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:02.289679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:02.290467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:02.297560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.298019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.298878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.299311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.302046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ba4fe0-c623-4bc4-8d2e-6fe748c318fe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.302546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ba4fe0-c623-4bc4-8d2e-6fe748c318fe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.306595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ba4fe0-c623-4bc4-8d2e-6fe748c318fe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.306595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ba4fe0-c623-4bc4-8d2e-6fe748c318fe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.411171 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6ba4fe0-c623-4bc4-8d2e-6fe748c318fe tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.135326 Dec 18 20:59:02.419651 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1677/3413] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:02 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:02.425477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-51330d06-7137-4ab1-a96d-c48b26c729af tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714eb6dd30>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:02.484292 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-51330d06-7137-4ab1-a96d-c48b26c729af tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.063241 Dec 18 20:59:02.486563 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1678/3414] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:02 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:02.491814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed0701a7-a148-4d89-9317-e14cdbfa4c36 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Calling method '.version_select at 0x7f714eb6d820>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:02.608825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:02.620618 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-640a47ee-7143-4d6b-8a1e-372a5c5570fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1681 microversion: 2.1 time: 0.335271 Dec 18 20:59:02.621108 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1737/3415] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:02 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:02.633913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9911212f-818d-4e08-b742-97995a46bb49 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:02.635212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9911212f-818d-4e08-b742-97995a46bb49 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:02.652221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9911212f-818d-4e08-b742-97995a46bb49 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.652810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9911212f-818d-4e08-b742-97995a46bb49 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.653800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9911212f-818d-4e08-b742-97995a46bb49 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.654546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9911212f-818d-4e08-b742-97995a46bb49 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.707733 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9911212f-818d-4e08-b742-97995a46bb49 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.079832 Dec 18 20:59:02.710483 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1738/3416] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:02 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:02.716102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b545cce-2e8e-4af9-9e87-a2654c5855e7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:02.719258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b545cce-2e8e-4af9-9e87-a2654c5855e7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:02.728173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b545cce-2e8e-4af9-9e87-a2654c5855e7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.728770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b545cce-2e8e-4af9-9e87-a2654c5855e7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.729678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b545cce-2e8e-4af9-9e87-a2654c5855e7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.730229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b545cce-2e8e-4af9-9e87-a2654c5855e7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.785896 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b545cce-2e8e-4af9-9e87-a2654c5855e7 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.073609 Dec 18 20:59:02.786234 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed0701a7-a148-4d89-9317-e14cdbfa4c36 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.298466 Dec 18 20:59:02.793523 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1679/3417] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Dec 18 20:59:02 2021] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 20:59:02.793708 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1739/3418] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:02 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:02.797681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:02.798447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:02.799044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8560db4-6872-4e9c-b0f3-f0e93c2c1971 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Calling method '.version_select at 0x7f715c45c790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:02.810498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.810962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:02.811778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:02.812220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:03.110725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8560db4-6872-4e9c-b0f3-f0e93c2c1971 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.314977 Dec 18 20:59:03.111309 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1740/3419] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 20:59:02 2021] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:03.120609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:03.129269 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6abc7246-35a1-412b-bc0b-4c56cc3fb69a tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.340960 Dec 18 20:59:03.130373 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1680/3420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:02 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:03.135799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75f81a35-cbbb-4be8-a147-17c10a69c22e tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Calling method '.version_select at 0x7f714fb1ad30>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:03.290178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:03.291689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:03.298651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:03.299116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:03.300247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:03.300701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:03.617586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:03.628592 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e69bcad6-d5b9-4c3e-a253-4b4f3ebb5f22 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1501 microversion: 2.1 time: 0.345661 Dec 18 20:59:03.640265 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1681/3421] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:03 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:03.640265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b6cbeb08-39f9-4061-be7e-45365d10a101 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:03.640265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b6cbeb08-39f9-4061-be7e-45365d10a101 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:03.644630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb08-39f9-4061-be7e-45365d10a101 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:03.645083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb08-39f9-4061-be7e-45365d10a101 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:03.645893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb08-39f9-4061-be7e-45365d10a101 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:03.646373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb08-39f9-4061-be7e-45365d10a101 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:03.743797 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b6cbeb08-39f9-4061-be7e-45365d10a101 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.111436 Dec 18 20:59:03.744600 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1682/3422] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:03 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:03.750811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ba11789-0aa2-4848-ba3f-c1614992716d tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714f852430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:03.800354 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ba11789-0aa2-4848-ba3f-c1614992716d tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.054483 Dec 18 20:59:03.801144 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1683/3423] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:03 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:03.805777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:03.806609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:03.812901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:03.813719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:03.814272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:03.814719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.056381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:04.069700 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6704bc89-153d-4d65-a287-80664c854fb0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1658 microversion: 2.1 time: 0.267129 Dec 18 20:59:04.070718 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1684/3424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:03 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1658 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:04.076022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:04.076853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:04.087914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.088564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.090344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.090489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.129184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lazy-loading 'flavor' on Instance uuid d410d2ca-b30b-47d1-a7f5-72a2f1940a28 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:59:04.196366 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75f81a35-cbbb-4be8-a147-17c10a69c22e tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/7546095b-caa4-4f9c-afd0-9e35260b79c0" status: 202 len: 0 microversion: 2.1 time: 1.073872 Dec 18 20:59:04.197261 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1741/3425] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:59:03 2021] DELETE /compute/v2.1/os-floating-ips/7546095b-caa4-4f9c-afd0-9e35260b79c0 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:04.205070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2226ee06-c317-4729-8e0c-3375d4cbcd50 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:04.206611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2226ee06-c317-4729-8e0c-3375d4cbcd50 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:04.214028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2226ee06-c317-4729-8e0c-3375d4cbcd50 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.214578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2226ee06-c317-4729-8e0c-3375d4cbcd50 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.215613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2226ee06-c317-4729-8e0c-3375d4cbcd50 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.216133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2226ee06-c317-4729-8e0c-3375d4cbcd50 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.224536 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f10f84a-7ccf-4444-85df-6e21373bb785 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action" status: 202 len: 0 microversion: 2.1 time: 0.152323 Dec 18 20:59:04.229851 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1685/3426] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:04 2021] POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:04.240834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da569383-5e5f-4ee2-88db-6468133dfd19 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:04.243579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da569383-5e5f-4ee2-88db-6468133dfd19 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:04.257265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da569383-5e5f-4ee2-88db-6468133dfd19 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.258740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da569383-5e5f-4ee2-88db-6468133dfd19 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.259726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da569383-5e5f-4ee2-88db-6468133dfd19 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.260237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da569383-5e5f-4ee2-88db-6468133dfd19 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.262810 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2226ee06-c317-4729-8e0c-3375d4cbcd50 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.064012 Dec 18 20:59:04.263926 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1742/3427] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:04 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:04.269719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2c42b44a-0c77-4b98-8be8-4e82392f3fd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:04.277499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c42b44a-0c77-4b98-8be8-4e82392f3fd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.278242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c42b44a-0c77-4b98-8be8-4e82392f3fd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.307377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2c42b44a-0c77-4b98-8be8-4e82392f3fd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Going to try to start instance {{(pid=140731) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 20:59:04.309898 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da569383-5e5f-4ee2-88db-6468133dfd19 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.078777 Dec 18 20:59:04.317306 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1686/3428] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:04 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:04.323048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:04.324089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:04.332511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.333313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.334398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.335058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.364574 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2c42b44a-0c77-4b98-8be8-4e82392f3fd8 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.098674 Dec 18 20:59:04.365490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1743/3429] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:04 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:04.382153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-10d5d390-8547-44e0-b6c9-7bfe7fd98fe2 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Calling method '.version_select at 0x7f715c33a550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:04.960262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:04.973702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4651fdeb-0acd-48a0-9c10-f001dbd14a20 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.654733 Dec 18 20:59:04.975021 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1687/3430] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:04 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:04.980033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:04.980889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:04.988676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.989591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:04.990710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:04.991797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.270314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:05.283060 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09df8df0-8923-40b7-8dff-04c0a090f3a8 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1492 microversion: 2.1 time: 0.304177 Dec 18 20:59:05.297218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1688/3431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:04 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1492 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:05.297218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:05.297218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:05.308397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.308862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.309674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.310180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.546440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:05.555360 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9373a785-06e3-45ad-ab3e-268546b0eea7 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1667 microversion: 2.1 time: 0.266525 Dec 18 20:59:05.556141 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1689/3432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:05 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1667 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:05.570651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-576ab98e-1090-4cfb-8d5b-409cdbe390dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:05.571632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-576ab98e-1090-4cfb-8d5b-409cdbe390dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:05.580303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-576ab98e-1090-4cfb-8d5b-409cdbe390dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.581556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-576ab98e-1090-4cfb-8d5b-409cdbe390dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.582422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-576ab98e-1090-4cfb-8d5b-409cdbe390dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.582880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-576ab98e-1090-4cfb-8d5b-409cdbe390dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.678301 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-576ab98e-1090-4cfb-8d5b-409cdbe390dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.110956 Dec 18 20:59:05.686665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1690/3433] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:05 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:05.695419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b94da2f8-5734-4f7c-9dd1-03cab03a81e6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f71612d8550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:05.755926 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b94da2f8-5734-4f7c-9dd1-03cab03a81e6 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.066807 Dec 18 20:59:05.756944 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1691/3434] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:05 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:05.762026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a8032a7-a215-41a5-b4a9-4a30ca0ae5cd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:05.763381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a8032a7-a215-41a5-b4a9-4a30ca0ae5cd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:05.771266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a8032a7-a215-41a5-b4a9-4a30ca0ae5cd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.772268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a8032a7-a215-41a5-b4a9-4a30ca0ae5cd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.773296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a8032a7-a215-41a5-b4a9-4a30ca0ae5cd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.773958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a8032a7-a215-41a5-b4a9-4a30ca0ae5cd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.825046 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-10d5d390-8547-44e0-b6c9-7bfe7fd98fe2 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/90735ead-b35a-43ee-8b64-101b06d30b4c" status: 202 len: 0 microversion: 2.1 time: 1.457364 Dec 18 20:59:05.826500 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1744/3435] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:59:04 2021] DELETE /compute/v2.1/os-floating-ips/90735ead-b35a-43ee-8b64-101b06d30b4c => generated 0 bytes in 1460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:05.840380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a8032a7-a215-41a5-b4a9-4a30ca0ae5cd tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.081329 Dec 18 20:59:05.846678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74e73a85-87da-4616-a7a3-ce318bf90152 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:05.847676 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1692/3436] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:05 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:05.849457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74e73a85-87da-4616-a7a3-ce318bf90152 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:05.868366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a13d9102-cccf-4e6b-bc7c-0eccba52ef80 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:05.870615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74e73a85-87da-4616-a7a3-ce318bf90152 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.871302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74e73a85-87da-4616-a7a3-ce318bf90152 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.871675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a13d9102-cccf-4e6b-bc7c-0eccba52ef80 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:05.873438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74e73a85-87da-4616-a7a3-ce318bf90152 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.875016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74e73a85-87da-4616-a7a3-ce318bf90152 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.894006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13d9102-cccf-4e6b-bc7c-0eccba52ef80 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.895086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13d9102-cccf-4e6b-bc7c-0eccba52ef80 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.897556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13d9102-cccf-4e6b-bc7c-0eccba52ef80 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:05.901556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13d9102-cccf-4e6b-bc7c-0eccba52ef80 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:05.963043 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a13d9102-cccf-4e6b-bc7c-0eccba52ef80 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.111896 Dec 18 20:59:05.967081 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1693/3437] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:05 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:05.971842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5026822a-2fc5-473f-a3c0-3f22b370abc5 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] Calling method '.version_select at 0x7f71612d8f70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:06.014937 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74e73a85-87da-4616-a7a3-ce318bf90152 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action" status: 202 len: 0 microversion: 2.1 time: 0.185662 Dec 18 20:59:06.016054 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1745/3438] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:05 2021] POST /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:06.024024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:06.028467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:06.042104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:06.042687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:06.043733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:06.044274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:06.301713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ceb4b626d5f479b9e28dd26702d9d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aba7bee78744949dc3323cb4c7df55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:06.329480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7c531cc-0810-434c-a0cb-3cd33551e56f tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 200 len: 1521 microversion: 2.1 time: 0.308375 Dec 18 20:59:06.330590 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1746/3439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:06 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:06.343822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:06.344649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:06.357175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:06.357788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:06.358748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:06.359233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:06.676038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:06.683746 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-315ad0b8-e5d7-43f8-bbd4-c05fe738e297 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1498 microversion: 2.1 time: 0.352069 Dec 18 20:59:06.684317 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1747/3440] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:06 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:06.695381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:06.698283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:06.709206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:06.709942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:06.710774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:06.711371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:06.977416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:06.991361 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d4f5389-0fc9-4270-b21e-8fc1a08ecf0c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.301469 Dec 18 20:59:06.992163 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1748/3441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:06 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:06.997070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-551247c5-a18e-4312-856b-52c51ef7520f req-2856eaa7-0e06-4e39-b19b-4ab18d9f8aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fcab40-88c7-4902-a1b7-60f4caecbb80", "name": "network-vif-deleted", "tag": "67829c42-153d-4545-a748-eb36ae44aa09"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:07.002823 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:07.002823 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:07.012418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-551247c5-a18e-4312-856b-52c51ef7520f req-2856eaa7-0e06-4e39-b19b-4ab18d9f8aae service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.012862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-551247c5-a18e-4312-856b-52c51ef7520f req-2856eaa7-0e06-4e39-b19b-4ab18d9f8aae service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.033847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-551247c5-a18e-4312-856b-52c51ef7520f req-2856eaa7-0e06-4e39-b19b-4ab18d9f8aae service nova] Creating event network-vif-deleted:67829c42-153d-4545-a748-eb36ae44aa09 for instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 on nch1-master-1 Dec 18 20:59:07.038924 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-551247c5-a18e-4312-856b-52c51ef7520f req-2856eaa7-0e06-4e39-b19b-4ab18d9f8aae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045861 Dec 18 20:59:07.040223 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1749/3442] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:07.045658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46fec9d7-9d56-4adf-88df-397cbbef2733 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:07.046596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46fec9d7-9d56-4adf-88df-397cbbef2733 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:07.053752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46fec9d7-9d56-4adf-88df-397cbbef2733 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.054267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46fec9d7-9d56-4adf-88df-397cbbef2733 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.055093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46fec9d7-9d56-4adf-88df-397cbbef2733 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.055532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46fec9d7-9d56-4adf-88df-397cbbef2733 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.115821 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46fec9d7-9d56-4adf-88df-397cbbef2733 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.073542 Dec 18 20:59:07.118521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1750/3443] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:07 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:07.126867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd3372b4-77db-406c-9b3b-90c6da0da65a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f7161346550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:07.212455 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd3372b4-77db-406c-9b3b-90c6da0da65a tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.092360 Dec 18 20:59:07.213314 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1751/3444] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:07 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:07.220594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6089406-9563-457f-84c4-b9e4fba3d25a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:07.221877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6089406-9563-457f-84c4-b9e4fba3d25a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:07.236001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6089406-9563-457f-84c4-b9e4fba3d25a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.236773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6089406-9563-457f-84c4-b9e4fba3d25a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.238133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6089406-9563-457f-84c4-b9e4fba3d25a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.238890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6089406-9563-457f-84c4-b9e4fba3d25a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.271926 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5026822a-2fc5-473f-a3c0-3f22b370abc5 tempest-FloatingIPDetailsTestJSON-914592191 tempest-FloatingIPDetailsTestJSON-914592191-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/99e7483b-3b54-40e9-aeb0-fa24aedd2a50" status: 202 len: 0 microversion: 2.1 time: 1.306057 Dec 18 20:59:07.272850 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1694/3445] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 20:59:05 2021] DELETE /compute/v2.1/os-floating-ips/99e7483b-3b54-40e9-aeb0-fa24aedd2a50 => generated 0 bytes in 1308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:07.277956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7223823-92a2-4884-b4bd-a5fab2bb7b8e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:07.281292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7223823-92a2-4884-b4bd-a5fab2bb7b8e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:07.289083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7223823-92a2-4884-b4bd-a5fab2bb7b8e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.289616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7223823-92a2-4884-b4bd-a5fab2bb7b8e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.290896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7223823-92a2-4884-b4bd-a5fab2bb7b8e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.291517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7223823-92a2-4884-b4bd-a5fab2bb7b8e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.298375 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6089406-9563-457f-84c4-b9e4fba3d25a tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.081440 Dec 18 20:59:07.301929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1752/3446] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:07 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:07.308881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:07.309645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:07.317080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.317607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.318916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.319621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.364946 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7223823-92a2-4884-b4bd-a5fab2bb7b8e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.090630 Dec 18 20:59:07.365655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1695/3447] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:07 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:07.372625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:07.373350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] [instance: f6fcab40-88c7-4902-a1b7-60f4caecbb80] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:07.397243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.399882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.400761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.401216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.435569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] HTTP exception thrown: Instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 could not be found. Dec 18 20:59:07.436183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] Returning 404 to user: Instance f6fcab40-88c7-4902-a1b7-60f4caecbb80 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:07.437045 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1607b956-9a44-4387-bfbd-7e2608926f75 tempest-ServerRescueNegativeTestJSON-2089751494 tempest-ServerRescueNegativeTestJSON-2089751494-project] 10.222.0.13 "GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80" status: 404 len: 111 microversion: 2.1 time: 0.070267 Dec 18 20:59:07.437639 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1696/3448] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:07 2021] GET /compute/v2.1/servers/f6fcab40-88c7-4902-a1b7-60f4caecbb80 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:07.658955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:07.668927 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-00a28c11-9fa1-41ff-a644-049d55aa4d57 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.365529 Dec 18 20:59:07.672968 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1753/3449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:07 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:07.694650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:07.695566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:07.701840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:07.702968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:07.713909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.714724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.723077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.724673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.729585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.730592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:07.743805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:07.745131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.104622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:08.107244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:08.116034 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cff272e-3225-4468-9dd6-6266cf4ca28a tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1501 microversion: 2.1 time: 0.418914 Dec 18 20:59:08.116631 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1754/3450] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:07 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1501 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:08.117867 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-93d21aef-e2c6-469d-9a7b-47ec3135df3f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.427277 Dec 18 20:59:08.120494 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1697/3451] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:07 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:08.132480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f52a6775-594d-4ea0-b764-9de3197e2115 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:08.133472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f52a6775-594d-4ea0-b764-9de3197e2115 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:08.139355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:08.139855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:08.148510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.148966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.149769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.150207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.155385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a6775-594d-4ea0-b764-9de3197e2115 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.155841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a6775-594d-4ea0-b764-9de3197e2115 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.160306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a6775-594d-4ea0-b764-9de3197e2115 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.160801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a6775-594d-4ea0-b764-9de3197e2115 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.221990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:08.241590 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f52a6775-594d-4ea0-b764-9de3197e2115 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.112629 Dec 18 20:59:08.242294 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1755/3452] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:08 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:08.249862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:08.250564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:08.266884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.267473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.268261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.268699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.332069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lazy-loading 'flavor' on Instance uuid d025fcfa-d293-483a-80c3-2100f89d26f4 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:59:08.374150 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c44a3608-4469-4c2a-b59d-c977de8d6ce2 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 204 len: 0 microversion: 2.1 time: 0.237442 Dec 18 20:59:08.379074 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1698/3453] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:08 2021] DELETE /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:08.385137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d556560e-f55b-43ab-ab0b-1e3cce836591 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714ef7ad30>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:08.459415 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d556560e-f55b-43ab-ab0b-1e3cce836591 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.078703 Dec 18 20:59:08.465117 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1699/3454] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:08 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:08.465293 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-628fed79-c829-40b3-9771-49ab9b869d5e tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.220430 Dec 18 20:59:08.465293 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1756/3455] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:08 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:08.472381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aa6af50c-cf15-47fd-b049-ea3be46363a0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:08.473704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa6af50c-cf15-47fd-b049-ea3be46363a0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:08.482138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-707ab558-6d66-4d67-a2b6-536f6f7630e6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:08.483311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-707ab558-6d66-4d67-a2b6-536f6f7630e6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:08.506034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707ab558-6d66-4d67-a2b6-536f6f7630e6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.506824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707ab558-6d66-4d67-a2b6-536f6f7630e6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.507791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707ab558-6d66-4d67-a2b6-536f6f7630e6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.508381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707ab558-6d66-4d67-a2b6-536f6f7630e6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.510173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa6af50c-cf15-47fd-b049-ea3be46363a0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.511166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa6af50c-cf15-47fd-b049-ea3be46363a0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.512271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa6af50c-cf15-47fd-b049-ea3be46363a0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.512799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa6af50c-cf15-47fd-b049-ea3be46363a0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.566790 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-707ab558-6d66-4d67-a2b6-536f6f7630e6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.105072 Dec 18 20:59:08.571297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1700/3456] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:08 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:08.572386 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aa6af50c-cf15-47fd-b049-ea3be46363a0 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.105382 Dec 18 20:59:08.573651 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1757/3457] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:08 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:08.577679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:08.577843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:08.578482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:08.590740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:08.591306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.591954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.592795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.593248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.604539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.605012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:08.611839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:08.612356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:09.208552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:09.216917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05f03aa1-d277-4683-996a-f4a0eba3006c tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1507 microversion: 2.1 time: 0.646967 Dec 18 20:59:09.228865 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1701/3458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:08 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:09.248168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:09.253256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a51d61b-e827-4aee-883f-a79b5b2e3560 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:09.254269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a51d61b-e827-4aee-883f-a79b5b2e3560 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:09.263571 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f61ed924-620f-4a15-92f1-fb2a4b4b096c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1679 microversion: 2.1 time: 0.689343 Dec 18 20:59:09.270716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a51d61b-e827-4aee-883f-a79b5b2e3560 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:09.271354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a51d61b-e827-4aee-883f-a79b5b2e3560 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:09.273100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a51d61b-e827-4aee-883f-a79b5b2e3560 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:09.273557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a51d61b-e827-4aee-883f-a79b5b2e3560 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:09.274059 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1758/3459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:08 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1679 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:09.349057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a51d61b-e827-4aee-883f-a79b5b2e3560 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.099293 Dec 18 20:59:09.353535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1702/3460] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:09 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:59:09.473228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13cbcbd3-5b8d-4f69-9d8e-8774dea1f0bd tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714f63bdc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:09.535644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13cbcbd3-5b8d-4f69-9d8e-8774dea1f0bd tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.065314 Dec 18 20:59:09.543618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1759/3461] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:09 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:09.585972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-175050d1-9e4c-48a9-a59f-94ff0b72d694 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:09.587472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ae623de-779d-45a7-86c9-59f15c365899 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:09.588507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ae623de-779d-45a7-86c9-59f15c365899 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:09.590814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-175050d1-9e4c-48a9-a59f-94ff0b72d694 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:09.610132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae623de-779d-45a7-86c9-59f15c365899 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:09.612330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-175050d1-9e4c-48a9-a59f-94ff0b72d694 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:09.612943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-175050d1-9e4c-48a9-a59f-94ff0b72d694 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:09.614097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-175050d1-9e4c-48a9-a59f-94ff0b72d694 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:09.614796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae623de-779d-45a7-86c9-59f15c365899 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:09.615614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae623de-779d-45a7-86c9-59f15c365899 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:09.616054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ae623de-779d-45a7-86c9-59f15c365899 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:09.622991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-175050d1-9e4c-48a9-a59f-94ff0b72d694 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:09.693250 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-175050d1-9e4c-48a9-a59f-94ff0b72d694 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.111174 Dec 18 20:59:09.698359 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1760/3462] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:09 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:09.723013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ae623de-779d-45a7-86c9-59f15c365899 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.144970 Dec 18 20:59:09.727356 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1703/3463] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:09 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:10.247033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:10.247887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:10.256001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.256675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.268410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.269152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.287761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:10.289104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:10.306626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.312300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.313550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.314128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.768546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:10.782714 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0398376f-f610-438b-9ddb-68e129c3b98d tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1662 microversion: 2.1 time: 0.501484 Dec 18 20:59:10.784005 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1704/3464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:10 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1662 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:10.792679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0687de52-2483-41cb-adac-774ec3dfd4d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:10.793944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0687de52-2483-41cb-adac-774ec3dfd4d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:10.810049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:10.810621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0687de52-2483-41cb-adac-774ec3dfd4d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.811095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0687de52-2483-41cb-adac-774ec3dfd4d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.811930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0687de52-2483-41cb-adac-774ec3dfd4d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.812382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0687de52-2483-41cb-adac-774ec3dfd4d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.822088 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-306894f3-23a4-42ed-97fc-f0b2d485ab72 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1507 microversion: 2.1 time: 0.576648 Dec 18 20:59:10.823005 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1761/3465] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:10 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1507 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:10.841246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dc2e342d-7937-42f7-b165-99e61e3c7dda tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714f63bc10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:10.920977 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dc2e342d-7937-42f7-b165-99e61e3c7dda tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.085324 Dec 18 20:59:10.921838 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1762/3466] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:10 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:10.928282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9d10bb6-6ac4-4d02-9f62-e706db2714a3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:10.934131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9d10bb6-6ac4-4d02-9f62-e706db2714a3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:10.947884 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0687de52-2483-41cb-adac-774ec3dfd4d0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.162196 Dec 18 20:59:10.955583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d10bb6-6ac4-4d02-9f62-e706db2714a3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.956110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d10bb6-6ac4-4d02-9f62-e706db2714a3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.956920 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1705/3467] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:10 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:10.957203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d10bb6-6ac4-4d02-9f62-e706db2714a3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.957537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d10bb6-6ac4-4d02-9f62-e706db2714a3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.965311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22adcf80-28d5-478a-983a-699630324834 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:10.971760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-22adcf80-28d5-478a-983a-699630324834 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:10.981166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22adcf80-28d5-478a-983a-699630324834 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.983010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22adcf80-28d5-478a-983a-699630324834 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:10.984221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22adcf80-28d5-478a-983a-699630324834 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:10.984957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22adcf80-28d5-478a-983a-699630324834 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.040923 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22adcf80-28d5-478a-983a-699630324834 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.079873 Dec 18 20:59:11.041360 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9d10bb6-6ac4-4d02-9f62-e706db2714a3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.117898 Dec 18 20:59:11.042500 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1706/3468] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:10 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:11.042996 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1763/3469] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:10 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:11.049048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aaa8f5b0-bcf6-4ddb-8fcb-4b9e79cb6e16 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:11.053566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aaa8f5b0-bcf6-4ddb-8fcb-4b9e79cb6e16 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:11.066923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa8f5b0-bcf6-4ddb-8fcb-4b9e79cb6e16 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:11.067753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa8f5b0-bcf6-4ddb-8fcb-4b9e79cb6e16 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.068788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa8f5b0-bcf6-4ddb-8fcb-4b9e79cb6e16 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:11.069549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa8f5b0-bcf6-4ddb-8fcb-4b9e79cb6e16 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.166820 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aaa8f5b0-bcf6-4ddb-8fcb-4b9e79cb6e16 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action" status: 202 len: 0 microversion: 2.1 time: 0.122190 Dec 18 20:59:11.167934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1707/3470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:11 2021] POST /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:11.183289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:11.192238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:11.225126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:11.225717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.228647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:11.229113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.695683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:11.703776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad59e7da-1527-4e52-9db6-b891fa93335f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1668 microversion: 2.1 time: 0.531183 Dec 18 20:59:11.719396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1764/3471] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:11 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1668 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:11.770989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3f74664c-5037-44e8-adf7-d434f171f054 req-f61b5425-4df1-42bf-b8a2-85a1b75ee543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d410d2ca-b30b-47d1-a7f5-72a2f1940a28", "name": "network-vif-deleted", "tag": "7a02115a-9983-4c01-949f-bb313b22b679"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:11.772935 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:11.772935 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:11.811128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3f74664c-5037-44e8-adf7-d434f171f054 req-f61b5425-4df1-42bf-b8a2-85a1b75ee543 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:11.811911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3f74664c-5037-44e8-adf7-d434f171f054 req-f61b5425-4df1-42bf-b8a2-85a1b75ee543 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.827356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3f74664c-5037-44e8-adf7-d434f171f054 req-f61b5425-4df1-42bf-b8a2-85a1b75ee543 service nova] Creating event network-vif-deleted:7a02115a-9983-4c01-949f-bb313b22b679 for instance d410d2ca-b30b-47d1-a7f5-72a2f1940a28 on nch2-master-1 Dec 18 20:59:11.839367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:11.840163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3f74664c-5037-44e8-adf7-d434f171f054 req-f61b5425-4df1-42bf-b8a2-85a1b75ee543 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072117 Dec 18 20:59:11.840796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:11.843018 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1708/3472] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:11.849934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:11.854689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.856109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:11.856737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:11.935632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6eadf630-3ce9-49b8-9180-29460c2190b3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714f76c430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:12.019597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27421f4afc3a4c1596fc19399e1616a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:12.035810 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-262289da-9b07-4911-879c-2f78786dc41b tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 200 len: 1299 microversion: 2.1 time: 0.200408 Dec 18 20:59:12.036432 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1765/3473] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:11 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:12.062377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6258d3ba-ad68-4608-9b99-1b8db4450882 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:12.067829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6258d3ba-ad68-4608-9b99-1b8db4450882 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:12.074877 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6eadf630-3ce9-49b8-9180-29460c2190b3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.143197 Dec 18 20:59:12.076027 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1709/3474] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:11 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:12.090587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22acbad2-c0eb-4090-bb16-9177089be2c5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:12.093854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-22acbad2-c0eb-4090-bb16-9177089be2c5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:12.099578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6258d3ba-ad68-4608-9b99-1b8db4450882 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.100286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6258d3ba-ad68-4608-9b99-1b8db4450882 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:12.103848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6258d3ba-ad68-4608-9b99-1b8db4450882 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.105203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22acbad2-c0eb-4090-bb16-9177089be2c5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.105663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22acbad2-c0eb-4090-bb16-9177089be2c5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:12.106126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6258d3ba-ad68-4608-9b99-1b8db4450882 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:12.106537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22acbad2-c0eb-4090-bb16-9177089be2c5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.107975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22acbad2-c0eb-4090-bb16-9177089be2c5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:12.171142 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22acbad2-c0eb-4090-bb16-9177089be2c5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.093280 Dec 18 20:59:12.175940 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1710/3475] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:12 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:12.181246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84e85ac0-3f7c-417d-85c5-adf76d2a8aee tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:12.182366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84e85ac0-3f7c-417d-85c5-adf76d2a8aee tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:12.192780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84e85ac0-3f7c-417d-85c5-adf76d2a8aee tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.193576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84e85ac0-3f7c-417d-85c5-adf76d2a8aee tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:12.195030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84e85ac0-3f7c-417d-85c5-adf76d2a8aee tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.195600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84e85ac0-3f7c-417d-85c5-adf76d2a8aee tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:12.219982 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6258d3ba-ad68-4608-9b99-1b8db4450882 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.170310 Dec 18 20:59:12.220640 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1766/3476] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:12 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:12.247489 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84e85ac0-3f7c-417d-85c5-adf76d2a8aee tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.070588 Dec 18 20:59:12.248401 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1711/3477] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:12 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:12.729333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:12.732626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:12.740478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.740943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:12.741778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:12.742196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.053570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:13.054299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] [instance: d410d2ca-b30b-47d1-a7f5-72a2f1940a28] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:13.067581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.069401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.074632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.075354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.119964 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] HTTP exception thrown: Instance d410d2ca-b30b-47d1-a7f5-72a2f1940a28 could not be found. Dec 18 20:59:13.119964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] Returning 404 to user: Instance d410d2ca-b30b-47d1-a7f5-72a2f1940a28 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:13.120636 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-559f01bc-699e-401f-b8a5-8de37ba21d06 tempest-TestServerAdvancedOps-2063223779 tempest-TestServerAdvancedOps-2063223779-project] 10.222.0.13 "GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28" status: 404 len: 111 microversion: 2.1 time: 0.071282 Dec 18 20:59:13.121414 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1712/3478] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:13 2021] GET /compute/v2.1/servers/d410d2ca-b30b-47d1-a7f5-72a2f1940a28 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 20:59:13.132881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-92256de1-f309-4fdd-81fe-4a91f9156fb8 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f7161323c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:13.195449 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-92256de1-f309-4fdd-81fe-4a91f9156fb8 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.066457 Dec 18 20:59:13.195674 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1713/3479] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:13 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:13.200698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ceb3322e-378c-409f-9fbc-8feb007ccab3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:13.201744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ceb3322e-378c-409f-9fbc-8feb007ccab3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:13.208474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb3322e-378c-409f-9fbc-8feb007ccab3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.209103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb3322e-378c-409f-9fbc-8feb007ccab3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.209987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb3322e-378c-409f-9fbc-8feb007ccab3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.210479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb3322e-378c-409f-9fbc-8feb007ccab3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.275672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ceb3322e-378c-409f-9fbc-8feb007ccab3 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.078190 Dec 18 20:59:13.279631 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1714/3480] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:13 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:13.287575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4589632-4f9b-4818-8275-80e219beb391 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:13.288749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4589632-4f9b-4818-8275-80e219beb391 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:13.301368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4589632-4f9b-4818-8275-80e219beb391 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.301963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4589632-4f9b-4818-8275-80e219beb391 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.304033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4589632-4f9b-4818-8275-80e219beb391 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.304583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4589632-4f9b-4818-8275-80e219beb391 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.394974 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4589632-4f9b-4818-8275-80e219beb391 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.116537 Dec 18 20:59:13.396679 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1715/3481] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:13 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:13.402286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-230587bd-86f9-4273-a5dd-3bfb9f5eab41 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:13.403573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-230587bd-86f9-4273-a5dd-3bfb9f5eab41 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:13.411124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-230587bd-86f9-4273-a5dd-3bfb9f5eab41 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.411752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-230587bd-86f9-4273-a5dd-3bfb9f5eab41 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.412553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-230587bd-86f9-4273-a5dd-3bfb9f5eab41 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:13.412992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-230587bd-86f9-4273-a5dd-3bfb9f5eab41 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:13.496610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-230587bd-86f9-4273-a5dd-3bfb9f5eab41 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.098262 Dec 18 20:59:13.502470 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1716/3482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:13 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:13.732770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:13.747613 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d916b9d-efb3-45de-81ed-64c97a3fc15a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1668 microversion: 2.1 time: 1.025809 Dec 18 20:59:13.748489 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1767/3483] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:12 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1668 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:14.208252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a05935aa-9333-48ec-971c-6ea9ab5b37a2 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f716138a820>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:14.279224 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a05935aa-9333-48ec-971c-6ea9ab5b37a2 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1429 microversion: 2.1 time: 0.074838 Dec 18 20:59:14.280553 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1717/3484] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:14 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:14.287238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-152e83b5-65a4-44e4-a7c5-80bc792f95cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:14.288439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-152e83b5-65a4-44e4-a7c5-80bc792f95cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:14.295875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-152e83b5-65a4-44e4-a7c5-80bc792f95cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.302561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-152e83b5-65a4-44e4-a7c5-80bc792f95cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:14.307433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-152e83b5-65a4-44e4-a7c5-80bc792f95cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.308108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-152e83b5-65a4-44e4-a7c5-80bc792f95cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:14.377825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-152e83b5-65a4-44e4-a7c5-80bc792f95cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.093848 Dec 18 20:59:14.382219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1768/3485] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:14 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:14.407745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8adb9140-5dae-4762-9145-8912bccb723f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:14.408882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8adb9140-5dae-4762-9145-8912bccb723f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:14.417744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8adb9140-5dae-4762-9145-8912bccb723f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.425855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8adb9140-5dae-4762-9145-8912bccb723f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:14.426951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8adb9140-5dae-4762-9145-8912bccb723f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.427437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8adb9140-5dae-4762-9145-8912bccb723f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:14.508015 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8adb9140-5dae-4762-9145-8912bccb723f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.104303 Dec 18 20:59:14.509222 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1718/3486] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:14 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:14.509764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e1d5044-f8f3-45fe-9932-543354e096d3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:14.510803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e1d5044-f8f3-45fe-9932-543354e096d3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:14.518641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1d5044-f8f3-45fe-9932-543354e096d3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.519385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1d5044-f8f3-45fe-9932-543354e096d3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:14.520402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1d5044-f8f3-45fe-9932-543354e096d3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.521049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1d5044-f8f3-45fe-9932-543354e096d3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:14.584500 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e1d5044-f8f3-45fe-9932-543354e096d3 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.078626 Dec 18 20:59:14.588929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1769/3487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:14 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:59:14.771518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:14.772712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:14.782834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.783521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:14.785508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:14.786420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.151276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:15.162700 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-562d6e2e-e668-440c-8250-9bdab9510481 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.400133 Dec 18 20:59:15.170304 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1719/3488] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:14 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:15.187283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:15.188161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:15.196879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.197341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.198281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.198890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.295721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64a89268-6f20-4be1-b4a2-493af43bdd27 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f71613238b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:15.384998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64a89268-6f20-4be1-b4a2-493af43bdd27 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1438 microversion: 2.1 time: 0.095205 Dec 18 20:59:15.389080 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1720/3489] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:15 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:15.397431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ee4c3e4-a0c6-41f4-9be4-e026357d5975 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:15.398618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ee4c3e4-a0c6-41f4-9be4-e026357d5975 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:15.405810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ee4c3e4-a0c6-41f4-9be4-e026357d5975 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.407206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ee4c3e4-a0c6-41f4-9be4-e026357d5975 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.408193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ee4c3e4-a0c6-41f4-9be4-e026357d5975 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.408797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ee4c3e4-a0c6-41f4-9be4-e026357d5975 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.451121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:15.459422 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ee4c3e4-a0c6-41f4-9be4-e026357d5975 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.068894 Dec 18 20:59:15.460519 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1721/3490] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:15 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:15.465695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cad747ed-5c78-4246-b5c4-69077fbf2557 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714ebbf790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:15.467890 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-619007b0-8fef-4162-92b3-a193cc0a13e1 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1671 microversion: 2.1 time: 0.287909 Dec 18 20:59:15.468863 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1770/3491] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:15 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1671 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:15.496586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:15.497208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:15.520200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.520666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.521468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.531466 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cad747ed-5c78-4246-b5c4-69077fbf2557 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 200 len: 1438 microversion: 2.1 time: 0.069672 Dec 18 20:59:15.532695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1722/3492] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:15 2021] GET /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 1438 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:15.539389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.546527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-08d991ad-7022-4f06-9b1d-4f9676f26aeb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:15.548967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-08d991ad-7022-4f06-9b1d-4f9676f26aeb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:15.559584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08d991ad-7022-4f06-9b1d-4f9676f26aeb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.560242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08d991ad-7022-4f06-9b1d-4f9676f26aeb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.562365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08d991ad-7022-4f06-9b1d-4f9676f26aeb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.565001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08d991ad-7022-4f06-9b1d-4f9676f26aeb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.614545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:15.648918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-08d991ad-7022-4f06-9b1d-4f9676f26aeb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.113610 Dec 18 20:59:15.650170 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1723/3493] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:15 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:15.654779 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Working on deleting snapshot 402779db-d442-4688-a56e-60cd0797d343 from shelved instance... Dec 18 20:59:15.655915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:15.658431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:15.667573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.668300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.669358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.670180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.907407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:15.926611 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c982ac3c-b0ab-411b-9f3a-512793a7a767 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1467 microversion: 2.1 time: 0.269522 Dec 18 20:59:15.927564 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1724/3494] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:15 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:15.936933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05aad11e-bc07-4326-b41d-851fbc744890 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:15.941786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05aad11e-bc07-4326-b41d-851fbc744890 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:15.950578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05aad11e-bc07-4326-b41d-851fbc744890 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.951286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05aad11e-bc07-4326-b41d-851fbc744890 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.952358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05aad11e-bc07-4326-b41d-851fbc744890 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:15.952970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05aad11e-bc07-4326-b41d-851fbc744890 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:15.997031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05aad11e-bc07-4326-b41d-851fbc744890 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.067996 Dec 18 20:59:15.997718 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1725/3495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:15 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:16.006968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f82b976-9962-49e6-a3ab-21949e107fe9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f714eb57ca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:17.146322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Doing local delete in cell cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=140731) _delete /opt/stack/nova/nova/compute/api.py:2439}} Dec 18 20:59:17.148687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.151092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.153192 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 18 20:59:17.164499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] deallocate_for_instance() {{(pid=140731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Dec 18 20:59:17.279873 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f82b976-9962-49e6-a3ab-21949e107fe9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "DELETE /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257" status: 204 len: 0 microversion: 2.1 time: 1.276479 Dec 18 20:59:17.284564 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1726/3496] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:16 2021] DELETE /compute/v2.1/images/e4fa1a47-6cf0-404e-96a5-a59df26ae257 => generated 0 bytes in 1279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:17.287439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bfe414ce-c2be-4a71-933c-4a6d4c607285 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:17.288881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bfe414ce-c2be-4a71-933c-4a6d4c607285 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:17.300701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfe414ce-c2be-4a71-933c-4a6d4c607285 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.303142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfe414ce-c2be-4a71-933c-4a6d4c607285 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.304563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfe414ce-c2be-4a71-933c-4a6d4c607285 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.305207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfe414ce-c2be-4a71-933c-4a6d4c607285 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.359362 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bfe414ce-c2be-4a71-933c-4a6d4c607285 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.076114 Dec 18 20:59:17.364837 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1727/3497] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:17 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:17.370127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2510bd31-99c6-43cc-aaea-00c81ce8b460 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:17.372347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2510bd31-99c6-43cc-aaea-00c81ce8b460 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:17.380671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2510bd31-99c6-43cc-aaea-00c81ce8b460 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.381417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2510bd31-99c6-43cc-aaea-00c81ce8b460 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.382357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2510bd31-99c6-43cc-aaea-00c81ce8b460 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.383076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2510bd31-99c6-43cc-aaea-00c81ce8b460 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.440820 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2510bd31-99c6-43cc-aaea-00c81ce8b460 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.076968 Dec 18 20:59:17.441864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1728/3498] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:17 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:17.448341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c763074-8f4b-43a1-9f06-e09342157ef8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:17.449388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c763074-8f4b-43a1-9f06-e09342157ef8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:17.458064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c763074-8f4b-43a1-9f06-e09342157ef8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.458586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c763074-8f4b-43a1-9f06-e09342157ef8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.459467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c763074-8f4b-43a1-9f06-e09342157ef8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.459913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c763074-8f4b-43a1-9f06-e09342157ef8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.509412 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c763074-8f4b-43a1-9f06-e09342157ef8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.064940 Dec 18 20:59:17.513514 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1729/3499] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:17 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:17.518540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-00a78793-5dd0-4d68-ab46-18dc49edafed tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '.version_select at 0x7f71613235e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:17.545351 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-00a78793-5dd0-4d68-ab46-18dc49edafed tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] HTTP exception thrown: Image not found. Dec 18 20:59:17.546214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-00a78793-5dd0-4d68-ab46-18dc49edafed tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Returning 404 to user: Image not found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:17.547259 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-00a78793-5dd0-4d68-ab46-18dc49edafed tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "DELETE /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230" status: 404 len: 62 microversion: 2.1 time: 0.034600 Dec 18 20:59:17.548105 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1730/3500] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:17 2021] DELETE /compute/v2.1/images/49fbf4df-c52e-49c8-9c42-7ec0b6c6d230 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:59:17.561729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:17.564651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:17.572573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.573079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.574884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.575512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.621432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:17.841502 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83ae2373-d0b4-4ba4-bef2-61256a619d42 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 204 len: 0 microversion: 2.1 time: 0.288395 Dec 18 20:59:17.847784 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1731/3501] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:17 2021] DELETE /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:17.866398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:17.867429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:17.879230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.881293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:17.883515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:17.884367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:18.194333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Updating instance_info_cache with network_info: [] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 20:59:18.350830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:18.359349 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32118a1d-8921-45bf-843a-968f3e2df8c9 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1473 microversion: 2.1 time: 0.506900 Dec 18 20:59:18.360340 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1732/3502] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:17 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1473 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:18.636266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2116162159", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1f7835a3-1921-420f-bc92-783d1cac5ba9"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:18.770480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] validate_networks() for [('1f7835a3-1921-420f-bc92-783d1cac5ba9', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:18.876148 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa0aed43-bafa-49e9-8abe-a6ecda856f5b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "DELETE /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 204 len: 0 microversion: 2.1 time: 3.382479 Dec 18 20:59:18.882948 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1771/3503] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:15 2021] DELETE /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 0 bytes in 3386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:59:18.894705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-eefb672f-abe6-41df-b524-fb47bd60598c req-78289010-48d5-4c1f-9297-af4a668737ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dfce29-5bdc-4127-9942-6377d7b7bc7e", "name": "network-vif-deleted", "tag": "2ec8fed1-1707-4075-bc28-f12d86c90468"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:18.897725 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:18.897725 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:18.911935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-eefb672f-abe6-41df-b524-fb47bd60598c req-78289010-48d5-4c1f-9297-af4a668737ea service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:18.912911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-eefb672f-abe6-41df-b524-fb47bd60598c req-78289010-48d5-4c1f-9297-af4a668737ea service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:18.933107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.compute.server_external_events [req-eefb672f-abe6-41df-b524-fb47bd60598c req-78289010-48d5-4c1f-9297-af4a668737ea service nova] Unable to find a host for instance 79dfce29-5bdc-4127-9942-6377d7b7bc7e. Dropping event network-vif-deleted {{(pid=140731) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 18 20:59:18.934494 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-eefb672f-abe6-41df-b524-fb47bd60598c req-78289010-48d5-4c1f-9297-af4a668737ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049017 Dec 18 20:59:18.935392 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1772/3504] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:18 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 18 20:59:18.943192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fcf7e197-37fe-4b24-ba4d-5a0fcdc7be9e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:18.944768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fcf7e197-37fe-4b24-ba4d-5a0fcdc7be9e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:18.955288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcf7e197-37fe-4b24-ba4d-5a0fcdc7be9e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:18.956050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcf7e197-37fe-4b24-ba4d-5a0fcdc7be9e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:18.957607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcf7e197-37fe-4b24-ba4d-5a0fcdc7be9e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:18.958477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcf7e197-37fe-4b24-ba4d-5a0fcdc7be9e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.029021 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fcf7e197-37fe-4b24-ba4d-5a0fcdc7be9e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.092011 Dec 18 20:59:19.030416 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1773/3505] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:18 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:19.038494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0724f56-0558-4996-83fd-30ee3cb65ec4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:19.039890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0724f56-0558-4996-83fd-30ee3cb65ec4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:19.048810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0724f56-0558-4996-83fd-30ee3cb65ec4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.049274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0724f56-0558-4996-83fd-30ee3cb65ec4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.050170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0724f56-0558-4996-83fd-30ee3cb65ec4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.050634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0724f56-0558-4996-83fd-30ee3cb65ec4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.105860 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0724f56-0558-4996-83fd-30ee3cb65ec4 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.073146 Dec 18 20:59:19.112698 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1774/3506] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:19 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:19.119539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d759cd96-28cf-4113-bd54-41b80df78c8c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:19.121271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d759cd96-28cf-4113-bd54-41b80df78c8c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:19.131412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d759cd96-28cf-4113-bd54-41b80df78c8c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.131879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d759cd96-28cf-4113-bd54-41b80df78c8c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.132697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d759cd96-28cf-4113-bd54-41b80df78c8c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.133153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d759cd96-28cf-4113-bd54-41b80df78c8c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.189413 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d759cd96-28cf-4113-bd54-41b80df78c8c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.077489 Dec 18 20:59:19.190088 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1775/3507] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:19 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:19.265367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-549884982", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "bfdb70fc-b6f1-4792-b656-71aeb0dae3b6"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:19.281814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:19.282394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:19.282930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:19.283521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:19.284077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:19.295277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.296218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.299243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.300013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.322830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:19.329937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for user 4196dd207ce543d3bdd5f48ae57e156a and project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:19.331739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] validate_networks() for [('bfdb70fc-b6f1-4792-b656-71aeb0dae3b6', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:19.345761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:19.348491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:19.414972 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca309bec-2eda-4841-8d79-55a053744c58 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053241 Dec 18 20:59:19.417465 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1733/3508] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:19.424750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:19.426468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 79dfce29-5bdc-4127-9942-6377d7b7bc7e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:19.444797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.445156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.446281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.446584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.462338 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] HTTP exception thrown: Instance 79dfce29-5bdc-4127-9942-6377d7b7bc7e could not be found. Dec 18 20:59:19.462999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Returning 404 to user: Instance 79dfce29-5bdc-4127-9942-6377d7b7bc7e could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:19.463922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0ee11e98-8038-4671-b8a0-4022c498244c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e" status: 404 len: 111 microversion: 2.1 time: 0.045180 Dec 18 20:59:19.464793 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1734/3509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:19 2021] GET /compute/v2.1/servers/79dfce29-5bdc-4127-9942-6377d7b7bc7e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:19.472388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4beca279-5dee-404d-a648-6994b9844c97 req-e1127c61-3a2a-48bf-9e96-ff84fba8dd47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479eeab2-5ceb-4408-b0a1-4d5eca0abc0e", "name": "network-vif-unplugged", "status": "completed", "tag": "8de86d40-0ffe-4a89-ae60-fdfa7a44d805"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:19.474328 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:19.474328 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:19.485098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4beca279-5dee-404d-a648-6994b9844c97 req-e1127c61-3a2a-48bf-9e96-ff84fba8dd47 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.485620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4beca279-5dee-404d-a648-6994b9844c97 req-e1127c61-3a2a-48bf-9e96-ff84fba8dd47 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.497863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4beca279-5dee-404d-a648-6994b9844c97 req-e1127c61-3a2a-48bf-9e96-ff84fba8dd47 service nova] Creating event network-vif-unplugged:8de86d40-0ffe-4a89-ae60-fdfa7a44d805 for instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e on nch1-master-1 Dec 18 20:59:19.518540 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4beca279-5dee-404d-a648-6994b9844c97 req-e1127c61-3a2a-48bf-9e96-ff84fba8dd47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050136 Dec 18 20:59:19.519484 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1735/3510] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:19.528338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:19.528495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:19.536005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.536435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.537287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:19.537731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:19.847202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:19.861936 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c08c40d-56d5-4ce3-a6d2-b53b60faee53 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1473 microversion: 2.1 time: 0.340584 Dec 18 20:59:19.864083 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1736/3511] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:19 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:19.872758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-975ff965-aaed-4e51-94fe-c1194eb29bf1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:19.876964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-975ff965-aaed-4e51-94fe-c1194eb29bf1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:19.973786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-975ff965-aaed-4e51-94fe-c1194eb29bf1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:19.981698 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-975ff965-aaed-4e51-94fe-c1194eb29bf1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1218 microversion: 2.1 time: 0.116158 Dec 18 20:59:19.989611 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1737/3512] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:19 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:19.997534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:19.998175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:19.998986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:19.999593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:20.000777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:20.005985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:20.007370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:20.012617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.013433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.014525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.015237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.015585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.020467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.021470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.022002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.049706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for project 80e8efe6135e41a689caf483b2c72af1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:20.057570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for user bc32317ed5e54f67b8ae64f92419bcc0 and project 80e8efe6135e41a689caf483b2c72af1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:20.076859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:20.080770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:20.082893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:20.146965 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9711f88-f661-4600-84a2-a16f0d780955 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954704 Dec 18 20:59:20.147721 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1776/3513] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:20.153843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d840aedf-953f-4193-8dfa-d941c5ef7989 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:20.155211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d840aedf-953f-4193-8dfa-d941c5ef7989 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:20.162895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d840aedf-953f-4193-8dfa-d941c5ef7989 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.163824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d840aedf-953f-4193-8dfa-d941c5ef7989 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.164941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d840aedf-953f-4193-8dfa-d941c5ef7989 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.165591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d840aedf-953f-4193-8dfa-d941c5ef7989 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.269797 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8eaa1b29-bc3a-4d23-a476-0e5527df9945 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 204 len: 0 microversion: 2.1 time: 0.267131 Dec 18 20:59:20.270520 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1738/3514] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:19 2021] DELETE /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:20.277881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-623fc73c-3633-4eae-811e-cc5dbd75aed9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:20.279506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-623fc73c-3633-4eae-811e-cc5dbd75aed9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:20.283732 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d840aedf-953f-4193-8dfa-d941c5ef7989 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.133314 Dec 18 20:59:20.290008 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1777/3515] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:20 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:20.296414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae53c3b6-85e0-4c98-a142-7b8f6e6bc5b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:20.297752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae53c3b6-85e0-4c98-a142-7b8f6e6bc5b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:20.310173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-623fc73c-3633-4eae-811e-cc5dbd75aed9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.310866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-623fc73c-3633-4eae-811e-cc5dbd75aed9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.312655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-623fc73c-3633-4eae-811e-cc5dbd75aed9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.315104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-623fc73c-3633-4eae-811e-cc5dbd75aed9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.374695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ae53c3b6-85e0-4c98-a142-7b8f6e6bc5b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:20.386644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae53c3b6-85e0-4c98-a142-7b8f6e6bc5b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1224 microversion: 2.1 time: 0.092452 Dec 18 20:59:20.398670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1778/3516] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:20 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:20.403914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-78a9b827-5a0f-4fe7-a178-faaf8013983d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:20.405252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-78a9b827-5a0f-4fe7-a178-faaf8013983d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:20.407533 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-623fc73c-3633-4eae-811e-cc5dbd75aed9 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.134404 Dec 18 20:59:20.408489 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1739/3517] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:20 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:20.413432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:20.414151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:20.414689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78a9b827-5a0f-4fe7-a178-faaf8013983d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.415349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78a9b827-5a0f-4fe7-a178-faaf8013983d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.416453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78a9b827-5a0f-4fe7-a178-faaf8013983d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.417271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78a9b827-5a0f-4fe7-a178-faaf8013983d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.438893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.439375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.439857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.440669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.486117 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-78a9b827-5a0f-4fe7-a178-faaf8013983d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.085924 Dec 18 20:59:20.489985 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1779/3518] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:20 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:20.633850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:20.648900 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-077e3598-ec95-4237-a488-ac1349498101 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1464 microversion: 2.1 time: 0.239236 Dec 18 20:59:20.649702 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1740/3519] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:20 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:20.880827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:20.882139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:20.892046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.892795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.894059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:20.894717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:20.993575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932b394322e2458baa8e8057ca4a9c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4275f97662f4f3b8eed66d55e5f050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:21.000618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:21.001532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:21.007878 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd4c6303-9cef-4396-8221-2f5726eb5099 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 200 len: 1431 microversion: 2.1 time: 0.131809 Dec 18 20:59:21.009196 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1780/3520] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:20 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 1431 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:21.012223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.012692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.013612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.014266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.094832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:21.105048 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccefab54-5768-4c7d-8d21-2a854cabd6af tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1276 microversion: 2.1 time: 0.109550 Dec 18 20:59:21.106140 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1741/3521] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:20 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:21.191108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-56443e2f-af7b-4594-bcfe-3bdd89f6667b req-097d4a7b-b6b3-4233-8dc3-7e1ebead156c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479eeab2-5ceb-4408-b0a1-4d5eca0abc0e", "name": "network-vif-deleted", "tag": "8de86d40-0ffe-4a89-ae60-fdfa7a44d805"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:21.193637 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:21.193637 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:21.204166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-56443e2f-af7b-4594-bcfe-3bdd89f6667b req-097d4a7b-b6b3-4233-8dc3-7e1ebead156c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.204796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-56443e2f-af7b-4594-bcfe-3bdd89f6667b req-097d4a7b-b6b3-4233-8dc3-7e1ebead156c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.217918 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-56443e2f-af7b-4594-bcfe-3bdd89f6667b req-097d4a7b-b6b3-4233-8dc3-7e1ebead156c service nova] Creating event network-vif-deleted:8de86d40-0ffe-4a89-ae60-fdfa7a44d805 for instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e on nch1-master-1 Dec 18 20:59:21.223103 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-56443e2f-af7b-4594-bcfe-3bdd89f6667b req-097d4a7b-b6b3-4233-8dc3-7e1ebead156c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048653 Dec 18 20:59:21.224770 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1781/3522] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:21.300453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71c2d973-4c04-4d1d-a88a-14faa27da2e5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:21.301404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71c2d973-4c04-4d1d-a88a-14faa27da2e5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:21.308880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c2d973-4c04-4d1d-a88a-14faa27da2e5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.309398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c2d973-4c04-4d1d-a88a-14faa27da2e5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.311122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c2d973-4c04-4d1d-a88a-14faa27da2e5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.311122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c2d973-4c04-4d1d-a88a-14faa27da2e5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.356159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71c2d973-4c04-4d1d-a88a-14faa27da2e5 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.059318 Dec 18 20:59:21.356816 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1742/3523] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:21 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:21.405852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:21.407644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:21.423998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2a95e82-7726-49a5-9d67-2d3998fac89f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:21.425652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2a95e82-7726-49a5-9d67-2d3998fac89f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:21.433006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.433721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.434577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.441184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2a95e82-7726-49a5-9d67-2d3998fac89f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.441702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2a95e82-7726-49a5-9d67-2d3998fac89f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.442664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2a95e82-7726-49a5-9d67-2d3998fac89f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.443587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2a95e82-7726-49a5-9d67-2d3998fac89f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.444534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.501827 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2a95e82-7726-49a5-9d67-2d3998fac89f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.083644 Dec 18 20:59:21.503014 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1743/3524] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:21 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:21.509342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-690f81d8-986f-4f23-9548-ac2f3ac0844d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:21.510408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-690f81d8-986f-4f23-9548-ac2f3ac0844d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:21.522977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-690f81d8-986f-4f23-9548-ac2f3ac0844d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.523451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-690f81d8-986f-4f23-9548-ac2f3ac0844d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.524127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-690f81d8-986f-4f23-9548-ac2f3ac0844d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.526429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-690f81d8-986f-4f23-9548-ac2f3ac0844d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.590291 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-690f81d8-986f-4f23-9548-ac2f3ac0844d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.085656 Dec 18 20:59:21.590834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:21.595585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1744/3525] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:21 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:21.599699 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb1b041b-6f54-43ab-8f39-d498e3ae4c3d tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1276 microversion: 2.1 time: 0.198394 Dec 18 20:59:21.602492 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1782/3526] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:21 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:21.667914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:21.668631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:21.676934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.677394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.678197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:21.678665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:21.837444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:21.851361 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b37005f5-3b1f-4a2e-980c-cf49bea2efe2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1464 microversion: 2.1 time: 0.187822 Dec 18 20:59:21.852001 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1745/3527] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:21 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:22.026473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:22.027566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] [instance: 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:22.038769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.039268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.042212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.042924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.075168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] HTTP exception thrown: Instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e could not be found. Dec 18 20:59:22.077216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] Returning 404 to user: Instance 479eeab2-5ceb-4408-b0a1-4d5eca0abc0e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:22.080700 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9d4e3bb-6fa6-46dc-af08-208b91268bc3 tempest-ImagesOneServerTestJSON-2073228419 tempest-ImagesOneServerTestJSON-2073228419-project] 10.222.0.13 "GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e" status: 404 len: 111 microversion: 2.1 time: 0.057023 Dec 18 20:59:22.085052 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1783/3528] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:22 2021] GET /compute/v2.1/servers/479eeab2-5ceb-4408-b0a1-4d5eca0abc0e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:22.124718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:22.125770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:22.138968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.144173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.145031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.145474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.369893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3094a21-289e-479b-a883-0453e078b98c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:22.371137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3094a21-289e-479b-a883-0453e078b98c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:22.378271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3094a21-289e-479b-a883-0453e078b98c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.378743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3094a21-289e-479b-a883-0453e078b98c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.379619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3094a21-289e-479b-a883-0453e078b98c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.380106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3094a21-289e-479b-a883-0453e078b98c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.398440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:22.407462 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-882c17d8-fa33-4a12-93b8-d3bc6937e213 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1276 microversion: 2.1 time: 0.288852 Dec 18 20:59:22.410512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1746/3529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:22 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:22.438407 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3094a21-289e-479b-a883-0453e078b98c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.072407 Dec 18 20:59:22.439293 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1784/3530] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:22 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:22.514598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c18ad1b-0f2f-43e0-92cd-49d02f791d9b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:22.516807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c18ad1b-0f2f-43e0-92cd-49d02f791d9b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:22.523877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c18ad1b-0f2f-43e0-92cd-49d02f791d9b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.524588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c18ad1b-0f2f-43e0-92cd-49d02f791d9b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.525596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c18ad1b-0f2f-43e0-92cd-49d02f791d9b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.526296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c18ad1b-0f2f-43e0-92cd-49d02f791d9b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.592567 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c18ad1b-0f2f-43e0-92cd-49d02f791d9b tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.082493 Dec 18 20:59:22.599801 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1747/3531] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:22 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:22.607557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9091ff9-26c7-4c76-a20b-411c6e993594 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:22.608596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c9091ff9-26c7-4c76-a20b-411c6e993594 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:22.621348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:22.623118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:22.647387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.648055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.648375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9091ff9-26c7-4c76-a20b-411c6e993594 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.648853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9091ff9-26c7-4c76-a20b-411c6e993594 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.649673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9091ff9-26c7-4c76-a20b-411c6e993594 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.650127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9091ff9-26c7-4c76-a20b-411c6e993594 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.651513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.652164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.725814 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9091ff9-26c7-4c76-a20b-411c6e993594 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.123834 Dec 18 20:59:22.727210 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1785/3532] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:22 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:22.781326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:22.788366 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cccae34f-68c1-4d64-b4bd-af144036c77b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1282 microversion: 2.1 time: 0.172144 Dec 18 20:59:22.789164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1748/3533] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:22 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:22.869412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:22.870393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:22.891363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.891831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.892650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.893091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.918089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-518bae26-4298-46b7-b16c-acba913d70de req-39d79367-3875-4d5f-b4be-12e605aaa761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cde937-d836-4d8a-8568-4e686b8ca4f2", "name": "network-vif-unplugged", "status": "completed", "tag": "07ac6499-0831-47d9-9072-52d994281360"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:22.919729 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:22.919729 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:22.951102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-518bae26-4298-46b7-b16c-acba913d70de req-39d79367-3875-4d5f-b4be-12e605aaa761 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:22.951604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-518bae26-4298-46b7-b16c-acba913d70de req-39d79367-3875-4d5f-b4be-12e605aaa761 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:22.972969 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-518bae26-4298-46b7-b16c-acba913d70de req-39d79367-3875-4d5f-b4be-12e605aaa761 service nova] Creating event network-vif-unplugged:07ac6499-0831-47d9-9072-52d994281360 for instance 16cde937-d836-4d8a-8568-4e686b8ca4f2 on nch1-master-1 Dec 18 20:59:22.987222 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-518bae26-4298-46b7-b16c-acba913d70de req-39d79367-3875-4d5f-b4be-12e605aaa761 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072460 Dec 18 20:59:22.988514 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1749/3534] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:23.130840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:23.142843 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b216ec1c-76a0-44ee-884c-0cd6ad7164fa tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1464 microversion: 2.1 time: 0.277461 Dec 18 20:59:23.143663 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1786/3535] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:22 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1464 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:23.434386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:23.435358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:23.451495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-474fc1f1-7b33-4b8c-a0b1-10e3502430ca tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:23.453230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-474fc1f1-7b33-4b8c-a0b1-10e3502430ca tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:23.461318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474fc1f1-7b33-4b8c-a0b1-10e3502430ca tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.461656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.462130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.462363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474fc1f1-7b33-4b8c-a0b1-10e3502430ca tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.463321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474fc1f1-7b33-4b8c-a0b1-10e3502430ca tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.463902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474fc1f1-7b33-4b8c-a0b1-10e3502430ca tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.465232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.465708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.533110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-474fc1f1-7b33-4b8c-a0b1-10e3502430ca tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.083828 Dec 18 20:59:23.535542 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1787/3536] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:23 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:23.606935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8522b6b5-ea39-4cbf-a11d-2b5914c82dd5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:23.607961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8522b6b5-ea39-4cbf-a11d-2b5914c82dd5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:23.625280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8522b6b5-ea39-4cbf-a11d-2b5914c82dd5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.626830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8522b6b5-ea39-4cbf-a11d-2b5914c82dd5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.630567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8522b6b5-ea39-4cbf-a11d-2b5914c82dd5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.633247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8522b6b5-ea39-4cbf-a11d-2b5914c82dd5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.701518 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8522b6b5-ea39-4cbf-a11d-2b5914c82dd5 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.099599 Dec 18 20:59:23.702522 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1788/3537] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:23 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:23.740220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9adf145f-c4be-4a97-b717-a0c7dd14e37c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:23.741571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9adf145f-c4be-4a97-b717-a0c7dd14e37c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:23.762593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9adf145f-c4be-4a97-b717-a0c7dd14e37c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.764310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9adf145f-c4be-4a97-b717-a0c7dd14e37c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.766830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9adf145f-c4be-4a97-b717-a0c7dd14e37c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.767769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9adf145f-c4be-4a97-b717-a0c7dd14e37c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.897272 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9adf145f-c4be-4a97-b717-a0c7dd14e37c tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.161971 Dec 18 20:59:23.900210 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1789/3538] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:23 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:59:23.919266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:23.921647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:23.937100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.937628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:23.943032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:23.943690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.391170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:24.401394 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13cd912a-48d9-4ecf-8b8a-4f34c2008470 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.498403 Dec 18 20:59:24.414688 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1790/3539] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:23 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:24.419764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-87a998bd-c1bf-4c6c-80be-070eccc61f22 req-277ecdbc-5464-4488-9941-15b00fa24000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cde937-d836-4d8a-8568-4e686b8ca4f2", "name": "network-vif-deleted", "tag": "07ac6499-0831-47d9-9072-52d994281360"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:24.421351 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:24.421351 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:24.429258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:24.440161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-87a998bd-c1bf-4c6c-80be-070eccc61f22 req-277ecdbc-5464-4488-9941-15b00fa24000 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.440880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-87a998bd-c1bf-4c6c-80be-070eccc61f22 req-277ecdbc-5464-4488-9941-15b00fa24000 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.447309 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cb6987f4-d5d6-41a6-baa2-1826a03c358f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 1.022054 Dec 18 20:59:24.458658 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1750/3540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:23 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:24.466118 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-87a998bd-c1bf-4c6c-80be-070eccc61f22 req-277ecdbc-5464-4488-9941-15b00fa24000 service nova] Creating event network-vif-deleted:07ac6499-0831-47d9-9072-52d994281360 for instance 16cde937-d836-4d8a-8568-4e686b8ca4f2 on nch1-master-1 Dec 18 20:59:24.473672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:24.475437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:24.475968 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-87a998bd-c1bf-4c6c-80be-070eccc61f22 req-277ecdbc-5464-4488-9941-15b00fa24000 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059949 Dec 18 20:59:24.478562 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1791/3541] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:24.490602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.491118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.492179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.492828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.549577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef703485-773c-4da5-9153-32b91717bffb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:24.551917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef703485-773c-4da5-9153-32b91717bffb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:24.564869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef703485-773c-4da5-9153-32b91717bffb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.565339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef703485-773c-4da5-9153-32b91717bffb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.567251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef703485-773c-4da5-9153-32b91717bffb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.567740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef703485-773c-4da5-9153-32b91717bffb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.572649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.573688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.574398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lazy-loading 'fault' on Instance uuid 16cde937-d836-4d8a-8568-4e686b8ca4f2 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:59:24.641967 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ef703485-773c-4da5-9153-32b91717bffb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.099643 Dec 18 20:59:24.642872 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1792/3542] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:24 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:24.651206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:24.676255 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c058185-cbbb-43f5-86ce-6c501b11d79f tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 200 len: 1304 microversion: 2.1 time: 0.213903 Dec 18 20:59:24.677181 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1751/3543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:24 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:24.716699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2658525d-dd42-4f88-97d6-3d747d278787 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:24.718040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2658525d-dd42-4f88-97d6-3d747d278787 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:24.728279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2658525d-dd42-4f88-97d6-3d747d278787 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.729007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2658525d-dd42-4f88-97d6-3d747d278787 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.729552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2658525d-dd42-4f88-97d6-3d747d278787 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.730007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2658525d-dd42-4f88-97d6-3d747d278787 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.808208 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2658525d-dd42-4f88-97d6-3d747d278787 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.095652 Dec 18 20:59:24.809537 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1793/3544] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:24 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:59:24.912329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1061293a-6f19-4633-8926-e4138d55935d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:24.913348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1061293a-6f19-4633-8926-e4138d55935d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:24.920271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1061293a-6f19-4633-8926-e4138d55935d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.921024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1061293a-6f19-4633-8926-e4138d55935d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.922680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1061293a-6f19-4633-8926-e4138d55935d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:24.923912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1061293a-6f19-4633-8926-e4138d55935d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:24.991148 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1061293a-6f19-4633-8926-e4138d55935d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.082500 Dec 18 20:59:24.995334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1752/3545] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:24 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:25.352472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b6dde83d-5b6c-475f-8809-d5e2871f9a69 req-a1573c82-6dae-402b-b406-e6c5043fa59c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a95061-f48a-4c6b-b3e7-afabba045761", "tag": "88dbfcb7-c934-431e-a0d0-8bf4116d376d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:25.354082 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:25.354082 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:25.362036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b6dde83d-5b6c-475f-8809-d5e2871f9a69 req-a1573c82-6dae-402b-b406-e6c5043fa59c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:25.362637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b6dde83d-5b6c-475f-8809-d5e2871f9a69 req-a1573c82-6dae-402b-b406-e6c5043fa59c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:25.374940 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b6dde83d-5b6c-475f-8809-d5e2871f9a69 req-a1573c82-6dae-402b-b406-e6c5043fa59c service nova] Creating event network-changed:88dbfcb7-c934-431e-a0d0-8bf4116d376d for instance d1a95061-f48a-4c6b-b3e7-afabba045761 on nch2-master-1 Dec 18 20:59:25.379845 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b6dde83d-5b6c-475f-8809-d5e2871f9a69 req-a1573c82-6dae-402b-b406-e6c5043fa59c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031407 Dec 18 20:59:25.380880 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1794/3546] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:25.419270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:25.420227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:25.439008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:25.439740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:25.440273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:25.440976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:25.465555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:25.466397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:25.478952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:25.485259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:25.487292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:25.489429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.096069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:26.103882 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7938891b-2812-4f10-84bf-93686bca6bdd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.688767 Dec 18 20:59:26.104474 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1753/3547] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:25 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:26.118572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:26.122814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6bac0f33-f1b8-4a84-be30-3abec5cbc91c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:26.130625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6bac0f33-f1b8-4a84-be30-3abec5cbc91c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:26.135194 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-005f2364-04ba-4250-8b6c-bb69d0bedc10 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.673956 Dec 18 20:59:26.151435 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1795/3548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:25 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:26.157271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bac0f33-f1b8-4a84-be30-3abec5cbc91c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.158403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bac0f33-f1b8-4a84-be30-3abec5cbc91c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.160426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bac0f33-f1b8-4a84-be30-3abec5cbc91c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.161841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:26.162544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bac0f33-f1b8-4a84-be30-3abec5cbc91c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.165923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 16cde937-d836-4d8a-8568-4e686b8ca4f2] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:26.174990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.185873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.187105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.193272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.221586 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] HTTP exception thrown: Instance 16cde937-d836-4d8a-8568-4e686b8ca4f2 could not be found. Dec 18 20:59:26.222201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Returning 404 to user: Instance 16cde937-d836-4d8a-8568-4e686b8ca4f2 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:26.223134 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72d0e21f-46df-48e8-8add-adc862ce73fc tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2" status: 404 len: 111 microversion: 2.1 time: 0.070419 Dec 18 20:59:26.223900 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1796/3549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:26 2021] GET /compute/v2.1/servers/16cde937-d836-4d8a-8568-4e686b8ca4f2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:26.229080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2df82cdd-4b65-461b-9d68-f0dc05a03d2c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:26.230057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2df82cdd-4b65-461b-9d68-f0dc05a03d2c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:26.241560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df82cdd-4b65-461b-9d68-f0dc05a03d2c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.242522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df82cdd-4b65-461b-9d68-f0dc05a03d2c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.244626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df82cdd-4b65-461b-9d68-f0dc05a03d2c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.244965 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6bac0f33-f1b8-4a84-be30-3abec5cbc91c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.139240 Dec 18 20:59:26.245308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df82cdd-4b65-461b-9d68-f0dc05a03d2c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.249073 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1754/3550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:26 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:26.255032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-55527fe1-3abe-4ecc-8f60-567b34c13800 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:26.256015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-55527fe1-3abe-4ecc-8f60-567b34c13800 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:26.279229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55527fe1-3abe-4ecc-8f60-567b34c13800 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.279918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55527fe1-3abe-4ecc-8f60-567b34c13800 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.280906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55527fe1-3abe-4ecc-8f60-567b34c13800 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.282055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55527fe1-3abe-4ecc-8f60-567b34c13800 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.321847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2df82cdd-4b65-461b-9d68-f0dc05a03d2c tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.096181 Dec 18 20:59:26.326694 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1797/3551] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:26 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:26.335407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-55527fe1-3abe-4ecc-8f60-567b34c13800 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.086783 Dec 18 20:59:26.336323 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1755/3552] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:26 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:26.348334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:26.349419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:26.364120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.364943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.371204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.372314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.439206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:26.541328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-85703954-af7b-466d-92a8-638ced16a281 req-a7dacf54-afad-4b08-a1b6-c105edee0240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12e2896-51c3-4ed6-abc1-fb782a8c9f48", "tag": "f436640a-8992-4e8c-bdca-8adcc9d844b1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:26.544051 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:26.544051 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:26.559546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-85703954-af7b-466d-92a8-638ced16a281 req-a7dacf54-afad-4b08-a1b6-c105edee0240 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.560486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-85703954-af7b-466d-92a8-638ced16a281 req-a7dacf54-afad-4b08-a1b6-c105edee0240 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.586692 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-85703954-af7b-466d-92a8-638ced16a281 req-a7dacf54-afad-4b08-a1b6-c105edee0240 service nova] Creating event network-changed:f436640a-8992-4e8c-bdca-8adcc9d844b1 for instance a12e2896-51c3-4ed6-abc1-fb782a8c9f48 on nch2-master-1 Dec 18 20:59:26.598481 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-85703954-af7b-466d-92a8-638ced16a281 req-a7dacf54-afad-4b08-a1b6-c105edee0240 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069575 Dec 18 20:59:26.600427 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1756/3553] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:26.691364 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-78ca0a25-ec75-42bf-b0a0-d96e477cfa28 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 204 len: 0 microversion: 2.1 time: 0.360770 Dec 18 20:59:26.692615 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1798/3554] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:26 2021] DELETE /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:26.705638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:26.706373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:26.722627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.724014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:26.725243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:26.726777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.106559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:27.126927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:27.130013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:27.141763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.143337 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22b50dcf-2f0c-46e4-a237-4bc9fbb265d3 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1508 microversion: 2.1 time: 0.443605 Dec 18 20:59:27.144885 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1757/3555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:26 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:27.145865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.147232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.147893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.156605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:27.160357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:27.173258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.173848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.175775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.178193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.564759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:27.573280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:27.578685 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ae9bddc-27b8-4d97-a26c-3db2251f4af7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.458660 Dec 18 20:59:27.597182 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1799/3556] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:27 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:27.600821 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b3b80195-e494-469a-a95c-0c93ad8654e4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.447952 Dec 18 20:59:27.601971 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1758/3557] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:27 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:27.604923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f9f0ddfe-1bf0-40bc-9504-753f89c1af55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:27.606233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f9f0ddfe-1bf0-40bc-9504-753f89c1af55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:27.612996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9f0ddfe-1bf0-40bc-9504-753f89c1af55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.613720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9f0ddfe-1bf0-40bc-9504-753f89c1af55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.614707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9f0ddfe-1bf0-40bc-9504-753f89c1af55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.616280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f9f0ddfe-1bf0-40bc-9504-753f89c1af55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.737424 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f9f0ddfe-1bf0-40bc-9504-753f89c1af55 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.138807 Dec 18 20:59:27.746803 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1800/3558] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:27 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:27.761764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6955f34c-291d-4fa8-aaa7-b5da2b320ce7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:27.763259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6955f34c-291d-4fa8-aaa7-b5da2b320ce7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:27.793180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6955f34c-291d-4fa8-aaa7-b5da2b320ce7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.794318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6955f34c-291d-4fa8-aaa7-b5da2b320ce7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.796048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6955f34c-291d-4fa8-aaa7-b5da2b320ce7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.797461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6955f34c-291d-4fa8-aaa7-b5da2b320ce7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.882865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ceda1b66-2cc0-4078-a477-418d979959d4 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f7161323940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1464450342", "description": "tempest-description-837385976"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:27.889772 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6955f34c-291d-4fa8-aaa7-b5da2b320ce7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.140946 Dec 18 20:59:27.892123 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1801/3559] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:27 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:27.904991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-212637c9-c4aa-4fda-b579-36acba029fb6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:27.907167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-212637c9-c4aa-4fda-b579-36acba029fb6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:27.927089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-212637c9-c4aa-4fda-b579-36acba029fb6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.928352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-212637c9-c4aa-4fda-b579-36acba029fb6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:27.930779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-212637c9-c4aa-4fda-b579-36acba029fb6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:27.933834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-212637c9-c4aa-4fda-b579-36acba029fb6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:28.007166 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-212637c9-c4aa-4fda-b579-36acba029fb6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.113138 Dec 18 20:59:28.008639 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1802/3560] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:27 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:28.130016 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ceda1b66-2cc0-4078-a477-418d979959d4 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.526514 Dec 18 20:59:28.131211 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1759/3561] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:27 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:28.147175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-322973b0-0c35-40dc-9a47-9698b4e0febe tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f715c33ac10>, body: {"security_group_rule": {"parent_group_id": "deb717b8-f9d7-453e-96fa-082df8ee870b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:28.161905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:28.162839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:28.169967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:28.171132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:28.172875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:28.173513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:28.434179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:28.442483 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-55377287-9789-472c-87a2-5788e51eddfb tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1508 microversion: 2.1 time: 0.284283 Dec 18 20:59:28.445712 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1760/3562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:28 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:28.515093 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-322973b0-0c35-40dc-9a47-9698b4e0febe tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.372143 Dec 18 20:59:28.515919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1803/3563] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:59:28 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:28.526719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a823a7a-d029-4c79-aadd-6c20c1f7ec8f tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f714e633790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2067018350", "description": "tempest-description-779204632"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:28.599315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:28.600258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:28.616200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:28.617660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:28.619840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:28.620491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:28.728390 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a823a7a-d029-4c79-aadd-6c20c1f7ec8f tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.205177 Dec 18 20:59:28.728999 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1761/3564] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:28 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:28.740155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:28.740704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:28.751706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:28.752445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:28.753443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:28.754061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:28.963601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:28.982377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32d91ab7-a3aa-4b00-ad65-fc39786ba3da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.386085 Dec 18 20:59:28.983315 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1804/3565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:28 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:28.996669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5954d9ac-d109-4404-989a-8065f10123d6 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f714ef71ee0>, body: {"security_group_rule": {"parent_group_id": "3c80e1f4-e422-4094-97b1-f521ba042b69", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:28.998083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:29.006625 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-51dcb2ac-b06c-4be2-ac1e-f9e135814222 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.276569 Dec 18 20:59:29.009577 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1762/3566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:28 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:29.024344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-643806e8-2b10-4315-b92e-2bd200293eb9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:29.025446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-643806e8-2b10-4315-b92e-2bd200293eb9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:29.041904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-643806e8-2b10-4315-b92e-2bd200293eb9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.042723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-643806e8-2b10-4315-b92e-2bd200293eb9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.043766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-643806e8-2b10-4315-b92e-2bd200293eb9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.044635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-643806e8-2b10-4315-b92e-2bd200293eb9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.090948 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-643806e8-2b10-4315-b92e-2bd200293eb9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.079522 Dec 18 20:59:29.092427 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1763/3567] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:29 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:29.099091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-50f2cfd5-70a0-49d0-a568-5c5f9d39ca40 req-0488bab9-8ea3-45c3-9653-5a4e8189b455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0093720e-0f18-4f7f-81a6-51de2283143e", "name": "network-vif-deleted", "tag": "dcd26d53-013a-41a0-b028-6f833c1afdf4"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:29.101121 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:29.101121 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:29.111948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-50f2cfd5-70a0-49d0-a568-5c5f9d39ca40 req-0488bab9-8ea3-45c3-9653-5a4e8189b455 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.112670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-50f2cfd5-70a0-49d0-a568-5c5f9d39ca40 req-0488bab9-8ea3-45c3-9653-5a4e8189b455 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.137362 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-50f2cfd5-70a0-49d0-a568-5c5f9d39ca40 req-0488bab9-8ea3-45c3-9653-5a4e8189b455 service nova] Creating event network-vif-deleted:dcd26d53-013a-41a0-b028-6f833c1afdf4 for instance 0093720e-0f18-4f7f-81a6-51de2283143e on nch2-master-1 Dec 18 20:59:29.143309 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-50f2cfd5-70a0-49d0-a568-5c5f9d39ca40 req-0488bab9-8ea3-45c3-9653-5a4e8189b455 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048255 Dec 18 20:59:29.144620 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1764/3568] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:29.152407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-918fc975-bd7f-4f65-8d9d-ea60fab93798 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:29.153630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-918fc975-bd7f-4f65-8d9d-ea60fab93798 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:29.167614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918fc975-bd7f-4f65-8d9d-ea60fab93798 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.168313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918fc975-bd7f-4f65-8d9d-ea60fab93798 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.169310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918fc975-bd7f-4f65-8d9d-ea60fab93798 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.169912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918fc975-bd7f-4f65-8d9d-ea60fab93798 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.244086 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-918fc975-bd7f-4f65-8d9d-ea60fab93798 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.097654 Dec 18 20:59:29.244516 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1765/3569] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:29 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:29.255815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3042273a-5802-4615-a6e1-afdc2dc962c8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:29.256838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3042273a-5802-4615-a6e1-afdc2dc962c8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:29.264596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3042273a-5802-4615-a6e1-afdc2dc962c8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.266616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3042273a-5802-4615-a6e1-afdc2dc962c8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.267972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3042273a-5802-4615-a6e1-afdc2dc962c8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.268764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3042273a-5802-4615-a6e1-afdc2dc962c8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.281538 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5954d9ac-d109-4404-989a-8065f10123d6 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.293986 Dec 18 20:59:29.282136 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1805/3570] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:59:28 2021] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:29.293491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7049d45e-662a-4fd9-9e61-824841653c26 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f714fb328b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1898816944", "description": "tempest-description-1299033132"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:29.338050 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3042273a-5802-4615-a6e1-afdc2dc962c8 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.090700 Dec 18 20:59:29.339089 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1766/3571] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:29 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:29.462483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:29.463198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:29.479072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.479541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.480492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.482096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.525588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7049d45e-662a-4fd9-9e61-824841653c26 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.235658 Dec 18 20:59:29.526366 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1806/3572] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:29 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:29.543009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aaa73be6-6070-4038-b246-4e3cfb152903 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f714ef11310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1329196068", "description": "tempest-description-664505320"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:29.570159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:29.571733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:29.572201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lazy-loading 'fault' on Instance uuid 0093720e-0f18-4f7f-81a6-51de2283143e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:59:29.622992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:29.640112 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3dddb5b4-f0bf-4923-827f-abb815e7fffe tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 200 len: 1305 microversion: 2.1 time: 0.181984 Dec 18 20:59:29.642701 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1767/3573] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:29 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:30.000401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:30.001904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.010069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.010948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.012085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.014411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.168786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aaa73be6-6070-4038-b246-4e3cfb152903 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.635292 Dec 18 20:59:30.170140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1807/3574] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:29 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:30.176652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:30.177266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.193166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.193743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.196381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.197004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.353066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:30.375257 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38166b10-99be-4fb1-b312-34a3f3ee3d3e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.379177 Dec 18 20:59:30.388868 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1768/3575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:29 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:30.396928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-162abcf4-45c0-42c5-ac44-443b4b76ba22 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:30.398353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-162abcf4-45c0-42c5-ac44-443b4b76ba22 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.412509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-162abcf4-45c0-42c5-ac44-443b4b76ba22 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.413317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-162abcf4-45c0-42c5-ac44-443b4b76ba22 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.424117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-162abcf4-45c0-42c5-ac44-443b4b76ba22 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.425153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-162abcf4-45c0-42c5-ac44-443b4b76ba22 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.480141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-162abcf4-45c0-42c5-ac44-443b4b76ba22 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.089582 Dec 18 20:59:30.481127 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1769/3576] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:30 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:30.487310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01f7b57a-2def-45de-9c34-bd2b933423bc tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f7161336ee0>, body: {"security_group_rule": {"parent_group_id": "0a41aa5b-83a4-4b95-ad0d-8651e36ceb65", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "aa9a5cb0-0673-47a9-9174-d089a6f2b327"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:30.526178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:30.534447 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4d42cbc-bb49-4a1d-8c64-2caaed740e1c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.361583 Dec 18 20:59:30.535287 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1808/3577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:30 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:30.542676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1f725de-ae7b-47d1-a7bb-5771266e97eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:30.546144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1f725de-ae7b-47d1-a7bb-5771266e97eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.552917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f725de-ae7b-47d1-a7bb-5771266e97eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.553533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f725de-ae7b-47d1-a7bb-5771266e97eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.554370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f725de-ae7b-47d1-a7bb-5771266e97eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.554822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f725de-ae7b-47d1-a7bb-5771266e97eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.607520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1f725de-ae7b-47d1-a7bb-5771266e97eb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.070570 Dec 18 20:59:30.608219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1809/3578] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:30 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:30.614625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-198ceda9-f541-4e0a-befb-9a16b74f675b tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:30.615738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-198ceda9-f541-4e0a-befb-9a16b74f675b tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.623916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198ceda9-f541-4e0a-befb-9a16b74f675b tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.624557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198ceda9-f541-4e0a-befb-9a16b74f675b tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.625482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198ceda9-f541-4e0a-befb-9a16b74f675b tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.625999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198ceda9-f541-4e0a-befb-9a16b74f675b tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.685828 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-198ceda9-f541-4e0a-befb-9a16b74f675b tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.075854 Dec 18 20:59:30.686794 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1810/3579] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:30 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:30.697260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:30.698653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: 0093720e-0f18-4f7f-81a6-51de2283143e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.709357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.710168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.711170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.711774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.741988 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] HTTP exception thrown: Instance 0093720e-0f18-4f7f-81a6-51de2283143e could not be found. Dec 18 20:59:30.742836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Returning 404 to user: Instance 0093720e-0f18-4f7f-81a6-51de2283143e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:30.743911 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9dd07b15-6b76-47ea-8398-2134524cefef tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e" status: 404 len: 111 microversion: 2.1 time: 0.051691 Dec 18 20:59:30.744486 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1811/3580] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:30 2021] GET /compute/v2.1/servers/0093720e-0f18-4f7f-81a6-51de2283143e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:30.754791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:30.755375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.763376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.763934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.764817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.765900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.802500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:30.932658 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01f7b57a-2def-45de-9c34-bd2b933423bc tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.449808 Dec 18 20:59:30.933938 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1770/3581] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:59:30 2021] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:30.953402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4e27e26-9bd1-4f04-896e-cb992045e8c7 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f714e633820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-107412275", "description": "tempest-description-1325334012"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:30.955426 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4f55e9d8-a5bb-47e1-ac55-28ea9b1a14c6 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 204 len: 0 microversion: 2.1 time: 0.204745 Dec 18 20:59:30.957507 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1812/3582] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:30 2021] DELETE /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 20:59:30.965624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:30.966769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:30.973737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.974693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:30.975717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:30.976637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:31.275061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:31.288658 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4e27e26-9bd1-4f04-896e-cb992045e8c7 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.342405 Dec 18 20:59:31.289214 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ab0e580-3a49-487c-bf75-9895c115e91b tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1495 microversion: 2.1 time: 0.327713 Dec 18 20:59:31.289721 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1771/3583] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:30 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:31.299389 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1813/3584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:30 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1495 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:31.302145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0fc6003c-1e16-4256-b183-d7ea536f0cf8 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f714f76ce50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1476873729", "description": "tempest-description-73435587"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:31.394940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:31.395559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:31.405729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:31.406419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:31.407276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:31.407718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:31.539397 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0fc6003c-1e16-4256-b183-d7ea536f0cf8 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.242766 Dec 18 20:59:31.540506 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1772/3585] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:31 2021] POST /compute/v2.1/os-security-groups => generated 246 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:31.560002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0ed56a98-d2b5-4c42-918f-98ed6ad4c8e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:31.562787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0ed56a98-d2b5-4c42-918f-98ed6ad4c8e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:31.573157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ed56a98-d2b5-4c42-918f-98ed6ad4c8e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:31.573684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ed56a98-d2b5-4c42-918f-98ed6ad4c8e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:31.574547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ed56a98-d2b5-4c42-918f-98ed6ad4c8e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:31.574991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ed56a98-d2b5-4c42-918f-98ed6ad4c8e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:31.632330 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0ed56a98-d2b5-4c42-918f-98ed6ad4c8e9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.090054 Dec 18 20:59:31.646194 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1773/3586] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:31 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:31.661111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0c4a7c74-c1a1-4969-a85e-2d8279278aa0 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f716138a700>, body: {"security_group_rule": {"parent_group_id": "31b52e86-b441-4f00-9795-ba7b47ab7e37", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "20087893-52e7-4989-85fb-306247bf2c1c"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:31.761695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:31.771918 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aea59a5d-887f-4333-ab76-263e396f862a tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.382725 Dec 18 20:59:31.773867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1814/3587] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:31 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:31.786768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:31.788320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:31.800889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:31.801648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:31.803071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:31.803765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.084114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:32.092378 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a763a96-67c4-4399-9e6f-78eded728de7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.316877 Dec 18 20:59:32.094055 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1815/3588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:31 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:32.108649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-507b621e-e4ed-4b7f-8005-cba6c86dc45d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:32.110012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-507b621e-e4ed-4b7f-8005-cba6c86dc45d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:32.117684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507b621e-e4ed-4b7f-8005-cba6c86dc45d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.119453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507b621e-e4ed-4b7f-8005-cba6c86dc45d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.120763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507b621e-e4ed-4b7f-8005-cba6c86dc45d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.121451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507b621e-e4ed-4b7f-8005-cba6c86dc45d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.200799 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0c4a7c74-c1a1-4969-a85e-2d8279278aa0 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.551230 Dec 18 20:59:32.207223 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1774/3589] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:59:31 2021] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:32.207437 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-507b621e-e4ed-4b7f-8005-cba6c86dc45d tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.109052 Dec 18 20:59:32.207437 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1816/3590] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:32 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:32.217295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-281c11d5-ebe2-4053-a047-8c3ef8c67719 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:32.217879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e2719e3b-229d-4edf-b1c9-3d15edfd5507 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714f67fee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:32.221267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-281c11d5-ebe2-4053-a047-8c3ef8c67719 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:32.239173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-281c11d5-ebe2-4053-a047-8c3ef8c67719 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.242080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-281c11d5-ebe2-4053-a047-8c3ef8c67719 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.245127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-281c11d5-ebe2-4053-a047-8c3ef8c67719 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.245831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-281c11d5-ebe2-4053-a047-8c3ef8c67719 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.306400 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-281c11d5-ebe2-4053-a047-8c3ef8c67719 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.101473 Dec 18 20:59:32.321200 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1775/3591] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:32 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:32.335658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:32.338839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:32.349312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.349873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.350590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.351032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.662763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:32.680307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d265c9d2-0592-451f-a0b2-03d1041a4ee2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1495 microversion: 2.1 time: 0.353103 Dec 18 20:59:32.690304 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1776/3592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:32 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1495 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:32.690304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d57de51-0e02-40e7-8c48-f13a8afe2991 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:32.690304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7d57de51-0e02-40e7-8c48-f13a8afe2991 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:32.707749 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e2719e3b-229d-4edf-b1c9-3d15edfd5507 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/20087893-52e7-4989-85fb-306247bf2c1c" status: 202 len: 0 microversion: 2.1 time: 0.498810 Dec 18 20:59:32.711263 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1817/3593] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:32 2021] DELETE /compute/v2.1/os-security-groups/20087893-52e7-4989-85fb-306247bf2c1c => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:32.711427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d57de51-0e02-40e7-8c48-f13a8afe2991 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.711533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d57de51-0e02-40e7-8c48-f13a8afe2991 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.712265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d57de51-0e02-40e7-8c48-f13a8afe2991 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.712707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d57de51-0e02-40e7-8c48-f13a8afe2991 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.719292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72c0bf6e-3964-4590-ae3c-4344b1e3570c tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714eee8310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:32.781543 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7d57de51-0e02-40e7-8c48-f13a8afe2991 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.099244 Dec 18 20:59:32.782745 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1777/3594] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:32 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:32.789287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:32.790233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:32.798496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.799230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.800373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:32.800983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:32.804280 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72c0bf6e-3964-4590-ae3c-4344b1e3570c tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/31b52e86-b441-4f00-9795-ba7b47ab7e37" status: 200 len: 247 microversion: 2.1 time: 0.088218 Dec 18 20:59:32.805423 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1818/3595] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 20:59:32 2021] GET /compute/v2.1/os-security-groups/31b52e86-b441-4f00-9795-ba7b47ab7e37 => generated 247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:32.821206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c76488a-7145-4870-a0b2-2c9ca6683bef tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f7161309310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1996892898", "description": "tempest-description-1779439372"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:33.021399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:33.031493 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b5eb4d2a-9fbb-40bb-b483-c3b96ee2d6e5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.245726 Dec 18 20:59:33.032079 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1778/3596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:32 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:33.052870 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c76488a-7145-4870-a0b2-2c9ca6683bef tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.235827 Dec 18 20:59:33.053472 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1819/3597] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:32 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:33.065832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f8ea9e5-b4d6-4839-a09b-2f32f015892a tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f714f852940>, body: {"security_group_rule": {"parent_group_id": "2b7cb475-9d2a-4008-835d-4ca50a89c510", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:33.111039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:33.112023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:33.118537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.119557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.127558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.128291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.332579 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f8ea9e5-b4d6-4839-a09b-2f32f015892a tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.270554 Dec 18 20:59:33.333732 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1779/3598] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:59:33 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:33.344357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-471f53ba-f24a-4b90-8e75-18a6e2deaa1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:33.345982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-471f53ba-f24a-4b90-8e75-18a6e2deaa1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:33.353505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-471f53ba-f24a-4b90-8e75-18a6e2deaa1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.354460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-471f53ba-f24a-4b90-8e75-18a6e2deaa1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.355557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-471f53ba-f24a-4b90-8e75-18a6e2deaa1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.356256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-471f53ba-f24a-4b90-8e75-18a6e2deaa1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.358686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:33.367093 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5af45bd-970f-4cee-9add-fdc074ea4715 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.260619 Dec 18 20:59:33.376185 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1820/3599] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:33 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:33.376185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04b41f81-08bf-4b7a-858d-920b4ce4b677 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:33.376185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04b41f81-08bf-4b7a-858d-920b4ce4b677 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:33.380121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b41f81-08bf-4b7a-858d-920b4ce4b677 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.380697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b41f81-08bf-4b7a-858d-920b4ce4b677 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.381600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b41f81-08bf-4b7a-858d-920b4ce4b677 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.382155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b41f81-08bf-4b7a-858d-920b4ce4b677 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.419050 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-471f53ba-f24a-4b90-8e75-18a6e2deaa1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.078094 Dec 18 20:59:33.419774 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1780/3600] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:33 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:33.425964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3941ee9f-de70-4438-b493-cfd1b993099e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Action: 'create', calling method: .version_select at 0x7f716138aca0>, body: {"security_group_rule": {"parent_group_id": "2b7cb475-9d2a-4008-835d-4ca50a89c510", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:33.428794 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04b41f81-08bf-4b7a-858d-920b4ce4b677 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.059215 Dec 18 20:59:33.430130 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1821/3601] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:33 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:33.571150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-8cdaeb80-44b5-42c2-a36c-ff2c8cf2fc67 req-324e52a0-cb65-4fa9-b473-d9c9da8e2ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9031e0-037c-409f-8807-2847c9499293", "name": "network-vif-deleted", "tag": "32869e6e-5796-4fce-881e-b53b1eb6f63a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:33.572958 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:33.572958 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:33.616370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-8cdaeb80-44b5-42c2-a36c-ff2c8cf2fc67 req-324e52a0-cb65-4fa9-b473-d9c9da8e2ebe service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.619042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-8cdaeb80-44b5-42c2-a36c-ff2c8cf2fc67 req-324e52a0-cb65-4fa9-b473-d9c9da8e2ebe service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.631829 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-8cdaeb80-44b5-42c2-a36c-ff2c8cf2fc67 req-324e52a0-cb65-4fa9-b473-d9c9da8e2ebe service nova] Creating event network-vif-deleted:32869e6e-5796-4fce-881e-b53b1eb6f63a for instance ed9031e0-037c-409f-8807-2847c9499293 on nch2-master-1 Dec 18 20:59:33.650372 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-8cdaeb80-44b5-42c2-a36c-ff2c8cf2fc67 req-324e52a0-cb65-4fa9-b473-d9c9da8e2ebe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087839 Dec 18 20:59:33.651024 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1822/3602] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:33.700557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:33.701458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:33.724924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.725494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.726186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.729666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.755237 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3941ee9f-de70-4438-b493-cfd1b993099e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.334227 Dec 18 20:59:33.755909 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1781/3603] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Dec 18 20:59:33 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:33.766421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f74234e-8e29-4263-a24f-14d0fff24b30 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f716131fb80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:33.786206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.786817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.787358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lazy-loading 'fault' on Instance uuid ed9031e0-037c-409f-8807-2847c9499293 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 20:59:33.867179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:33.878865 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f74234e-8e29-4263-a24f-14d0fff24b30 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/2b7cb475-9d2a-4008-835d-4ca50a89c510" status: 200 len: 665 microversion: 2.1 time: 0.116343 Dec 18 20:59:33.880117 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1782/3604] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 20:59:33 2021] GET /compute/v2.1/os-security-groups/2b7cb475-9d2a-4008-835d-4ca50a89c510 => generated 665 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:33.885612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed2bc2be-e1f0-48e2-85a3-6a9c9b1001e4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:33.887477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ed2bc2be-e1f0-48e2-85a3-6a9c9b1001e4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:33.889271 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f91e68cf-eea2-408b-bab8-0fdc96a822d2 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 200 len: 1305 microversion: 2.1 time: 0.182860 Dec 18 20:59:33.889945 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1823/3605] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:33 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 1305 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:33.896272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2fca513-948a-461b-8077-fb6ecc2909e2 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714ef6bdc0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:33.905109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed2bc2be-e1f0-48e2-85a3-6a9c9b1001e4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.905910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed2bc2be-e1f0-48e2-85a3-6a9c9b1001e4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.906851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed2bc2be-e1f0-48e2-85a3-6a9c9b1001e4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:33.907298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed2bc2be-e1f0-48e2-85a3-6a9c9b1001e4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:33.964101 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed2bc2be-e1f0-48e2-85a3-6a9c9b1001e4 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.082204 Dec 18 20:59:33.966541 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1783/3606] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:33 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:34.049848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:34.050592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:34.076439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.077097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.084503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.085222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.104437 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2fca513-948a-461b-8077-fb6ecc2909e2 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/e4a458e7-bb65-4724-abb3-28ed533e49cc" status: 202 len: 0 microversion: 2.1 time: 0.212488 Dec 18 20:59:34.105662 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1824/3607] 10.222.0.13 () {58 vars in 1286 bytes} [Sat Dec 18 20:59:33 2021] DELETE /compute/v2.1/os-security-group-rules/e4a458e7-bb65-4724-abb3-28ed533e49cc => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:34.119066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b7da600-adc3-4926-ba98-14f58cdea3a7 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714ff80430>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:34.336739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:34.349721 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1f931ca-56ca-492d-ace2-1380cef00146 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.305031 Dec 18 20:59:34.351180 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1784/3608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:34 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:34.384683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:34.385924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:34.396071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.396787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.397993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.399973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.492591 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b7da600-adc3-4926-ba98-14f58cdea3a7 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2b7cb475-9d2a-4008-835d-4ca50a89c510" status: 202 len: 0 microversion: 2.1 time: 0.378875 Dec 18 20:59:34.493413 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1825/3609] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:34 2021] DELETE /compute/v2.1/os-security-groups/2b7cb475-9d2a-4008-835d-4ca50a89c510 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:34.500028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee367828-247e-40df-89cc-e20770d620a7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:34.501328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee367828-247e-40df-89cc-e20770d620a7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:34.533954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee367828-247e-40df-89cc-e20770d620a7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.537512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee367828-247e-40df-89cc-e20770d620a7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.543142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee367828-247e-40df-89cc-e20770d620a7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.543906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee367828-247e-40df-89cc-e20770d620a7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.639386 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee367828-247e-40df-89cc-e20770d620a7 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.142930 Dec 18 20:59:34.640100 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1826/3610] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:34 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:34.645893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:34.666047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a2e76b8d-ae76-4762-b1da-83c1acc06669 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:34.667373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a2e76b8d-ae76-4762-b1da-83c1acc06669 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:34.670463 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40e7fbc8-c8c1-41d4-b4e0-e8e49b382159 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.288570 Dec 18 20:59:34.671000 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1785/3611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:34 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:34.681090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2e76b8d-ae76-4762-b1da-83c1acc06669 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.682623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2e76b8d-ae76-4762-b1da-83c1acc06669 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.683995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8e2ad19-03dc-429b-9957-d54303bc6c5e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714e5c2430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:34.684906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2e76b8d-ae76-4762-b1da-83c1acc06669 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.685372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2e76b8d-ae76-4762-b1da-83c1acc06669 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.720884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-f8e2ad19-03dc-429b-9957-d54303bc6c5e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 20087893-52e7-4989-85fb-306247bf2c1c does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 20:59:34.721471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-f8e2ad19-03dc-429b-9957-d54303bc6c5e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Neutron security group 20087893-52e7-4989-85fb-306247bf2c1c not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 20:59:34.722246 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f8e2ad19-03dc-429b-9957-d54303bc6c5e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] HTTP exception thrown: Security group 20087893-52e7-4989-85fb-306247bf2c1c does not exist Dec 18 20:59:34.722246 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-6f353d46-473c-4484-92e7-ecfec401ac99'] Dec 18 20:59:34.723608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8e2ad19-03dc-429b-9957-d54303bc6c5e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Returning 404 to user: Security group 20087893-52e7-4989-85fb-306247bf2c1c does not exist Dec 18 20:59:34.723608 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-6f353d46-473c-4484-92e7-ecfec401ac99'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:34.724765 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8e2ad19-03dc-429b-9957-d54303bc6c5e tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/20087893-52e7-4989-85fb-306247bf2c1c" status: 404 len: 194 microversion: 2.1 time: 0.050145 Dec 18 20:59:34.726046 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1786/3612] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:34 2021] DELETE /compute/v2.1/os-security-groups/20087893-52e7-4989-85fb-306247bf2c1c => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:34.743288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-55344a67-a07e-4e0f-bfbc-46d805aa255f tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714e613b80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:34.789776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a2e76b8d-ae76-4762-b1da-83c1acc06669 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.143091 Dec 18 20:59:34.794710 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1827/3613] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:34 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:34.908559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:34.909344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: ed9031e0-037c-409f-8807-2847c9499293] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:34.920152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.921229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.922873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.923680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.963694 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] HTTP exception thrown: Instance ed9031e0-037c-409f-8807-2847c9499293 could not be found. Dec 18 20:59:34.964322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Returning 404 to user: Instance ed9031e0-037c-409f-8807-2847c9499293 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:34.965239 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5d52030-415d-429c-94d6-04d1f2419e14 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293" status: 404 len: 111 microversion: 2.1 time: 0.061892 Dec 18 20:59:34.965794 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1828/3614] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:34 2021] GET /compute/v2.1/servers/ed9031e0-037c-409f-8807-2847c9499293 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:34.969578 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-55344a67-a07e-4e0f-bfbc-46d805aa255f tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/31b52e86-b441-4f00-9795-ba7b47ab7e37" status: 202 len: 0 microversion: 2.1 time: 0.238335 Dec 18 20:59:34.970551 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1787/3615] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:34 2021] DELETE /compute/v2.1/os-security-groups/31b52e86-b441-4f00-9795-ba7b47ab7e37 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:59:34.977602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:34.978113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:34.980573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28f89614-caca-43c3-8681-c3a062d1b311 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:34.981915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28f89614-caca-43c3-8681-c3a062d1b311 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:34.996044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.996309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f89614-caca-43c3-8681-c3a062d1b311 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.996429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.997195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f89614-caca-43c3-8681-c3a062d1b311 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.997315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:34.997656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:34.998671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f89614-caca-43c3-8681-c3a062d1b311 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.000944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f89614-caca-43c3-8681-c3a062d1b311 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.027762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:35.109932 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28f89614-caca-43c3-8681-c3a062d1b311 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.134820 Dec 18 20:59:35.117849 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1788/3616] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:34 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:35.129484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2b35e47-e9e7-4b3c-a508-48e494c473c5 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714e6138b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:35.167733 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4cb80b1b-dec9-45f9-9f10-1970329add8c tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 204 len: 0 microversion: 2.1 time: 0.196378 Dec 18 20:59:35.169128 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1829/3617] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:34 2021] DELETE /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:35.196560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:35.198140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:35.219624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.220875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.222660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.223348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.570758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:35.585567 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-90772ee6-ca04-4744-a7f1-8b08a8bbd373 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1677 microversion: 2.1 time: 0.408250 Dec 18 20:59:35.595658 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1830/3618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:35 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1677 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:35.600173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:35.600789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:35.616106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.616750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.617869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.618587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.652803 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2b35e47-e9e7-4b3c-a508-48e494c473c5 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/aa9a5cb0-0673-47a9-9174-d089a6f2b327" status: 202 len: 0 microversion: 2.1 time: 0.533313 Dec 18 20:59:35.653481 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1789/3619] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:35 2021] DELETE /compute/v2.1/os-security-groups/aa9a5cb0-0673-47a9-9174-d089a6f2b327 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:35.661156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ded9be9a-d40d-4455-adeb-449922d1de47 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:35.663629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ded9be9a-d40d-4455-adeb-449922d1de47 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:35.681241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ded9be9a-d40d-4455-adeb-449922d1de47 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.682581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ded9be9a-d40d-4455-adeb-449922d1de47 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.683565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ded9be9a-d40d-4455-adeb-449922d1de47 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.684160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ded9be9a-d40d-4455-adeb-449922d1de47 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.762752 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ded9be9a-d40d-4455-adeb-449922d1de47 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action" status: 200 len: 40417 microversion: 2.32 time: 0.107579 Dec 18 20:59:35.764260 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1790/3620] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 20:59:35 2021] POST /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/action => generated 40417 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:35.772022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6d6ed30-2942-4fcb-97b3-30c6ab2303d3 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714e6314c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:35.847354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:35.855931 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5a9a208-8cb7-4a64-a47b-ab34838d5325 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.258962 Dec 18 20:59:35.857175 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1831/3621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:35 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:35.866854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-cacd4062-64d3-45b3-a04f-00b7ed568ab4 req-1f613b7d-998b-4def-9c51-a118c36c46b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a95061-f48a-4c6b-b3e7-afabba045761", "name": "network-vif-plugged", "status": "completed", "tag": "88dbfcb7-c934-431e-a0d0-8bf4116d376d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:35.869914 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:35.869914 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:35.889304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cacd4062-64d3-45b3-a04f-00b7ed568ab4 req-1f613b7d-998b-4def-9c51-a118c36c46b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.889993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cacd4062-64d3-45b3-a04f-00b7ed568ab4 req-1f613b7d-998b-4def-9c51-a118c36c46b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.906524 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-cacd4062-64d3-45b3-a04f-00b7ed568ab4 req-1f613b7d-998b-4def-9c51-a118c36c46b9 service nova] Creating event network-vif-plugged:88dbfcb7-c934-431e-a0d0-8bf4116d376d for instance d1a95061-f48a-4c6b-b3e7-afabba045761 on nch2-master-1 Dec 18 20:59:35.912673 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-cacd4062-64d3-45b3-a04f-00b7ed568ab4 req-1f613b7d-998b-4def-9c51-a118c36c46b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054145 Dec 18 20:59:35.914682 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1832/3622] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:35.937741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:35.939915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:35.949480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.950145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:35.951343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:35.952107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.139030 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6d6ed30-2942-4fcb-97b3-30c6ab2303d3 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/0a41aa5b-83a4-4b95-ad0d-8651e36ceb65" status: 202 len: 0 microversion: 2.1 time: 0.372968 Dec 18 20:59:36.139551 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1791/3623] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:35 2021] DELETE /compute/v2.1/os-security-groups/0a41aa5b-83a4-4b95-ad0d-8651e36ceb65 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:36.146961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:36.147956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:36.159227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.164538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.165681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.166338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.214908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:36.225395 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9730061-00e4-4f84-bd39-cb6accb3ebc1 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.309177 Dec 18 20:59:36.225981 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1833/3624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:35 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:36.235523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a2635e3-827c-4385-a4c6-64a276c98fe6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:36.241100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a2635e3-827c-4385-a4c6-64a276c98fe6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:36.253292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2635e3-827c-4385-a4c6-64a276c98fe6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.254420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2635e3-827c-4385-a4c6-64a276c98fe6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.255510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2635e3-827c-4385-a4c6-64a276c98fe6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.256185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a2635e3-827c-4385-a4c6-64a276c98fe6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.325208 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a2635e3-827c-4385-a4c6-64a276c98fe6 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.095011 Dec 18 20:59:36.326613 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1834/3625] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:36 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:36.334968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b665b717-fbf9-4095-b3a3-a6abd1d14031 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:36.336271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b665b717-fbf9-4095-b3a3-a6abd1d14031 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:36.350896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b665b717-fbf9-4095-b3a3-a6abd1d14031 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.351461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b665b717-fbf9-4095-b3a3-a6abd1d14031 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.353026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b665b717-fbf9-4095-b3a3-a6abd1d14031 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.353782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b665b717-fbf9-4095-b3a3-a6abd1d14031 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.427882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:36.437636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:36.439262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:36.441425 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed6807f0-08d3-488b-a069-6a2021619c1f tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2943 microversion: 2.32 time: 0.299838 Dec 18 20:59:36.442365 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1792/3626] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 20:59:36 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2943 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:59:36.446932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-faa09710-b8fe-4ef5-923b-142d711f6267 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714e633430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:36.511018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b665b717-fbf9-4095-b3a3-a6abd1d14031 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.177922 Dec 18 20:59:36.512734 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1835/3627] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:36 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:36.518023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22ec20fa-c0fd-4e61-bf75-c27c7ecb2851 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:36.518535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22ec20fa-c0fd-4e61-bf75-c27c7ecb2851 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:36.525291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22ec20fa-c0fd-4e61-bf75-c27c7ecb2851 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.525758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22ec20fa-c0fd-4e61-bf75-c27c7ecb2851 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.526595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22ec20fa-c0fd-4e61-bf75-c27c7ecb2851 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.527036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22ec20fa-c0fd-4e61-bf75-c27c7ecb2851 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.714521 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22ec20fa-c0fd-4e61-bf75-c27c7ecb2851 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.201452 Dec 18 20:59:36.715699 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1836/3628] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Dec 18 20:59:36 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd/os-interface => generated 1830 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 20:59:36.724458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:36.725421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:36.744799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.745351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.746376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.746495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.771623 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-faa09710-b8fe-4ef5-923b-142d711f6267 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3c80e1f4-e422-4094-97b1-f521ba042b69" status: 202 len: 0 microversion: 2.1 time: 0.327836 Dec 18 20:59:36.772530 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1793/3629] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:36 2021] DELETE /compute/v2.1/os-security-groups/3c80e1f4-e422-4094-97b1-f521ba042b69 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:36.902304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cc148289-5934-4c4b-b806-bfe3326d5922 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:36.903437 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:36.903437 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:36.905280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc148289-5934-4c4b-b806-bfe3326d5922 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.906346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc148289-5934-4c4b-b806-bfe3326d5922 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.907566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc148289-5934-4c4b-b806-bfe3326d5922 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.915758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc148289-5934-4c4b-b806-bfe3326d5922 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.941653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:36.950004 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-684e8d79-c5ed-46a3-aec0-12110c791209 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1677 microversion: 2.1 time: 0.233045 Dec 18 20:59:36.951322 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1837/3630] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:36 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:36.956940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7f888b9f-5d00-47b8-89d1-4b850f67c522 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] Calling method '.version_select at 0x7f714fae8ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:36.964875 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cc148289-5934-4c4b-b806-bfe3326d5922 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.190404 Dec 18 20:59:36.965729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1794/3631] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Dec 18 20:59:36 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:36.970808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:36.971631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:36.981901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.982665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:36.984878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:36.986199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:37.269713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:37.278313 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03b529d9-4796-4fe3-bcb6-6bd87f442304 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1324 microversion: 2.1 time: 0.310459 Dec 18 20:59:37.279176 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1795/3632] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:36 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:37.304064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1420553773", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "11a2412d-58d1-4b26-9a42-5b9697cc2593"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:37.384602 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7f888b9f-5d00-47b8-89d1-4b850f67c522 tempest-SecurityGroupRulesTestJSON-233984731 tempest-SecurityGroupRulesTestJSON-233984731-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/deb717b8-f9d7-453e-96fa-082df8ee870b" status: 202 len: 0 microversion: 2.1 time: 0.431742 Dec 18 20:59:37.386110 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1838/3633] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 20:59:36 2021] DELETE /compute/v2.1/os-security-groups/deb717b8-f9d7-453e-96fa-082df8ee870b => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 20:59:37.394052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:37.395220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:37.408100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:37.410187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:37.411286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:37.412195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:37.424372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] validate_networks() for [('11a2412d-58d1-4b26-9a42-5b9697cc2593', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:37.928664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:37.947716 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40851fab-1c77-470c-9551-128af4714849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.559491 Dec 18 20:59:37.949526 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1839/3634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:37 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:37.956795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0aa9ff45-31a4-4295-b48d-1ad0cffc7618 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:37.958080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0aa9ff45-31a4-4295-b48d-1ad0cffc7618 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:37.967704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa9ff45-31a4-4295-b48d-1ad0cffc7618 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:37.968479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa9ff45-31a4-4295-b48d-1ad0cffc7618 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:37.969835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa9ff45-31a4-4295-b48d-1ad0cffc7618 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:37.970596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aa9ff45-31a4-4295-b48d-1ad0cffc7618 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.065441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0aa9ff45-31a4-4295-b48d-1ad0cffc7618 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.112994 Dec 18 20:59:38.070736 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1840/3635] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:37 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:38.083647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-852cad20-5dca-4fc5-83bf-eca2867273d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:38.084765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-852cad20-5dca-4fc5-83bf-eca2867273d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:38.098369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-852cad20-5dca-4fc5-83bf-eca2867273d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.099457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-852cad20-5dca-4fc5-83bf-eca2867273d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.101409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-852cad20-5dca-4fc5-83bf-eca2867273d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.102030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-852cad20-5dca-4fc5-83bf-eca2867273d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.152780 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-852cad20-5dca-4fc5-83bf-eca2867273d6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.080199 Dec 18 20:59:38.153757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1841/3636] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:38 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:38.160618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9e1b0fa7-1de6-4a96-8ddc-436873160b89 req-1876fee7-3f03-4a3f-8335-11ed9d63cf53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12e2896-51c3-4ed6-abc1-fb782a8c9f48", "name": "network-vif-plugged", "status": "completed", "tag": "f436640a-8992-4e8c-bdca-8adcc9d844b1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:38.162615 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:38.162615 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:38.173547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9e1b0fa7-1de6-4a96-8ddc-436873160b89 req-1876fee7-3f03-4a3f-8335-11ed9d63cf53 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.174014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9e1b0fa7-1de6-4a96-8ddc-436873160b89 req-1876fee7-3f03-4a3f-8335-11ed9d63cf53 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.188506 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9e1b0fa7-1de6-4a96-8ddc-436873160b89 req-1876fee7-3f03-4a3f-8335-11ed9d63cf53 service nova] Creating event network-vif-plugged:f436640a-8992-4e8c-bdca-8adcc9d844b1 for instance a12e2896-51c3-4ed6-abc1-fb782a8c9f48 on nch2-master-1 Dec 18 20:59:38.195357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9e1b0fa7-1de6-4a96-8ddc-436873160b89 req-1876fee7-3f03-4a3f-8335-11ed9d63cf53 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Dec 18 20:59:38.201082 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1842/3637] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:38.208270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:38.208995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:38.217954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.219022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.220077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.221315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.356816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd83848fe8d4e7284291660eb51da51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de37deec2a49ff9eaad9cbb7c48f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:38.377269 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b9b7023-986e-441e-bc9f-ef8f945bd3a0 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 200 len: 1609 microversion: 2.1 time: 0.174560 Dec 18 20:59:38.391744 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1843/3638] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:38 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 1609 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:38.398306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:38.403011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:38.415500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.416962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.418011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.418670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.648960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:38.649992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:38.649992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:38.650245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:38.657755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:38.683738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.684969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.686777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.687478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.740906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Getting quotas for project 75c84e493553475aa1781e3e9528e50a. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:38.748114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Getting quotas for user 864d0556412b4165a129dc1c69c68d44 and project 75c84e493553475aa1781e3e9528e50a. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:38.766534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:38.769225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:38.829864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a28ac53b-7536-4fe3-89da-a053ac0b593b tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.536550 Dec 18 20:59:38.836633 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1796/3639] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:38.842274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b9499f10-5232-4941-bf48-b75ebf6cff08 req-d2c4ac82-a455-4742-9045-200934000a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025fcfa-d293-483a-80c3-2100f89d26f4", "name": "network-vif-deleted", "tag": "b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:38.844783 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:38.844783 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:38.857804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9499f10-5232-4941-bf48-b75ebf6cff08 req-d2c4ac82-a455-4742-9045-200934000a75 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:38.858627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9499f10-5232-4941-bf48-b75ebf6cff08 req-d2c4ac82-a455-4742-9045-200934000a75 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:38.879072 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b9499f10-5232-4941-bf48-b75ebf6cff08 req-d2c4ac82-a455-4742-9045-200934000a75 service nova] Creating event network-vif-deleted:b4a5e1ad-6b7c-4cdd-b1cb-5cb9f4fc6699 for instance d025fcfa-d293-483a-80c3-2100f89d26f4 on nch1-master-1 Dec 18 20:59:38.896053 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b9499f10-5232-4941-bf48-b75ebf6cff08 req-d2c4ac82-a455-4742-9045-200934000a75 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057761 Dec 18 20:59:38.898200 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1797/3640] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:38.904905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc9c810f-f4b0-460f-8e1c-8788837a48d2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:38.907490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc9c810f-f4b0-460f-8e1c-8788837a48d2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:39.013081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:39.016571 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc9c810f-f4b0-460f-8e1c-8788837a48d2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1329 microversion: 2.1 time: 0.115772 Dec 18 20:59:39.017165 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1798/3641] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:38 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:39.025875 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22da71a4-b3dc-4688-822e-ad2e034f48b6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.632786 Dec 18 20:59:39.031874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:39.036654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:39.040651 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1844/3642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:38 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:39.046492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:39.047509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:39.054669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.055535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.056562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.057214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.057711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.058181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.066293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.069402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.294760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:39.309611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87ac74df-2332-4ebc-96c3-bb748ffde757 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.267525 Dec 18 20:59:39.327255 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1845/3643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:39 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:39.342172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca2200f3-51f7-49f9-95a0-4a206f34e2bc tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:39.347276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca2200f3-51f7-49f9-95a0-4a206f34e2bc tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:39.365258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2200f3-51f7-49f9-95a0-4a206f34e2bc tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.366640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2200f3-51f7-49f9-95a0-4a206f34e2bc tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.367786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2200f3-51f7-49f9-95a0-4a206f34e2bc tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.369849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca2200f3-51f7-49f9-95a0-4a206f34e2bc tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.496644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca2200f3-51f7-49f9-95a0-4a206f34e2bc tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.165370 Dec 18 20:59:39.497778 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1846/3644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:39 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:39.513700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4acf3a35-2ed3-4d4c-918b-a50a83347ea9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:39.519318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4acf3a35-2ed3-4d4c-918b-a50a83347ea9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:39.564150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4acf3a35-2ed3-4d4c-918b-a50a83347ea9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.567699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4acf3a35-2ed3-4d4c-918b-a50a83347ea9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.572579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4acf3a35-2ed3-4d4c-918b-a50a83347ea9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.574092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4acf3a35-2ed3-4d4c-918b-a50a83347ea9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.663629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:39.677281 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60a033d0-a2c2-40ed-811d-9c610510f0c6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1318 microversion: 2.1 time: 0.655586 Dec 18 20:59:39.690276 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1799/3645] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:39 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:39.707516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-faa50c30-384b-4ba2-a07d-4001594f8568 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1370010052", "metadata": {"": ""}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:39.712887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-faa50c30-384b-4ba2-a07d-4001594f8568 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:39.713776 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-faa50c30-384b-4ba2-a07d-4001594f8568 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action" status: 400 len: 170 microversion: 2.1 time: 0.020319 Dec 18 20:59:39.714770 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4acf3a35-2ed3-4d4c-918b-a50a83347ea9 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.212903 Dec 18 20:59:39.724269 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1800/3646] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Dec 18 20:59:39 2021] POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action => generated 170 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:59:39.724592 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1847/3647] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:39 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:39.747749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:39.750796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] [instance: d025fcfa-d293-483a-80c3-2100f89d26f4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:39.751429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:39.753433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:39.769998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.771291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.772816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.773457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.775395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.776087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.779432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:39.780144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:39.818185 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] HTTP exception thrown: Instance d025fcfa-d293-483a-80c3-2100f89d26f4 could not be found. Dec 18 20:59:39.823236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Returning 404 to user: Instance d025fcfa-d293-483a-80c3-2100f89d26f4 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:39.826227 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72ae28e1-4a34-44d6-8c59-76535e271ba4 tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4" status: 404 len: 111 microversion: 2.1 time: 0.100593 Dec 18 20:59:39.830057 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1801/3648] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:39 2021] GET /compute/v2.1/servers/d025fcfa-d293-483a-80c3-2100f89d26f4 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:39.853400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-04cead36-f3c0-476b-9823-4ee264cc8b0a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] Calling method '.version_select at 0x7f7161323700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:39.912328 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-04cead36-f3c0-476b-9823-4ee264cc8b0a tempest-ServerActionsTestJSON-771169336 tempest-ServerActionsTestJSON-771169336-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824634061" status: 202 len: 0 microversion: 2.1 time: 0.074136 Dec 18 20:59:39.914862 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1802/3649] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 20:59:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824634061 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 20:59:40.012389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:40.027566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e675d8b5-f4f6-4528-a5b3-04c43f390169 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.300090 Dec 18 20:59:40.040254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-348833c9-8dd7-4872-8341-e23efd686c7c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:40.041911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-348833c9-8dd7-4872-8341-e23efd686c7c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:40.043658 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1848/3650] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:39 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:40.055232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:40.056239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:40.062952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.064067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:40.073214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.074903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:40.753853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-348833c9-8dd7-4872-8341-e23efd686c7c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1329 microversion: 2.1 time: 0.700357 Dec 18 20:59:40.759472 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1803/3651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:40 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1329 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:40.780692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b5c13ac-87cc-4c07-bc86-e39791c1e97f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:40.781936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9b5c13ac-87cc-4c07-bc86-e39791c1e97f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:40.790574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b5c13ac-87cc-4c07-bc86-e39791c1e97f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.791359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b5c13ac-87cc-4c07-bc86-e39791c1e97f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:40.792407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b5c13ac-87cc-4c07-bc86-e39791c1e97f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.793260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b5c13ac-87cc-4c07-bc86-e39791c1e97f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:40.857511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:40.878778 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48d3391b-55e2-42ec-91cc-d289933194c5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.820816 Dec 18 20:59:40.878778 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1849/3652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:40 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:40.878778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:40.878778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:40.902138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.908679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:40.914437 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b5c13ac-87cc-4c07-bc86-e39791c1e97f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.152601 Dec 18 20:59:40.915123 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1804/3653] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:40 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:40.918985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.919459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:40.931101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75c4d379-ad8f-41fc-b753-a04913d0783b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:40.932176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75c4d379-ad8f-41fc-b753-a04913d0783b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:40.952729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4d379-ad8f-41fc-b753-a04913d0783b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.953155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4d379-ad8f-41fc-b753-a04913d0783b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:40.953958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4d379-ad8f-41fc-b753-a04913d0783b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:40.954565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4d379-ad8f-41fc-b753-a04913d0783b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.005368 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75c4d379-ad8f-41fc-b753-a04913d0783b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.088665 Dec 18 20:59:41.007970 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1805/3654] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:40 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:41.023545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4d933c2-387b-4b3f-b855-5d57d021c704 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2006440292", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:41.024980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4d933c2-387b-4b3f-b855-5d57d021c704 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:41.025853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4d933c2-387b-4b3f-b855-5d57d021c704 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action" status: 400 len: 938 microversion: 2.1 time: 0.016665 Dec 18 20:59:41.031443 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1806/3655] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Dec 18 20:59:41 2021] POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:59:41.044615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:41.045364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:41.069604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.070075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.070944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.071395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.187928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:41.199476 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8bad845d-2d19-4682-aac2-9ed2d9952fc0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1508 microversion: 2.1 time: 0.328732 Dec 18 20:59:41.204416 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1850/3656] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:40 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:41.336933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:41.350577 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b53b69ac-4030-47ab-ab23-e207846fdfa4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.312979 Dec 18 20:59:41.357948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1807/3657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:41 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:41.375329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:41.375969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:41.389085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.389541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.390456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.391793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.762136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:41.772010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0b69b452-0e17-4879-82f3-34212899ba3d tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:41.773586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0b69b452-0e17-4879-82f3-34212899ba3d tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:41.787690 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a1c7291b-69dd-4113-a065-4a7f191280e2 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.414912 Dec 18 20:59:41.792477 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1851/3658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:41 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:41.797783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b69b452-0e17-4879-82f3-34212899ba3d tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.802082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b69b452-0e17-4879-82f3-34212899ba3d tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.803155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b69b452-0e17-4879-82f3-34212899ba3d tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.819862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b69b452-0e17-4879-82f3-34212899ba3d tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.822011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99b31a6f-6003-47e4-8746-de8a387f45f6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:41.833484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99b31a6f-6003-47e4-8746-de8a387f45f6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:41.836191 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99b31a6f-6003-47e4-8746-de8a387f45f6 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action" status: 400 len: 619 microversion: 2.1 time: 0.028641 Dec 18 20:59:41.843545 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1852/3659] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Dec 18 20:59:41 2021] POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 20:59:41.857254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:41.857886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:41.901902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.902685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:41.904276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:41.904944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.035087 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0b69b452-0e17-4879-82f3-34212899ba3d tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1422 microversion: 2.1 time: 0.267752 Dec 18 20:59:42.036582 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1808/3660] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:41 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1422 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:42.042956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba9c9574-4f14-4593-b1bc-4d9a0e81939d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:42.045328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba9c9574-4f14-4593-b1bc-4d9a0e81939d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:42.053829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9c9574-4f14-4593-b1bc-4d9a0e81939d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.054715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9c9574-4f14-4593-b1bc-4d9a0e81939d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.055834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9c9574-4f14-4593-b1bc-4d9a0e81939d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.057826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9c9574-4f14-4593-b1bc-4d9a0e81939d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.115723 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba9c9574-4f14-4593-b1bc-4d9a0e81939d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.077543 Dec 18 20:59:42.117344 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1809/3661] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:42 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:42.125113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74209629-40ca-4695-9a1b-18482b7569a6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:42.126593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74209629-40ca-4695-9a1b-18482b7569a6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:42.151392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74209629-40ca-4695-9a1b-18482b7569a6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.152657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74209629-40ca-4695-9a1b-18482b7569a6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.157089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74209629-40ca-4695-9a1b-18482b7569a6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.158831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74209629-40ca-4695-9a1b-18482b7569a6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.242422 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74209629-40ca-4695-9a1b-18482b7569a6 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.122044 Dec 18 20:59:42.247579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1810/3662] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:42 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:42.258868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:42.268295 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2f58d4a6-a05a-4f90-b4c1-7d7c1ada4f7c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.417990 Dec 18 20:59:42.269492 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1853/3663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:41 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:42.292575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:42.293467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:42.306648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.307804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.309025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.309761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.529721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:42.548523 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7da31664-ccbd-488e-9276-f5173da3d810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.265224 Dec 18 20:59:42.559847 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1811/3664] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:42 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:42.567108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5ecf017-7480-45bd-a36d-1f587b1619b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1403603470"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:42.568955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d5ecf017-7480-45bd-a36d-1f587b1619b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:42.575958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ecf017-7480-45bd-a36d-1f587b1619b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.576712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ecf017-7480-45bd-a36d-1f587b1619b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.578468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ecf017-7480-45bd-a36d-1f587b1619b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:42.579133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ecf017-7480-45bd-a36d-1f587b1619b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:42.984033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b346c98b-a78a-457d-8d83-24d76cff8afe tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17286a65-2bb6-4891-8fc9-210c222fe2a9"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:42.985677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b346c98b-a78a-457d-8d83-24d76cff8afe tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:43.005718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b346c98b-a78a-457d-8d83-24d76cff8afe tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.006611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b346c98b-a78a-457d-8d83-24d76cff8afe tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.007684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b346c98b-a78a-457d-8d83-24d76cff8afe tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.008283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b346c98b-a78a-457d-8d83-24d76cff8afe tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.031172 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d5ecf017-7480-45bd-a36d-1f587b1619b1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action" status: 202 len: 0 microversion: 2.1 time: 0.467336 Dec 18 20:59:43.033426 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1854/3665] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:42 2021] POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 20:59:43.052843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1383962744"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:43.056539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:43.075104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.075692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.076628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.079049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.173796 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Cannot 'createImage' instance d1a95061-f48a-4c6b-b3e7-afabba045761 while it is in task_state image_snapshot_pending Dec 18 20:59:43.175850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 409 to user: Cannot 'createImage' instance d1a95061-f48a-4c6b-b3e7-afabba045761 while it is in task_state image_snapshot_pending {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:43.189058 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf2d52bb-a68e-478a-81ec-f285a17779f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action" status: 409 len: 167 microversion: 2.1 time: 0.140699 Dec 18 20:59:43.193876 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1855/3666] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:43 2021] POST /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761/action => generated 167 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 20:59:43.200370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54a9706b-a043-48c1-9229-b427917033d7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:43.201193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54a9706b-a043-48c1-9229-b427917033d7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:43.221401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a9706b-a043-48c1-9229-b427917033d7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.226603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a9706b-a043-48c1-9229-b427917033d7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.227945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a9706b-a043-48c1-9229-b427917033d7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.229478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a9706b-a043-48c1-9229-b427917033d7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.475110 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b346c98b-a78a-457d-8d83-24d76cff8afe tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493833 Dec 18 20:59:43.477608 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1812/3667] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 20:59:42 2021] POST /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:43.513696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-629789db-abf6-4511-a12a-f1b5defff8c5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:43.515319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-629789db-abf6-4511-a12a-f1b5defff8c5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:43.530012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-629789db-abf6-4511-a12a-f1b5defff8c5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.531047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-629789db-abf6-4511-a12a-f1b5defff8c5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.537167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-629789db-abf6-4511-a12a-f1b5defff8c5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.537675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-629789db-abf6-4511-a12a-f1b5defff8c5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.611890 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-629789db-abf6-4511-a12a-f1b5defff8c5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.115020 Dec 18 20:59:43.612538 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1813/3668] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:43 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:43.627033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02e7295e-ca0b-41f8-be93-9cb6bd7fd994 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '.version_select at 0x7f714e631280>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:43.835362 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54a9706b-a043-48c1-9229-b427917033d7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1464 microversion: 2.1 time: 0.639333 Dec 18 20:59:43.850463 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1856/3669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:43 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1464 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:43.863273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7f8bcb19-e37e-4906-b972-f6cf60577779 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:43.865605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7f8bcb19-e37e-4906-b972-f6cf60577779 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:43.879507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb19-e37e-4906-b972-f6cf60577779 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.884020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb19-e37e-4906-b972-f6cf60577779 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.886877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb19-e37e-4906-b972-f6cf60577779 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.887629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb19-e37e-4906-b972-f6cf60577779 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.925579 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-02e7295e-ca0b-41f8-be93-9cb6bd7fd994 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/images/7dbfd92e-372c-4f86-bb45-439d157609a9" status: 204 len: 0 microversion: 2.1 time: 0.311661 Dec 18 20:59:43.926958 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1814/3670] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:43 2021] DELETE /compute/v2.1/images/7dbfd92e-372c-4f86-bb45-439d157609a9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:43.935543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:43.937413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:43.951865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.953255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.954279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:43.957744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:43.985942 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7f8bcb19-e37e-4906-b972-f6cf60577779 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.132941 Dec 18 20:59:43.987118 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1857/3671] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:43 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:44.304952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:44.314987 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d666bf1-6e20-4972-b5fd-70ce2ee6e10f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1532 microversion: 2.1 time: 0.383780 Dec 18 20:59:44.325730 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1815/3672] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:43 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1532 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:44.628696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-46090e2a-142d-4115-bae6-8a77a7803962 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:44.629879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-46090e2a-142d-4115-bae6-8a77a7803962 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:44.642342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-46090e2a-142d-4115-bae6-8a77a7803962 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:44.643031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-46090e2a-142d-4115-bae6-8a77a7803962 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:44.644472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-46090e2a-142d-4115-bae6-8a77a7803962 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:44.646671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-46090e2a-142d-4115-bae6-8a77a7803962 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:44.716225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e40dbbf-b2b7-4566-985b-d694f791c5c2 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f715c33aaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1247017277", "description": "tempest-description-1499697445"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:44.764436 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-46090e2a-142d-4115-bae6-8a77a7803962 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.139422 Dec 18 20:59:44.766958 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1816/3673] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:44 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:44.857259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f1aafaa-aa62-41aa-9c30-2c050e5857af tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:44.857970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f1aafaa-aa62-41aa-9c30-2c050e5857af tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:44.867671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f1aafaa-aa62-41aa-9c30-2c050e5857af tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:44.867962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f1aafaa-aa62-41aa-9c30-2c050e5857af tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:44.880761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f1aafaa-aa62-41aa-9c30-2c050e5857af tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:44.881496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f1aafaa-aa62-41aa-9c30-2c050e5857af tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:45.296092 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e40dbbf-b2b7-4566-985b-d694f791c5c2 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.942785 Dec 18 20:59:45.296786 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1858/3674] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:44 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:45.305802 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f1aafaa-aa62-41aa-9c30-2c050e5857af tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1464 microversion: 2.1 time: 0.452477 Dec 18 20:59:45.312653 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1817/3675] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:44 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1464 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:45.316131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-09a78dfb-a2ec-4c87-9245-5ab10a7ef6cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:45.317782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-09a78dfb-a2ec-4c87-9245-5ab10a7ef6cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:45.319712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc6ce0a5-96f6-4282-bc64-6c03794384b0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f714e5d5d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-181831606", "description": "tempest-description-1652963602"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:45.328769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a78dfb-a2ec-4c87-9245-5ab10a7ef6cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:45.330428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a78dfb-a2ec-4c87-9245-5ab10a7ef6cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:45.332297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a78dfb-a2ec-4c87-9245-5ab10a7ef6cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:45.333516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09a78dfb-a2ec-4c87-9245-5ab10a7ef6cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:45.474879 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-09a78dfb-a2ec-4c87-9245-5ab10a7ef6cb tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.165853 Dec 18 20:59:45.475859 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1859/3676] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:45 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:45.481036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:45.481816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:45.494893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:45.495416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:45.498226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:45.498784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.153311 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc6ce0a5-96f6-4282-bc64-6c03794384b0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.839284 Dec 18 20:59:46.154620 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1818/3677] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 20:59:45 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:46.172011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-2f5ffc99-b02b-488a-90ec-08bfb011ab41 req-7fa57d98-a3ef-4f70-8bf5-bcd78f679455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568a5cf4-f4a7-422f-91f2-9981295940ff", "tag": "0da2c32b-1622-4614-8ba1-9f9480ff52bf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:46.174938 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:46.174938 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:46.212708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2f5ffc99-b02b-488a-90ec-08bfb011ab41 req-7fa57d98-a3ef-4f70-8bf5-bcd78f679455 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:46.213916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2f5ffc99-b02b-488a-90ec-08bfb011ab41 req-7fa57d98-a3ef-4f70-8bf5-bcd78f679455 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.230720 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-2f5ffc99-b02b-488a-90ec-08bfb011ab41 req-7fa57d98-a3ef-4f70-8bf5-bcd78f679455 service nova] Creating event network-changed:0da2c32b-1622-4614-8ba1-9f9480ff52bf for instance 568a5cf4-f4a7-422f-91f2-9981295940ff on nch2-master-1 Dec 18 20:59:46.246913 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-2f5ffc99-b02b-488a-90ec-08bfb011ab41 req-7fa57d98-a3ef-4f70-8bf5-bcd78f679455 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089713 Dec 18 20:59:46.251787 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1819/3678] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:46.267408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2d1c8a3-ba7c-44d1-85c4-625b021ca068 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:46.274356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2d1c8a3-ba7c-44d1-85c4-625b021ca068 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:46.287664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d1c8a3-ba7c-44d1-85c4-625b021ca068 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:46.289552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d1c8a3-ba7c-44d1-85c4-625b021ca068 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.291246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d1c8a3-ba7c-44d1-85c4-625b021ca068 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:46.291951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d1c8a3-ba7c-44d1-85c4-625b021ca068 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.297759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:46.305903 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-347dec10-c80f-4f0f-a387-5a59cb8f25da tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1538 microversion: 2.1 time: 0.828607 Dec 18 20:59:46.309407 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1860/3679] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:45 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1538 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:46.316566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2109609099", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "a54d1475-0f49-45b1-a549-1796cbed269f"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:46.398801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] validate_networks() for [('a54d1475-0f49-45b1-a549-1796cbed269f', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:46.406996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2d1c8a3-ba7c-44d1-85c4-625b021ca068 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.152790 Dec 18 20:59:46.408912 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1820/3680] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:46 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:46.419077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84129411-4875-480e-ad94-941831a9d494 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:46.420628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84129411-4875-480e-ad94-941831a9d494 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:46.431442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84129411-4875-480e-ad94-941831a9d494 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:46.432939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84129411-4875-480e-ad94-941831a9d494 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.435441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84129411-4875-480e-ad94-941831a9d494 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:46.436236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84129411-4875-480e-ad94-941831a9d494 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.819342 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84129411-4875-480e-ad94-941831a9d494 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1464 microversion: 2.1 time: 0.408868 Dec 18 20:59:46.830395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1821/3681] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:46 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:46.835562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6b35a501-7fb8-4c6a-a952-5c8c964b6255 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:46.836503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6b35a501-7fb8-4c6a-a952-5c8c964b6255 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:46.849736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b35a501-7fb8-4c6a-a952-5c8c964b6255 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:46.850194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b35a501-7fb8-4c6a-a952-5c8c964b6255 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.851023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b35a501-7fb8-4c6a-a952-5c8c964b6255 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:46.851466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b35a501-7fb8-4c6a-a952-5c8c964b6255 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:46.941242 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6b35a501-7fb8-4c6a-a952-5c8c964b6255 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.109045 Dec 18 20:59:46.942556 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1822/3682] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:46 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:47.128460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1375961296", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1f7835a3-1921-420f-bc92-783d1cac5ba9"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:47.135473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:47.135993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:47.136580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:47.136911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:47.137818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:47.158366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:47.158881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:47.159764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:47.160218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:47.183682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Getting quotas for project 0d7fb5d0ce9f40d2b55296706489a86a. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:47.191346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Getting quotas for user 7ca060b0759d4bb687977d2435ce74e9 and project 0d7fb5d0ce9f40d2b55296706489a86a. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:47.206800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] validate_networks() for [('1f7835a3-1921-420f-bc92-783d1cac5ba9', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:47.208055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:47.216795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:47.289626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc935a67-3991-424b-badc-9f4df5e03870 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976635 Dec 18 20:59:47.290347 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1861/3683] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:47.301403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-975ce5e6-4e68-417c-a68e-7ffbf1d3f4a3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:47.304338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-975ce5e6-4e68-417c-a68e-7ffbf1d3f4a3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:47.458085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-975ce5e6-4e68-417c-a68e-7ffbf1d3f4a3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:47.464982 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-975ce5e6-4e68-417c-a68e-7ffbf1d3f4a3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1216 microversion: 2.1 time: 0.167396 Dec 18 20:59:47.465556 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1862/3684] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:47 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:47.473267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:47.474902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:47.484515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:47.485474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:47.487647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:47.488182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:47.910033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:47.921571 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ddfa6dcf-229d-4bc6-8308-db4384a95079 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1520 microversion: 2.1 time: 0.452318 Dec 18 20:59:47.935779 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1863/3685] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:47 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:47.951147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2bdc2beb-5a9d-48db-8481-80884fdb2338 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:47.952197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2bdc2beb-5a9d-48db-8481-80884fdb2338 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:47.970298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdc2beb-5a9d-48db-8481-80884fdb2338 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:47.970741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdc2beb-5a9d-48db-8481-80884fdb2338 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:47.971566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdc2beb-5a9d-48db-8481-80884fdb2338 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:47.972018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdc2beb-5a9d-48db-8481-80884fdb2338 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.029129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:48.029617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:48.030011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:48.030996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:48.031411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:48.031846 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2bdc2beb-5a9d-48db-8481-80884fdb2338 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.091227 Dec 18 20:59:48.036506 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1864/3686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:47 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:48.041072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.041741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.042771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.043309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-214bedae-44ce-4594-a028-314a1246e462 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:48.043634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.044032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-214bedae-44ce-4594-a028-314a1246e462 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:48.054530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214bedae-44ce-4594-a028-314a1246e462 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.055128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214bedae-44ce-4594-a028-314a1246e462 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.056193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214bedae-44ce-4594-a028-314a1246e462 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.057844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214bedae-44ce-4594-a028-314a1246e462 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.064671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:48.071077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for user 4196dd207ce543d3bdd5f48ae57e156a and project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:48.085048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:48.087807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:48.159647 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ec3560e-dfd2-4891-9b01-0a9e8a876596 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036353 Dec 18 20:59:48.168047 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1823/3687] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:48.178720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:48.179345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:48.187438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.188136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.189202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.189807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.228908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:48.248836 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-214bedae-44ce-4594-a028-314a1246e462 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1464 microversion: 2.1 time: 0.210789 Dec 18 20:59:48.250465 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1865/3688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:48 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:48.267719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0e77432-4192-47fa-8d07-50fac7a6e53c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:48.268690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0e77432-4192-47fa-8d07-50fac7a6e53c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:48.286013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e77432-4192-47fa-8d07-50fac7a6e53c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.286494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e77432-4192-47fa-8d07-50fac7a6e53c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.287509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e77432-4192-47fa-8d07-50fac7a6e53c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.287952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e77432-4192-47fa-8d07-50fac7a6e53c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.372475 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b49ce26-8a12-462d-843a-5ff3c3ccb69c tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 204 len: 0 microversion: 2.1 time: 0.202823 Dec 18 20:59:48.373379 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1824/3689] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:48 2021] DELETE /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:48.376051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0e77432-4192-47fa-8d07-50fac7a6e53c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.124146 Dec 18 20:59:48.385415 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1866/3690] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:48 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:48.390800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d4517bb2-f7a8-4973-8490-4f809df68e15 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:48.391517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d4517bb2-f7a8-4973-8490-4f809df68e15 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:48.402714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:48.404781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:48.425711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.426164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.426989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.427429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.543828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d4517bb2-f7a8-4973-8490-4f809df68e15 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:48.561062 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d4517bb2-f7a8-4973-8490-4f809df68e15 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1218 microversion: 2.1 time: 0.186456 Dec 18 20:59:48.564869 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1825/3691] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:48 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:48.573215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:48.578831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:48.595696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.596167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.600441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:48.600957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:48.885914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:48.894909 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d507cb5f-d3c3-4095-8c26-cfe50c6b673a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1276 microversion: 2.1 time: 0.328440 Dec 18 20:59:48.904608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:48.905193 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1826/3692] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:48 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1276 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:48.907062 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7dfa431c-4f45-426a-93e1-9516c39f7650 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1526 microversion: 2.1 time: 0.520069 Dec 18 20:59:48.907842 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1867/3693] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:48 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1526 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:49.049210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62443aca-3d16-4b97-a2e5-8ca8b3875788 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:49.056116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62443aca-3d16-4b97-a2e5-8ca8b3875788 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:49.063360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62443aca-3d16-4b97-a2e5-8ca8b3875788 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.064119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62443aca-3d16-4b97-a2e5-8ca8b3875788 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.065932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62443aca-3d16-4b97-a2e5-8ca8b3875788 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.071131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62443aca-3d16-4b97-a2e5-8ca8b3875788 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.151655 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62443aca-3d16-4b97-a2e5-8ca8b3875788 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.111349 Dec 18 20:59:49.153149 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1827/3694] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:49 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:49.267659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c9bcdc3-e4a2-433b-a4ec-05e0386a9e7f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:49.268338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c9bcdc3-e4a2-433b-a4ec-05e0386a9e7f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:49.286038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c9bcdc3-e4a2-433b-a4ec-05e0386a9e7f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.286555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c9bcdc3-e4a2-433b-a4ec-05e0386a9e7f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.287484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c9bcdc3-e4a2-433b-a4ec-05e0386a9e7f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.287931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c9bcdc3-e4a2-433b-a4ec-05e0386a9e7f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.390124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-180b5344-b3a7-49c9-b011-0cceab798371 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:49.391705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-180b5344-b3a7-49c9-b011-0cceab798371 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:49.407638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-180b5344-b3a7-49c9-b011-0cceab798371 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.410851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-180b5344-b3a7-49c9-b011-0cceab798371 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.414441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-180b5344-b3a7-49c9-b011-0cceab798371 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.414835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-180b5344-b3a7-49c9-b011-0cceab798371 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.474516 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-180b5344-b3a7-49c9-b011-0cceab798371 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.090003 Dec 18 20:59:49.475175 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1828/3695] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:49 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:59:49.484406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6ce876ea-37aa-4874-9660-81901fcb6843 req-3c805bab-2734-4ed3-9ee4-c8fb55595ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a95061-f48a-4c6b-b3e7-afabba045761", "name": "network-vif-plugged", "status": "completed", "tag": "88dbfcb7-c934-431e-a0d0-8bf4116d376d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:49.495606 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:49.495606 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:49.509028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6ce876ea-37aa-4874-9660-81901fcb6843 req-3c805bab-2734-4ed3-9ee4-c8fb55595ff3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.510745 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c9bcdc3-e4a2-433b-a4ec-05e0386a9e7f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1464 microversion: 2.1 time: 0.245832 Dec 18 20:59:49.519896 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1868/3696] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:49 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1464 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:49.520393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6ce876ea-37aa-4874-9660-81901fcb6843 req-3c805bab-2734-4ed3-9ee4-c8fb55595ff3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.533816 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6ce876ea-37aa-4874-9660-81901fcb6843 req-3c805bab-2734-4ed3-9ee4-c8fb55595ff3 service nova] Creating event network-vif-plugged:88dbfcb7-c934-431e-a0d0-8bf4116d376d for instance d1a95061-f48a-4c6b-b3e7-afabba045761 on nch2-master-1 Dec 18 20:59:49.538838 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6ce876ea-37aa-4874-9660-81901fcb6843 req-3c805bab-2734-4ed3-9ee4-c8fb55595ff3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062048 Dec 18 20:59:49.539958 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1829/3697] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:49.580490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:49.581404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:49.588494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.588953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.598496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.598992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.676918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:49.684790 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7661933a-be2a-48da-9d25-a4a334e5b933 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1278 microversion: 2.1 time: 0.109959 Dec 18 20:59:49.686227 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1869/3698] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:49 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:49.912761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:49.913540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:49.919740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.920692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.921480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.921929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.927434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:49.928200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:49.936000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.937243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:49.938356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:49.939184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.138705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:50.149928 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-177f2657-34c2-4366-872e-8340f1308458 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1526 microversion: 2.1 time: 0.228156 Dec 18 20:59:50.157526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:50.160313 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1870/3699] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:49 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:50.167531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e1fe1e5c-1387-4d62-aeb3-430280b8c556 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:50.168572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e1fe1e5c-1387-4d62-aeb3-430280b8c556 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:50.177332 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b21e5d63-7b5f-44f1-9638-9b086828b639 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1316 microversion: 2.1 time: 0.268844 Dec 18 20:59:50.177943 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1830/3700] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:49 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:50.183147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e5c-1387-4d62-aeb3-430280b8c556 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.183608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e5c-1387-4d62-aeb3-430280b8c556 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.184416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e5c-1387-4d62-aeb3-430280b8c556 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.184860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e5c-1387-4d62-aeb3-430280b8c556 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.233915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e1fe1e5c-1387-4d62-aeb3-430280b8c556 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.069640 Dec 18 20:59:50.234798 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1871/3701] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:50 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:50.486174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89447c81-54ef-49e4-a48f-e45dfddd522b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:50.487296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89447c81-54ef-49e4-a48f-e45dfddd522b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:50.493731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89447c81-54ef-49e4-a48f-e45dfddd522b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.494506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89447c81-54ef-49e4-a48f-e45dfddd522b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.495009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89447c81-54ef-49e4-a48f-e45dfddd522b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.495476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89447c81-54ef-49e4-a48f-e45dfddd522b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.529664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b52a1228-7669-489a-8c97-5ccb021b3766 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:50.531229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b52a1228-7669-489a-8c97-5ccb021b3766 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:50.539925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b52a1228-7669-489a-8c97-5ccb021b3766 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.540474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b52a1228-7669-489a-8c97-5ccb021b3766 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.542473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b52a1228-7669-489a-8c97-5ccb021b3766 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.544370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b52a1228-7669-489a-8c97-5ccb021b3766 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.547286 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89447c81-54ef-49e4-a48f-e45dfddd522b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.064544 Dec 18 20:59:50.548827 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1831/3702] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:50 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:50.706845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:50.706845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:50.724209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.726031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.727185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:50.728223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:50.983454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:50.994625 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05e9e5ec-eaa4-46d9-b509-8ee0eef30849 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1276 microversion: 2.1 time: 0.295316 Dec 18 20:59:51.005282 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1832/3703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:50 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:51.024339 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b52a1228-7669-489a-8c97-5ccb021b3766 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1464 microversion: 2.1 time: 0.500378 Dec 18 20:59:51.037852 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1872/3704] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:50 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1464 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:51.169029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:51.171580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:51.179312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.180117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.181121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.181762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.202714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:51.203119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:51.231656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.232116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.233099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.233814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.308569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:51.320004 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4393fea-a9fd-4fc2-9c29-bac877ec2639 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 200 len: 1484 microversion: 2.1 time: 0.154795 Dec 18 20:59:51.321171 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1833/3705] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:51 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 1484 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:51.329619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b99f3224-c484-4c97-bbfb-92456948b9c9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:51.333322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b99f3224-c484-4c97-bbfb-92456948b9c9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:51.353916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b99f3224-c484-4c97-bbfb-92456948b9c9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.356484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b99f3224-c484-4c97-bbfb-92456948b9c9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.359974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b99f3224-c484-4c97-bbfb-92456948b9c9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.365604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b99f3224-c484-4c97-bbfb-92456948b9c9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.460995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b99f3224-c484-4c97-bbfb-92456948b9c9 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.137882 Dec 18 20:59:51.461929 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1834/3706] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:51 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:51.473370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-62c571b3-f171-4dcf-b5a5-4bc7944cda8c req-562343f5-a4a8-4422-bc02-a56ceab00825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6330b4d1-f33b-40ed-87d9-4029566f8b51", "tag": "95468de0-87ec-4e68-8883-879d214ec825"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:51.477739 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:51.477739 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:51.489208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-62c571b3-f171-4dcf-b5a5-4bc7944cda8c req-562343f5-a4a8-4422-bc02-a56ceab00825 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.489980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-62c571b3-f171-4dcf-b5a5-4bc7944cda8c req-562343f5-a4a8-4422-bc02-a56ceab00825 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.493158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:51.503107 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-62c571b3-f171-4dcf-b5a5-4bc7944cda8c req-562343f5-a4a8-4422-bc02-a56ceab00825 service nova] Creating event network-changed:95468de0-87ec-4e68-8883-879d214ec825 for instance 6330b4d1-f33b-40ed-87d9-4029566f8b51 on nch1-master-1 Dec 18 20:59:51.509187 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-62c571b3-f171-4dcf-b5a5-4bc7944cda8c req-562343f5-a4a8-4422-bc02-a56ceab00825 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045599 Dec 18 20:59:51.510119 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1835/3707] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:51.516166 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5df7a84-f6fb-4cfe-98ea-cb465b049ef6 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1316 microversion: 2.1 time: 0.322521 Dec 18 20:59:51.516814 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1873/3708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:51 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:51.558209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b0c60317-86c0-4301-b7dc-5ea229125afe req-fbd19ec3-22fd-4fed-a872-ae28cd3a60f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568a5cf4-f4a7-422f-91f2-9981295940ff", "name": "network-vif-plugged", "status": "completed", "tag": "0da2c32b-1622-4614-8ba1-9f9480ff52bf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:51.558866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d269c2b-1242-4a2b-927f-d6153b35cb94 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:51.559856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d269c2b-1242-4a2b-927f-d6153b35cb94 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:51.559969 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:51.559969 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:51.566818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d269c2b-1242-4a2b-927f-d6153b35cb94 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.567274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d269c2b-1242-4a2b-927f-d6153b35cb94 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.567719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b0c60317-86c0-4301-b7dc-5ea229125afe req-fbd19ec3-22fd-4fed-a872-ae28cd3a60f3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.568078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d269c2b-1242-4a2b-927f-d6153b35cb94 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:51.568202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b0c60317-86c0-4301-b7dc-5ea229125afe req-fbd19ec3-22fd-4fed-a872-ae28cd3a60f3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.568571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d269c2b-1242-4a2b-927f-d6153b35cb94 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:51.580378 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b0c60317-86c0-4301-b7dc-5ea229125afe req-fbd19ec3-22fd-4fed-a872-ae28cd3a60f3 service nova] Creating event network-vif-plugged:0da2c32b-1622-4614-8ba1-9f9480ff52bf for instance 568a5cf4-f4a7-422f-91f2-9981295940ff on nch2-master-1 Dec 18 20:59:51.585783 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b0c60317-86c0-4301-b7dc-5ea229125afe req-fbd19ec3-22fd-4fed-a872-ae28cd3a60f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 Dec 18 20:59:51.586617 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1836/3709] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:51.618165 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d269c2b-1242-4a2b-927f-d6153b35cb94 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.062946 Dec 18 20:59:51.619502 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1874/3710] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:51 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:52.022481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:52.023321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:52.029422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.029879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.030891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.031340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.043439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dfabe642-7335-4cb2-a001-e410a687dfb2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:52.044332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dfabe642-7335-4cb2-a001-e410a687dfb2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:52.054079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfabe642-7335-4cb2-a001-e410a687dfb2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.054849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfabe642-7335-4cb2-a001-e410a687dfb2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.055928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfabe642-7335-4cb2-a001-e410a687dfb2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.056785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfabe642-7335-4cb2-a001-e410a687dfb2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.243385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:52.257595 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e879c0df-814a-434a-8634-832df853a959 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.239606 Dec 18 20:59:52.258287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1837/3711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:52 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:52.263230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dfabe642-7335-4cb2-a001-e410a687dfb2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1464 microversion: 2.1 time: 0.223852 Dec 18 20:59:52.264120 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1875/3712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:52 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1464 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:52.336774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:52.337377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:52.343284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.343735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.344516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.344955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.358981 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Instance d1a95061-f48a-4c6b-b3e7-afabba045761 could not be found. Dec 18 20:59:52.359570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Instance d1a95061-f48a-4c6b-b3e7-afabba045761 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 20:59:52.360399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c51bbf4d-e388-4ace-8e0a-d6223b147f22 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 404 len: 111 microversion: 2.1 time: 0.027454 Dec 18 20:59:52.360947 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1838/3713] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:52 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:52.379154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b26fd00-fc8d-4c59-8efa-5135b7f0e595 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'create', calling method: .version_select at 0x7f714ef1e1f0>, body: {"keypair": {"name": "tempest-keypair-479047281"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:52.394289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2b26fd00-fc8d-4c59-8efa-5135b7f0e595 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for project 80e8efe6135e41a689caf483b2c72af1. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:52.399255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2b26fd00-fc8d-4c59-8efa-5135b7f0e595 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for user bc32317ed5e54f67b8ae64f92419bcc0 and project 80e8efe6135e41a689caf483b2c72af1. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:52.474616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ba6d2aa-291c-43c8-8885-279fba0fa052 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:52.475900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ba6d2aa-291c-43c8-8885-279fba0fa052 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:52.482990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ba6d2aa-291c-43c8-8885-279fba0fa052 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.484097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ba6d2aa-291c-43c8-8885-279fba0fa052 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.485067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ba6d2aa-291c-43c8-8885-279fba0fa052 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.485566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ba6d2aa-291c-43c8-8885-279fba0fa052 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.535716 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ba6d2aa-291c-43c8-8885-279fba0fa052 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.063957 Dec 18 20:59:52.541626 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1839/3714] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:52 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:59:52.550364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:52.551580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:52.560501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.561809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.562847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.563440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.621836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2b26fd00-fc8d-4c59-8efa-5135b7f0e595 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for project 80e8efe6135e41a689caf483b2c72af1. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:52.634036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2b26fd00-fc8d-4c59-8efa-5135b7f0e595 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for user bc32317ed5e54f67b8ae64f92419bcc0 and project 80e8efe6135e41a689caf483b2c72af1. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:52.677447 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b26fd00-fc8d-4c59-8efa-5135b7f0e595 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.311003 Dec 18 20:59:52.679448 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1876/3715] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 20:59:52 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:52.684435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-37dbd508-5920-43f0-b082-0be26a185395 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:52.685595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-37dbd508-5920-43f0-b082-0be26a185395 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:52.694699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37dbd508-5920-43f0-b082-0be26a185395 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.695147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37dbd508-5920-43f0-b082-0be26a185395 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.703543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37dbd508-5920-43f0-b082-0be26a185395 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:52.708517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37dbd508-5920-43f0-b082-0be26a185395 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:52.781082 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-37dbd508-5920-43f0-b082-0be26a185395 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.099701 Dec 18 20:59:52.781819 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1877/3716] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:52 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:52.855328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:52.864629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e61cc2f7-24fd-442a-b90d-35c1a7ad9493 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1316 microversion: 2.1 time: 0.321182 Dec 18 20:59:52.872679 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1840/3717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:52 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:53.274942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:53.276544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:53.296601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:53.297624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:53.299174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:53.299782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:53.394384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2032538874", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "74ad1df6-b439-443c-a033-fdb0a24ed87f"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:53.470044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] validate_networks() for [('74ad1df6-b439-443c-a033-fdb0a24ed87f', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:53.620846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:53.630643 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-310369f5-0db9-46a3-aefa-8beba3d5b762 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.359224 Dec 18 20:59:53.631870 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1841/3718] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:53 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:53.636646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ff9030c-6f12-476e-a362-8f07cbdb4870 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:53.637438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ff9030c-6f12-476e-a362-8f07cbdb4870 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:53.653244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ff9030c-6f12-476e-a362-8f07cbdb4870 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:53.656537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ff9030c-6f12-476e-a362-8f07cbdb4870 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:53.657800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ff9030c-6f12-476e-a362-8f07cbdb4870 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:53.658634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ff9030c-6f12-476e-a362-8f07cbdb4870 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:53.902830 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ff9030c-6f12-476e-a362-8f07cbdb4870 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1649 microversion: 2.1 time: 0.269358 Dec 18 20:59:53.903484 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1842/3719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:53 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1649 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:53.909359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f0b47cc5-1471-43a7-99ed-98f148687620 req-b22919cb-3cce-4ba4-a9d9-da5e0dbd3113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a95061-f48a-4c6b-b3e7-afabba045761", "name": "network-vif-deleted", "tag": "88dbfcb7-c934-431e-a0d0-8bf4116d376d"}, {"name": "network-changed", "server_uuid": "7d17b336-2d79-4cfe-a5ef-fa648eec0574", "tag": "df772871-7061-43d6-b5d3-522b6ef7eef9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:53.912552 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:53.912552 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:53.922488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f0b47cc5-1471-43a7-99ed-98f148687620 req-b22919cb-3cce-4ba4-a9d9-da5e0dbd3113 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:53.922958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f0b47cc5-1471-43a7-99ed-98f148687620 req-b22919cb-3cce-4ba4-a9d9-da5e0dbd3113 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:53.936171 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f0b47cc5-1471-43a7-99ed-98f148687620 req-b22919cb-3cce-4ba4-a9d9-da5e0dbd3113 service nova] Creating event network-vif-deleted:88dbfcb7-c934-431e-a0d0-8bf4116d376d for instance d1a95061-f48a-4c6b-b3e7-afabba045761 on nch2-master-1 Dec 18 20:59:53.937241 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f0b47cc5-1471-43a7-99ed-98f148687620 req-b22919cb-3cce-4ba4-a9d9-da5e0dbd3113 service nova] Creating event network-changed:df772871-7061-43d6-b5d3-522b6ef7eef9 for instance 7d17b336-2d79-4cfe-a5ef-fa648eec0574 on nch1-master-1 Dec 18 20:59:53.945663 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f0b47cc5-1471-43a7-99ed-98f148687620 req-b22919cb-3cce-4ba4-a9d9-da5e0dbd3113 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040640 Dec 18 20:59:53.946447 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1843/3720] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:53 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:53.951811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66716e66-ae02-438a-b29a-e1f8016f8bc5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:53.953020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66716e66-ae02-438a-b29a-e1f8016f8bc5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:53.959449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66716e66-ae02-438a-b29a-e1f8016f8bc5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:53.960175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66716e66-ae02-438a-b29a-e1f8016f8bc5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:53.961135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66716e66-ae02-438a-b29a-e1f8016f8bc5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:53.961750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66716e66-ae02-438a-b29a-e1f8016f8bc5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.007498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66716e66-ae02-438a-b29a-e1f8016f8bc5 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.059274 Dec 18 20:59:54.011763 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1844/3721] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:53 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:54.013269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-824d1f44-a520-4c0e-aa1e-a7d77cf61f31 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:54.014286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-824d1f44-a520-4c0e-aa1e-a7d77cf61f31 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:54.020859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:54.021565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:54.022023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:54.022327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-824d1f44-a520-4c0e-aa1e-a7d77cf61f31 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.022664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:54.022790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-824d1f44-a520-4c0e-aa1e-a7d77cf61f31 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.023382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:54.023589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-824d1f44-a520-4c0e-aa1e-a7d77cf61f31 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.024056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-824d1f44-a520-4c0e-aa1e-a7d77cf61f31 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.035337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.036199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.037171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.037715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.058641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Getting quotas for project c4dac9c70ce64bab85da8c23bafd20cc. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:54.063954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Getting quotas for user 515dc27f25b847a0922262533aa0d5b1 and project c4dac9c70ce64bab85da8c23bafd20cc. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:54.067918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-824d1f44-a520-4c0e-aa1e-a7d77cf61f31 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 32645 microversion: 2.1 time: 0.058331 Dec 18 20:59:54.068592 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1845/3722] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:54 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:54.074219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:54.074940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:54.079027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:54.081935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:54.082081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.082424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.083665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.084110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.141908 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98358054-834a-499c-b026-80fa25ce261d tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951268 Dec 18 20:59:54.146394 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1878/3723] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:54.152195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-734d322b-5587-42da-a578-7ca6bd57f5f7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:54.152879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-734d322b-5587-42da-a578-7ca6bd57f5f7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:54.160325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734d322b-5587-42da-a578-7ca6bd57f5f7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.161041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734d322b-5587-42da-a578-7ca6bd57f5f7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.162008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734d322b-5587-42da-a578-7ca6bd57f5f7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.162635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734d322b-5587-42da-a578-7ca6bd57f5f7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.300842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:54.309468 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba85eb97-b72b-4bea-af9d-fe53ca63bfea tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1316 microversion: 2.1 time: 0.239296 Dec 18 20:59:54.310635 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1846/3724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:54 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:54.315990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-47509c80-2f60-4312-bf51-718bd56cb64b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:54.316938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-47509c80-2f60-4312-bf51-718bd56cb64b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:54.358299 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-734d322b-5587-42da-a578-7ca6bd57f5f7 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1649 microversion: 2.1 time: 0.209752 Dec 18 20:59:54.359175 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1879/3725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:54 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1649 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:54.374852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1547d839-292c-4956-b42e-85195600969f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:54.375764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1547d839-292c-4956-b42e-85195600969f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:54.382716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1547d839-292c-4956-b42e-85195600969f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.383505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1547d839-292c-4956-b42e-85195600969f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.384886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1547d839-292c-4956-b42e-85195600969f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.385340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1547d839-292c-4956-b42e-85195600969f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.388045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-47509c80-2f60-4312-bf51-718bd56cb64b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:54.398762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-47509c80-2f60-4312-bf51-718bd56cb64b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1217 microversion: 2.1 time: 0.086750 Dec 18 20:59:54.399972 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1847/3726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:54 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:54.529789 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1547d839-292c-4956-b42e-85195600969f tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1649 microversion: 2.1 time: 0.158614 Dec 18 20:59:54.531271 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1880/3727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:54 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1649 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:54.649998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:54.650662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:54.652874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-455607843", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "11a2412d-58d1-4b26-9a42-5b9697cc2593"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:54.660591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.661306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.662565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:54.663208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:54.727884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] validate_networks() for [('11a2412d-58d1-4b26-9a42-5b9697cc2593', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:54.926301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:54.937082 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-865f7cf2-835b-40d9-8fde-c9e058e85fa7 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.292158 Dec 18 20:59:54.946672 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1848/3728] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:54 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:55.019241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c666583-d937-41e9-8dcc-f1f39f80ce6a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:55.020210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c666583-d937-41e9-8dcc-f1f39f80ce6a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:55.026136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c666583-d937-41e9-8dcc-f1f39f80ce6a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.026829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c666583-d937-41e9-8dcc-f1f39f80ce6a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.027620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c666583-d937-41e9-8dcc-f1f39f80ce6a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.028275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c666583-d937-41e9-8dcc-f1f39f80ce6a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.079064 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c666583-d937-41e9-8dcc-f1f39f80ce6a tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.062968 Dec 18 20:59:55.080154 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1849/3729] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:55 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:59:55.089412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44680801-5648-45d4-b90e-84ff07717eb7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:55.090570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44680801-5648-45d4-b90e-84ff07717eb7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:55.107603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44680801-5648-45d4-b90e-84ff07717eb7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.108150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44680801-5648-45d4-b90e-84ff07717eb7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.109239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44680801-5648-45d4-b90e-84ff07717eb7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.109814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44680801-5648-45d4-b90e-84ff07717eb7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.171831 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44680801-5648-45d4-b90e-84ff07717eb7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action" status: 200 len: 40795 microversion: 2.1 time: 0.089998 Dec 18 20:59:55.172436 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1850/3730] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:55 2021] POST /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca/action => generated 40795 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:55.190466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:55.191572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:55.209144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.209584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.214384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.215010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.243085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:55.243622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:55.243974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:55.244389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:55.244795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:55.258587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.259042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.259907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.260398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.281340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Getting quotas for project 75c84e493553475aa1781e3e9528e50a. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:55.287294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Getting quotas for user 864d0556412b4165a129dc1c69c68d44 and project 75c84e493553475aa1781e3e9528e50a. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:55.317998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:55.338397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:55.414952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e0ea2de-5ecb-4cc2-9f07-ff11829935cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767095 Dec 18 20:59:55.416260 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1881/3731] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:55.423649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:55.425092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:55.425869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:55.434807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.435780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.436804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.437255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.441199 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-33e08910-f2d8-4c4e-9c0b-ddaa78acfc6f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1710 microversion: 2.1 time: 0.261400 Dec 18 20:59:55.441894 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1851/3732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:55 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1710 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:55.468765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:55.469515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:55.482129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.482762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.483762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.494457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.607794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:55.623265 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72cdb5ab-0ee6-4e99-b864-6e020208385b tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1275 microversion: 2.1 time: 0.169189 Dec 18 20:59:55.628517 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1852/3733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:55 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:55.639410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-839bdb46-9a71-4d2b-a88f-098ef631f6ff tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:55.641451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-839bdb46-9a71-4d2b-a88f-098ef631f6ff tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:55.652127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:55.661425 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-84faaecc-4d3a-4494-a6d5-44d2fbbf3332 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1316 microversion: 2.1 time: 0.243651 Dec 18 20:59:55.662368 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1882/3734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:55 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:55.668453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-813546793", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfdb70fc-b6f1-4792-b656-71aeb0dae3b6"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:55.726649 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-839bdb46-9a71-4d2b-a88f-098ef631f6ff tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1328 microversion: 2.1 time: 0.096346 Dec 18 20:59:55.727731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1853/3735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:55 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:55.740806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] validate_networks() for [('bfdb70fc-b6f1-4792-b656-71aeb0dae3b6', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 20:59:55.957863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:55.959532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:55.971176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.972555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:55.974354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:55.975641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.239538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 20:59:56.239982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 20:59:56.240785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 20:59:56.241220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 20:59:56.241816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 20:59:56.245362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:56.255734 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae69037e-2c4c-414e-be47-4211cfda82c8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.303731 Dec 18 20:59:56.257034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1854/3736] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:55 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:56.259211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.259795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.260946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.261657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.269582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d7d43fc-79ed-493e-ade5-21cb7ec2cba4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:56.271418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8d7d43fc-79ed-493e-ade5-21cb7ec2cba4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:56.278198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d7d43fc-79ed-493e-ade5-21cb7ec2cba4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.279122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d7d43fc-79ed-493e-ade5-21cb7ec2cba4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.279978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d7d43fc-79ed-493e-ade5-21cb7ec2cba4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.281070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d7d43fc-79ed-493e-ade5-21cb7ec2cba4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.281245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for project 80e8efe6135e41a689caf483b2c72af1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 20:59:56.287159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for user bc32317ed5e54f67b8ae64f92419bcc0 and project 80e8efe6135e41a689caf483b2c72af1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 20:59:56.300322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 20:59:56.302606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 20:59:56.324780 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8d7d43fc-79ed-493e-ade5-21cb7ec2cba4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.065897 Dec 18 20:59:56.325453 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1855/3737] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:56 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:56.332009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:56.335613 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:56.335613 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:56.336923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:56.337842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Searching by: {'deleted': False, 'project_id': '2ab34e83092a4610b03af4bfa353fb09'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:59:56.343953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.344397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.345199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.345630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.349570 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb3e084d-1622-4ab8-82e9-6da162e31567 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.685995 Dec 18 20:59:56.356221 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1883/3738] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:59:55 2021] POST /compute/v2.1/servers => generated 383 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 20:59:56.362220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7290fcbb-5f08-4997-8c44-ee960096f236 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:56.363465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7290fcbb-5f08-4997-8c44-ee960096f236 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:56.387822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:59:56.431745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7290fcbb-5f08-4997-8c44-ee960096f236 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:56.442110 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a47b040-5e04-42d0-a4d9-8c63fc27f119 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.114235 Dec 18 20:59:56.446388 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1856/3739] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 20:59:56 2021] GET /compute/v2.1/servers => generated 340 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:56.447604 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7290fcbb-5f08-4997-8c44-ee960096f236 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1224 microversion: 2.1 time: 0.089869 Dec 18 20:59:56.448675 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1884/3740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:56 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:56.459975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:56.463135 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:56.463135 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:56.464259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:56.465312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Searching by: {'deleted': False, 'project_id': '2ab34e83092a4610b03af4bfa353fb09'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 20:59:56.472003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.472624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.473479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.473912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.503066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 20:59:56.539576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:56.546211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.546510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.645156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:56.645924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:56.661897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.662389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.671359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.671833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.695019 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56561298-5f59-40f5-a002-1b3cee2a029e tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.238322 Dec 18 20:59:56.696102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1857/3741] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 20:59:56 2021] GET /compute/v2.1/servers/detail => generated 1713 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:56.703027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:56.704070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:56.718611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.719330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.720379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:56.721665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:56.991515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:56.995304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:57.002784 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ea648767-41ae-485b-af29-914acc1e20a8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1316 microversion: 2.1 time: 0.305127 Dec 18 20:59:57.004116 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35454ef4-8cd2-4c12-a0ad-5c202e20c4d2 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1317 microversion: 2.1 time: 0.362946 Dec 18 20:59:57.005884 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1858/3742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:56 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:57.007304 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1885/3743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:56 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:57.013441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-677364d9-a949-43d8-9b96-03b37c41f8ee tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:57.014233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-677364d9-a949-43d8-9b96-03b37c41f8ee tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:57.022018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-677364d9-a949-43d8-9b96-03b37c41f8ee tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.022737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-677364d9-a949-43d8-9b96-03b37c41f8ee tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.023705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-677364d9-a949-43d8-9b96-03b37c41f8ee tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.024140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-677364d9-a949-43d8-9b96-03b37c41f8ee tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.024779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5dc3f61-2b72-4da3-b729-30a6b782b00c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:57.044135 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b5dc3f61-2b72-4da3-b729-30a6b782b00c tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032854 Dec 18 20:59:57.045343 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1859/3744] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 20:59:57 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 20:59:57.129167 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-677364d9-a949-43d8-9b96-03b37c41f8ee tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1421 microversion: 2.1 time: 0.120281 Dec 18 20:59:57.130517 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1886/3745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:57 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:57.273360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:57.273976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:57.278475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-06a1cf91-d97b-465a-b4d8-2fefcb6e8eec req-73d33408-df8a-4a21-8497-8f889a8af746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6330b4d1-f33b-40ed-87d9-4029566f8b51", "name": "network-vif-plugged", "status": "completed", "tag": "95468de0-87ec-4e68-8883-879d214ec825"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:57.280751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.281204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.281779 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:57.281779 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 20:59:57.282146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.282616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.292241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-06a1cf91-d97b-465a-b4d8-2fefcb6e8eec req-73d33408-df8a-4a21-8497-8f889a8af746 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.293094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-06a1cf91-d97b-465a-b4d8-2fefcb6e8eec req-73d33408-df8a-4a21-8497-8f889a8af746 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.318060 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-06a1cf91-d97b-465a-b4d8-2fefcb6e8eec req-73d33408-df8a-4a21-8497-8f889a8af746 service nova] Creating event network-vif-plugged:95468de0-87ec-4e68-8883-879d214ec825 for instance 6330b4d1-f33b-40ed-87d9-4029566f8b51 on nch1-master-1 Dec 18 20:59:57.331115 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-06a1cf91-d97b-465a-b4d8-2fefcb6e8eec req-73d33408-df8a-4a21-8497-8f889a8af746 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056695 Dec 18 20:59:57.332719 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1887/3746] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:57.339021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58744e50-22d8-4a1f-91fc-d098ece67272 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:57.340369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58744e50-22d8-4a1f-91fc-d098ece67272 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:57.438177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58744e50-22d8-4a1f-91fc-d098ece67272 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.440451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58744e50-22d8-4a1f-91fc-d098ece67272 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.448292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58744e50-22d8-4a1f-91fc-d098ece67272 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.449101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58744e50-22d8-4a1f-91fc-d098ece67272 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.490452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:57.521867 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58744e50-22d8-4a1f-91fc-d098ece67272 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.187312 Dec 18 20:59:57.523164 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1888/3747] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:57 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 20:59:57.531629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b8ebe144-cff3-4b32-a023-bd18feaaf021 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.262308 Dec 18 20:59:57.532455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:57.533576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:57.551850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.552440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.553356 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1860/3748] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:57 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:57.555637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.556263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.575996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:57.576893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:57.614440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 20:59:57.615651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.616120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.620275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.621153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.792329 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a691d3a7-c989-41bd-b20c-4f7f5f24e2f7 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "DELETE /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 204 len: 0 microversion: 2.1 time: 0.266638 Dec 18 20:59:57.802117 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1889/3749] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 20:59:57 2021] DELETE /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 20:59:57.808056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:57.808954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:57.816196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.816744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.817886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:57.819413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:57.828542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:57.843001 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fb1746f4-d5b7-45fb-b95e-e8ae96fe5ab1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1284 microversion: 2.1 time: 0.282344 Dec 18 20:59:57.843860 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1861/3750] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:57 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:57.963502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-028ff634-9ec4-4738-93c7-80556f72dcb8 req-2fc358d1-9b39-4b33-9d5a-9f5ce13aa462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5ad229-3042-4816-865e-c5055f87a909", "tag": "2f46a0da-28aa-4aef-82c3-f3adb2fd5bad"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:57.984942 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:59:57.984942 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 20:59:58.007178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-028ff634-9ec4-4738-93c7-80556f72dcb8 req-2fc358d1-9b39-4b33-9d5a-9f5ce13aa462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.007918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-028ff634-9ec4-4738-93c7-80556f72dcb8 req-2fc358d1-9b39-4b33-9d5a-9f5ce13aa462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.030117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-028ff634-9ec4-4738-93c7-80556f72dcb8 req-2fc358d1-9b39-4b33-9d5a-9f5ce13aa462 service nova] Creating event network-changed:2f46a0da-28aa-4aef-82c3-f3adb2fd5bad for instance 9c5ad229-3042-4816-865e-c5055f87a909 on nch2-master-1 Dec 18 20:59:58.037356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-028ff634-9ec4-4738-93c7-80556f72dcb8 req-2fc358d1-9b39-4b33-9d5a-9f5ce13aa462 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083802 Dec 18 20:59:58.038346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1862/3751] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 20:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 20:59:58.045218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:58.046451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:58.057577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.058342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.059554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.060289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.075856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:58.087079 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf67bce6-0c57-4cd8-903f-3b0ed19e3c8f tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1716 microversion: 2.1 time: 0.283456 Dec 18 20:59:58.093386 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1890/3752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:57 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1716 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:58.101691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:58.107580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:58.124766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.125501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.127379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.129503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.456178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:58.462157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:58.468011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0883ab7a-70dd-4c6d-a685-638e25c02c7a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1317 microversion: 2.1 time: 0.370545 Dec 18 20:59:58.478811 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1891/3753] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:58 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:58.479413 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a2a021d-540e-4a0d-901b-2943be3058ca tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1316 microversion: 2.1 time: 0.435696 Dec 18 20:59:58.479413 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1863/3754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:58 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:58.484556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-debb1e04-8289-4220-bff6-6c6bffaa75ac tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:58.485451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-debb1e04-8289-4220-bff6-6c6bffaa75ac tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:58.493711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-debb1e04-8289-4220-bff6-6c6bffaa75ac tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.494449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-debb1e04-8289-4220-bff6-6c6bffaa75ac tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.495501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-debb1e04-8289-4220-bff6-6c6bffaa75ac tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.496170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-debb1e04-8289-4220-bff6-6c6bffaa75ac tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.534070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24fe5f1e-dc15-4bea-95e9-11f98890e094 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 20:59:58.535033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-24fe5f1e-dc15-4bea-95e9-11f98890e094 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:58.541425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24fe5f1e-dc15-4bea-95e9-11f98890e094 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.541893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24fe5f1e-dc15-4bea-95e9-11f98890e094 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.543054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24fe5f1e-dc15-4bea-95e9-11f98890e094 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.543505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24fe5f1e-dc15-4bea-95e9-11f98890e094 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.587396 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24fe5f1e-dc15-4bea-95e9-11f98890e094 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.057319 Dec 18 20:59:58.591547 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1864/3755] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 20:59:58 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 20:59:58.594335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:58.595217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:58.602324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.602782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.603572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.604072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.801955 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-debb1e04-8289-4220-bff6-6c6bffaa75ac tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1463 microversion: 2.1 time: 0.328528 Dec 18 20:59:58.803442 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1892/3756] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:58 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1463 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:58.862001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:58.864291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:58.872105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.872977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.874164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:58.875999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:58.880051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:58.896521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f69dc2b-45ae-4e89-ae0b-38f8d5b4eb02 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.307101 Dec 18 20:59:58.897317 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1865/3757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:58 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:59.112569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:59.113550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:59.133073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:59.133528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:59.134498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:59.134947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:59.591170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:59.599362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 20:59:59.599880 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-78ab0ccd-fc5b-4a40-b59e-46e2c59dd767 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1324 microversion: 2.1 time: 0.742875 Dec 18 20:59:59.609730 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1893/3758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:58 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1324 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 20:59:59.614625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:59.615228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:59.623695 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84ab11e6-ce20-4996-9dd7-136fe6065021 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1716 microversion: 2.1 time: 0.516659 Dec 18 20:59:59.625814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:59.626523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:59.627502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:59.628097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:59.628335 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1866/3759] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:59 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1716 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 20:59:59.641134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 20:59:59.641897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 20:59:59.649692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:59.650658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 20:59:59.652399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 20:59:59.652854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.202234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:00.209736 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f2faf4a8-b8ee-4124-8534-6b86dfc94c85 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1317 microversion: 2.1 time: 0.598836 Dec 18 21:00:00.210428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:00.210567 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1894/3760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:59 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:00.214977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5337eb18-757f-43a9-8474-21cf2511e18f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:00.215969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5337eb18-757f-43a9-8474-21cf2511e18f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:00.222238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5337eb18-757f-43a9-8474-21cf2511e18f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.222934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5337eb18-757f-43a9-8474-21cf2511e18f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.223760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5337eb18-757f-43a9-8474-21cf2511e18f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.224371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5337eb18-757f-43a9-8474-21cf2511e18f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.228101 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f074714-a32d-4dc8-af19-d4ee23ad354f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1503 microversion: 2.1 time: 0.598637 Dec 18 21:00:00.228677 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1867/3761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 20:59:59 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1503 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:00.234177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab283c3a-1a4d-4dd3-bdf3-aea9e4d6efa4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:00.234807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab283c3a-1a4d-4dd3-bdf3-aea9e4d6efa4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:00.241336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab283c3a-1a4d-4dd3-bdf3-aea9e4d6efa4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.241786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab283c3a-1a4d-4dd3-bdf3-aea9e4d6efa4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.242600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab283c3a-1a4d-4dd3-bdf3-aea9e4d6efa4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.243036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab283c3a-1a4d-4dd3-bdf3-aea9e4d6efa4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.277793 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5337eb18-757f-43a9-8474-21cf2511e18f tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.066028 Dec 18 21:00:00.279452 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1895/3762] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:00 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:00:00.284086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:00.284868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:00.292065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.292519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.293316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.293757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.676336 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab283c3a-1a4d-4dd3-bdf3-aea9e4d6efa4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1463 microversion: 2.1 time: 0.446357 Dec 18 21:00:00.676921 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1868/3763] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:00 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1463 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:00.685918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7a6a685a-3a99-449c-82e0-96c63faa06ef req-5c2be59e-fb5f-4343-b971-023a8e83d1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39122197-3868-45d6-b159-242f70881ec6", "tag": "cff4e8d4-5231-483d-9fa7-4cda76d2c814"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:00.685918 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:00.685918 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:00.690450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7a6a685a-3a99-449c-82e0-96c63faa06ef req-5c2be59e-fb5f-4343-b971-023a8e83d1a8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.691295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7a6a685a-3a99-449c-82e0-96c63faa06ef req-5c2be59e-fb5f-4343-b971-023a8e83d1a8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.694112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:00.703327 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7a6a685a-3a99-449c-82e0-96c63faa06ef req-5c2be59e-fb5f-4343-b971-023a8e83d1a8 service nova] Creating event network-changed:cff4e8d4-5231-483d-9fa7-4cda76d2c814 for instance 39122197-3868-45d6-b159-242f70881ec6 on nch1-master-1 Dec 18 21:00:00.703896 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a6c2aef-c4de-4a65-ae17-22b6ae7ae3c0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.423798 Dec 18 21:00:00.714120 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1896/3764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:00 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:00.715609 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7a6a685a-3a99-449c-82e0-96c63faa06ef req-5c2be59e-fb5f-4343-b971-023a8e83d1a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037316 Dec 18 21:00:00.717427 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1869/3765] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:00.720455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1247017277"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:00.720667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:00.724559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:00.725733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:00.730356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.730814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.731842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.733007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.738411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.738876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:00.739690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:00.740304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:01.505558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:01.513059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b0667e5-efd5-4fdb-a3ac-81c7b0a59831 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1324 microversion: 2.1 time: 0.793747 Dec 18 21:00:01.513485 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1870/3766] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:00 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1324 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:01.516287 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.network.security_group_api [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Adding security group 2acbe28c-d33b-484c-ba42-430a5ae43ad6 to port 95468de0-87ec-4e68-8883-879d214ec825 Dec 18 21:00:01.518118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:01.518763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:01.526046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:01.526531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:01.528136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:01.528345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:01.615328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba996171cc148a5b0fe75a937f59055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab34e83092a4610b03af4bfa353fb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:01.623963 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ebb614e-c034-4311-b10c-f647b9355b09 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 200 len: 1648 microversion: 2.1 time: 0.109463 Dec 18 21:00:01.624775 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1871/3767] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:01 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 1648 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:01.629249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5ae00ce8-a92f-45ed-9267-32ef8c68e33d req-b924214b-047d-423c-b5a3-7a48842bf859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d17b336-2d79-4cfe-a5ef-fa648eec0574", "name": "network-vif-plugged", "status": "completed", "tag": "df772871-7061-43d6-b5d3-522b6ef7eef9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:01.630880 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:01.630880 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:01.638810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5ae00ce8-a92f-45ed-9267-32ef8c68e33d req-b924214b-047d-423c-b5a3-7a48842bf859 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:01.639481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5ae00ce8-a92f-45ed-9267-32ef8c68e33d req-b924214b-047d-423c-b5a3-7a48842bf859 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:01.653938 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5ae00ce8-a92f-45ed-9267-32ef8c68e33d req-b924214b-047d-423c-b5a3-7a48842bf859 service nova] Creating event network-vif-plugged:df772871-7061-43d6-b5d3-522b6ef7eef9 for instance 7d17b336-2d79-4cfe-a5ef-fa648eec0574 on nch1-master-1 Dec 18 21:00:01.659366 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5ae00ce8-a92f-45ed-9267-32ef8c68e33d req-b924214b-047d-423c-b5a3-7a48842bf859 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033328 Dec 18 21:00:01.659978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1872/3768] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:01.665156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:01.665845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:01.682027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:01.682727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:01.683881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:01.683881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.185697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:02.194575 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7e383b8-0762-422c-9762-d22def900507 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1317 microversion: 2.1 time: 0.533238 Dec 18 21:00:02.195454 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1873/3769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:01 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:02.200249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e915230-0b38-4947-a91e-5a2a9bc903fd tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:02.201440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0e915230-0b38-4947-a91e-5a2a9bc903fd tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:02.208676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e915230-0b38-4947-a91e-5a2a9bc903fd tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.209224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e915230-0b38-4947-a91e-5a2a9bc903fd tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.210296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e915230-0b38-4947-a91e-5a2a9bc903fd tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.211029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e915230-0b38-4947-a91e-5a2a9bc903fd tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.254299 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e915230-0b38-4947-a91e-5a2a9bc903fd tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.057296 Dec 18 21:00:02.254962 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1874/3770] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:02 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:00:02.262231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-09c80d51-06ec-4610-be1b-72b4eeb80407 req-018f6eef-20bf-4b1d-a06d-5fd1bc615ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b8c792-da21-4d87-9e75-96d0445e8db0", "tag": "bae4e65d-ce16-4411-8971-1163bdcdb591"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:02.263907 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:02.263907 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:02.272735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-09c80d51-06ec-4610-be1b-72b4eeb80407 req-018f6eef-20bf-4b1d-a06d-5fd1bc615ec2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.273183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-09c80d51-06ec-4610-be1b-72b4eeb80407 req-018f6eef-20bf-4b1d-a06d-5fd1bc615ec2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.286233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-09c80d51-06ec-4610-be1b-72b4eeb80407 req-018f6eef-20bf-4b1d-a06d-5fd1bc615ec2 service nova] Creating event network-changed:bae4e65d-ce16-4411-8971-1163bdcdb591 for instance b7b8c792-da21-4d87-9e75-96d0445e8db0 on nch2-master-1 Dec 18 21:00:02.291771 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-09c80d51-06ec-4610-be1b-72b4eeb80407 req-018f6eef-20bf-4b1d-a06d-5fd1bc615ec2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034563 Dec 18 21:00:02.292848 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1875/3771] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:02.298305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d65c138b-8c91-4fdf-ac17-30a00c52f5bd tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:02.298963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d65c138b-8c91-4fdf-ac17-30a00c52f5bd tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:02.305580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65c138b-8c91-4fdf-ac17-30a00c52f5bd tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.306037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65c138b-8c91-4fdf-ac17-30a00c52f5bd tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.307093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65c138b-8c91-4fdf-ac17-30a00c52f5bd tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.307784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d65c138b-8c91-4fdf-ac17-30a00c52f5bd tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.423364 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bbffaa4c-b8b0-4973-9127-992a0dff6613 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51/action" status: 202 len: 0 microversion: 2.1 time: 1.708040 Dec 18 21:00:02.427292 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1897/3772] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:00 2021] POST /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51/action => generated 0 bytes in 1712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:02.432334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:02.433344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:02.440960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.441833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.443093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.443882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.659453 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d65c138b-8c91-4fdf-ac17-30a00c52f5bd tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1463 microversion: 2.1 time: 0.365349 Dec 18 21:00:02.669168 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1876/3773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:02 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1463 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:02.676625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-181831606"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:02.677957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:02.689495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.691736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.693345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.693967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.852369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:02.860897 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-898468dc-189a-4d87-8a08-e4ef6ed1b28c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1318 microversion: 2.1 time: 0.432180 Dec 18 21:00:02.861718 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1898/3774] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:02 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:02.879110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:02.880010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:02.892706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.893473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:02.895930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:02.896424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.094899 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.network.security_group_api [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Adding security group 3b90f329-7660-493e-b8db-5f87c7ac22f4 to port 95468de0-87ec-4e68-8883-879d214ec825 Dec 18 21:00:03.338463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:03.348403 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fae65b62-3505-465d-b376-97891f7e94c1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1324 microversion: 2.1 time: 0.486027 Dec 18 21:00:03.348997 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1899/3775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:02 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1324 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:03.354454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:03.355651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] [instance: 198e9dd2-01b2-4119-9848-b5c9db0cb7ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:03.364930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.366121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.367044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.367681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.382052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] HTTP exception thrown: Instance 198e9dd2-01b2-4119-9848-b5c9db0cb7ca could not be found. Dec 18 21:00:03.382677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Returning 404 to user: Instance 198e9dd2-01b2-4119-9848-b5c9db0cb7ca could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:03.383521 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7a39606-f609-4da9-95f3-3961a262856b tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca" status: 404 len: 111 microversion: 2.1 time: 0.033103 Dec 18 21:00:03.384075 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1900/3776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:03 2021] GET /compute/v2.1/servers/198e9dd2-01b2-4119-9848-b5c9db0cb7ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:03.390072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:03.391012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:03.398393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.398921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.400024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.400758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.723369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:03.732262 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-538bc378-aa88-453a-8038-1c8eac96f616 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1317 microversion: 2.1 time: 0.346974 Dec 18 21:00:03.741589 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1901/3777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:03 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:03.746458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e241a02-63fc-4b37-be82-0685203e9924 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:03.747447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e241a02-63fc-4b37-be82-0685203e9924 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:03.754419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e241a02-63fc-4b37-be82-0685203e9924 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.754872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e241a02-63fc-4b37-be82-0685203e9924 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.755675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e241a02-63fc-4b37-be82-0685203e9924 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.756108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e241a02-63fc-4b37-be82-0685203e9924 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.797731 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e241a02-63fc-4b37-be82-0685203e9924 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 32637 microversion: 2.1 time: 0.054802 Dec 18 21:00:03.798718 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1902/3778] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:03 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:00:03.807357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-674f0508-e198-4e09-bfcf-d1440b821851 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] Calling method '.version_select at 0x7f71612dba60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:03.829139 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-674f0508-e198-4e09-bfcf-d1440b821851 tempest-ServersTestManualDisk-922629628 tempest-ServersTestManualDisk-922629628-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157002417" status: 202 len: 0 microversion: 2.1 time: 0.025903 Dec 18 21:00:03.830038 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1903/3779] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 21:00:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157002417 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:03.834632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-32982730-4f17-4804-b8d7-ee379dd1adc4 req-c1354a15-7525-4d57-b11f-5b5364c10436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5ad229-3042-4816-865e-c5055f87a909", "name": "network-vif-plugged", "status": "completed", "tag": "2f46a0da-28aa-4aef-82c3-f3adb2fd5bad"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:03.836163 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:03.836163 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:03.845864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-32982730-4f17-4804-b8d7-ee379dd1adc4 req-c1354a15-7525-4d57-b11f-5b5364c10436 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.846375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-32982730-4f17-4804-b8d7-ee379dd1adc4 req-c1354a15-7525-4d57-b11f-5b5364c10436 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.868996 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-32982730-4f17-4804-b8d7-ee379dd1adc4 req-c1354a15-7525-4d57-b11f-5b5364c10436 service nova] Creating event network-vif-plugged:2f46a0da-28aa-4aef-82c3-f3adb2fd5bad for instance 9c5ad229-3042-4816-865e-c5055f87a909 on nch2-master-1 Dec 18 21:00:03.879420 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-32982730-4f17-4804-b8d7-ee379dd1adc4 req-c1354a15-7525-4d57-b11f-5b5364c10436 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047898 Dec 18 21:00:03.880031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1904/3780] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:03.880584 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7efde7f6-5990-43b3-8eb3-791989911aa8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51/action" status: 202 len: 0 microversion: 2.1 time: 1.213636 Dec 18 21:00:03.884585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1877/3781] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:02 2021] POST /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51/action => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:03.889194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff05861d-4d1e-4e77-8e10-66bda04602a2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:03.890283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:03.890889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff05861d-4d1e-4e77-8e10-66bda04602a2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:03.891010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:03.897994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff05861d-4d1e-4e77-8e10-66bda04602a2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.898241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff05861d-4d1e-4e77-8e10-66bda04602a2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.899064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff05861d-4d1e-4e77-8e10-66bda04602a2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.900099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff05861d-4d1e-4e77-8e10-66bda04602a2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.903739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.904203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:03.905047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:03.905488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.274490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:04.281880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c8865aa6-fe63-4d19-9a11-1c461911e5be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1508 microversion: 2.1 time: 0.396281 Dec 18 21:00:04.282494 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1878/3782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:03 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:04.287036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-262811dd-a856-4c8f-ac8f-621d14ed5ab1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:04.288184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-262811dd-a856-4c8f-ac8f-621d14ed5ab1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:04.294786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262811dd-a856-4c8f-ac8f-621d14ed5ab1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.296274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262811dd-a856-4c8f-ac8f-621d14ed5ab1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.297081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262811dd-a856-4c8f-ac8f-621d14ed5ab1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.297519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262811dd-a856-4c8f-ac8f-621d14ed5ab1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.309781 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff05861d-4d1e-4e77-8e10-66bda04602a2 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1463 microversion: 2.1 time: 0.427316 Dec 18 21:00:04.311071 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1905/3783] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:03 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1463 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:04.324661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17286a65-2bb6-4891-8fc9-210c222fe2a9"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:04.326276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:04.334157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.334643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.335437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.335874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.411481 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] HTTP exception thrown: Invalid volume: volume 17286a65-2bb6-4891-8fc9-210c222fe2a9 is already attached to instances: a12e2896-51c3-4ed6-abc1-fb782a8c9f48 Dec 18 21:00:04.412084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Returning 400 to user: Invalid volume: volume 17286a65-2bb6-4891-8fc9-210c222fe2a9 is already attached to instances: a12e2896-51c3-4ed6-abc1-fb782a8c9f48 {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:04.412920 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e4a28f1-c3cc-415b-8d36-7e2e25e8ebad tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092692 Dec 18 21:00:04.413473 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1906/3784] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:00:04 2021] POST /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:00:04.417917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a5079465-886f-4aaf-bfca-9fcb9e998d7f req-87fae9ca-7e5e-4a94-a2cc-4248ff4f795f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198e9dd2-01b2-4119-9848-b5c9db0cb7ca", "name": "network-vif-deleted", "tag": "fea449d4-dbd8-44cd-99aa-d486449cf15d"}, {"name": "network-changed", "server_uuid": "6330b4d1-f33b-40ed-87d9-4029566f8b51", "tag": "95468de0-87ec-4e68-8883-879d214ec825"}, {"name": "network-changed", "server_uuid": "6330b4d1-f33b-40ed-87d9-4029566f8b51", "tag": "95468de0-87ec-4e68-8883-879d214ec825"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:04.419832 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:04.419832 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:04.428478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a5079465-886f-4aaf-bfca-9fcb9e998d7f req-87fae9ca-7e5e-4a94-a2cc-4248ff4f795f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.429216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a5079465-886f-4aaf-bfca-9fcb9e998d7f req-87fae9ca-7e5e-4a94-a2cc-4248ff4f795f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.444201 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a5079465-886f-4aaf-bfca-9fcb9e998d7f req-87fae9ca-7e5e-4a94-a2cc-4248ff4f795f service nova] Creating event network-vif-deleted:fea449d4-dbd8-44cd-99aa-d486449cf15d for instance 198e9dd2-01b2-4119-9848-b5c9db0cb7ca on nch2-master-1 Dec 18 21:00:04.444850 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a5079465-886f-4aaf-bfca-9fcb9e998d7f req-87fae9ca-7e5e-4a94-a2cc-4248ff4f795f service nova] Creating event network-changed:95468de0-87ec-4e68-8883-879d214ec825 for instance 6330b4d1-f33b-40ed-87d9-4029566f8b51 on nch1-master-1 Dec 18 21:00:04.445593 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a5079465-886f-4aaf-bfca-9fcb9e998d7f req-87fae9ca-7e5e-4a94-a2cc-4248ff4f795f service nova] Creating event network-changed:95468de0-87ec-4e68-8883-879d214ec825 for instance 6330b4d1-f33b-40ed-87d9-4029566f8b51 on nch1-master-1 Dec 18 21:00:04.456088 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a5079465-886f-4aaf-bfca-9fcb9e998d7f req-87fae9ca-7e5e-4a94-a2cc-4248ff4f795f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.041453 Dec 18 21:00:04.456977 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1907/3785] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:04 2021] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:04.465132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:04.466268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:04.473780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.474479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.475361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.475904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.620417 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-262811dd-a856-4c8f-ac8f-621d14ed5ab1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.336839 Dec 18 21:00:04.621310 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1879/3786] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:00:04 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51/os-security-groups => generated 1158 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:04.631820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:04.632598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:04.651425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.652653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.653841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.654493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.728336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:04.738925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-130d96a6-8627-4e82-9fea-7d0f33955b10 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1324 microversion: 2.1 time: 0.280417 Dec 18 21:00:04.739894 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1908/3787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:04 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:04.745128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c21be3b-a5b0-491c-a11d-300d6e5c7141 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f71613081f0>, body: {"security_group": {"name": " tempest-securitygroup -1537248269 ", "description": "tempest-description-577145987"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:04.761622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lazy-loading 'services' on Instance uuid a12e2896-51c3-4ed6-abc1-fb782a8c9f48 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:00:04.858510 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a00e3ae-5fd1-4a6d-a137-0dc4a5f8580b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments/17286a65-2bb6-4891-8fc9-210c222fe2a9" status: 202 len: 0 microversion: 2.1 time: 0.233887 Dec 18 21:00:04.859642 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1880/3788] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:00:04 2021] DELETE /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments/17286a65-2bb6-4891-8fc9-210c222fe2a9 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:04.867262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:04.868914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:04.880190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.880998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:04.882581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:04.883277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.496932 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c21be3b-a5b0-491c-a11d-300d6e5c7141 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.755831 Dec 18 21:00:05.498051 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1909/3789] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:00:04 2021] POST /compute/v2.1/os-security-groups => generated 223 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:05.508173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34cd44ab-f106-4c27-a6f8-a43ad6788d85 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:05.509846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-34cd44ab-f106-4c27-a6f8-a43ad6788d85 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:05.517497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34cd44ab-f106-4c27-a6f8-a43ad6788d85 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.518198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34cd44ab-f106-4c27-a6f8-a43ad6788d85 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.519211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34cd44ab-f106-4c27-a6f8-a43ad6788d85 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.519816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34cd44ab-f106-4c27-a6f8-a43ad6788d85 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.566952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:05.577782 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ea13db59-d5f8-4d27-a619-03fbae417d43 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1317 microversion: 2.1 time: 0.715897 Dec 18 21:00:05.580043 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1881/3790] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:04 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:05.586644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34cd44ab-f106-4c27-a6f8-a43ad6788d85 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action" status: 200 len: 40789 microversion: 2.1 time: 0.086173 Dec 18 21:00:05.587378 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1910/3791] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:05 2021] POST /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818/action => generated 40789 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:00:05.589394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4d04b6f-0c9a-43f5-b071-47351a8e5a13 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:05.590745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4d04b6f-0c9a-43f5-b071-47351a8e5a13 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:05.595505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eeffbe84-bda2-4e9a-b74d-2ba1ed85d46c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:05.596253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eeffbe84-bda2-4e9a-b74d-2ba1ed85d46c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:05.602440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4d04b6f-0c9a-43f5-b071-47351a8e5a13 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.603493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4d04b6f-0c9a-43f5-b071-47351a8e5a13 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.605182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4d04b6f-0c9a-43f5-b071-47351a8e5a13 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.606432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4d04b6f-0c9a-43f5-b071-47351a8e5a13 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.620033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eeffbe84-bda2-4e9a-b74d-2ba1ed85d46c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.620504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eeffbe84-bda2-4e9a-b74d-2ba1ed85d46c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.623586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eeffbe84-bda2-4e9a-b74d-2ba1ed85d46c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.624895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eeffbe84-bda2-4e9a-b74d-2ba1ed85d46c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.660092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4d04b6f-0c9a-43f5-b071-47351a8e5a13 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078147 Dec 18 21:00:05.664288 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1882/3792] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:00:05 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:05.687581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-20a813d6-5681-41ef-a832-ebdb0638ad65 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e58dee0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:05.829937 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-20a813d6-5681-41ef-a832-ebdb0638ad65 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3" status: 200 len: 223 microversion: 2.1 time: 0.165619 Dec 18 21:00:05.830566 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1883/3793] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:00:05 2021] GET /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:05.835597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:05.837039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:05.843586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.844548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.846158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.846939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.931238 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eeffbe84-bda2-4e9a-b74d-2ba1ed85d46c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1463 microversion: 2.1 time: 0.341884 Dec 18 21:00:05.931738 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1911/3794] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:05 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1463 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:05.936856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:05.937617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:05.944464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.945164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:05.946459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:05.947584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.076714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:06.084122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-617d26fb-6696-445f-85f3-364b29959235 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1693 microversion: 2.1 time: 0.252431 Dec 18 21:00:06.084830 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1884/3795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:05 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1693 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:06.107345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70c42d7b-2265-4466-b3bf-ee343fdf6145 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5c2820>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:06.238819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:06.246177 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c1547de-ed53-4ef5-9db8-d073b5a6be5e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1324 microversion: 2.1 time: 0.313527 Dec 18 21:00:06.247215 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1912/3796] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:05 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:06.260245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6b209a4a-f706-4c70-b1eb-c2185a878e4d req-ef51cc55-410a-49e0-bc0e-f8a715530899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39122197-3868-45d6-b159-242f70881ec6", "name": "network-vif-plugged", "status": "completed", "tag": "cff4e8d4-5231-483d-9fa7-4cda76d2c814"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:06.261888 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:06.261888 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:06.268718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6b209a4a-f706-4c70-b1eb-c2185a878e4d req-ef51cc55-410a-49e0-bc0e-f8a715530899 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:06.269169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6b209a4a-f706-4c70-b1eb-c2185a878e4d req-ef51cc55-410a-49e0-bc0e-f8a715530899 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.280287 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6b209a4a-f706-4c70-b1eb-c2185a878e4d req-ef51cc55-410a-49e0-bc0e-f8a715530899 service nova] Creating event network-vif-plugged:cff4e8d4-5231-483d-9fa7-4cda76d2c814 for instance 39122197-3868-45d6-b159-242f70881ec6 on nch1-master-1 Dec 18 21:00:06.284944 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6b209a4a-f706-4c70-b1eb-c2185a878e4d req-ef51cc55-410a-49e0-bc0e-f8a715530899 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028184 Dec 18 21:00:06.285541 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1913/3797] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:06.495327 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70c42d7b-2265-4466-b3bf-ee343fdf6145 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3" status: 202 len: 0 microversion: 2.1 time: 0.395523 Dec 18 21:00:06.496135 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1885/3798] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:06 2021] DELETE /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:06.504566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fadcfe5-3d49-42c0-9867-fb499b555be5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f71613784c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:06.541810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-2fadcfe5-3d49-42c0-9867-fb499b555be5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 does not exist", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:06.542461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-2fadcfe5-3d49-42c0-9867-fb499b555be5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 not found {{(pid=140731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:06.542997 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2fadcfe5-3d49-42c0-9867-fb499b555be5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 does not exist Dec 18 21:00:06.542997 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-88b25288-72ea-458b-8f44-56399efc35bc'] Dec 18 21:00:06.543653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fadcfe5-3d49-42c0-9867-fb499b555be5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 does not exist Dec 18 21:00:06.543653 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-88b25288-72ea-458b-8f44-56399efc35bc'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:06.544521 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2fadcfe5-3d49-42c0-9867-fb499b555be5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3" status: 404 len: 194 microversion: 2.1 time: 0.044160 Dec 18 21:00:06.545079 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1914/3799] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:00:06 2021] GET /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:00:06.554229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b417e5b3-24d1-44f4-bd11-2e643b53434d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f714e613ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1072866114", "description": "tempest-description-2081008567"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:06.596816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:06.597552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:06.604784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:06.605236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.606393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:06.607027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.928243 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b417e5b3-24d1-44f4-bd11-2e643b53434d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.377619 Dec 18 21:00:06.928842 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1886/3800] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:00:06 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:00:06.933798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf909326-97eb-42e9-b7fa-c5ac41707c1a tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:06.934880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf909326-97eb-42e9-b7fa-c5ac41707c1a tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:06.939039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:06.942544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf909326-97eb-42e9-b7fa-c5ac41707c1a tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:06.942984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf909326-97eb-42e9-b7fa-c5ac41707c1a tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.943843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf909326-97eb-42e9-b7fa-c5ac41707c1a tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:06.944458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf909326-97eb-42e9-b7fa-c5ac41707c1a tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.951086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-63388ba9-7184-4ad4-8e2c-34ba1151a531 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1506 microversion: 2.1 time: 0.358173 Dec 18 21:00:06.951205 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1915/3801] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:06 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:06.957777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:06.961162 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:06.961162 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:06.962170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:06.963381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Searching by: {'deleted': False, 'project_id': '09cf6435c2a148c6998dd3b1d301da96'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 21:00:06.969950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:06.970542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.971473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:06.971945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:06.977995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf909326-97eb-42e9-b7fa-c5ac41707c1a tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048105 Dec 18 21:00:06.984513 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1887/3802] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:00:06 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:00:06.989426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-36bce18d-ee33-40cc-b9f4-9f69ee6a3f36 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f714e5c2ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1755393881", "description": "tempest-description-106844963"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:07.000107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 21:00:07.032612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3518c506-5073-4cdf-a575-5149d9badfea tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.080387 Dec 18 21:00:07.039384 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1916/3803] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 21:00:06 2021] GET /compute/v2.1/servers => generated 334 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:07.039384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e523f8ff-a49c-41c8-aba5-3e327858f4a4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:07.040438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e523f8ff-a49c-41c8-aba5-3e327858f4a4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:07.047276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e523f8ff-a49c-41c8-aba5-3e327858f4a4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.047879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e523f8ff-a49c-41c8-aba5-3e327858f4a4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.050302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e523f8ff-a49c-41c8-aba5-3e327858f4a4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.050302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e523f8ff-a49c-41c8-aba5-3e327858f4a4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.429896 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e523f8ff-a49c-41c8-aba5-3e327858f4a4 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1463 microversion: 2.1 time: 0.395055 Dec 18 21:00:07.440428 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1917/3804] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:07 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1463 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:07.440984 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-36bce18d-ee33-40cc-b9f4-9f69ee6a3f36 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.445713 Dec 18 21:00:07.440984 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1888/3805] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:00:06 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:07.440984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:07.443324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b62ef60-b568-44f4-8cd5-07d393892bf6 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:07.443668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b62ef60-b568-44f4-8cd5-07d393892bf6 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:07.444320 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:07.444320 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:07.447063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:07.447859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Searching by: {'deleted': False, 'project_id': '09cf6435c2a148c6998dd3b1d301da96'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 21:00:07.450798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b62ef60-b568-44f4-8cd5-07d393892bf6 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.451964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b62ef60-b568-44f4-8cd5-07d393892bf6 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.453527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.454106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.454398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b62ef60-b568-44f4-8cd5-07d393892bf6 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.454798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b62ef60-b568-44f4-8cd5-07d393892bf6 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.456255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.456889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.484038 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b62ef60-b568-44f4-8cd5-07d393892bf6 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909/ips" status: 200 len: 109 microversion: 2.1 time: 0.051656 Dec 18 21:00:07.485234 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1918/3806] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:00:07 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909/ips => generated 109 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:07.495942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 21:00:07.496170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-835084567", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1f7835a3-1921-420f-bc92-783d1cac5ba9"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:07.536275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:07.557297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.557751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.558400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] validate_networks() for [('1f7835a3-1921-420f-bc92-783d1cac5ba9', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:00:07.861866 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19e035ae-7eb6-4fa6-9cd1-406e5780ea2e tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.427218 Dec 18 21:00:07.862594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1889/3807] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 21:00:07 2021] GET /compute/v2.1/servers/detail => generated 1696 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:07.867119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:07.867726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:07.875593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.876146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:07.877198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:07.877713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.169704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:08.177542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-478b84a0-9748-42a0-9e82-0ded44fd29df tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1324 microversion: 2.1 time: 0.313610 Dec 18 21:00:08.178380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1890/3808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:07 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:08.184072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a7697aa-c299-48fa-80b9-09798751d7b8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f7161323b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1939693406", "description": "tempest-description-2055172446"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:08.311774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:08.313700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:08.314576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:08.315146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:08.315972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:08.334698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:08.335792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.336735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:08.337270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.356948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:08.362971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for user 4196dd207ce543d3bdd5f48ae57e156a and project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:08.380578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:08.383105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:08.423386 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a7697aa-c299-48fa-80b9-09798751d7b8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.243709 Dec 18 21:00:08.424317 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1891/3809] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:00:08 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:08.429247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-115f699e-0702-4deb-8b9a-36b11731094a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:08.430130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-115f699e-0702-4deb-8b9a-36b11731094a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:08.446482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-115f699e-0702-4deb-8b9a-36b11731094a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:08.447929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-115f699e-0702-4deb-8b9a-36b11731094a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.448991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-115f699e-0702-4deb-8b9a-36b11731094a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:08.449733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-115f699e-0702-4deb-8b9a-36b11731094a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.459852 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-96b12695-e3d0-4f74-833a-a8eeb03d6709 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.973335 Dec 18 21:00:08.460519 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1919/3810] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:00:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:00:08.479675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-115f699e-0702-4deb-8b9a-36b11731094a tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909/ips" status: 200 len: 109 microversion: 2.1 time: 0.053725 Dec 18 21:00:08.480791 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1892/3811] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:00:08 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909/ips => generated 109 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:08.487083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-89829bc3-05a2-4fc9-a2e6-f54e96dfdbf6 req-275740f0-ad9b-4e2c-884b-5b929c32261a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b8c792-da21-4d87-9e75-96d0445e8db0", "name": "network-vif-plugged", "status": "completed", "tag": "bae4e65d-ce16-4411-8971-1163bdcdb591"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:08.489056 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:08.489056 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:08.497202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-89829bc3-05a2-4fc9-a2e6-f54e96dfdbf6 req-275740f0-ad9b-4e2c-884b-5b929c32261a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:08.497975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-89829bc3-05a2-4fc9-a2e6-f54e96dfdbf6 req-275740f0-ad9b-4e2c-884b-5b929c32261a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.505085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a23bc49d-500b-482b-886d-ee873960a75d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:08.511495 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-89829bc3-05a2-4fc9-a2e6-f54e96dfdbf6 req-275740f0-ad9b-4e2c-884b-5b929c32261a service nova] Creating event network-vif-plugged:bae4e65d-ce16-4411-8971-1163bdcdb591 for instance b7b8c792-da21-4d87-9e75-96d0445e8db0 on nch2-master-1 Dec 18 21:00:08.518272 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-89829bc3-05a2-4fc9-a2e6-f54e96dfdbf6 req-275740f0-ad9b-4e2c-884b-5b929c32261a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035785 Dec 18 21:00:08.519675 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1893/3812] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:08.540823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7802bbd-ae5b-4373-ab73-2d42d67c763c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5bc790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:08.541760 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a23bc49d-500b-482b-886d-ee873960a75d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.079313 Dec 18 21:00:08.543385 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1920/3813] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 21:00:08 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:08.564157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e1747ba-ff38-4c5a-9912-93c6757d8556 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:08.565532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e1747ba-ff38-4c5a-9912-93c6757d8556 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:08.574865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e1747ba-ff38-4c5a-9912-93c6757d8556 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:08.575692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e1747ba-ff38-4c5a-9912-93c6757d8556 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.577690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e1747ba-ff38-4c5a-9912-93c6757d8556 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:08.578609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e1747ba-ff38-4c5a-9912-93c6757d8556 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:08.918078 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e1747ba-ff38-4c5a-9912-93c6757d8556 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1648 microversion: 2.1 time: 0.371830 Dec 18 21:00:08.919762 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1921/3814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:08 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1648 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:08.927978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6fd48d7-6f96-46d9-bd67-c60933e3edf0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:08.928597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6fd48d7-6f96-46d9-bd67-c60933e3edf0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:08.998180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6fd48d7-6f96-46d9-bd67-c60933e3edf0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:09.007124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6fd48d7-6f96-46d9-bd67-c60933e3edf0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1217 microversion: 2.1 time: 0.085340 Dec 18 21:00:09.017478 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1922/3815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:08 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:09.024924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-037a81ad-ee5d-41b4-9785-92ce40a571c9 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:09.025715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-037a81ad-ee5d-41b4-9785-92ce40a571c9 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:09.034725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-037a81ad-ee5d-41b4-9785-92ce40a571c9 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.035667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-037a81ad-ee5d-41b4-9785-92ce40a571c9 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.036896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-037a81ad-ee5d-41b4-9785-92ce40a571c9 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.039760 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7802bbd-ae5b-4373-ab73-2d42d67c763c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.517783 Dec 18 21:00:09.040520 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1894/3816] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 21:00:08 2021] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:09.046153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:09.046793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:09.047237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-037a81ad-ee5d-41b4-9785-92ce40a571c9 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.056118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.056928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.057736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.058211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.085925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-037a81ad-ee5d-41b4-9785-92ce40a571c9 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909/ips/tempest-ServerAddressesTestJSON-2036616535-network" status: 200 len: 94 microversion: 2.1 time: 0.066804 Dec 18 21:00:09.087837 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1923/3817] 10.222.0.13 () {58 vars in 1400 bytes} [Sat Dec 18 21:00:09 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909/ips/tempest-ServerAddressesTestJSON-2036616535-network => generated 94 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:00:09.102553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:09.107202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7964e34f-8961-48f4-bddb-4f7e2c5efc8e tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:09.107949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7964e34f-8961-48f4-bddb-4f7e2c5efc8e tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:09.128722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7964e34f-8961-48f4-bddb-4f7e2c5efc8e tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.129189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7964e34f-8961-48f4-bddb-4f7e2c5efc8e tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.130043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7964e34f-8961-48f4-bddb-4f7e2c5efc8e tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.130521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7964e34f-8961-48f4-bddb-4f7e2c5efc8e tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.242667 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7486a7fe-c4fd-46f3-bca5-d1875a851b03 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 204 len: 0 microversion: 2.1 time: 0.199727 Dec 18 21:00:09.243897 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1895/3818] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:09 2021] DELETE /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:09.251273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22bf0d5d-73b3-4b3e-a044-38ac3e2df4c3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5d5670>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:09.760779 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7964e34f-8961-48f4-bddb-4f7e2c5efc8e tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1648 microversion: 2.1 time: 0.671548 Dec 18 21:00:09.773238 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1924/3819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:09 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1648 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:09.778164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:09.778982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:09.791759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.792146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.794569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.795045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.831723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:09.909053 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22bf0d5d-73b3-4b3e-a044-38ac3e2df4c3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/57759464-1812-4f6a-88d2-0cc1abd10c2e" status: 202 len: 0 microversion: 2.1 time: 0.663711 Dec 18 21:00:09.910162 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1896/3820] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:09 2021] DELETE /compute/v2.1/os-security-groups/57759464-1812-4f6a-88d2-0cc1abd10c2e => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:09.917947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:09.919450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:09.935463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.938180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:09.939601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:09.940263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.012118 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d0433f0-ebcc-4460-a260-db9e670935df tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 204 len: 0 microversion: 2.1 time: 0.237139 Dec 18 21:00:10.013095 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1925/3821] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:09 2021] DELETE /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:10.019722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:10.020771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:10.027014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.027664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.028618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.029202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.247362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:10.262860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67404957-59ee-45a9-b7a9-e4a5bf992810 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1324 microversion: 2.1 time: 0.351414 Dec 18 21:00:10.273946 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1897/3822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:09 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:10.279546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-20ba81e9-a6c7-4436-bb21-6e4602975318 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:10.280601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-20ba81e9-a6c7-4436-bb21-6e4602975318 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:10.288472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ba81e9-a6c7-4436-bb21-6e4602975318 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.289554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ba81e9-a6c7-4436-bb21-6e4602975318 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.290816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ba81e9-a6c7-4436-bb21-6e4602975318 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.291613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20ba81e9-a6c7-4436-bb21-6e4602975318 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.410800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:10.428002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bb2b6dc4-6d12-44ba-bfee-ecba3d472b29 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1699 microversion: 2.1 time: 0.412617 Dec 18 21:00:10.440281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1926/3823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:10 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1699 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:10.445847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2602e613-0fa2-48cf-862c-417068e93ef7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714f637e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:10.507251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-2602e613-0fa2-48cf-862c-417068e93ef7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57759464-1812-4f6a-88d2-0cc1abd10c2e does not exist", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:10.508836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-2602e613-0fa2-48cf-862c-417068e93ef7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group 57759464-1812-4f6a-88d2-0cc1abd10c2e not found {{(pid=140731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:10.508836 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2602e613-0fa2-48cf-862c-417068e93ef7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group 57759464-1812-4f6a-88d2-0cc1abd10c2e does not exist Dec 18 21:00:10.508836 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-877126f9-bd8f-4996-b40b-4bc986760a50'] Dec 18 21:00:10.509121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2602e613-0fa2-48cf-862c-417068e93ef7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group 57759464-1812-4f6a-88d2-0cc1abd10c2e does not exist Dec 18 21:00:10.509121 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-877126f9-bd8f-4996-b40b-4bc986760a50'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:10.509812 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2602e613-0fa2-48cf-862c-417068e93ef7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/57759464-1812-4f6a-88d2-0cc1abd10c2e" status: 404 len: 194 microversion: 2.1 time: 0.068273 Dec 18 21:00:10.513545 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1927/3824] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:00:10 2021] GET /compute/v2.1/os-security-groups/57759464-1812-4f6a-88d2-0cc1abd10c2e => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:10.516334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:10.516958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:10.524854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.525560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.526428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.526867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.554685 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-20ba81e9-a6c7-4436-bb21-6e4602975318 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1648 microversion: 2.1 time: 0.279222 Dec 18 21:00:10.555263 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1898/3825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:10 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1648 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:10.566540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:10.567359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:10.576715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.577218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.578163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.579431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.895196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:10.904002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da7173c9-2ef8-4f4c-8ad9-b8e910fef069 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1512 microversion: 2.1 time: 0.392245 Dec 18 21:00:10.907259 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1928/3826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:10 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:10.911918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6509a09-827f-4904-bc06-35021b53f26f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f7161317160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:10.924408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:10.933128 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3b986bf-fabe-4c8d-9e1d-1f2919ca4f68 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1317 microversion: 2.1 time: 0.375575 Dec 18 21:00:10.943238 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1899/3827] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:10 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:10.943238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:10.943238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:10.945627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.946140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.947028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:10.947532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:10.973739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:11.058454 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-005e43ef-ac69-4a62-a09d-9aa330c2e5d1 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 204 len: 0 microversion: 2.1 time: 0.122748 Dec 18 21:00:11.059475 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1900/3828] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:10 2021] DELETE /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:11.069326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8fb5925a-88a5-488a-875d-8f0dd6a3c745 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:11.070449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8fb5925a-88a5-488a-875d-8f0dd6a3c745 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:11.077394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb5925a-88a5-488a-875d-8f0dd6a3c745 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.078176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb5925a-88a5-488a-875d-8f0dd6a3c745 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:11.079029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb5925a-88a5-488a-875d-8f0dd6a3c745 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.079470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb5925a-88a5-488a-875d-8f0dd6a3c745 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:11.292865 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6509a09-827f-4904-bc06-35021b53f26f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3f18a890-12fc-49bb-a36f-325c7109cfc6" status: 202 len: 0 microversion: 2.1 time: 0.384261 Dec 18 21:00:11.293455 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1929/3829] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:10 2021] DELETE /compute/v2.1/os-security-groups/3f18a890-12fc-49bb-a36f-325c7109cfc6 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:11.300575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:11.301347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:11.308592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.309338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:11.310414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.311739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:11.325639 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8fb5925a-88a5-488a-875d-8f0dd6a3c745 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1654 microversion: 2.1 time: 0.261016 Dec 18 21:00:11.326352 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1901/3830] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:11 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1654 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:11.331541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41c4d704-8446-4988-825f-fd77228e8b5d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5e1dc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:11.361507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-41c4d704-8446-4988-825f-fd77228e8b5d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:11.362983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-41c4d704-8446-4988-825f-fd77228e8b5d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:11.363516 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-41c4d704-8446-4988-825f-fd77228e8b5d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 does not exist Dec 18 21:00:11.363516 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-93ef21d4-0ee1-4a48-a84d-1206cdce6a9d'] Dec 18 21:00:11.364109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41c4d704-8446-4988-825f-fd77228e8b5d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 does not exist Dec 18 21:00:11.364109 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-93ef21d4-0ee1-4a48-a84d-1206cdce6a9d'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:11.365833 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41c4d704-8446-4988-825f-fd77228e8b5d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/3f18a890-12fc-49bb-a36f-325c7109cfc6" status: 404 len: 194 microversion: 2.1 time: 0.037304 Dec 18 21:00:11.366533 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1902/3831] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:00:11 2021] GET /compute/v2.1/os-security-groups/3f18a890-12fc-49bb-a36f-325c7109cfc6 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:11.378166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b46ed1e9-4fc1-417e-97f5-5b400c514bc7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5eca60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:11.629194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:11.643729 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dbe09708-9e71-4cb3-8086-6d60b50a9d45 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1521 microversion: 2.1 time: 0.348373 Dec 18 21:00:11.661474 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1930/3832] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:11 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:11.669340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:11.670058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:11.680416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.681933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:11.683456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.684566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:11.910094 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b46ed1e9-4fc1-417e-97f5-5b400c514bc7 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/64ce66b0-75f7-46c2-bea5-c3ddc8850d03" status: 202 len: 0 microversion: 2.1 time: 0.538879 Dec 18 21:00:11.910893 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1903/3833] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:11 2021] DELETE /compute/v2.1/os-security-groups/64ce66b0-75f7-46c2-bea5-c3ddc8850d03 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:00:11.918105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:11.919019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:11.936639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.937969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:11.939221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:11.939825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:12.125049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:12.139271 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-061524b5-651b-4b4f-a3f0-bbc8a50d34a4 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1699 microversion: 2.1 time: 0.475130 Dec 18 21:00:12.140429 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1931/3834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:11 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1699 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:12.153646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbbd8a50-5e9c-4000-8c05-db3bc4921435 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714ef11b80>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:12.209226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-bbbd8a50-5e9c-4000-8c05-db3bc4921435 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 does not exist", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:12.209822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-bbbd8a50-5e9c-4000-8c05-db3bc4921435 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 not found {{(pid=140731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:12.210493 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-bbbd8a50-5e9c-4000-8c05-db3bc4921435 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 does not exist Dec 18 21:00:12.210493 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-1bc5568c-c5d9-4085-bf27-1e7b1d495c89'] Dec 18 21:00:12.211688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbbd8a50-5e9c-4000-8c05-db3bc4921435 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 does not exist Dec 18 21:00:12.211688 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-1bc5568c-c5d9-4085-bf27-1e7b1d495c89'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:12.212785 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bbbd8a50-5e9c-4000-8c05-db3bc4921435 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/64ce66b0-75f7-46c2-bea5-c3ddc8850d03" status: 404 len: 194 microversion: 2.1 time: 0.070654 Dec 18 21:00:12.213874 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1932/3835] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:00:12 2021] GET /compute/v2.1/os-security-groups/64ce66b0-75f7-46c2-bea5-c3ddc8850d03 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:12.220592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:12.221498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:12.228955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:12.229655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:12.230723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:12.231374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:12.382311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:12.421683 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f9252fd9-da6d-4e8f-b0b9-a8f4a079d4bc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1521 microversion: 2.1 time: 0.507934 Dec 18 21:00:12.425106 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1904/3836] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:11 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:12.436868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-9b26797e-5dbf-4c15-b24f-c855bc6c6270 req-ccca787b-9f4f-4e95-85a2-5b8799ad4a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b133169-7f92-48da-a3a0-5fc9a86455ff", "tag": "d926283b-c07a-4bd8-97f5-e45248571489"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:12.442147 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:12.442147 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:12.458028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9b26797e-5dbf-4c15-b24f-c855bc6c6270 req-ccca787b-9f4f-4e95-85a2-5b8799ad4a68 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:12.458821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9b26797e-5dbf-4c15-b24f-c855bc6c6270 req-ccca787b-9f4f-4e95-85a2-5b8799ad4a68 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:12.473815 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9b26797e-5dbf-4c15-b24f-c855bc6c6270 req-ccca787b-9f4f-4e95-85a2-5b8799ad4a68 service nova] Creating event network-changed:d926283b-c07a-4bd8-97f5-e45248571489 for instance 5b133169-7f92-48da-a3a0-5fc9a86455ff on nch1-master-1 Dec 18 21:00:12.480168 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-9b26797e-5dbf-4c15-b24f-c855bc6c6270 req-ccca787b-9f4f-4e95-85a2-5b8799ad4a68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050748 Dec 18 21:00:12.483948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1905/3837] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:12.497142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:12.498897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:12.505595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:12.506480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:12.507532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:12.508168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:12.569696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dc27f25b847a0922262533aa0d5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dac9c70ce64bab85da8c23bafd20cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:12.578490 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4859c74-12b6-426a-ad78-1607887d843f tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 200 len: 1512 microversion: 2.1 time: 0.362944 Dec 18 21:00:12.584484 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1933/3838] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:12 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:12.594822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b0186f02-447b-46f5-9d0c-d1b169d4084c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f71612d8820>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:12.999711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:13.008426 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b19bcfe-6bd3-4b48-82aa-9d486562d1f9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1317 microversion: 2.1 time: 0.522990 Dec 18 21:00:13.025491 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1906/3839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:12 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:13.047547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4d94769-ce7a-4c86-9d0d-14e107e39b66 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:13.049322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4d94769-ce7a-4c86-9d0d-14e107e39b66 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:13.070302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4d94769-ce7a-4c86-9d0d-14e107e39b66 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.070866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4d94769-ce7a-4c86-9d0d-14e107e39b66 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.071782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4d94769-ce7a-4c86-9d0d-14e107e39b66 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.072326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4d94769-ce7a-4c86-9d0d-14e107e39b66 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.143423 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b0186f02-447b-46f5-9d0c-d1b169d4084c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.557469 Dec 18 21:00:13.144584 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1934/3840] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 21:00:12 2021] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:13.150292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-507da4ac-ce80-41c0-8cd9-2a61fe577bcc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1311443646"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:13.151921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-507da4ac-ce80-41c0-8cd9-2a61fe577bcc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:13.168387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507da4ac-ce80-41c0-8cd9-2a61fe577bcc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.171292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507da4ac-ce80-41c0-8cd9-2a61fe577bcc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.172509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507da4ac-ce80-41c0-8cd9-2a61fe577bcc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.173815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-507da4ac-ce80-41c0-8cd9-2a61fe577bcc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.394991 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4d94769-ce7a-4c86-9d0d-14e107e39b66 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 200 len: 1654 microversion: 2.1 time: 0.356306 Dec 18 21:00:13.397767 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1907/3841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:13 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 1654 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:13.415405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c727c935-1796-4b8e-be10-6de09c7889c5 req-0ec063db-e5df-410e-8f98-adf48fe69705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5ad229-3042-4816-865e-c5055f87a909", "name": "network-vif-deleted", "tag": "2f46a0da-28aa-4aef-82c3-f3adb2fd5bad"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:13.417586 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:13.417586 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:13.447434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c727c935-1796-4b8e-be10-6de09c7889c5 req-0ec063db-e5df-410e-8f98-adf48fe69705 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.448417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c727c935-1796-4b8e-be10-6de09c7889c5 req-0ec063db-e5df-410e-8f98-adf48fe69705 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.482715 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c727c935-1796-4b8e-be10-6de09c7889c5 req-0ec063db-e5df-410e-8f98-adf48fe69705 service nova] Creating event network-vif-deleted:2f46a0da-28aa-4aef-82c3-f3adb2fd5bad for instance 9c5ad229-3042-4816-865e-c5055f87a909 on nch2-master-1 Dec 18 21:00:13.495002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c727c935-1796-4b8e-be10-6de09c7889c5 req-0ec063db-e5df-410e-8f98-adf48fe69705 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084996 Dec 18 21:00:13.495978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1908/3842] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:13.512697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:13.514667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:13.532267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.535282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.535446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.536264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.607303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.607730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.614734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lazy-loading 'fault' on Instance uuid ec3cf0f4-2856-469d-9f26-86f473b11818 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:00:13.696238 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-507da4ac-ce80-41c0-8cd9-2a61fe577bcc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0/action" status: 202 len: 0 microversion: 2.1 time: 0.548300 Dec 18 21:00:13.703861 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1935/3843] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:13 2021] POST /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 21:00:13.724977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76644e7b-013f-467d-952e-ddf2f68b43d0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f714ef71820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-704291274", "description": "tempest-description-1007346360"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:13.759402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3166e271ba6f418d9c71cd661ef23226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf6435c2a148c6998dd3b1d301da96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:13.768606 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24de5255-5d5a-41e2-bf45-1e4917e61833 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 200 len: 1359 microversion: 2.1 time: 0.268688 Dec 18 21:00:13.781607 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1909/3844] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:13 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:13.792524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:13.793172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] [instance: 9c5ad229-3042-4816-865e-c5055f87a909] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:13.805619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.806379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.809538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:13.810394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:13.836498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] HTTP exception thrown: Instance 9c5ad229-3042-4816-865e-c5055f87a909 could not be found. Dec 18 21:00:13.837569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] Returning 404 to user: Instance 9c5ad229-3042-4816-865e-c5055f87a909 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:13.837994 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f9d7507c-2177-4011-8d93-8107659bd014 tempest-ServerAddressesTestJSON-444315448 tempest-ServerAddressesTestJSON-444315448-project] 10.222.0.13 "GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909" status: 404 len: 111 microversion: 2.1 time: 0.055271 Dec 18 21:00:13.838602 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1910/3845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:13 2021] GET /compute/v2.1/servers/9c5ad229-3042-4816-865e-c5055f87a909 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:13.854601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fdc9905b-fbce-4330-ae30-d2d7857e6de4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '.version_select at 0x7f714e5b4f70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:14.078688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fdc9905b-fbce-4330-ae30-d2d7857e6de4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/images/0205c674-6943-4e95-9e63-c62ddade4a63" status: 204 len: 0 microversion: 2.1 time: 0.238971 Dec 18 21:00:14.079887 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1911/3846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:13 2021] DELETE /compute/v2.1/images/0205c674-6943-4e95-9e63-c62ddade4a63 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:14.089274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:14.091227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:14.106325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:14.108834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:14.110973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:14.112139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:14.254336 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76644e7b-013f-467d-952e-ddf2f68b43d0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.548640 Dec 18 21:00:14.255571 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1936/3847] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:00:13 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:14.272021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e83280b-c91c-4cd7-9e63-ab42c1b371ab tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '.version_select at 0x7f71612d81f0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:14.325403 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-9e83280b-c91c-4cd7-9e63-ab42c1b371ab tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Image not found. Dec 18 21:00:14.327737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e83280b-c91c-4cd7-9e63-ab42c1b371ab tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Image not found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:14.330276 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e83280b-c91c-4cd7-9e63-ab42c1b371ab tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/images/0205c674-6943-4e95-9e63-c62ddade4a63" status: 404 len: 62 microversion: 2.1 time: 0.072137 Dec 18 21:00:14.331895 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1937/3848] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:14 2021] GET /compute/v2.1/images/0205c674-6943-4e95-9e63-c62ddade4a63 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:00:14.348593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce5218bc-9f5d-43a8-8221-329afb80cd49 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f714ef1d160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-664210975", "description": "tempest-description-643946194"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:14.470092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:14.479369 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41bece27-77e8-41e2-a625-5bada8b58340 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1317 microversion: 2.1 time: 0.395345 Dec 18 21:00:14.483264 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1912/3849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:14 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:14.501453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:14.502462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:14.509423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:14.510712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:14.511737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:14.512435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.260124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:15.268959 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e47214c-96f0-40ce-83d0-302868da376b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1533 microversion: 2.1 time: 0.776362 Dec 18 21:00:15.270135 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1913/3850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:14 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1533 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:15.275237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:15.276189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 39122197-3868-45d6-b159-242f70881ec6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:15.281825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce5218bc-9f5d-43a8-8221-329afb80cd49 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.945819 Dec 18 21:00:15.283115 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1938/3851] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:00:14 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:15.283945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:15.284651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.285667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:15.286184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.288297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:15.289031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] [instance: ec3cf0f4-2856-469d-9f26-86f473b11818] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:15.298054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:15.307901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.309087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:15.309579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.340807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] HTTP exception thrown: Instance 39122197-3868-45d6-b159-242f70881ec6 could not be found. Dec 18 21:00:15.341508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Returning 404 to user: Instance 39122197-3868-45d6-b159-242f70881ec6 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:15.344620 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-079c0abc-21fc-4020-9199-7355dfa551d6 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6" status: 404 len: 111 microversion: 2.1 time: 0.073218 Dec 18 21:00:15.348849 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1914/3852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:15 2021] GET /compute/v2.1/servers/39122197-3868-45d6-b159-242f70881ec6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:15.349513 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] HTTP exception thrown: Instance ec3cf0f4-2856-469d-9f26-86f473b11818 could not be found. Dec 18 21:00:15.350188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Returning 404 to user: Instance ec3cf0f4-2856-469d-9f26-86f473b11818 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:15.353365 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b696e32-bfff-4d0c-9308-f0a1cc7e9e2d tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818" status: 404 len: 111 microversion: 2.1 time: 0.066703 Dec 18 21:00:15.354324 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1939/3853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:15 2021] GET /compute/v2.1/servers/ec3cf0f4-2856-469d-9f26-86f473b11818 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:15.360616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4ecce9f0-b79d-4a67-83c0-02338b76f8d5 req-25a2e394-bb65-4e45-bbbb-c93320d3c8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3cf0f4-2856-469d-9f26-86f473b11818", "name": "network-vif-deleted", "tag": "b4996ca0-f713-420d-9ffb-a367ca1896f7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:15.364433 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:15.364433 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:15.373471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4ecce9f0-b79d-4a67-83c0-02338b76f8d5 req-25a2e394-bb65-4e45-bbbb-c93320d3c8af service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:15.374212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4ecce9f0-b79d-4a67-83c0-02338b76f8d5 req-25a2e394-bb65-4e45-bbbb-c93320d3c8af service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.387220 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4ecce9f0-b79d-4a67-83c0-02338b76f8d5 req-25a2e394-bb65-4e45-bbbb-c93320d3c8af service nova] Creating event network-vif-deleted:b4996ca0-f713-420d-9ffb-a367ca1896f7 for instance ec3cf0f4-2856-469d-9f26-86f473b11818 on nch1-master-1 Dec 18 21:00:15.393071 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4ecce9f0-b79d-4a67-83c0-02338b76f8d5 req-25a2e394-bb65-4e45-bbbb-c93320d3c8af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045449 Dec 18 21:00:15.393774 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1915/3854] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:15.399690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:15.400491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:15.409943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:15.410499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.411343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:15.411912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:15.436848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:15.528970 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8073b76d-7471-47b5-8f25-ad88484f557c tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 204 len: 0 microversion: 2.1 time: 0.133235 Dec 18 21:00:15.531319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1916/3855] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:15 2021] DELETE /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:15.539131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78c744a0-9896-4e2a-900b-7c0baabcfb15 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] Calling method '.version_select at 0x7f714e5bc790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:15.573957 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78c744a0-9896-4e2a-900b-7c0baabcfb15 tempest-ServersTestJSON-438352234 tempest-ServersTestJSON-438352234-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243282819" status: 202 len: 0 microversion: 2.1 time: 0.040849 Dec 18 21:00:15.576106 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1917/3856] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 21:00:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243282819 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:15.583498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-407006821", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "a54d1475-0f49-45b1-a549-1796cbed269f"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:15.647616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] validate_networks() for [('a54d1475-0f49-45b1-a549-1796cbed269f', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:00:15.776539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-970756147", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "d6e4e95e-eb3d-4204-ba23-6134021d7916"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:15.858361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] validate_networks() for [('d6e4e95e-eb3d-4204-ba23-6134021d7916', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:00:16.304618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:16.305648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:16.309888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:16.311917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:16.312397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:16.325251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.325798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.327103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.327926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.346909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Getting quotas for project 0d7fb5d0ce9f40d2b55296706489a86a. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:16.353013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Getting quotas for user 7ca060b0759d4bb687977d2435ce74e9 and project 0d7fb5d0ce9f40d2b55296706489a86a. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:16.367576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:16.371368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:16.433592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:16.434653 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64da0b97-3238-40a6-b0a9-17691651d2af tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856235 Dec 18 21:00:16.434909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:16.435400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:16.436426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:16.436822 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1918/3857] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:00:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:00:16.437003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:16.442427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:16.443551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:16.451471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.454060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.454389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.455169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.456140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.456735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.460455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.460906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.489476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Getting quotas for project 653558ed3d3248ea8f07a3066b6c3d88. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:16.496233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Getting quotas for user 54121b5d80d64c4796889183c5197853 and project 653558ed3d3248ea8f07a3066b6c3d88. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:16.514718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:16.517702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:16.595650 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6c4d98a-97a0-4800-aa9a-bb18887696aa tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240135 Dec 18 21:00:16.596966 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1940/3858] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:00:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:00:16.602244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6c774d0f-0427-443c-bc8c-ca191765bb83 req-bb59f75e-4cd2-4d83-9b08-c8cd8a1ddc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39122197-3868-45d6-b159-242f70881ec6", "name": "network-vif-deleted", "tag": "cff4e8d4-5231-483d-9fa7-4cda76d2c814"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:16.606716 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:16.606716 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:16.616510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6c774d0f-0427-443c-bc8c-ca191765bb83 req-bb59f75e-4cd2-4d83-9b08-c8cd8a1ddc93 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.617353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6c774d0f-0427-443c-bc8c-ca191765bb83 req-bb59f75e-4cd2-4d83-9b08-c8cd8a1ddc93 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.629405 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6c774d0f-0427-443c-bc8c-ca191765bb83 req-bb59f75e-4cd2-4d83-9b08-c8cd8a1ddc93 service nova] Creating event network-vif-deleted:cff4e8d4-5231-483d-9fa7-4cda76d2c814 for instance 39122197-3868-45d6-b159-242f70881ec6 on nch1-master-1 Dec 18 21:00:16.640393 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6c774d0f-0427-443c-bc8c-ca191765bb83 req-bb59f75e-4cd2-4d83-9b08-c8cd8a1ddc93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041973 Dec 18 21:00:16.641393 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1941/3859] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:16.663162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fefeb570-7469-4a63-a813-58efbb702976 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:16.664908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fefeb570-7469-4a63-a813-58efbb702976 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:16.675346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fefeb570-7469-4a63-a813-58efbb702976 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.676176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fefeb570-7469-4a63-a813-58efbb702976 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.677145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fefeb570-7469-4a63-a813-58efbb702976 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.677919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fefeb570-7469-4a63-a813-58efbb702976 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.748699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:16.760489 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c7178710-62de-4854-9ffc-2ec69988733f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1317 microversion: 2.1 time: 0.322222 Dec 18 21:00:16.763876 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1919/3860] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:16 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:16.772872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:16.775601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:16.784502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.784951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.785748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:16.786181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:16.984727 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fefeb570-7469-4a63-a813-58efbb702976 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1655 microversion: 2.1 time: 0.341809 Dec 18 21:00:16.987615 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1942/3861] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:16 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1655 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:17.000225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d62bff6b-cd04-48c4-aac7-722449c213e1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:17.002823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d62bff6b-cd04-48c4-aac7-722449c213e1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:17.100990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d62bff6b-cd04-48c4-aac7-722449c213e1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:17.109975 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d62bff6b-cd04-48c4-aac7-722449c213e1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1215 microversion: 2.1 time: 0.119709 Dec 18 21:00:17.111598 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1943/3862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:16 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:17.137444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-335a3f8b-a2ef-4d38-8a99-90e1a140070c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:17.138741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-335a3f8b-a2ef-4d38-8a99-90e1a140070c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:17.178482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:17.188012 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-61f37dbb-d250-426e-8368-73d31e46c6a7 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1539 microversion: 2.1 time: 0.422662 Dec 18 21:00:17.188993 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1920/3863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:16 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1539 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:17.235647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-335a3f8b-a2ef-4d38-8a99-90e1a140070c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:17.251058 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-335a3f8b-a2ef-4d38-8a99-90e1a140070c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1217 microversion: 2.1 time: 0.136856 Dec 18 21:00:17.258423 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1944/3864] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:17 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:17.401959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-59361be1-6730-438e-a41b-345c23351413 req-980c8e1c-0173-416c-b6a5-78859a7948a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b133169-7f92-48da-a3a0-5fc9a86455ff", "name": "network-vif-plugged", "status": "completed", "tag": "d926283b-c07a-4bd8-97f5-e45248571489"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:17.405509 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:17.405509 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:17.424639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-59361be1-6730-438e-a41b-345c23351413 req-980c8e1c-0173-416c-b6a5-78859a7948a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:17.426043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-59361be1-6730-438e-a41b-345c23351413 req-980c8e1c-0173-416c-b6a5-78859a7948a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:17.452403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1994598783", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": "none"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:17.456040 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-59361be1-6730-438e-a41b-345c23351413 req-980c8e1c-0173-416c-b6a5-78859a7948a0 service nova] Creating event network-vif-plugged:d926283b-c07a-4bd8-97f5-e45248571489 for instance 5b133169-7f92-48da-a3a0-5fc9a86455ff on nch1-master-1 Dec 18 21:00:17.476830 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-59361be1-6730-438e-a41b-345c23351413 req-980c8e1c-0173-416c-b6a5-78859a7948a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084529 Dec 18 21:00:17.480854 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1945/3865] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:17.557488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:17.557925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:17.558435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:17.558842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:17.559493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:17.582485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:17.583447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:17.584783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:17.585295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:17.609976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Getting quotas for project f77a53112c4344578a937b3f9396e848. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:17.617216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Getting quotas for user 7d31494c29fc4f62b4a28f384fc15c13 and project f77a53112c4344578a937b3f9396e848. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:17.633229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:17.637546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:17.700743 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c1a8e5f3-652f-4278-b73b-1ae979df5325 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.508837 Dec 18 21:00:17.702124 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1921/3866] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:00:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 21:00:17.713851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f050a259-2eee-4b51-8f69-eb014972799f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:17.714596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f050a259-2eee-4b51-8f69-eb014972799f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:17.781926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:17.785682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:17.796117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:17.796789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:17.797920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:17.798572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:17.846405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f050a259-2eee-4b51-8f69-eb014972799f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:17.854424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f050a259-2eee-4b51-8f69-eb014972799f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:17.855942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f050a259-2eee-4b51-8f69-eb014972799f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:17.863429 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f050a259-2eee-4b51-8f69-eb014972799f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a" status: 200 len: 1278 microversion: 2.47 time: 0.147330 Dec 18 21:00:17.865578 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1946/3867] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:17 2021] GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:17.947323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1303951009", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": "none"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:18.055362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:18.056213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:18.056213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:18.056599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:18.057130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:18.082425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.083256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.086236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.086840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.109589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Getting quotas for project f77a53112c4344578a937b3f9396e848. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:18.115661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Getting quotas for user 7d31494c29fc4f62b4a28f384fc15c13 and project f77a53112c4344578a937b3f9396e848. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:18.133456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:18.136725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:18.199396 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a4768149-64c1-496c-9923-07332ec4bcef tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.255648 Dec 18 21:00:18.205797 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1947/3868] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:00:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 263 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 18 21:00:18.211438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f50bc4b-502e-4cf8-876c-3adf90f72362 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:18.212105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f50bc4b-502e-4cf8-876c-3adf90f72362 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:18.220104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f50bc4b-502e-4cf8-876c-3adf90f72362 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.220832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f50bc4b-502e-4cf8-876c-3adf90f72362 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.221836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f50bc4b-502e-4cf8-876c-3adf90f72362 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.222495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f50bc4b-502e-4cf8-876c-3adf90f72362 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.513006 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f50bc4b-502e-4cf8-876c-3adf90f72362 tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 200 len: 1613 microversion: 2.1 time: 0.305918 Dec 18 21:00:18.517583 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1948/3869] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:18 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 1613 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:18.558695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:18.562414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:18.572485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.573298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.574754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.575464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.758159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:18.768710 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0d474189-0631-4961-9a7a-16048f18503f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1273 microversion: 2.1 time: 0.224857 Dec 18 21:00:18.784133 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1949/3870] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:18 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:18.796592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:18.797194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:18.806754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:18.814397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.814874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.815711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:18.816410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:18.828717 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df5ed91c-d9b5-4320-b689-1515ddc7d6ac tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1317 microversion: 2.1 time: 1.051951 Dec 18 21:00:18.838164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1922/3871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:17 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1317 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:18.850752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f7961427-3fa3-4788-9be3-3e15ad1e8b7d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:18.858542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f7961427-3fa3-4788-9be3-3e15ad1e8b7d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:18.985219 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f7961427-3fa3-4788-9be3-3e15ad1e8b7d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "PUT /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 992 microversion: 2.47 time: 0.139228 Dec 18 21:00:18.996594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1923/3872] 10.222.0.13 () {62 vars in 1296 bytes} [Sat Dec 18 21:00:18 2021] PUT /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 992 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:00:19.002001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:19.002953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:19.023258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.023666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.024457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.031038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.177335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:19.196389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29ca6878-3f49-42be-bf8e-590743d9af1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1275 microversion: 2.1 time: 0.204396 Dec 18 21:00:19.199830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:19.207578 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1924/3873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:18 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:19.209919 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0cbed15-f6e6-4c6c-9a63-41c8d1d51dec tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1521 microversion: 2.1 time: 0.424446 Dec 18 21:00:19.210766 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1950/3874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:18 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:19.216359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:19.217262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:19.223362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-788a963d-8f20-48d1-a3a7-f7bca484b3c5 req-d06e17c0-f1d3-419b-b1f9-d936de37116f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568a5cf4-f4a7-422f-91f2-9981295940ff", "name": "network-vif-deleted", "tag": "0da2c32b-1622-4614-8ba1-9f9480ff52bf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:19.226308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.227034 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:19.227034 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:19.227353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.228565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.229629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.237765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-788a963d-8f20-48d1-a3a7-f7bca484b3c5 req-d06e17c0-f1d3-419b-b1f9-d936de37116f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.238881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-788a963d-8f20-48d1-a3a7-f7bca484b3c5 req-d06e17c0-f1d3-419b-b1f9-d936de37116f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.255782 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-788a963d-8f20-48d1-a3a7-f7bca484b3c5 req-d06e17c0-f1d3-419b-b1f9-d936de37116f service nova] Creating event network-vif-deleted:0da2c32b-1622-4614-8ba1-9f9480ff52bf for instance 568a5cf4-f4a7-422f-91f2-9981295940ff on nch2-master-1 Dec 18 21:00:19.263084 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-788a963d-8f20-48d1-a3a7-f7bca484b3c5 req-d06e17c0-f1d3-419b-b1f9-d936de37116f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054154 Dec 18 21:00:19.266274 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1925/3875] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:19.273127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:19.273860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:19.285486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.286401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.288379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.289084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.328917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:19.369752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:19.383301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:19.385834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:19.390818 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ea1c0ee2-926a-4e68-9b33-0fe483932d69 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1274 microversion: 2.47 time: 0.175821 Dec 18 21:00:19.402799 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1951/3876] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:19 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:19.454484 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-94c5d9da-7899-41f0-9e40-0f0aaf3c7e09 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 204 len: 0 microversion: 2.1 time: 0.186071 Dec 18 21:00:19.456767 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1926/3877] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:19 2021] DELETE /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:19.464662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:19.465448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:19.475465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.478777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.482094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.483270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.511774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-33b37b4e-0b84-4ed9-8e7f-b870cbf224b8 req-11b2dcfe-b1b7-4814-aec8-1553a7c66fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b8c792-da21-4d87-9e75-96d0445e8db0", "name": "network-vif-plugged", "status": "completed", "tag": "bae4e65d-ce16-4411-8971-1163bdcdb591"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:19.513496 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:19.513496 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:19.532397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-33b37b4e-0b84-4ed9-8e7f-b870cbf224b8 req-11b2dcfe-b1b7-4814-aec8-1553a7c66fbb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.534530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-33b37b4e-0b84-4ed9-8e7f-b870cbf224b8 req-11b2dcfe-b1b7-4814-aec8-1553a7c66fbb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.564357 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-33b37b4e-0b84-4ed9-8e7f-b870cbf224b8 req-11b2dcfe-b1b7-4814-aec8-1553a7c66fbb service nova] Creating event network-vif-plugged:bae4e65d-ce16-4411-8971-1163bdcdb591 for instance b7b8c792-da21-4d87-9e75-96d0445e8db0 on nch2-master-1 Dec 18 21:00:19.577288 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-33b37b4e-0b84-4ed9-8e7f-b870cbf224b8 req-11b2dcfe-b1b7-4814-aec8-1553a7c66fbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070271 Dec 18 21:00:19.578123 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1927/3878] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:00:19.590501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:19.594143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] [instance: 568a5cf4-f4a7-422f-91f2-9981295940ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:19.610374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.612567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.614779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.615634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.663713 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] HTTP exception thrown: Instance 568a5cf4-f4a7-422f-91f2-9981295940ff could not be found. Dec 18 21:00:19.664225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] Returning 404 to user: Instance 568a5cf4-f4a7-422f-91f2-9981295940ff could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:19.673421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-02f78293-854e-4e62-a5da-5390654fd4cc tempest-TestServerMultinode-138106620 tempest-TestServerMultinode-138106620-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff" status: 404 len: 111 microversion: 2.1 time: 0.085819 Dec 18 21:00:19.676748 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1928/3879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:19 2021] GET /compute/v2.1/servers/568a5cf4-f4a7-422f-91f2-9981295940ff => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:19.788994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:19.789617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:19.798711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.799168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.799976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.800426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.907287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:19.917364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b158b6fa-ac71-4f94-b95d-d5ecbd7b81e5 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1273 microversion: 2.1 time: 0.131898 Dec 18 21:00:19.918325 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1929/3880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:19 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:19.931070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:19.932137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:19.941481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.942290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:19.944275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:19.947655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:20.107613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:20.115161 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7251d2cf-d0ef-4b1b-bb80-10a2c2e8f462 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1527 microversion: 2.1 time: 0.654221 Dec 18 21:00:20.126788 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1952/3881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:19 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1527 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:20.214855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:20.215761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:20.228274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:20.230111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:20.231138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:20.235170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:20.413152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:20.424057 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8817f003-a3a6-4501-8b3b-3bf750d4e3a5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1275 microversion: 2.1 time: 0.213201 Dec 18 21:00:20.436538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1953/3882] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:20 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:20.447418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:20.449063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:20.456735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:20.466629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:20.467521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:20.470143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:20.471841 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1350406-cce3-40d3-bf72-a28f44ae719f tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1508 microversion: 2.1 time: 0.551337 Dec 18 21:00:20.471841 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1930/3883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:19 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:20.472428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:20.907317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:20.933879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:20.934532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:20.942408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:20.942837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:20.943297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:20.944106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:20.944551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:20.950415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:20.952490 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf7c96e1-8048-470a-b465-a68fe03615ac tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1336 microversion: 2.47 time: 0.514208 Dec 18 21:00:20.953190 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1954/3884] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:20 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1336 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:21.131890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:21.132611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:21.142838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:21.143424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:21.144407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:21.145333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:21.562736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:21.570903 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa233a37-7724-4ba3-92fb-52b3fbe1ada1 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1315 microversion: 2.1 time: 0.640564 Dec 18 21:00:21.580932 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1931/3885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:20 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:21.585912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:21.586725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:21.597763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:21.598504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:21.599700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:21.600246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:21.772274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:21.783153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71b701c1-8344-4aac-ba00-462d95a0aea1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1527 microversion: 2.1 time: 0.654891 Dec 18 21:00:21.784124 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1955/3886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:21 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1527 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:21.975401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:21.975808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:21.987645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:21.988817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:21.992051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:21.992744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.105838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:22.114264 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66f90320-6178-464b-97fa-f447f8760d99 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1317 microversion: 2.1 time: 0.531912 Dec 18 21:00:22.123119 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1932/3887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:21 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:22.127961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b9f4fd58-1074-48ae-9796-0b552ac4f105 req-74f6ca22-a5c9-45b7-bf88-b9ad4184fb98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99065c17-efa8-47de-ad99-b21a3541dc5a", "tag": "eb1e3ece-13e6-4590-918b-eb0ad8dcfedf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:22.129547 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:22.129547 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:22.147880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9f4fd58-1074-48ae-9796-0b552ac4f105 req-74f6ca22-a5c9-45b7-bf88-b9ad4184fb98 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.148193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9f4fd58-1074-48ae-9796-0b552ac4f105 req-74f6ca22-a5c9-45b7-bf88-b9ad4184fb98 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.163749 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b9f4fd58-1074-48ae-9796-0b552ac4f105 req-74f6ca22-a5c9-45b7-bf88-b9ad4184fb98 service nova] Creating event network-changed:eb1e3ece-13e6-4590-918b-eb0ad8dcfedf for instance 99065c17-efa8-47de-ad99-b21a3541dc5a on nch2-master-1 Dec 18 21:00:22.166165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:22.170140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b9f4fd58-1074-48ae-9796-0b552ac4f105 req-74f6ca22-a5c9-45b7-bf88-b9ad4184fb98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045090 Dec 18 21:00:22.171284 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1933/3888] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:22.184062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:22.189408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:22.191214 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-17d53f92-7116-47c5-9ea1-b9044c3a10d5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1336 microversion: 2.47 time: 0.220423 Dec 18 21:00:22.193146 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1956/3889] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:21 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1336 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:22.196031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e5362099-5818-4466-96e6-e971b5f74c19 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d0bb476-e8f3-480c-9032-e87a7899ee26"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:22.197507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e5362099-5818-4466-96e6-e971b5f74c19 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:22.211909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5362099-5818-4466-96e6-e971b5f74c19 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.212754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5362099-5818-4466-96e6-e971b5f74c19 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.214226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5362099-5818-4466-96e6-e971b5f74c19 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.214909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5362099-5818-4466-96e6-e971b5f74c19 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.588439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:22.589608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:22.598025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.604573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.605641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.606282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.712314 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e5362099-5818-4466-96e6-e971b5f74c19 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539225 Dec 18 21:00:22.713749 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1934/3890] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:00:22 2021] POST /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:22.722340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f2a53d53-2e7c-4560-a9b7-b53800daf60a req-8839b96f-d984-4d01-b278-cfac6febe07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fda487-271d-438c-9327-f48f40474e6c", "tag": "c1bac115-de87-4762-9518-c18983081d31"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:22.726436 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:22.726436 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:22.742142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f2a53d53-2e7c-4560-a9b7-b53800daf60a req-8839b96f-d984-4d01-b278-cfac6febe07c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.742977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f2a53d53-2e7c-4560-a9b7-b53800daf60a req-8839b96f-d984-4d01-b278-cfac6febe07c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.786018 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f2a53d53-2e7c-4560-a9b7-b53800daf60a req-8839b96f-d984-4d01-b278-cfac6febe07c service nova] Creating event network-changed:c1bac115-de87-4762-9518-c18983081d31 for instance d2fda487-271d-438c-9327-f48f40474e6c on nch2-master-1 Dec 18 21:00:22.804939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f2a53d53-2e7c-4560-a9b7-b53800daf60a req-8839b96f-d984-4d01-b278-cfac6febe07c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084509 Dec 18 21:00:22.804939 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1935/3891] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:22.807498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:22.808344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:22.823853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.824296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:22.826097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:22.828096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:23.061579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:23.072117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5cafeb48-fbb2-4ba0-af68-906f932b12d5 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 200 len: 1485 microversion: 2.1 time: 0.269083 Dec 18 21:00:23.073000 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1936/3892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:22 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 1485 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:23.138566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:23.139970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:23.149742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:23.150488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:23.157609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:23.158337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:23.431686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:23.450649 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad7e2d50-e698-4e25-b805-30a0328ed15d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1315 microversion: 2.1 time: 0.866092 Dec 18 21:00:23.455731 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1957/3893] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:22 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:23.465396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:23.468251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:23.481755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:23.482299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:23.486822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:23.487449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:23.502156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:23.518656 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e81435f7-c4c2-4de9-9ed4-870133954ae5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1317 microversion: 2.1 time: 0.383659 Dec 18 21:00:23.521693 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1937/3894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:23 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:23.940755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:23.955413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:23.960315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:23.961563 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f645b36a-ec3a-4747-b069-4d62d2642411 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1357 microversion: 2.47 time: 0.504652 Dec 18 21:00:23.962126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1958/3895] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:23 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1357 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:23.984437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:23.987726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:23.996834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:23.997606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:23.999101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:23.999697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.091649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:24.094563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:24.110421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.111278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.112553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.113160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.124604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:24.125088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:24.125982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:24.126845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:24.128062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:24.137057 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Instance b7b8c792-da21-4d87-9e75-96d0445e8db0 could not be found. Dec 18 21:00:24.137787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Instance b7b8c792-da21-4d87-9e75-96d0445e8db0 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:24.138597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01ef57c2-1fcd-487f-80db-9bc6d1c172be tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 404 len: 111 microversion: 2.1 time: 0.053308 Dec 18 21:00:24.139563 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1959/3896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:24 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:24.245235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:24.254375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.255317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.256460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.257194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.294443 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15604f08-d055-41f6-9565-cbadd0914cf6 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "POST /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07/action" status: 202 len: 1079 microversion: 2.47 time: 0.315363 Dec 18 21:00:24.296735 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1938/3897] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:00:23 2021] POST /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07/action => generated 1079 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Dec 18 21:00:24.313259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:24.314958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:24.322331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.324379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.326906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.328180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.387512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-482508894", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfdb70fc-b6f1-4792-b656-71aeb0dae3b6"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:24.445227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] validate_networks() for [('bfdb70fc-b6f1-4792-b656-71aeb0dae3b6', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:00:24.468510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:24.480870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:24.484017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:24.486052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bce38508-3e6d-4997-9af6-17147deb43d1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.178878 Dec 18 21:00:24.487375 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1960/3898] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:24 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:24.494094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:24.495022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:24.504277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.505186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:24.506405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:24.506781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.017624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:25.025576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d132b67f-dfc9-478e-b9e1-f5941c8d7c16 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1315 microversion: 2.1 time: 0.536764 Dec 18 21:00:25.026245 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1961/3899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:24 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:25.030590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:25.031487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:25.037279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:25.037840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.038741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:25.039293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.511122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:25.528221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:25.529831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:25.530513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:25.531114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:25.531530 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0aaeaa59-3041-4200-a6a3-9cd4a68ada90 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1317 microversion: 2.1 time: 0.504058 Dec 18 21:00:25.531671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:25.532906 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1962/3900] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:25 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:25.550089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:25.550825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.551852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:25.553243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.569370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6cf77642-a816-4e8a-83b8-9758c05eed68 req-608f1b37-a802-43bf-a4e2-582718517a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b8c792-da21-4d87-9e75-96d0445e8db0", "name": "network-vif-deleted", "tag": "bae4e65d-ce16-4411-8971-1163bdcdb591"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:25.574205 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:25.574205 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:25.584942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for project 80e8efe6135e41a689caf483b2c72af1. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:25.591661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Getting quotas for user bc32317ed5e54f67b8ae64f92419bcc0 and project 80e8efe6135e41a689caf483b2c72af1. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:25.593825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6cf77642-a816-4e8a-83b8-9758c05eed68 req-608f1b37-a802-43bf-a4e2-582718517a9f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:25.595151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6cf77642-a816-4e8a-83b8-9758c05eed68 req-608f1b37-a802-43bf-a4e2-582718517a9f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.608762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:25.611517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:25.618703 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6cf77642-a816-4e8a-83b8-9758c05eed68 req-608f1b37-a802-43bf-a4e2-582718517a9f service nova] Creating event network-vif-deleted:bae4e65d-ce16-4411-8971-1163bdcdb591 for instance b7b8c792-da21-4d87-9e75-96d0445e8db0 on nch2-master-1 Dec 18 21:00:25.625380 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6cf77642-a816-4e8a-83b8-9758c05eed68 req-608f1b37-a802-43bf-a4e2-582718517a9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090846 Dec 18 21:00:25.626185 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1963/3901] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:25.634863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:25.636339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:25.643988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:25.644733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.645833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:25.647247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:25.680055 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38b8fe31-b64c-4ff3-80aa-4a9a84232a29 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.297852 Dec 18 21:00:25.680941 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1939/3902] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:00:24 2021] POST /compute/v2.1/servers => generated 383 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:00:25.691810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52ec1c73-de3a-41e5-be20-173c8dc14ccc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:25.692649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52ec1c73-de3a-41e5-be20-173c8dc14ccc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:26.048211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:26.057385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:26.060119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:26.061484 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-df552dff-d621-405b-932d-9474162401e4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.433224 Dec 18 21:00:26.074468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1964/3903] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:25 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:26.084754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:26.087086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:26.102377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52ec1c73-de3a-41e5-be20-173c8dc14ccc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:26.119612 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52ec1c73-de3a-41e5-be20-173c8dc14ccc tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1224 microversion: 2.1 time: 0.427217 Dec 18 21:00:26.120937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.121695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1940/3904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:25 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1224 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:26.125845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.126878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.128997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.140273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d0bb476-e8f3-480c-9032-e87a7899ee26"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:26.147399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:26.160001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.161725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.166383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.167084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.302201 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] HTTP exception thrown: Invalid volume: volume 4d0bb476-e8f3-480c-9032-e87a7899ee26 is already attached to instances: 5b133169-7f92-48da-a3a0-5fc9a86455ff Dec 18 21:00:26.302945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Returning 400 to user: Invalid volume: volume 4d0bb476-e8f3-480c-9032-e87a7899ee26 is already attached to instances: 5b133169-7f92-48da-a3a0-5fc9a86455ff {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:26.304130 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1b991d1-90b6-4ac1-b48d-2e1104349376 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.179818 Dec 18 21:00:26.304936 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1941/3905] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:00:26 2021] POST /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments => generated 174 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:00:26.409526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:26.410448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:26.417523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.418234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.419429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.420149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.532480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lazy-loading 'services' on Instance uuid 5b133169-7f92-48da-a3a0-5fc9a86455ff {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:00:26.637711 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a0e95819-5dd2-4ff3-9c48-662e879b72aa tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments/4d0bb476-e8f3-480c-9032-e87a7899ee26" status: 202 len: 0 microversion: 2.1 time: 0.231637 Dec 18 21:00:26.639318 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1942/3906] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:00:26 2021] DELETE /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments/4d0bb476-e8f3-480c-9032-e87a7899ee26 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:26.646779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:26.663435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:26.686821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.688144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.689700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.690535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.908518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:26.915803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57fae794-53cc-4b2f-a8b8-fdc24366ac50 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1315 microversion: 2.1 time: 0.840045 Dec 18 21:00:26.916381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1965/3907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:26 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:26.924214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f67e8037-b5cd-41d0-a273-6d4698df8ab4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:26.925129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f67e8037-b5cd-41d0-a273-6d4698df8ab4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:26.936746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67e8037-b5cd-41d0-a273-6d4698df8ab4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.937296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67e8037-b5cd-41d0-a273-6d4698df8ab4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.938170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67e8037-b5cd-41d0-a273-6d4698df8ab4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:26.938993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67e8037-b5cd-41d0-a273-6d4698df8ab4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:26.971825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f67e8037-b5cd-41d0-a273-6d4698df8ab4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054403 Dec 18 21:00:26.972830 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1966/3908] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:00:26 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:27.017789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:27.027262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b063232a-e4a3-4e4e-8f3e-ce6a557a8c30 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1317 microversion: 2.1 time: 0.386177 Dec 18 21:00:27.030204 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1943/3909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:26 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:27.081696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:27.082523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:27.092901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.093664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:27.095135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.095690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:27.140465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:27.142222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:27.177381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.179554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:27.181855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.187576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:27.319479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:27.339138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:27.341123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:27.348243 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ab8d94b-d801-4d84-85bd-68e3f4eb56c2 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.271027 Dec 18 21:00:27.348871 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1967/3910] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:27 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:27.379938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:27.391418 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-12ff0152-9f2e-4696-b9d8-cf994f002b52 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1284 microversion: 2.1 time: 0.256481 Dec 18 21:00:27.392832 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1944/3911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:27 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:27.933507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:27.934134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:27.941899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.944121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:27.945132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.946231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:27.983636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fbad123-8a44-447b-b667-229a078dd1c5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:27.984843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fbad123-8a44-447b-b667-229a078dd1c5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:27.997368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbad123-8a44-447b-b667-229a078dd1c5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.997850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbad123-8a44-447b-b667-229a078dd1c5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:27.999202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbad123-8a44-447b-b667-229a078dd1c5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:27.999648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fbad123-8a44-447b-b667-229a078dd1c5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.078575 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fbad123-8a44-447b-b667-229a078dd1c5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098597 Dec 18 21:00:28.079669 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1945/3912] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:00:27 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:00:28.085426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-2fdbb1d1-a975-47a0-b38c-896579bdab43 req-96ac7ce2-41c6-4750-bd89-dbaf9a6507dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99065c17-efa8-47de-ad99-b21a3541dc5a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1e3ece-13e6-4590-918b-eb0ad8dcfedf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:28.103936 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:28.103936 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:28.116604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2fdbb1d1-a975-47a0-b38c-896579bdab43 req-96ac7ce2-41c6-4750-bd89-dbaf9a6507dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:28.117280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2fdbb1d1-a975-47a0-b38c-896579bdab43 req-96ac7ce2-41c6-4750-bd89-dbaf9a6507dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.137289 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-2fdbb1d1-a975-47a0-b38c-896579bdab43 req-96ac7ce2-41c6-4750-bd89-dbaf9a6507dd service nova] Creating event network-vif-plugged:eb1e3ece-13e6-4590-918b-eb0ad8dcfedf for instance 99065c17-efa8-47de-ad99-b21a3541dc5a on nch2-master-1 Dec 18 21:00:28.154434 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-2fdbb1d1-a975-47a0-b38c-896579bdab43 req-96ac7ce2-41c6-4750-bd89-dbaf9a6507dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073086 Dec 18 21:00:28.154985 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1946/3913] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:28.161978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:28.162717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:28.180321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:28.180789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.181603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:28.182052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.452349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:28.460250 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c8c802e3-4cfd-400d-8ffe-d23dd5e95056 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1315 microversion: 2.1 time: 0.530975 Dec 18 21:00:28.460864 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1968/3914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:27 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:28.465224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:28.465836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:28.482346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:28.483754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.485545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:28.486339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.624060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:28.639730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:28.643358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:28.644916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f699e9fa-6a1b-4250-8db6-2dae7fbe607c tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.183140 Dec 18 21:00:28.651698 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1969/3915] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:28 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:28.663191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-497058068", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1f7835a3-1921-420f-bc92-783d1cac5ba9"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:28.685248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:28.700228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3893bd83-974b-4ac7-addd-b87ab87cf254 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1317 microversion: 2.1 time: 0.544033 Dec 18 21:00:28.712448 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1947/3916] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:28 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:28.722589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:28.723540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:28.738244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:28.741190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.742231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:28.742886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:28.801322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] validate_networks() for [('1f7835a3-1921-420f-bc92-783d1cac5ba9', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:00:28.865183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:28.873546 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-642fe8e1-d8c0-40a9-95d4-047f0ebecb35 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1282 microversion: 2.1 time: 0.159191 Dec 18 21:00:28.875040 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1948/3917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:28 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:29.476834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:29.477482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:29.484527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:29.485609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:29.486754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:29.487351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:29.699730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:29.700254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:29.701039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:29.701685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:29.702367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:29.719632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:29.727161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:29.728421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:29.729102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:29.765351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:29.772960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Getting quotas for user 4196dd207ce543d3bdd5f48ae57e156a and project d1b96ca6ed964b6a9db0ed2249251328. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:29.787363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:29.789936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:29.848776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7d88c0f-5dc4-4c43-be33-4e9983542cde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194601 Dec 18 21:00:29.850310 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1970/3918] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:00:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:00:29.855881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:29.856804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:29.864223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:29.864909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:29.865881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:29.866540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:30.023278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:30.033264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:30.041722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:30.043226 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20f2afe9-ec01-4d1e-9748-b416c15feb23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.191537 Dec 18 21:00:30.046119 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1971/3919] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:29 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:30.069173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:30.071716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:30.092854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:30.093313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:30.094118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:30.094588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:30.377884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:30.386669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b60f8173-c47b-4ca8-94fc-db93ed259623 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1315 microversion: 2.1 time: 0.913534 Dec 18 21:00:30.387258 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1949/3920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:29 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1315 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:30.401561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a842e8fd-e413-436a-94a9-961199ea8109 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:30.402398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a842e8fd-e413-436a-94a9-961199ea8109 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:30.517403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a842e8fd-e413-436a-94a9-961199ea8109 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:30.527379 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a842e8fd-e413-436a-94a9-961199ea8109 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1217 microversion: 2.1 time: 0.128708 Dec 18 21:00:30.530770 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1950/3921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:30 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:30.540930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:30.543128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:30.553334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:30.554163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:30.555338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:30.556150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:30.930906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:30.939980 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c89a3a01-15bc-4cb3-9794-640bd3c225bd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1508 microversion: 2.1 time: 0.889592 Dec 18 21:00:30.953266 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1972/3922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:30 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1508 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:30.960584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c0c3404b-e787-4468-8fdb-6b52cba3e2a3 req-c880ede0-092b-4545-aa67-7a09675f07d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fda487-271d-438c-9327-f48f40474e6c", "name": "network-vif-plugged", "status": "completed", "tag": "c1bac115-de87-4762-9518-c18983081d31"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:30.963223 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:30.963223 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:30.979397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c0c3404b-e787-4468-8fdb-6b52cba3e2a3 req-c880ede0-092b-4545-aa67-7a09675f07d6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:30.983957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c0c3404b-e787-4468-8fdb-6b52cba3e2a3 req-c880ede0-092b-4545-aa67-7a09675f07d6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.023817 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c0c3404b-e787-4468-8fdb-6b52cba3e2a3 req-c880ede0-092b-4545-aa67-7a09675f07d6 service nova] Creating event network-vif-plugged:c1bac115-de87-4762-9518-c18983081d31 for instance d2fda487-271d-438c-9327-f48f40474e6c on nch2-master-1 Dec 18 21:00:31.047995 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c0c3404b-e787-4468-8fdb-6b52cba3e2a3 req-c880ede0-092b-4545-aa67-7a09675f07d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082707 Dec 18 21:00:31.048670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1973/3923] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:31.054033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:31.056533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:31.072646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.073115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.073926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.074395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.190015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:31.199071 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-86cb5fd9-d415-4591-9e8b-06aafcdeb186 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1324 microversion: 2.1 time: 0.667025 Dec 18 21:00:31.214665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1951/3924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:30 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1324 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:31.227396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:31.228311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:31.237749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.238507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.242138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.243491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.412978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:31.430206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:31.437042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:31.440632 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-963802f0-1299-433a-a3a7-e3ff6ed831a5 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.216173 Dec 18 21:00:31.442243 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1952/3925] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:31 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:31.455450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:31.456394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:31.473842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.474682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.477630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.479479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.870512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:31.883778 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fba8d2ab-db11-4a5d-8196-e6ec3216e591 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1508 microversion: 2.1 time: 0.833327 Dec 18 21:00:31.885111 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1974/3926] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:31 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1508 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:31.899536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:31.902730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:31.916040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.917583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:31.919109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:31.937133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.249979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:32.265834 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d5c8c04b-033e-4079-8995-2389927d4a2d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1275 microversion: 2.1 time: 0.373841 Dec 18 21:00:32.267718 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1975/3927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:31 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1275 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:32.273249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:32.277383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:32.289077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.289607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.290553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.291011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.329557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:32.337994 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28f61928-efd6-473d-8918-7e9b2444233a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1315 microversion: 2.1 time: 0.893827 Dec 18 21:00:32.342412 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1953/3928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:31 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:32.347286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-153429d4-089d-4b9c-9fe1-ee4e7c6f2018 req-32a24e36-b38d-46fb-b513-4d2f28326789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770e4df9-f6a3-4355-aaba-dd70810ad41c", "tag": "e8d47f63-22de-48b3-bd10-4bb15c953401"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:32.355101 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:32.355101 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:32.370142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-153429d4-089d-4b9c-9fe1-ee4e7c6f2018 req-32a24e36-b38d-46fb-b513-4d2f28326789 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.383014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-153429d4-089d-4b9c-9fe1-ee4e7c6f2018 req-32a24e36-b38d-46fb-b513-4d2f28326789 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.398299 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-153429d4-089d-4b9c-9fe1-ee4e7c6f2018 req-32a24e36-b38d-46fb-b513-4d2f28326789 service nova] Creating event network-changed:e8d47f63-22de-48b3-bd10-4bb15c953401 for instance 770e4df9-f6a3-4355-aaba-dd70810ad41c on nch2-master-1 Dec 18 21:00:32.419723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:32.420095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-153429d4-089d-4b9c-9fe1-ee4e7c6f2018 req-32a24e36-b38d-46fb-b513-4d2f28326789 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076161 Dec 18 21:00:32.420972 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1954/3929] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:32.421162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:32.421838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:32.422391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:32.422899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:32.425499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:32.426199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:32.440224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.440688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.441751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.442194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.510598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:32.520025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.520773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.521941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.522984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.558614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af447111-d149-49bb-903d-da18c9f7ffc7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "POST /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a/action" status: 202 len: 1110 microversion: 2.1 time: 0.289131 Dec 18 21:00:32.559709 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1976/3930] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:32 2021] POST /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a/action => generated 1110 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 18 21:00:32.577544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:32.578875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:32.594087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.594756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.596269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.598965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.873545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:32.887197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:32.889773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:32.898348 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba8c7b33-27f7-4e0d-bc43-fec24c840ee1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.332614 Dec 18 21:00:32.910408 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1977/3931] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:32 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:32.916463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:32.917482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:32.925906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.926807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:32.928002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:32.928703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:33.337141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:33.348622 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-121f6cda-9a5f-413b-80c3-c820db7ac268 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1324 microversion: 2.1 time: 0.925067 Dec 18 21:00:33.350688 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1955/3932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:32 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1324 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:33.364710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:33.365645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:33.373780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:33.374656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:33.375957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:33.376724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:33.589610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:33.613751 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65daf8e3-5287-44f9-928f-08f0278a48c4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1275 microversion: 2.1 time: 0.258705 Dec 18 21:00:33.615890 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1956/3933] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:33 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1275 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:33.624053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:33.624686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:33.627682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:33.639637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:33.640016 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a5388f9-412c-4e5e-84cf-fb1a993b88f1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.728101 Dec 18 21:00:33.640361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:33.641188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:33.641633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:33.649728 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1978/3934] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:32 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:33.921094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:33.921950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:33.929315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:33.929972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:33.931002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:33.931609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:34.067587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:34.076606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:34.078441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:34.081193 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ecc3d7f1-4e02-4fa8-883a-d3daed24fa23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.168209 Dec 18 21:00:34.091323 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1979/3935] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:33 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:34.195785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:34.205451 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a115a57f-5384-42c7-94ad-7951d840664d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1501 microversion: 2.1 time: 0.588033 Dec 18 21:00:34.206039 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1957/3936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:33 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1501 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:34.225073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-704291274"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:34.225769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:34.234019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:34.234899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:34.235963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:34.236654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:34.370272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:34.371474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:34.383170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:34.383834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:34.387043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:34.387738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:35.257487 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.network.security_group_api [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Adding security group 48577c73-82a2-4735-bc37-dd6b3d9d81dc to port c1bac115-de87-4762-9518-c18983081d31 Dec 18 21:00:35.464220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:35.477397 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-795d9664-e409-47d5-9231-332c80d7376f tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1324 microversion: 2.1 time: 1.112462 Dec 18 21:00:35.480028 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1958/3937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:34 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1324 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:35.492410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:35.498498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:35.512186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:35.518200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:35.519447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:35.520134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:36.277267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:36.298806 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c8cc7df-4b75-45fe-9e9a-27c70fa30497 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 0.816831 Dec 18 21:00:36.300406 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1959/3938] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:35 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:36.315541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:36.316539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:36.322827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:36.323654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:36.335408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:36.337973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:37.063518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:37.072338 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c4cea2cf-6ca8-449f-ac3c-64ba54a027b5 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.761435 Dec 18 21:00:37.073230 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1960/3939] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:36 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:37.080146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:37.083785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:37.101526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:37.102528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:37.103652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:37.104356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:37.307592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:37.324498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:37.329698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:37.344776 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b0d4fd0-678f-49a1-88b1-db474f850de1 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.270048 Dec 18 21:00:37.356493 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1961/3940] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:37 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:37.358994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:37.361328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:37.370011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:37.370520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:37.372306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:37.373406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:37.894418 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-38769de5-904b-4f43-b217-c4a7e925210d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c/action" status: 202 len: 0 microversion: 2.1 time: 3.673063 Dec 18 21:00:37.895048 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1980/3941] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:34 2021] POST /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c/action => generated 0 bytes in 3675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:37.905158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:37.906889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:37.919071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:37.923024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:37.924035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:37.924497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:38.338793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:38.346992 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-42ed1680-04ae-4a53-a4e0-a0d1fef914cd tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1324 microversion: 2.1 time: 1.000474 Dec 18 21:00:38.363744 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1962/3942] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:37 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1324 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:38.363744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-586fe47f-6f30-46ef-b5bd-b4247f670b7f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e503b80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:38.649639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:38.658500 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fda7f88c-8a5c-4069-b02c-f62917c1b469 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 0.758206 Dec 18 21:00:38.663396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1981/3943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:37 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:38.687938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-98a0b06e-d9d3-420b-b734-498bf890cfe3 req-a40b0090-d37c-4f52-a582-846b3e15e229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fda487-271d-438c-9327-f48f40474e6c", "tag": "c1bac115-de87-4762-9518-c18983081d31"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:38.690055 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:38.690055 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:38.706160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-98a0b06e-d9d3-420b-b734-498bf890cfe3 req-a40b0090-d37c-4f52-a582-846b3e15e229 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:38.710652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-98a0b06e-d9d3-420b-b734-498bf890cfe3 req-a40b0090-d37c-4f52-a582-846b3e15e229 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:38.740631 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-98a0b06e-d9d3-420b-b734-498bf890cfe3 req-a40b0090-d37c-4f52-a582-846b3e15e229 service nova] Creating event network-changed:c1bac115-de87-4762-9518-c18983081d31 for instance d2fda487-271d-438c-9327-f48f40474e6c on nch2-master-1 Dec 18 21:00:38.753210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-98a0b06e-d9d3-420b-b734-498bf890cfe3 req-a40b0090-d37c-4f52-a582-846b3e15e229 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080601 Dec 18 21:00:38.774059 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1982/3944] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:38.781207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:38.781931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:38.801024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:38.801498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:38.802419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:38.802797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.477719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-586fe47f-6f30-46ef-b5bd-b4247f670b7f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 48577c73-82a2-4735-bc37-dd6b3d9d81dc in use.", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:39.480271 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-586fe47f-6f30-46ef-b5bd-b4247f670b7f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security Group 48577c73-82a2-4735-bc37-dd6b3d9d81dc in use. Dec 18 21:00:39.480271 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-546d26ab-d61f-42a5-a43a-7596d5dfcc29'] Dec 18 21:00:39.482764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-586fe47f-6f30-46ef-b5bd-b4247f670b7f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 400 to user: Security Group 48577c73-82a2-4735-bc37-dd6b3d9d81dc in use. Dec 18 21:00:39.482764 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-546d26ab-d61f-42a5-a43a-7596d5dfcc29'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:39.484069 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-586fe47f-6f30-46ef-b5bd-b4247f670b7f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/48577c73-82a2-4735-bc37-dd6b3d9d81dc" status: 400 len: 185 microversion: 2.1 time: 1.127342 Dec 18 21:00:39.486495 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1963/3945] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:38 2021] DELETE /compute/v2.1/os-security-groups/48577c73-82a2-4735-bc37-dd6b3d9d81dc => generated 185 bytes in 1130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:00:39.499611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:39.500955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:39.513866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.515695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.516962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.517583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.519214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:39.536777 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53db5ed5-3613-429e-b59c-a2d14ee81313 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.761145 Dec 18 21:00:39.548545 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1983/3946] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:38 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:39.563355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:39.567061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:39.589151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.589996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.593250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.594142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.664853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:39.677727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:39.679758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:39.681343 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3fb8ccb7-7d02-4e95-a564-925df4e8ea6d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.193430 Dec 18 21:00:39.683815 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1964/3947] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:39 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:39.690329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3dc485e-5286-4a95-a466-bd122ce6cd0c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:39.691930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a3dc485e-5286-4a95-a466-bd122ce6cd0c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:39.702483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3dc485e-5286-4a95-a466-bd122ce6cd0c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.714702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3dc485e-5286-4a95-a466-bd122ce6cd0c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.725213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3dc485e-5286-4a95-a466-bd122ce6cd0c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.726033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3dc485e-5286-4a95-a466-bd122ce6cd0c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.896180 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3dc485e-5286-4a95-a466-bd122ce6cd0c tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c/action" status: 202 len: 0 microversion: 2.1 time: 0.210258 Dec 18 21:00:39.900135 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1965/3948] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:39 2021] POST /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:39.909681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:39.911121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:39.921078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.921854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:39.924113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:39.925841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:40.365677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:40.374129 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72f9b5f3-3a13-4b6e-9759-80f6818478c4 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1324 microversion: 2.1 time: 0.823764 Dec 18 21:00:40.383506 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1984/3949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:39 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1324 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:40.392623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:40.396691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:40.407142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:40.408390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:40.409406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:40.410325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:40.922592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:40.937957 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83d93a95-8f22-4837-ac1a-cb17cf62add8 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 1.036047 Dec 18 21:00:40.941344 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1966/3950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:39 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:40.950216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:40.953166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:40.963029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:40.971693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:40.973358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:40.973944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.255595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:41.262969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60d5246c-7e54-4268-bab7-5672c3c2219b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1571 microversion: 2.1 time: 0.879166 Dec 18 21:00:41.264681 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1985/3951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:40 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1571 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:41.269350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:41.270179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:41.276557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.277194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.278164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.278839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.450529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:41.467107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:41.468851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:41.470282 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a99c8a1c-87c4-49c2-be49-1d061649af23 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.204426 Dec 18 21:00:41.471361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1986/3952] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:41 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:41.485067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f704b9cb-5b8d-4577-b1dc-5eba82abfc96 req-145a2def-b9b3-4f0a-bd5e-91667eaa35dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739aef66-e288-446f-8e66-89bc17a985c5", "tag": "f2b62aae-383e-45ee-bbe4-c5b660bf6e40"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:41.486911 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:41.486911 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:41.502897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f704b9cb-5b8d-4577-b1dc-5eba82abfc96 req-145a2def-b9b3-4f0a-bd5e-91667eaa35dc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.503346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f704b9cb-5b8d-4577-b1dc-5eba82abfc96 req-145a2def-b9b3-4f0a-bd5e-91667eaa35dc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.521004 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f704b9cb-5b8d-4577-b1dc-5eba82abfc96 req-145a2def-b9b3-4f0a-bd5e-91667eaa35dc service nova] Creating event network-changed:f2b62aae-383e-45ee-bbe4-c5b660bf6e40 for instance 739aef66-e288-446f-8e66-89bc17a985c5 on nch2-master-1 Dec 18 21:00:41.531187 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f704b9cb-5b8d-4577-b1dc-5eba82abfc96 req-145a2def-b9b3-4f0a-bd5e-91667eaa35dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048973 Dec 18 21:00:41.534025 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1987/3953] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:41.551645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:41.552571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:41.564083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.564748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.565837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.566705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.697431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:41.705931 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fe9e8334-7f32-4854-b310-2cde0ab8d0af tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.762403 Dec 18 21:00:41.706692 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1967/3954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:40 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:41.742662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0441c6c1-f745-44f9-929e-e6da94bf945d req-2c7e54b5-0780-4a3a-8da8-e4f36b33ea84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770e4df9-f6a3-4355-aaba-dd70810ad41c", "name": "network-vif-plugged", "status": "completed", "tag": "e8d47f63-22de-48b3-bd10-4bb15c953401"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:41.744247 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:41.744247 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:41.757763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0441c6c1-f745-44f9-929e-e6da94bf945d req-2c7e54b5-0780-4a3a-8da8-e4f36b33ea84 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.758215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0441c6c1-f745-44f9-929e-e6da94bf945d req-2c7e54b5-0780-4a3a-8da8-e4f36b33ea84 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.783977 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0441c6c1-f745-44f9-929e-e6da94bf945d req-2c7e54b5-0780-4a3a-8da8-e4f36b33ea84 service nova] Creating event network-vif-plugged:e8d47f63-22de-48b3-bd10-4bb15c953401 for instance 770e4df9-f6a3-4355-aaba-dd70810ad41c on nch2-master-1 Dec 18 21:00:41.790463 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0441c6c1-f745-44f9-929e-e6da94bf945d req-2c7e54b5-0780-4a3a-8da8-e4f36b33ea84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050997 Dec 18 21:00:41.792804 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1968/3955] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:00:41.957787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:41.959406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:41.972928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.974636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:41.977459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:41.977568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:42.076009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:42.084342 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-50a276a6-0444-4c7b-8837-9300fcc07419 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1324 microversion: 2.1 time: 0.546125 Dec 18 21:00:42.092158 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1988/3956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:41 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1324 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:42.255566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:42.266521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-06aa83a9-399c-49de-8758-525e16c37e4d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 0.312873 Dec 18 21:00:42.267400 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1969/3957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:41 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:42.282550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:42.283172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:42.289783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:42.290453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:42.291569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:42.292937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:42.493663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:42.494854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:42.509403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:42.514188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:42.516982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:42.519805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:42.753603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:42.809667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:42.817386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:42.819715 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c77efb7c-c4e0-4b2b-b857-018f13e30615 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.330954 Dec 18 21:00:42.821248 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1970/3958] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:42 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:00:42.841453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:42.842488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:42.850409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:42.851149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:42.852148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:42.854846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:42.983587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:43.001067 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9cdeb1d6-4000-4cd7-8010-ef931656be3d tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1571 microversion: 2.1 time: 0.723551 Dec 18 21:00:43.003462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1989/3959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:42 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1571 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:43.105643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:43.108022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:43.123248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:43.123715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:43.124838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:43.125795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:43.409767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:43.431482 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fb1add6-5c27-4303-bceb-18fd7b29df7f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.608139 Dec 18 21:00:43.440311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1971/3960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:42 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:43.455635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:43.461967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:43.484239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:43.486991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:43.492726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:43.493440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:43.531973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:43.549881 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51450c89-75c8-4d21-b6c1-b037510cac6e tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1324 microversion: 2.1 time: 0.451248 Dec 18 21:00:43.551616 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1990/3961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:43 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:43.704146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:43.712650 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c0dbeab-b80c-4fca-b3df-848c58d94df4 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 0.270886 Dec 18 21:00:43.722868 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1972/3962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:43 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:43.840796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:43.842887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:43.849725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:43.850185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:43.851217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:43.853360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:43.938789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:43.949550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:43.951658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:43.952808 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e3b4c67-fed5-48ed-99a9-8acc689f7147 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.115786 Dec 18 21:00:43.958316 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1991/3963] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:43 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:00:44.021893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:44.022967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:44.030848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.031986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:44.033235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.033841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:44.224932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:44.233554 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-368e77d3-91f3-4474-a5fa-e670ddaad10e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1569 microversion: 2.1 time: 0.216461 Dec 18 21:00:44.234673 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1973/3964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:44 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:44.252730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-664210975"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:44.256571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:44.266907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.267358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:44.268218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.268659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:44.418062 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.network.security_group_api [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Adding security group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 to port c1bac115-de87-4762-9518-c18983081d31 Dec 18 21:00:44.459611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:44.460882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:44.468435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.469095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:44.470061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.470677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:44.735495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:44.764813 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-10382982-9a47-44f0-a690-a0204e811587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.310419 Dec 18 21:00:44.768323 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1974/3965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:44 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:44.780926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:44.782627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:44.812539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.815811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:44.818394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:44.822390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.065051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db8543e5-6def-433d-a276-44dbb606ad43 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c/action" status: 202 len: 0 microversion: 2.1 time: 0.818498 Dec 18 21:00:45.070104 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1992/3966] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:00:44 2021] POST /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:45.071968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:45.073097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:45.082146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.083058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.085047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.085674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.116497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:45.123860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-791dfb63-42b6-420a-a8e6-65ab60d99956 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1521 microversion: 2.1 time: 0.353752 Dec 18 21:00:45.143574 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1975/3967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:44 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:45.151774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:45.152910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:45.160431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.161139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.162292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.162954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.251955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:45.266688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:45.272661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:45.275481 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c1174446-1faa-410e-a64b-800934e09eb0 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.130044 Dec 18 21:00:45.276495 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1976/3968] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:45 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:45.283607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aefbc5b9-67ed-42b0-8633-4b7987230270 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e57daf0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:45.335457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:45.343809 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5b10013-270d-4132-a79e-5506b9f52a3e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 0.275744 Dec 18 21:00:45.345091 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1993/3969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:45 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:45.349878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e248eaf3-1b0b-4d30-b33e-8ff982e4dcae req-f05ba7ed-e1ac-4e16-aff3-eb08fd1db779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fda487-271d-438c-9327-f48f40474e6c", "tag": "c1bac115-de87-4762-9518-c18983081d31"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:45.351643 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:45.351643 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:45.359896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e248eaf3-1b0b-4d30-b33e-8ff982e4dcae req-f05ba7ed-e1ac-4e16-aff3-eb08fd1db779 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.360631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e248eaf3-1b0b-4d30-b33e-8ff982e4dcae req-f05ba7ed-e1ac-4e16-aff3-eb08fd1db779 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.382748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e248eaf3-1b0b-4d30-b33e-8ff982e4dcae req-f05ba7ed-e1ac-4e16-aff3-eb08fd1db779 service nova] Creating event network-changed:c1bac115-de87-4762-9518-c18983081d31 for instance d2fda487-271d-438c-9327-f48f40474e6c on nch2-master-1 Dec 18 21:00:45.392530 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e248eaf3-1b0b-4d30-b33e-8ff982e4dcae req-f05ba7ed-e1ac-4e16-aff3-eb08fd1db779 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046070 Dec 18 21:00:45.393140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1994/3970] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:45.401059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:45.401902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:45.409369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.410004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.411092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.412042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.447942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:45.508297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-aefbc5b9-67ed-42b0-8633-4b7987230270 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 in use.", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:45.509007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-aefbc5b9-67ed-42b0-8633-4b7987230270 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security Group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 in use. Dec 18 21:00:45.509007 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-0d492d2f-3a3e-4f24-87d1-f324423e9e7f'] Dec 18 21:00:45.509778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aefbc5b9-67ed-42b0-8633-4b7987230270 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 400 to user: Security Group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 in use. Dec 18 21:00:45.509778 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-0d492d2f-3a3e-4f24-87d1-f324423e9e7f'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:45.511183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aefbc5b9-67ed-42b0-8633-4b7987230270 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/dd7f6bb4-f9a0-4545-b0e9-aef7094e3573" status: 400 len: 185 microversion: 2.1 time: 0.233323 Dec 18 21:00:45.511867 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1977/3971] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:45 2021] DELETE /compute/v2.1/os-security-groups/dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 => generated 185 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:00:45.525026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:45.525883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:45.535656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.536918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.538749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.539715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.596828 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d6c9aa7-ca5c-42b8-8ba7-4e752de692f1 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 204 len: 0 microversion: 2.1 time: 0.200349 Dec 18 21:00:45.598325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:45.602290 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1995/3972] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:45 2021] DELETE /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:45.616287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:45.630360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:45.641111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.641953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.643527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.651875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.753895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3c5bc23-bdf5-43f7-829c-e6be8eacf876 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 204 len: 0 microversion: 2.1 time: 0.233462 Dec 18 21:00:45.755074 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1978/3973] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:45 2021] DELETE /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:00:45.765385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:45.766502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:45.773187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.773841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.774870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:45.775468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:45.969288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:45.978671 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c18e2602-f4cc-4d9e-b95a-ffbcbb07c162 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1527 microversion: 2.1 time: 0.374686 Dec 18 21:00:45.979502 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1996/3974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:45 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1527 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:46.000191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:46.001013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:46.007580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:46.009496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:46.010591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:46.011300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:46.131466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:46.140713 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-86bf4d16-d309-4da1-b1eb-d4951da3bbfd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1643 microversion: 2.1 time: 0.380926 Dec 18 21:00:46.141619 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1979/3975] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:45 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1643 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:46.146630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c2ee60e3-1c52-4197-b447-4bcaca0dbcb0 req-e4ebb83d-48bc-44f3-b62e-a11ac4adb1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739aef66-e288-446f-8e66-89bc17a985c5", "name": "network-vif-plugged", "status": "completed", "tag": "f2b62aae-383e-45ee-bbe4-c5b660bf6e40"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:46.148571 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:46.148571 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:46.158534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c2ee60e3-1c52-4197-b447-4bcaca0dbcb0 req-e4ebb83d-48bc-44f3-b62e-a11ac4adb1b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:46.159307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c2ee60e3-1c52-4197-b447-4bcaca0dbcb0 req-e4ebb83d-48bc-44f3-b62e-a11ac4adb1b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:46.170811 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c2ee60e3-1c52-4197-b447-4bcaca0dbcb0 req-e4ebb83d-48bc-44f3-b62e-a11ac4adb1b9 service nova] Creating event network-vif-plugged:f2b62aae-383e-45ee-bbe4-c5b660bf6e40 for instance 739aef66-e288-446f-8e66-89bc17a985c5 on nch2-master-1 Dec 18 21:00:46.175762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c2ee60e3-1c52-4197-b447-4bcaca0dbcb0 req-e4ebb83d-48bc-44f3-b62e-a11ac4adb1b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032602 Dec 18 21:00:46.177440 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1980/3976] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:46.309934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:46.309934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:46.317661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:46.318105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:46.319458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:46.320065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:46.552671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:46.581590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:46.583700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:46.585244 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-656ea326-bab0-45e2-b9de-6db32bbff848 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.284209 Dec 18 21:00:46.597816 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1981/3977] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:46 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:46.597816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:46.597816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:46.603762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:46.604379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:46.605497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:46.606050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:46.641250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:46.655214 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40c640f1-6749-41c0-97a9-8aa6ec1f2c1d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.661028 Dec 18 21:00:46.656939 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1997/3978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:45 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:46.848274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:46.856047 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-245cf0c7-cd87-4405-9361-69961b3456be tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 0.265583 Dec 18 21:00:46.856637 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1982/3979] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:46 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:46.996798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:46.998337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:47.005476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.006182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.007074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.007556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.158648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:47.170810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:47.183615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.184692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.186295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.186761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.235867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:47.250751 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a409d361-d92f-4000-842c-241c9a52f365 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1527 microversion: 2.1 time: 0.258245 Dec 18 21:00:47.252981 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1998/3980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:46 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1527 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:47.518085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:47.535717 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f19679ab-091f-4544-be54-5325b13584b3 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1643 microversion: 2.1 time: 0.381289 Dec 18 21:00:47.551166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1983/3981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:47 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1643 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:47.607632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:47.608577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:47.626688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.636004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.637495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.639968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.673850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:47.675626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:47.687392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.687780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.691394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.692270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.808337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:47.821391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:47.823761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:47.825228 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6b3cce3-7c45-4c35-b53e-2eadbd10a1df tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.222966 Dec 18 21:00:47.827492 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 1999/3982] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:47 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:47.875155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:47.876173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:47.884120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.884976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:47.886100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:47.886827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.174584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:48.185371 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a67a2169-5657-4529-b70d-a60974a49646 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.515633 Dec 18 21:00:48.186643 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1984/3983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:47 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:48.272773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:48.273644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:48.282800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:48.283442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.284613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:48.285320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.337968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:48.346312 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ab548c6-1195-4ffc-b457-e4f1d82fe1ec tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1317 microversion: 2.1 time: 0.477016 Dec 18 21:00:48.346903 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2000/3984] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:47 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:48.556727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:48.557268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:48.570888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:48.571698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.572894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:48.573576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.644531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc32317ed5e54f67b8ae64f92419bcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e8efe6135e41a689caf483b2c72af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:48.652245 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-482197c1-b6df-43fe-953a-b07bfe1990ce tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 200 len: 1527 microversion: 2.1 time: 0.385179 Dec 18 21:00:48.657825 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1985/3985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:48 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 1527 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:48.705898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-dadbc9d1-f3d8-432c-9148-c3957add5b3d req-a5904465-f03b-46b1-9ad0-77a062eaaf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770e4df9-f6a3-4355-aaba-dd70810ad41c", "name": "network-vif-deleted", "tag": "e8d47f63-22de-48b3-bd10-4bb15c953401"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:48.708842 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:48.708842 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:48.723353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dadbc9d1-f3d8-432c-9148-c3957add5b3d req-a5904465-f03b-46b1-9ad0-77a062eaaf9d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:48.724082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dadbc9d1-f3d8-432c-9148-c3957add5b3d req-a5904465-f03b-46b1-9ad0-77a062eaaf9d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.758959 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-dadbc9d1-f3d8-432c-9148-c3957add5b3d req-a5904465-f03b-46b1-9ad0-77a062eaaf9d service nova] Creating event network-vif-deleted:e8d47f63-22de-48b3-bd10-4bb15c953401 for instance 770e4df9-f6a3-4355-aaba-dd70810ad41c on nch2-master-1 Dec 18 21:00:48.782920 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-dadbc9d1-f3d8-432c-9148-c3957add5b3d req-a5904465-f03b-46b1-9ad0-77a062eaaf9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081300 Dec 18 21:00:48.783872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1986/3986] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:00:48.846971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:48.847486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:48.858218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:48.858930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.860028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:48.861195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:48.886299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:48.900610 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-91ec6d94-5c5a-49ab-b13c-03df2111345f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 200 len: 1643 microversion: 2.1 time: 0.347542 Dec 18 21:00:48.910999 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2001/3987] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:48 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 1643 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:48.970710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:48.979098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:48.980618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:48.982410 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-833ec44d-420c-4307-9f3b-b0da1fa4582f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.139483 Dec 18 21:00:48.983203 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1987/3988] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:48 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:00:49.206429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.207680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:49.219881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.220738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.222045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.222587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.365806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.367202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:49.376654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.377269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.378582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.379219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.542048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:49.552345 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce931a34-177c-497f-b795-6cfe68edb37b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.353415 Dec 18 21:00:49.552944 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2002/3989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:49 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:49.651069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:49.663092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09859373-35ee-4c35-b294-37bf43a8bdda tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1508 microversion: 2.1 time: 0.302167 Dec 18 21:00:49.664606 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1988/3990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:49 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:49.669897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.670922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: 770e4df9-f6a3-4355-aaba-dd70810ad41c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:49.693964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.695272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.702064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.702811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.734050 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Instance 770e4df9-f6a3-4355-aaba-dd70810ad41c could not be found. Dec 18 21:00:49.734833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Instance 770e4df9-f6a3-4355-aaba-dd70810ad41c could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:49.739109 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-086fd975-049b-4274-a6cd-e840dd5d2dd8 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c" status: 404 len: 111 microversion: 2.1 time: 0.073899 Dec 18 21:00:49.740120 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2003/3991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:49 2021] GET /compute/v2.1/servers/770e4df9-f6a3-4355-aaba-dd70810ad41c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:49.749363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-faa5afee-ebc4-4d62-a50d-35f7c0fa5d9b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '.version_select at 0x7f714e5ffa60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.780885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-faa5afee-ebc4-4d62-a50d-35f7c0fa5d9b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Image not found. Dec 18 21:00:49.781498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-faa5afee-ebc4-4d62-a50d-35f7c0fa5d9b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Image not found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:49.782361 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-faa5afee-ebc4-4d62-a50d-35f7c0fa5d9b tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/images/0205c674-6943-4e95-9e63-c62ddade4a63" status: 404 len: 62 microversion: 2.1 time: 0.038371 Dec 18 21:00:49.783297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1989/3992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:49 2021] DELETE /compute/v2.1/images/0205c674-6943-4e95-9e63-c62ddade4a63 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:00:49.795231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.795857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:49.806229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.806729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.808945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.809558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.838557 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Instance b7b8c792-da21-4d87-9e75-96d0445e8db0 could not be found. Dec 18 21:00:49.839507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Instance b7b8c792-da21-4d87-9e75-96d0445e8db0 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:49.849612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-991e2e7e-2a30-42ed-93e2-3b93f854e481 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 404 len: 111 microversion: 2.1 time: 0.052963 Dec 18 21:00:49.854075 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2004/3993] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:49 2021] DELETE /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:49.862430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.863334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: b7b8c792-da21-4d87-9e75-96d0445e8db0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:49.877552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.879404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.883314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.884036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.904607 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Instance b7b8c792-da21-4d87-9e75-96d0445e8db0 could not be found. Dec 18 21:00:49.905444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Instance b7b8c792-da21-4d87-9e75-96d0445e8db0 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:49.906942 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2453bfc3-85d5-48c6-bbc0-7cad870c3fd3 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0" status: 404 len: 111 microversion: 2.1 time: 0.048055 Dec 18 21:00:49.908045 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1990/3994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:49 2021] GET /compute/v2.1/servers/b7b8c792-da21-4d87-9e75-96d0445e8db0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:49.918830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ffd40c5-3dfa-485b-a4e9-0fbd154e7003 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '.version_select at 0x7f714ee65040>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.927225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:49.933721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:49.949634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.951514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.952934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:49.953663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:49.963738 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8ffd40c5-3dfa-485b-a4e9-0fbd154e7003 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479047281" status: 202 len: 0 microversion: 2.1 time: 0.050333 Dec 18 21:00:49.965046 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2005/3995] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 21:00:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479047281 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:49.984388 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Instance d2fda487-271d-438c-9327-f48f40474e6c could not be found. Dec 18 21:00:49.992686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Instance d2fda487-271d-438c-9327-f48f40474e6c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:49.993990 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62ad8104-96bf-4c68-9d0b-c815cf5c043a tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 404 len: 111 microversion: 2.1 time: 0.075810 Dec 18 21:00:49.995459 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1991/3996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:49 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:50.004387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a3367c1-ca36-4bdf-a24d-9a6e26ccf28e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714eee8670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:50.023979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:50.024595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:50.035908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:50.040219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:50.046600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:50.047156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:50.321026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:50.342377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:50.347071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:50.352155 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-79cd4908-2d68-4b17-b3b4-ac076f34de40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.340302 Dec 18 21:00:50.365434 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1992/3997] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:50 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:50.572348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:50.573290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:50.587812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:50.588956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:50.592074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:50.592737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:50.703314 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a3367c1-ca36-4bdf-a24d-9a6e26ccf28e tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/48577c73-82a2-4735-bc37-dd6b3d9d81dc" status: 202 len: 0 microversion: 2.1 time: 0.702576 Dec 18 21:00:50.704326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2006/3998] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:49 2021] DELETE /compute/v2.1/os-security-groups/48577c73-82a2-4735-bc37-dd6b3d9d81dc => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:50.713309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f27bf69f-7663-4758-9814-463af2656e08 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f715c2fe8b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:50.927787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:50.983147 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ab1286d-9456-4b1d-b878-8476cdb4443a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.416627 Dec 18 21:00:50.987221 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1993/3999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:50 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:00:50.992617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7821fc61-33e1-498d-9abe-50f53463e52c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'create', calling method: .version_select at 0x7f714e5b6a60>, body: {"keypair": {"name": "tempest-keypair-2096132544"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:51.015242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7821fc61-33e1-498d-9abe-50f53463e52c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Getting quotas for project 08fc19b054a54a08aec65b0870725eb8. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:51.020603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7821fc61-33e1-498d-9abe-50f53463e52c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Getting quotas for user e80a2e31964348e7b4abd7c321e713b7 and project 08fc19b054a54a08aec65b0870725eb8. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:51.052573 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f27bf69f-7663-4758-9814-463af2656e08 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/dd7f6bb4-f9a0-4545-b0e9-aef7094e3573" status: 202 len: 0 microversion: 2.1 time: 0.343904 Dec 18 21:00:51.053495 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2007/4000] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:50 2021] DELETE /compute/v2.1/os-security-groups/dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:51.060540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-fc6f4bbe-aaa5-40ae-ba68-b41b9f8d275b req-a464fa9f-d3e2-4059-94b7-c9ec26c3a0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fda487-271d-438c-9327-f48f40474e6c", "name": "network-vif-deleted", "tag": "c1bac115-de87-4762-9518-c18983081d31"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:51.064210 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:51.064210 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:00:51.090275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fc6f4bbe-aaa5-40ae-ba68-b41b9f8d275b req-a464fa9f-d3e2-4059-94b7-c9ec26c3a0ba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.093100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fc6f4bbe-aaa5-40ae-ba68-b41b9f8d275b req-a464fa9f-d3e2-4059-94b7-c9ec26c3a0ba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.117396 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-fc6f4bbe-aaa5-40ae-ba68-b41b9f8d275b req-a464fa9f-d3e2-4059-94b7-c9ec26c3a0ba service nova] Creating event network-vif-deleted:c1bac115-de87-4762-9518-c18983081d31 for instance d2fda487-271d-438c-9327-f48f40474e6c on nch2-master-1 Dec 18 21:00:51.133071 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-fc6f4bbe-aaa5-40ae-ba68-b41b9f8d275b req-a464fa9f-d3e2-4059-94b7-c9ec26c3a0ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077357 Dec 18 21:00:51.134930 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2008/4001] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:51.144496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9bb42e11-4dde-4412-8596-30fc030efc18 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'create', calling method: .version_select at 0x7f714ee65b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-386070356", "description": "tempest-description-1315519067"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:51.395533 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9bb42e11-4dde-4412-8596-30fc030efc18 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.257030 Dec 18 21:00:51.399267 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2009/4002] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:00:51 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:51.412707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-771b4088-ab64-4d8f-ad2d-c4b596d49ade tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6f5fd62-4a46-4649-8474-05602a3eed93"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:51.414570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-771b4088-ab64-4d8f-ad2d-c4b596d49ade tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:51.417511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7821fc61-33e1-498d-9abe-50f53463e52c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Getting quotas for project 08fc19b054a54a08aec65b0870725eb8. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:51.422151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-771b4088-ab64-4d8f-ad2d-c4b596d49ade tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.422782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-771b4088-ab64-4d8f-ad2d-c4b596d49ade tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.423456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7821fc61-33e1-498d-9abe-50f53463e52c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Getting quotas for user e80a2e31964348e7b4abd7c321e713b7 and project 08fc19b054a54a08aec65b0870725eb8. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:51.423983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-771b4088-ab64-4d8f-ad2d-c4b596d49ade tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.424650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-771b4088-ab64-4d8f-ad2d-c4b596d49ade tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.445773 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7821fc61-33e1-498d-9abe-50f53463e52c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.42 time: 0.457047 Dec 18 21:00:51.446558 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1994/4003] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Dec 18 21:00:50 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 458 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:00:51.466856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:51.468240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:51.481268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.481416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.482760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.483213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.605516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:51.628811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:51.631092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:51.632894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67848364-ea5b-4897-863d-9e235693511d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.185150 Dec 18 21:00:51.645813 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1995/4004] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:51 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:51.651205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1e81dde-5307-4670-980d-19fd378697eb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '.version_select at 0x7f714e5b6160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:51.690230 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-a1e81dde-5307-4670-980d-19fd378697eb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Image not found. Dec 18 21:00:51.691571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1e81dde-5307-4670-980d-19fd378697eb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Image not found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:51.692762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1e81dde-5307-4670-980d-19fd378697eb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/images/7dbfd92e-372c-4f86-bb45-439d157609a9" status: 404 len: 62 microversion: 2.1 time: 0.045284 Dec 18 21:00:51.693484 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1996/4005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:51 2021] DELETE /compute/v2.1/images/7dbfd92e-372c-4f86-bb45-439d157609a9 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:00:51.699350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ceba17a-47d8-407c-a0ce-a1b0a7e6a060 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Action: 'update', calling method: .version_select at 0x7f714e5c2c10>, body: {"security_group": {"name": "tempest-sg-hth-1851757567", "description": "tempest-description-hth-879619988"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:51.839712 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-771b4088-ab64-4d8f-ad2d-c4b596d49ade tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "POST /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437154 Dec 18 21:00:51.854628 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2010/4006] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:00:51 2021] POST /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:51.871579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:51.873256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:51.882177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.882696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.883668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.884110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.909380 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Instance d1a95061-f48a-4c6b-b3e7-afabba045761 could not be found. Dec 18 21:00:51.909978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Instance d1a95061-f48a-4c6b-b3e7-afabba045761 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:51.912945 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a746a53-be13-4166-9f75-79cae3794fd9 tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 404 len: 111 microversion: 2.1 time: 0.056697 Dec 18 21:00:51.915605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2011/4007] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:51 2021] DELETE /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:51.928224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:51.931945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] [instance: d1a95061-f48a-4c6b-b3e7-afabba045761] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:51.953855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.954636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.955526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:51.956030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:51.971873 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] HTTP exception thrown: Instance d1a95061-f48a-4c6b-b3e7-afabba045761 could not be found. Dec 18 21:00:51.972643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] Returning 404 to user: Instance d1a95061-f48a-4c6b-b3e7-afabba045761 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:51.973706 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c1b4afb8-397b-4ca2-b15d-07faac404edb tempest-ImagesOneServerNegativeTestJSON-525119256 tempest-ImagesOneServerNegativeTestJSON-525119256-project] 10.222.0.13 "GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761" status: 404 len: 111 microversion: 2.1 time: 0.052318 Dec 18 21:00:51.983517 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ceba17a-47d8-407c-a0ce-a1b0a7e6a060 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/57226a5d-d472-4561-89a2-49e374c1984c" status: 200 len: 217 microversion: 2.1 time: 0.288239 Dec 18 21:00:51.985359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1997/4009] 10.222.0.13 () {60 vars in 1289 bytes} [Sat Dec 18 21:00:51 2021] PUT /compute/v2.1/os-security-groups/57226a5d-d472-4561-89a2-49e374c1984c => generated 217 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:51.986650 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2012/4009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:51 2021] GET /compute/v2.1/servers/d1a95061-f48a-4c6b-b3e7-afabba045761 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:51.996803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-06d50660-24ae-42e3-ac0b-36646034eba8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e515d30>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.007093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.007720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:52.017492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.017961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.022403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.024707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.221098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-06d50660-24ae-42e3-ac0b-36646034eba8 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/57226a5d-d472-4561-89a2-49e374c1984c" status: 200 len: 217 microversion: 2.1 time: 0.229204 Dec 18 21:00:52.222351 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1998/4010] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:00:51 2021] GET /compute/v2.1/os-security-groups/57226a5d-d472-4561-89a2-49e374c1984c => generated 217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:52.234702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2cf6dc80-9fc7-4efe-94b3-0f8dd66cb597 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5c7c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.455682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:52.470183 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5938ffff-8b55-40a6-b218-fda3c34d3bca tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.466683 Dec 18 21:00:52.471874 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2013/4011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:51 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:52.645839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2cf6dc80-9fc7-4efe-94b3-0f8dd66cb597 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/57226a5d-d472-4561-89a2-49e374c1984c" status: 202 len: 0 microversion: 2.1 time: 0.413320 Dec 18 21:00:52.648365 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 1999/4012] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:52 2021] DELETE /compute/v2.1/os-security-groups/57226a5d-d472-4561-89a2-49e374c1984c => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:00:52.654788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.655835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:52.663287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.663861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:52.674288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.675823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.678415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.679450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.681598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.685974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.687418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.687879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.731262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Instance d2fda487-271d-438c-9327-f48f40474e6c could not be found. Dec 18 21:00:52.732880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Instance d2fda487-271d-438c-9327-f48f40474e6c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:52.734166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4732c910-20fa-45cb-b225-5905a7262715 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 404 len: 111 microversion: 2.1 time: 0.078804 Dec 18 21:00:52.739359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2000/4013] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:52 2021] DELETE /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:52.752211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.753985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: d2fda487-271d-438c-9327-f48f40474e6c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:52.762309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.764142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.765560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:52.766399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:52.791292 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Instance d2fda487-271d-438c-9327-f48f40474e6c could not be found. Dec 18 21:00:52.792440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Instance d2fda487-271d-438c-9327-f48f40474e6c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:52.793804 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9793dfd8-c6cd-4078-98ce-121c1b5a0581 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c" status: 404 len: 111 microversion: 2.1 time: 0.052091 Dec 18 21:00:52.798720 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2001/4014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:52 2021] GET /compute/v2.1/servers/d2fda487-271d-438c-9327-f48f40474e6c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:52.803792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f122ff96-885e-45f4-8d20-915fa1aea9a0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5af790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.820922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:52.830224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:52.836438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-f122ff96-885e-45f4-8d20-915fa1aea9a0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:52.837059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-f122ff96-885e-45f4-8d20-915fa1aea9a0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:52.837590 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f122ff96-885e-45f4-8d20-915fa1aea9a0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 does not exist Dec 18 21:00:52.837590 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-519271af-ad4a-4cf1-9065-f5452fe37b23'] Dec 18 21:00:52.838187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f122ff96-885e-45f4-8d20-915fa1aea9a0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 does not exist Dec 18 21:00:52.838187 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-519271af-ad4a-4cf1-9065-f5452fe37b23'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:52.840222 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f122ff96-885e-45f4-8d20-915fa1aea9a0 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/dd7f6bb4-f9a0-4545-b0e9-aef7094e3573" status: 404 len: 194 microversion: 2.1 time: 0.040524 Dec 18 21:00:52.840799 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2002/4015] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:52 2021] DELETE /compute/v2.1/os-security-groups/dd7f6bb4-f9a0-4545-b0e9-aef7094e3573 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:52.843349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:52.847464 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2730c300-e2a6-4723-87cf-424c758f212e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.198754 Dec 18 21:00:52.849954 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2014/4016] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:52 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:52.869963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9c33ea2-9f35-4e2a-8d46-42903a26bd98 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e51b670>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.900190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-d9c33ea2-9f35-4e2a-8d46-42903a26bd98 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48577c73-82a2-4735-bc37-dd6b3d9d81dc does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:52.900797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-d9c33ea2-9f35-4e2a-8d46-42903a26bd98 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group 48577c73-82a2-4735-bc37-dd6b3d9d81dc not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:52.901588 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d9c33ea2-9f35-4e2a-8d46-42903a26bd98 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group 48577c73-82a2-4735-bc37-dd6b3d9d81dc does not exist Dec 18 21:00:52.901588 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-ea809270-1830-4ddb-a7b3-2c5d44e23ed2'] Dec 18 21:00:52.902186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9c33ea2-9f35-4e2a-8d46-42903a26bd98 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group 48577c73-82a2-4735-bc37-dd6b3d9d81dc does not exist Dec 18 21:00:52.902186 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-ea809270-1830-4ddb-a7b3-2c5d44e23ed2'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:52.903726 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9c33ea2-9f35-4e2a-8d46-42903a26bd98 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/48577c73-82a2-4735-bc37-dd6b3d9d81dc" status: 404 len: 194 microversion: 2.1 time: 0.057848 Dec 18 21:00:52.908335 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2003/4017] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:52 2021] DELETE /compute/v2.1/os-security-groups/48577c73-82a2-4735-bc37-dd6b3d9d81dc => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:52.913209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e549b5ae-a2bd-44fc-b1c9-aa6266f2b841 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714ee65790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:52.957714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-e549b5ae-a2bd-44fc-b1c9-aa6266f2b841 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 does not exist", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:52.958498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-e549b5ae-a2bd-44fc-b1c9-aa6266f2b841 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 not found {{(pid=140731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:52.959036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e549b5ae-a2bd-44fc-b1c9-aa6266f2b841 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 does not exist Dec 18 21:00:52.959036 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-9c00511e-c58a-4eb6-812f-1b76c5214980'] Dec 18 21:00:52.959630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e549b5ae-a2bd-44fc-b1c9-aa6266f2b841 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group 64ce66b0-75f7-46c2-bea5-c3ddc8850d03 does not exist Dec 18 21:00:52.959630 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-9c00511e-c58a-4eb6-812f-1b76c5214980'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:52.960861 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e549b5ae-a2bd-44fc-b1c9-aa6266f2b841 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/64ce66b0-75f7-46c2-bea5-c3ddc8850d03" status: 404 len: 194 microversion: 2.1 time: 0.052154 Dec 18 21:00:52.965236 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2015/4018] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:52 2021] DELETE /compute/v2.1/os-security-groups/64ce66b0-75f7-46c2-bea5-c3ddc8850d03 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:00:52.972264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-793363b6-dab4-4b67-a4e2-2038cbb0ac53 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e51bdc0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:53.014639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-793363b6-dab4-4b67-a4e2-2038cbb0ac53 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:53.015465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-793363b6-dab4-4b67-a4e2-2038cbb0ac53 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:53.016050 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-793363b6-dab4-4b67-a4e2-2038cbb0ac53 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 does not exist Dec 18 21:00:53.016050 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-dac542c5-6584-46a7-a819-d1c402ec3ead'] Dec 18 21:00:53.016653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-793363b6-dab4-4b67-a4e2-2038cbb0ac53 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group 3f18a890-12fc-49bb-a36f-325c7109cfc6 does not exist Dec 18 21:00:53.016653 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-dac542c5-6584-46a7-a819-d1c402ec3ead'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:53.018225 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-793363b6-dab4-4b67-a4e2-2038cbb0ac53 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3f18a890-12fc-49bb-a36f-325c7109cfc6" status: 404 len: 194 microversion: 2.1 time: 0.051292 Dec 18 21:00:53.018812 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2004/4019] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:52 2021] DELETE /compute/v2.1/os-security-groups/3f18a890-12fc-49bb-a36f-325c7109cfc6 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:53.034306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4acb7c08-2c5d-4c81-9494-e74b171f8d05 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f71613bdc10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:53.063546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG neutronclient.v2_0.client [None req-4acb7c08-2c5d-4c81-9494-e74b171f8d05 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57759464-1812-4f6a-88d2-0cc1abd10c2e does not exist", "detail": ""}} {{(pid=140731) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:53.064690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-4acb7c08-2c5d-4c81-9494-e74b171f8d05 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group 57759464-1812-4f6a-88d2-0cc1abd10c2e not found {{(pid=140731) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:53.064833 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4acb7c08-2c5d-4c81-9494-e74b171f8d05 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group 57759464-1812-4f6a-88d2-0cc1abd10c2e does not exist Dec 18 21:00:53.064833 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-9d8879a8-f133-4639-951b-56b7b59e548b'] Dec 18 21:00:53.065619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4acb7c08-2c5d-4c81-9494-e74b171f8d05 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group 57759464-1812-4f6a-88d2-0cc1abd10c2e does not exist Dec 18 21:00:53.065619 ncdv-master-1 devstack@n-api.service[140731]: Neutron server returns request_ids: ['req-9d8879a8-f133-4639-951b-56b7b59e548b'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:53.068213 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4acb7c08-2c5d-4c81-9494-e74b171f8d05 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/57759464-1812-4f6a-88d2-0cc1abd10c2e" status: 404 len: 194 microversion: 2.1 time: 0.042419 Dec 18 21:00:53.070098 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2016/4020] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:53 2021] DELETE /compute/v2.1/os-security-groups/57759464-1812-4f6a-88d2-0cc1abd10c2e => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:53.077152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1fe30435-62c7-4c00-a397-8c23cdb46e78 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e5ff9d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:53.126964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG neutronclient.v2_0.client [None req-1fe30435-62c7-4c00-a397-8c23cdb46e78 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 does not exist", "detail": ""}} {{(pid=140732) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 18 21:00:53.127568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.security_group_api [None req-1fe30435-62c7-4c00-a397-8c23cdb46e78 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Neutron security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 not found {{(pid=140732) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 18 21:00:53.128094 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1fe30435-62c7-4c00-a397-8c23cdb46e78 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 does not exist Dec 18 21:00:53.128094 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-24da55ab-2986-4111-8690-7b8795ab2000'] Dec 18 21:00:53.130146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1fe30435-62c7-4c00-a397-8c23cdb46e78 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Security group e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 does not exist Dec 18 21:00:53.130146 ncdv-master-1 devstack@n-api.service[140732]: Neutron server returns request_ids: ['req-24da55ab-2986-4111-8690-7b8795ab2000'] {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:53.131170 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1fe30435-62c7-4c00-a397-8c23cdb46e78 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3" status: 404 len: 194 microversion: 2.1 time: 0.058571 Dec 18 21:00:53.131918 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2005/4021] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:53 2021] DELETE /compute/v2.1/os-security-groups/e7b3e25a-84c1-453c-a7d6-6bcf70947fa3 => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:00:53.140062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:53.140622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:53.160309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.163856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.166666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.168195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.216627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:53.332654 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9714aedc-e760-477d-b7ac-fbe9fb36e3bd tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 204 len: 0 microversion: 2.1 time: 0.196341 Dec 18 21:00:53.342425 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2017/4022] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:53 2021] DELETE /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:53.342671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:53.343304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:53.355426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.355885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.360025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.360121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.489805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:53.490660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:53.498800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.504501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.505563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.506235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.670758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:53.680532 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7bae771c-1dc2-490b-8a7d-3d33a52406d9 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1646 microversion: 2.1 time: 0.341805 Dec 18 21:00:53.682908 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2006/4023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:53 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1646 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:53.790790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:53.803199 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39ee51b2-ac3c-4b36-a0d4-029f8bb376b6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.318576 Dec 18 21:00:53.804932 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2018/4024] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:53 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:53.868762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:53.869569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:53.881588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.882118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.893113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:53.893796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:53.972048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:53.983594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:53.985449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:53.987051 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b434dd4a-58e4-405c-a25a-eed9230c257f tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.123071 Dec 18 21:00:54.002295 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2007/4025] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:53 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:54.694152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-109410979", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "50f70d1e-856f-4dc0-8d15-f219387fa189"}, {"port": "fbcf81f3-8b8e-462f-9434-1aafb30b288a", "tag": "port-1"}, {"port": "f844557f-eb38-48aa-8a3a-a4ec5d372124", "tag": "port-2"}, {"uuid": "e4fbd253-ec67-4760-9f35-d8231c84dace", "tag": "net-1"}, {"uuid": "e4fbd253-ec67-4760-9f35-d8231c84dace"}, {"uuid": "3e4696f9-9ec3-403c-b1d1-c2615c38c344", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3e4696f9-9ec3-403c-b1d1-c2615c38c344", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8f6e05d6-463a-4bb2-82e3-f0b21a816f31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ef3e7ab0-e225-41eb-80c8-31e494531508", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--937779596"}], "key_name": "tempest-keypair-2096132544", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:54.698976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:54.699579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:54.713830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:54.714332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:54.716434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:54.716870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:54.876222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] validate_networks() for [('50f70d1e-856f-4dc0-8d15-f219387fa189', None, None, None, None, None), (None, None, 'fbcf81f3-8b8e-462f-9434-1aafb30b288a', None, None, None), (None, None, 'f844557f-eb38-48aa-8a3a-a4ec5d372124', None, None, None), ('e4fbd253-ec67-4760-9f35-d8231c84dace', None, None, None, None, None), ('e4fbd253-ec67-4760-9f35-d8231c84dace', None, None, None, None, None), ('3e4696f9-9ec3-403c-b1d1-c2615c38c344', '10.2.2.100', None, None, None, None), ('3e4696f9-9ec3-403c-b1d1-c2615c38c344', '10.2.2.200', None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:00:55.023677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca060b0759d4bb687977d2435ce74e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7fb5d0ce9f40d2b55296706489a86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:55.031255 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0fe0aa3e-8e96-4156-98eb-570367c4fc5f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 200 len: 1646 microversion: 2.1 time: 0.335865 Dec 18 21:00:55.031824 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2008/4026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:54 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 1646 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:55.036342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:55.037342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:55.045654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.046102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.047365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.047888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.389188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:55.397153 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a77a9475-e98e-499d-a366-2879116673ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.364169 Dec 18 21:00:55.397725 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2009/4027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:55 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:55.402518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:55.403149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:55.410960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.412311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.413271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.413861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.523267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:55.532469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:55.533984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:55.535260 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec8744c6-b0b0-4d7a-bdc8-90ece73ce19e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1366 microversion: 2.47 time: 0.136370 Dec 18 21:00:55.535892 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2010/4028] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:55 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:55.547750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:55.548510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:55.555661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.556815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.557823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.558688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.646215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lazy-loading 'services' on Instance uuid 739aef66-e288-446f-8e66-89bc17a985c5 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:00:55.852429 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8b3c24f8-156d-4844-ac3d-7459b9c102f0 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments/f6f5fd62-4a46-4649-8474-05602a3eed93" status: 202 len: 0 microversion: 2.1 time: 0.315080 Dec 18 21:00:55.856570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2011/4029] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:00:55 2021] DELETE /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments/f6f5fd62-4a46-4649-8474-05602a3eed93 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:55.860945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7f740345-820d-4575-b2d4-e52e19dd6791 req-a25591e1-4f73-4315-9c6e-143014847137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6330b4d1-f33b-40ed-87d9-4029566f8b51", "name": "network-vif-deleted", "tag": "95468de0-87ec-4e68-8883-879d214ec825"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:55.862634 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:55.862634 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:55.870090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7f740345-820d-4575-b2d4-e52e19dd6791 req-a25591e1-4f73-4315-9c6e-143014847137 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.870622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7f740345-820d-4575-b2d4-e52e19dd6791 req-a25591e1-4f73-4315-9c6e-143014847137 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.886998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7f740345-820d-4575-b2d4-e52e19dd6791 req-a25591e1-4f73-4315-9c6e-143014847137 service nova] Creating event network-vif-deleted:95468de0-87ec-4e68-8883-879d214ec825 for instance 6330b4d1-f33b-40ed-87d9-4029566f8b51 on nch1-master-1 Dec 18 21:00:55.893008 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7f740345-820d-4575-b2d4-e52e19dd6791 req-a25591e1-4f73-4315-9c6e-143014847137 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038136 Dec 18 21:00:55.898187 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2012/4030] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:00:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:55.905087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c2d5fb90-a9e0-464c-ba0a-1a150b73d573 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:55.907326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c2d5fb90-a9e0-464c-ba0a-1a150b73d573 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:55.913841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2d5fb90-a9e0-464c-ba0a-1a150b73d573 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.914513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2d5fb90-a9e0-464c-ba0a-1a150b73d573 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.915481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2d5fb90-a9e0-464c-ba0a-1a150b73d573 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:55.916092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2d5fb90-a9e0-464c-ba0a-1a150b73d573 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:55.967528 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c2d5fb90-a9e0-464c-ba0a-1a150b73d573 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067602 Dec 18 21:00:55.969617 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2013/4031] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:00:55 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:00:56.051062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:56.053496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] [instance: 6330b4d1-f33b-40ed-87d9-4029566f8b51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:56.061260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:56.061723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:56.063613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:56.064375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:56.084707 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] HTTP exception thrown: Instance 6330b4d1-f33b-40ed-87d9-4029566f8b51 could not be found. Dec 18 21:00:56.085433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Returning 404 to user: Instance 6330b4d1-f33b-40ed-87d9-4029566f8b51 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:00:56.086448 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8d74fd43-5d4b-401c-b6c2-1cb848b1b90b tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51" status: 404 len: 111 microversion: 2.1 time: 0.040614 Dec 18 21:00:56.087650 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2014/4032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:56 2021] GET /compute/v2.1/servers/6330b4d1-f33b-40ed-87d9-4029566f8b51 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:00:56.096935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dfa8eada-2acd-448e-8307-bd04010d5e00 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e53e700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:56.454907 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dfa8eada-2acd-448e-8307-bd04010d5e00 tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3b90f329-7660-493e-b8db-5f87c7ac22f4" status: 202 len: 0 microversion: 2.1 time: 0.362062 Dec 18 21:00:56.455831 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2015/4033] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:56 2021] DELETE /compute/v2.1/os-security-groups/3b90f329-7660-493e-b8db-5f87c7ac22f4 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:56.460421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:56.461384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:56.468206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:56.468970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:56.470556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:56.471197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:56.688938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:56.698512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48124c4d-b82e-4c3b-9bbe-14840a765e1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.241210 Dec 18 21:00:56.699554 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2016/4034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:56 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:56.705762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9831492-cd6d-42ff-83e2-8048bde8778f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] Calling method '.version_select at 0x7f714e503700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:57.040982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9831492-cd6d-42ff-83e2-8048bde8778f tempest-SecurityGroupsTestJSON-1987008224 tempest-SecurityGroupsTestJSON-1987008224-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2acbe28c-d33b-484c-ba42-430a5ae43ad6" status: 202 len: 0 microversion: 2.1 time: 0.339780 Dec 18 21:00:57.041591 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2017/4035] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:00:56 2021] DELETE /compute/v2.1/os-security-groups/2acbe28c-d33b-484c-ba42-430a5ae43ad6 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:00:57.184249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1249538343", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "9c8c69eb-3187-4fe6-b473-e011aabfbaf1"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:00:57.243257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] validate_networks() for [('9c8c69eb-3187-4fe6-b473-e011aabfbaf1', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:00:57.852134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:57.853238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:57.854003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:57.854528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:57.855089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:57.864214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:57.864673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:57.865489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:57.865930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:57.885591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Getting quotas for project cd0d854b4dbc4609a90bb655f3adc132. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:57.891926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Getting quotas for user a832b93ee54244f29be05f54f0eae567 and project cd0d854b4dbc4609a90bb655f3adc132. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:57.904951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:57.907644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:57.957987 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d67a4622-471d-4e3b-9aa6-5d8bf16c136f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915371 Dec 18 21:00:57.958689 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2018/4036] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:00:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:00:57.962985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:57.963593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:57.971678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:57.972418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:57.973636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:57.974361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:58.074290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.084903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.086777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.088265 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-db2a6935-2a67-498f-987a-a40383308a4e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1372 microversion: 2.47 time: 0.128661 Dec 18 21:00:58.089853 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2019/4037] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:57 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:58.104740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0bb8aafc-316c-4056-8f14-3a222681d474 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:58.105773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bb8aafc-316c-4056-8f14-3a222681d474 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:58.113543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb8aafc-316c-4056-8f14-3a222681d474 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:58.113999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb8aafc-316c-4056-8f14-3a222681d474 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:58.115282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb8aafc-316c-4056-8f14-3a222681d474 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:58.115678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb8aafc-316c-4056-8f14-3a222681d474 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:58.124682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:00:58.125935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:00:58.127155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:00:58.127897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:00:58.128809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:00:58.142486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:58.142948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:58.143778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:58.144282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:58.153842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0bb8aafc-316c-4056-8f14-3a222681d474 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062270 Dec 18 21:00:58.159247 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2020/4038] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:00:58 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:00:58.166583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:58.167915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:58.176569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:58.177261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:58.178575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:58.179211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:58.184521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Getting quotas for project 08fc19b054a54a08aec65b0870725eb8. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:00:58.191980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Getting quotas for user e80a2e31964348e7b4abd7c321e713b7 and project 08fc19b054a54a08aec65b0870725eb8. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:00:58.394399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.404095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59ef5083-65df-4120-b4db-ae3b88156d45 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.242012 Dec 18 21:00:58.404751 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2021/4039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:58 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:58.416860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9574c66e-2eb3-4feb-8b85-9be497ef7060 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:58.417657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9574c66e-2eb3-4feb-8b85-9be497ef7060 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:58.460940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:00:58.464209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8f6e05d6-463a-4bb2-82e3-f0b21a816f31',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1ea7630c-e820-4aaa-bc7b-d24a0a7e0bab',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef3e7ab0-e225-41eb-80c8-31e494531508',volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:00:58.486392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9574c66e-2eb3-4feb-8b85-9be497ef7060 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.495140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9574c66e-2eb3-4feb-8b85-9be497ef7060 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1225 microversion: 2.1 time: 0.087589 Dec 18 21:00:58.496662 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2022/4040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:58 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:58.868452 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99d3c0ff-0722-4931-8bfe-b2b1e0516107 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.179639 Dec 18 21:00:58.869409 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2019/4041] 10.222.0.13 () {62 vars in 1188 bytes} [Sat Dec 18 21:00:54 2021] POST /compute/v2.1/servers => generated 405 bytes in 4181 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 18 21:00:58.880193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35ee053e-d751-423b-b9f7-38bdaf5f2c6d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:58.880823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35ee053e-d751-423b-b9f7-38bdaf5f2c6d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:58.983983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35ee053e-d751-423b-b9f7-38bdaf5f2c6d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.996142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35ee053e-d751-423b-b9f7-38bdaf5f2c6d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.998289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35ee053e-d751-423b-b9f7-38bdaf5f2c6d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:58.999443 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35ee053e-d751-423b-b9f7-38bdaf5f2c6d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1285 microversion: 2.42 time: 0.123276 Dec 18 21:00:59.000014 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2023/4042] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:58 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:59.108187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:59.108932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:59.115473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.115926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.116903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.117481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.193544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.202952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.204997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.206324 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f37ac244-225b-4b3b-a7c3-986b01b2dc40 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1357 microversion: 2.47 time: 0.102798 Dec 18 21:00:59.220238 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2020/4043] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:00:59 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:59.225405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:59.230541 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:00:59.230541 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:00:59.233359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.234561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Searching by: {'deleted': False, 'project_id': 'f77a53112c4344578a937b3f9396e848'} {{(pid=140732) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 21:00:59.240861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.241397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.242462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.243105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.425794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:59.426803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:59.440843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.441977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.443782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.444353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.683375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.698980 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ffb2ee3-43c7-442a-8ac8-e8a3bf9721c1 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1515 microversion: 2.1 time: 0.278451 Dec 18 21:00:59.709419 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2021/4044] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:59 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:00:59.720878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:59.721393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:59.727726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.multi_cell_list [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 21:00:59.731574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.735279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.742520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.742922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.802786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:00:59.862713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.873488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.873977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.890382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.892977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:00:59.928066 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66422f37-bdee-4e6c-b32b-15ecf8e4acbd tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 204 len: 0 microversion: 2.1 time: 0.222312 Dec 18 21:00:59.931987 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2022/4045] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:00:59 2021] DELETE /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:00:59.937849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:59.938773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:59.940304 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f0a9693-918f-4263-a492-1711524d439d tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.719002 Dec 18 21:00:59.941012 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2024/4046] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Dec 18 21:00:59 2021] GET /compute/v2.1/servers/detail => generated 2707 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:00:59.947703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:00:59.948596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:00:59.954684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.961627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.961627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.961627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.966299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.966978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:00:59.967807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:00:59.968412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.061923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.070759 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45b9cf9d-77db-4fa1-8252-4f2803b15e4f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1283 microversion: 2.1 time: 0.137290 Dec 18 21:01:00.071694 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2023/4047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:59 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:00.077234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:00.077730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:00.084411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.085007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.085803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.086519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.112039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:00.154946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.166688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-627ab831-a0aa-4dcf-a33d-85297d965ee9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1514 microversion: 2.1 time: 0.223613 Dec 18 21:01:00.167823 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2025/4048] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:00:59 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:00.182083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:00.186425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:00.195078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.196062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.197172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.203738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.218390 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1bdc25ff-7d9a-45a1-b7e7-ab4e3a7c906e tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 204 len: 0 microversion: 2.47 time: 0.144266 Dec 18 21:01:00.224109 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2024/4049] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:01:00 2021] DELETE /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:01:00.232618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:00.233332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:00.243093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.243749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.244995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.246210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.297736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.312646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.318613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.320998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97c70f52-077e-481e-8029-16b3a9610698 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1575 microversion: 2.42 time: 0.151900 Dec 18 21:01:00.322731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2026/4050] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:00 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:00.430052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.445129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.446608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:00.447981 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2bca56af-f985-453c-a58d-23d89467b9b4 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1363 microversion: 2.47 time: 0.219445 Dec 18 21:01:00.458569 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2025/4051] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:00 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:00.721566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:00.722469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:00.729700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.730532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:00.732714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:00.733395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.049141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:01.062226 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab9debca-5b13-4df1-a7f5-8f8bafa63e6c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1521 microversion: 2.1 time: 0.348776 Dec 18 21:01:01.065057 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2027/4052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:00 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:01.090319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:01.091765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:01.105331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.105331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.105870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.109771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.184064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:01.184732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:01.192287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.192745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.193547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.193990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.583260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:01.600517 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b36ce3e9-161f-4eef-984d-d30127735014 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1514 microversion: 2.1 time: 0.420081 Dec 18 21:01:01.601311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2028/4053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:01 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:01.610053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:01.627097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:01.646202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.647081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.648126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.648794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.650977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:01.664008 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e2ed9d11-8601-43bf-aff0-0260000be4bb tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.579680 Dec 18 21:01:01.664615 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2026/4054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:01 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:01.669023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:01.669633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:01.685538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.686921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:01.688776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:01.689907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:02.152611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:02.162653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:02.164328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:02.167240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:02.169986 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-586e5c1e-781c-4a85-9702-62a3d1527993 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1593 microversion: 2.42 time: 0.567940 Dec 18 21:01:02.170602 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2029/4055] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:01 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1593 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:02.188463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:02.190004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:02.191499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-765a8a66-53e0-4191-afdc-1ccb8dbf23d7 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 200 len: 1363 microversion: 2.47 time: 0.525692 Dec 18 21:01:02.192075 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2027/4056] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:01 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 1363 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:02.219206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:02.219861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:02.225973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:02.226472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:02.227283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:02.227731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:02.617026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:02.618400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:02.629314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:02.630802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:02.638452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:02.643730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:02.676231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:02.687322 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9a7bb195-1e2c-4029-bb8d-7b427836dfa8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1521 microversion: 2.1 time: 0.482734 Dec 18 21:01:02.695981 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2028/4057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:02 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:02.706644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:02.707520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:02.730954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:02.736270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:02.739233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:02.739895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.335191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:03.343379 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0786ebef-7970-4cab-96d5-0870833573ed tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1514 microversion: 2.1 time: 0.730199 Dec 18 21:01:03.348942 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2030/4058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:02 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1514 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:03.353867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e7e803e5-82b2-4aa6-9271-e307cefed8a0 req-fff6fae7-3af7-4fd0-b55e-27ad2d32cfce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45482c58-7d4f-4437-97c5-4473a966c9be", "tag": "c6be3f74-5eea-4881-81d9-59f8a22e72d5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:03.359915 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:03.359915 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:03.394382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e7e803e5-82b2-4aa6-9271-e307cefed8a0 req-fff6fae7-3af7-4fd0-b55e-27ad2d32cfce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.395180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e7e803e5-82b2-4aa6-9271-e307cefed8a0 req-fff6fae7-3af7-4fd0-b55e-27ad2d32cfce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.429120 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e7e803e5-82b2-4aa6-9271-e307cefed8a0 req-fff6fae7-3af7-4fd0-b55e-27ad2d32cfce service nova] Creating event network-changed:c6be3f74-5eea-4881-81d9-59f8a22e72d5 for instance 45482c58-7d4f-4437-97c5-4473a966c9be on nch1-master-1 Dec 18 21:01:03.437407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e7e803e5-82b2-4aa6-9271-e307cefed8a0 req-fff6fae7-3af7-4fd0-b55e-27ad2d32cfce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086840 Dec 18 21:01:03.438354 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2031/4059] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:03.448133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:03.450069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:03.457184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:03.459965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.461300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.462558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.463396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.466804 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e5d509c-68fd-4318-a690-15b8088a3ab9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.769190 Dec 18 21:01:03.479440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2029/4060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:02 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:03.504266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:03.506816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: a3ad1435-2af2-4304-a343-6763fca22b07] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:03.528170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.535845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.537011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.538971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.577795 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] HTTP exception thrown: Instance a3ad1435-2af2-4304-a343-6763fca22b07 could not be found. Dec 18 21:01:03.581976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Returning 404 to user: Instance a3ad1435-2af2-4304-a343-6763fca22b07 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:03.583692 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a44a7c0-cee3-4899-aa65-2206a6b2e167 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07" status: 404 len: 111 microversion: 2.47 time: 0.103187 Dec 18 21:01:03.591883 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2030/4061] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:03 2021] GET /compute/v2.1/servers/a3ad1435-2af2-4304-a343-6763fca22b07 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:01:03.604227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:03.605017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:03.636801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.637618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.639754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.642202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.686861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:03.864484 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-450fe97e-5612-4b43-8cc0-dcd6464afa39 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a" status: 204 len: 0 microversion: 2.47 time: 0.270929 Dec 18 21:01:03.866770 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2031/4062] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:01:03 2021] DELETE /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:01:03.881699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:03.884640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:03.905911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.907448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.909690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:03.912481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:03.957346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:03.982564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:03.987352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:03.990903 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cb40c11e-35dd-42b4-abc3-43df4051141b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1660 microversion: 2.42 time: 0.548262 Dec 18 21:01:04.002290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2032/4063] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:03 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1660 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:04.005577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f094427a-c43e-4c65-82b7-acc0eccc780f req-23ce4b30-432b-4234-82ce-1166c33c6ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739aef66-e288-446f-8e66-89bc17a985c5", "name": "network-vif-deleted", "tag": "f2b62aae-383e-45ee-bbe4-c5b660bf6e40"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:04.011771 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:04.011771 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:04.027606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f094427a-c43e-4c65-82b7-acc0eccc780f req-23ce4b30-432b-4234-82ce-1166c33c6ccf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.028793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f094427a-c43e-4c65-82b7-acc0eccc780f req-23ce4b30-432b-4234-82ce-1166c33c6ccf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.056402 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f094427a-c43e-4c65-82b7-acc0eccc780f req-23ce4b30-432b-4234-82ce-1166c33c6ccf service nova] Creating event network-vif-deleted:f2b62aae-383e-45ee-bbe4-c5b660bf6e40 for instance 739aef66-e288-446f-8e66-89bc17a985c5 on nch2-master-1 Dec 18 21:01:04.073380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f094427a-c43e-4c65-82b7-acc0eccc780f req-23ce4b30-432b-4234-82ce-1166c33c6ccf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072363 Dec 18 21:01:04.074273 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2033/4064] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:04.081879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:04.083793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:04.098423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.098907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.099762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.101669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.275221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:04.285127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:04.288865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:04.291995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1482ba75-5dca-4558-a5fb-52314279cbcc tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a" status: 200 len: 1363 microversion: 2.47 time: 0.216091 Dec 18 21:01:04.292585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2034/4065] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:04 2021] GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:04.364795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:04.365661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:04.373391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.383676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.388426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.389079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.478062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.479484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.480143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lazy-loading 'fault' on Instance uuid 739aef66-e288-446f-8e66-89bc17a985c5 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:01:04.690027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:04.699202 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aba95b59-3c16-4b1a-8f5c-37178d3bfbe6 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 200 len: 1307 microversion: 2.1 time: 0.338027 Dec 18 21:01:04.700640 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2035/4066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:04 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:04.710495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:04.723178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:04.729179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.729639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.730487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:04.730936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:04.810288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:04.829990 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-033e6904-ba4e-4fc7-9124-afecf0c0d88d tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1521 microversion: 2.1 time: 0.961332 Dec 18 21:01:04.834089 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2032/4067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:03 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1521 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:05.010199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:05.011194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:05.023758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.024381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:05.025315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.025875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:05.307855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:05.321935 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cc1447a7-d737-495d-a4b6-d8292d8bdae7 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.617411 Dec 18 21:01:05.324902 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2036/4068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:04 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:05.336878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:05.341758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:05.353552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.356212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:05.359523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.360866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:05.586188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:05.600311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:05.603334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:05.609626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4df1c6d8-8fe1-4b96-b071-956d1aa93933 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1706 microversion: 2.42 time: 0.603283 Dec 18 21:01:05.629700 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2033/4069] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:05 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1706 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:05.652736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:05.669062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:05.672149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:05.677012 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a685a2c-c1fb-4a04-b735-01eec31e89dd tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a" status: 200 len: 1363 microversion: 2.47 time: 0.350141 Dec 18 21:01:05.681290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2037/4070] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:05 2021] GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:05.720111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:05.721163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 739aef66-e288-446f-8e66-89bc17a985c5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:05.737033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.738044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:05.739560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.741916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:05.798390 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] HTTP exception thrown: Instance 739aef66-e288-446f-8e66-89bc17a985c5 could not be found. Dec 18 21:01:05.799661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Returning 404 to user: Instance 739aef66-e288-446f-8e66-89bc17a985c5 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:05.808256 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d98cccf3-d313-4e81-aaff-382dfe39353c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5" status: 404 len: 111 microversion: 2.1 time: 0.095708 Dec 18 21:01:05.812691 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2034/4071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:05 2021] GET /compute/v2.1/servers/739aef66-e288-446f-8e66-89bc17a985c5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:01:05.853344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:05.854571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:05.874787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.878544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:05.883129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:05.884077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:06.179835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:06.198144 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-372ed6a5-3b3a-4db1-bd40-61a7a75c3208 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1521 microversion: 2.1 time: 0.350891 Dec 18 21:01:06.200672 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2038/4072] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:05 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:06.341130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:06.342053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:06.353390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:06.354191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:06.355614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:06.356434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:06.640543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:06.641638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:06.657274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:06.658013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:06.660629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:06.662696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:06.920658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:06.932084 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0036eee0-9c40-412b-b07d-176875509c73 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.595560 Dec 18 21:01:06.940148 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2035/4073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:06 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:06.954207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:06.957349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:06.982037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:06.983550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:06.990894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:06.992007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.091324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.091851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.092640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lazy-loading 'fault' on Instance uuid 0b891381-d4af-4fda-9ec6-22b0d6bf055a {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:01:07.223751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.251944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.253639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d31494c29fc4f62b4a28f384fc15c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a53112c4344578a937b3f9396e848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.255137 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a4698f29-fbc7-4da0-800f-e75a7674f368 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a" status: 200 len: 1368 microversion: 2.47 time: 0.313736 Dec 18 21:01:07.256245 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2036/4074] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:06 2021] GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:07.261144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:07.261868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:07.268331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.269224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.270208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.270839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.306674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:07.327837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.348188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.355147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.357365 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7d5fe6d0-4ad7-4177-8993-3a0e9e48f1f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1740 microversion: 2.42 time: 0.722504 Dec 18 21:01:07.365864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2039/4075] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:06 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1740 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:07.374743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:07.377410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:07.393981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.396950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.408538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.409215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.477833 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-77b86c71-6e92-4244-8f58-b7f8a5c934bc tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 204 len: 0 microversion: 2.1 time: 0.218783 Dec 18 21:01:07.486053 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2037/4076] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:01:07 2021] DELETE /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:01:07.502627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:07.503705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:07.524792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.525677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.526858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.528521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.841901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.852895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0bd22391-6e32-4e95-bdf7-cba103dd7f59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1521 microversion: 2.1 time: 0.484823 Dec 18 21:01:07.854861 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2040/4077] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:07 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:07.885355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:07.901767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7ec028e-11ef-45f5-b900-caaffc32a2d9 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1514 microversion: 2.1 time: 0.407793 Dec 18 21:01:07.904388 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2038/4078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:07 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1514 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:07.960913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:07.962245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:07.984194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.991473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:07.993621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:07.995710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:08.053551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d8b4755c-bf72-4f3f-b76d-7d8e4838c978 req-6b314684-8ae2-49a9-95c6-2057a528cf76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99065c17-efa8-47de-ad99-b21a3541dc5a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1e3ece-13e6-4590-918b-eb0ad8dcfedf"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:08.055796 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:08.055796 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:08.071816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d8b4755c-bf72-4f3f-b76d-7d8e4838c978 req-6b314684-8ae2-49a9-95c6-2057a528cf76 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:08.073912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d8b4755c-bf72-4f3f-b76d-7d8e4838c978 req-6b314684-8ae2-49a9-95c6-2057a528cf76 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:08.091955 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d8b4755c-bf72-4f3f-b76d-7d8e4838c978 req-6b314684-8ae2-49a9-95c6-2057a528cf76 service nova] Creating event network-vif-plugged:eb1e3ece-13e6-4590-918b-eb0ad8dcfedf for instance 99065c17-efa8-47de-ad99-b21a3541dc5a on nch2-master-1 Dec 18 21:01:08.097593 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d8b4755c-bf72-4f3f-b76d-7d8e4838c978 req-6b314684-8ae2-49a9-95c6-2057a528cf76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048721 Dec 18 21:01:08.098209 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2039/4079] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:01:08.280498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:08.281813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] [instance: 0b891381-d4af-4fda-9ec6-22b0d6bf055a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:08.289223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:08.289688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:08.290550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:08.292203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:08.334887 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] HTTP exception thrown: Instance 0b891381-d4af-4fda-9ec6-22b0d6bf055a could not be found. Dec 18 21:01:08.339016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] Returning 404 to user: Instance 0b891381-d4af-4fda-9ec6-22b0d6bf055a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:08.340288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c489dffc-8ac7-4d5f-b7e1-fb3933e91c06 tempest-ServerShowV247Test-1707110035 tempest-ServerShowV247Test-1707110035-project] 10.222.0.13 "GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a" status: 404 len: 111 microversion: 2.47 time: 0.070581 Dec 18 21:01:08.343383 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2040/4080] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:08 2021] GET /compute/v2.1/servers/0b891381-d4af-4fda-9ec6-22b0d6bf055a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:01:08.388731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:08.389479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:08.406976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:08.407438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:08.408455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:08.408911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:08.820027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:08.829207 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3ca4394-43f7-4819-acf9-ef48610c301f tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.873893 Dec 18 21:01:08.829802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2041/4081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:07 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:09.059153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b0281d9-60a9-4173-94db-1c1e5857d7df tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'create', calling method: .version_select at 0x7f714e503dc0>, body: {"keypair": {"name": "tempest-keypair-845202643"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:09.080154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7b0281d9-60a9-4173-94db-1c1e5857d7df tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Getting quotas for project 6e12ada67cbd430bbf671d34c0cc74f3. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:01:09.091509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7b0281d9-60a9-4173-94db-1c1e5857d7df tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Getting quotas for user 1a062c1000f94164ac8da89a383c22e0 and project 6e12ada67cbd430bbf671d34c0cc74f3. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:01:09.095425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:09.111582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:09.113082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:09.114287 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51a11af2-99f6-453b-9f5c-54357f03f5d6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1740 microversion: 2.42 time: 0.732456 Dec 18 21:01:09.118663 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2041/4082] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:08 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1740 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:09.123294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:09.124043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:09.140872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:09.141339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:09.142379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:09.142825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:09.431319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7b0281d9-60a9-4173-94db-1c1e5857d7df tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Getting quotas for project 6e12ada67cbd430bbf671d34c0cc74f3. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:01:09.437540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7b0281d9-60a9-4173-94db-1c1e5857d7df tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Getting quotas for user 1a062c1000f94164ac8da89a383c22e0 and project 6e12ada67cbd430bbf671d34c0cc74f3. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:01:09.455928 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b0281d9-60a9-4173-94db-1c1e5857d7df tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.623904 Dec 18 21:01:09.457176 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2042/4083] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:01:08 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:09.467304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:09.468189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:09.479675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:09.480634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:09.483179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:09.484186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:09.665604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:09.676424 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e7214e8-d737-4bd5-a81c-3eb305449b82 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1521 microversion: 2.1 time: 0.555583 Dec 18 21:01:09.677828 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2042/4084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:09 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:09.836644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:09.845784 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5b482903-fa94-4943-be83-44896de2791c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1514 microversion: 2.1 time: 0.387217 Dec 18 21:01:09.845942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:09.846484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:09.855460 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2043/4085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:09 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1514 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:09.856095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:09.856805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:09.859706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:09.861921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:10.142526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:10.145081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:10.162890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:10.164304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:10.169803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:10.170967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:10.274013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:10.296957 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-599c53de-6615-49a4-aba3-00a04f37b256 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.454644 Dec 18 21:01:10.310415 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2043/4086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:09 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:10.680807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:10.692214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:10.697426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:10.701076 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d02ea2b7-c193-44d1-befa-c5c284d0061b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1786 microversion: 2.42 time: 0.565963 Dec 18 21:01:10.705691 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2044/4087] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:10 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1786 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:10.710517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:10.714652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:10.727856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:10.730056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:10.733526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:10.736726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:10.764418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1508377394", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": "none"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:10.845027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:01:10.845740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:01:10.846589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:01:10.847084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:01:10.847530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:01:10.861009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:10.861466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:10.862408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:10.863041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:10.891321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Getting quotas for project ac3feffe1ea94b838e64069470ea9862. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:01:10.905882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Getting quotas for user 79d04306b7d24e96bfb99a2707d24695 and project ac3feffe1ea94b838e64069470ea9862. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:01:10.947659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:01:10.961741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:01:11.093426 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3ada4c27-2165-4a12-9146-d319d65f272e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.491224 Dec 18 21:01:11.097266 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2044/4088] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:01:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 21:01:11.109863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-97ebd907-c6a4-4b5d-8182-f5abf45e4a97 req-e2b60e93-83c4-41e8-b310-f0f829d9150a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b133169-7f92-48da-a3a0-5fc9a86455ff", "name": "network-vif-deleted", "tag": "d926283b-c07a-4bd8-97f5-e45248571489"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:11.111942 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:11.111942 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:11.134080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-97ebd907-c6a4-4b5d-8182-f5abf45e4a97 req-e2b60e93-83c4-41e8-b310-f0f829d9150a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.137723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-97ebd907-c6a4-4b5d-8182-f5abf45e4a97 req-e2b60e93-83c4-41e8-b310-f0f829d9150a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.165817 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-97ebd907-c6a4-4b5d-8182-f5abf45e4a97 req-e2b60e93-83c4-41e8-b310-f0f829d9150a service nova] Creating event network-vif-deleted:d926283b-c07a-4bd8-97f5-e45248571489 for instance 5b133169-7f92-48da-a3a0-5fc9a86455ff on nch1-master-1 Dec 18 21:01:11.179571 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-97ebd907-c6a4-4b5d-8182-f5abf45e4a97 req-e2b60e93-83c4-41e8-b310-f0f829d9150a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079311 Dec 18 21:01:11.180539 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2045/4089] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:11.192724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:11.193463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:11.211533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.211990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.212795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.213235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.226866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:11.240159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6905d2e5-4e3b-4944-b54f-0e709d2778e3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1506 microversion: 2.1 time: 0.532926 Dec 18 21:01:11.251377 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2045/4090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:10 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:11.251377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac99b876-4a8b-47eb-b61c-ea05760b44e7 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:11.252422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac99b876-4a8b-47eb-b61c-ea05760b44e7 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:11.322563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.323102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.323478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lazy-loading 'fault' on Instance uuid 5b133169-7f92-48da-a3a0-5fc9a86455ff {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:01:11.418946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac99b876-4a8b-47eb-b61c-ea05760b44e7 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:11.435979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:11.439834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac99b876-4a8b-47eb-b61c-ea05760b44e7 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:11.441793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac99b876-4a8b-47eb-b61c-ea05760b44e7 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:11.446509 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaeadb28-cd34-4e8c-9a24-db7cdff2b015 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 200 len: 1307 microversion: 2.1 time: 0.264711 Dec 18 21:01:11.447113 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2046/4091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:11 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:11.457834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac99b876-4a8b-47eb-b61c-ea05760b44e7 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1278 microversion: 2.57 time: 0.215531 Dec 18 21:01:11.458738 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2046/4092] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:11 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:11.465729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:11.466677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:11.477287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:11.477566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.478212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.478483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:11.479420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.480323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.495529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.497501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.499195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.503596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.868973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:11.878784 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45123ea0-cbd3-4238-8579-43a23a75cc2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 200 len: 1506 microversion: 2.1 time: 0.423007 Dec 18 21:01:11.879828 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2047/4093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:11 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:11.894601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:11.895688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:11.904852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.905731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:11.907795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:11.908718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.028518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:12.037645 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d4035806-2346-4355-943a-6b2549d39949 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.577642 Dec 18 21:01:12.038223 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2047/4094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:11 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:12.044122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:12.046120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:12.053619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.054418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.055443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.056576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.115397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:12.284577 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-586aec9a-aaac-4e4c-b9dd-b8d7f87e1c68 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 204 len: 0 microversion: 2.1 time: 0.243558 Dec 18 21:01:12.289334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2048/4095] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:01:12 2021] DELETE /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:01:12.335495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6d43c97b-6d41-43a4-92b4-13fc6dde30a0 req-087e8ac6-6424-4884-b23d-0b722b1ed39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45482c58-7d4f-4437-97c5-4473a966c9be", "name": "network-vif-plugged", "status": "completed", "tag": "c6be3f74-5eea-4881-81d9-59f8a22e72d5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:12.341300 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:12.341300 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:12.367556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6d43c97b-6d41-43a4-92b4-13fc6dde30a0 req-087e8ac6-6424-4884-b23d-0b722b1ed39d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.368051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6d43c97b-6d41-43a4-92b4-13fc6dde30a0 req-087e8ac6-6424-4884-b23d-0b722b1ed39d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.412925 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6d43c97b-6d41-43a4-92b4-13fc6dde30a0 req-087e8ac6-6424-4884-b23d-0b722b1ed39d service nova] Creating event network-vif-plugged:c6be3f74-5eea-4881-81d9-59f8a22e72d5 for instance 45482c58-7d4f-4437-97c5-4473a966c9be on nch1-master-1 Dec 18 21:01:12.431079 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6d43c97b-6d41-43a4-92b4-13fc6dde30a0 req-087e8ac6-6424-4884-b23d-0b722b1ed39d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122418 Dec 18 21:01:12.432157 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2049/4096] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:12.469418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:12.470236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 5b133169-7f92-48da-a3a0-5fc9a86455ff] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:12.491198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.494892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.495780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.496241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.566655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:12.581753 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] HTTP exception thrown: Instance 5b133169-7f92-48da-a3a0-5fc9a86455ff could not be found. Dec 18 21:01:12.582435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Returning 404 to user: Instance 5b133169-7f92-48da-a3a0-5fc9a86455ff could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:12.583688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a6fa675-d767-4107-9c2b-bbfb2645eb52 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff" status: 404 len: 111 microversion: 2.1 time: 0.123082 Dec 18 21:01:12.583900 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2050/4097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:12 2021] GET /compute/v2.1/servers/5b133169-7f92-48da-a3a0-5fc9a86455ff => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:01:12.593405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:12.598114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:12.600924 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-607c3b90-3905-4e64-84e2-ed30ce4e4288 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1832 microversion: 2.42 time: 0.719416 Dec 18 21:01:12.609832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:12.610983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:12.611419 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2048/4098] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:11 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1832 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:12.625303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-515306012", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "d6e4e95e-eb3d-4204-ba23-6134021d7916"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:12.634026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.634026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.643805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.644564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.773846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] validate_networks() for [('d6e4e95e-eb3d-4204-ba23-6134021d7916', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:01:12.841361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:12.856920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:12.859435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:12.861463 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c755cac-9003-43e3-89ec-adb647a2f997 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1348 microversion: 2.57 time: 0.276423 Dec 18 21:01:12.862342 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2051/4099] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:12 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1348 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:12.867869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:12.868579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:12.877237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.878284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.879321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:12.880107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:12.912220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:13.029918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-93d5ae38-ccbb-433b-8c99-4d807d1a4fde tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 204 len: 0 microversion: 2.1 time: 0.164798 Dec 18 21:01:13.031165 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2052/4100] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:01:12 2021] DELETE /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:01:13.041373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:13.042124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:13.048687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:13.049138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:13.050658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:13.051783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:13.450421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:13.458309 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81477663-0863-4146-b930-63faf915768b tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1514 microversion: 2.1 time: 0.421951 Dec 18 21:01:13.458892 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2053/4101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:13 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1514 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:13.466122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:13.466122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:13.475912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:13.476367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:13.477193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:13.477631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.330981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:14.338382 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-239087f7-50ee-4dc7-bbb9-858abdfbc503 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1325 microversion: 2.1 time: 0.878485 Dec 18 21:01:14.339085 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2054/4102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:13 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1325 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:14.351105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:14.351719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:14.357459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.357913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.358734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.359177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.373719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:01:14.374993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:01:14.375646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:01:14.376063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:01:14.376617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:01:14.387056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.388130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.389088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.390020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.409647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Getting quotas for project 653558ed3d3248ea8f07a3066b6c3d88. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:01:14.414657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Getting quotas for user 54121b5d80d64c4796889183c5197853 and project 653558ed3d3248ea8f07a3066b6c3d88. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:01:14.427258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:01:14.429661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:01:14.476229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51907281-1da2-4ae2-947c-f1a7c77aad06 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862720 Dec 18 21:01:14.476920 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2049/4103] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:01:14.482621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:14.492112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:14.516838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.521189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.522357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.524347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.672633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:14.683505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:14.685862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:14.687284 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81882bfb-8ab1-479a-b781-7e02fe2bc935 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1336 microversion: 2.57 time: 0.209377 Dec 18 21:01:14.699640 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2050/4104] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:14 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1336 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:14.706104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-298a943f-6b5b-4219-8cf2-e3bfe06a0ed4 req-0b055674-2c82-4714-b125-e655e07124b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "f1860d8e-c101-497b-93b4-18753b0bd5c6"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:14.708062 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:14.708062 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:14.722820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-298a943f-6b5b-4219-8cf2-e3bfe06a0ed4 req-0b055674-2c82-4714-b125-e655e07124b6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.723502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-298a943f-6b5b-4219-8cf2-e3bfe06a0ed4 req-0b055674-2c82-4714-b125-e655e07124b6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.736619 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-298a943f-6b5b-4219-8cf2-e3bfe06a0ed4 req-0b055674-2c82-4714-b125-e655e07124b6 service nova] Creating event network-changed:f1860d8e-c101-497b-93b4-18753b0bd5c6 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:14.746367 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-298a943f-6b5b-4219-8cf2-e3bfe06a0ed4 req-0b055674-2c82-4714-b125-e655e07124b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045254 Dec 18 21:01:14.759406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2051/4105] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:14.773968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:14.774771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:14.784257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.784811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:14.786332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:14.786882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:15.050475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:15.062279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:15.064051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:15.065412 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e9eaa33-6efe-4cee-814f-91610df938ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1832 microversion: 2.42 time: 0.725178 Dec 18 21:01:15.066781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2055/4106] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:14 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1832 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:15.071779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:15.072574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:15.079004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:15.079648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:15.080611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:15.081360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:15.248133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:15.256945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-989c47c0-4899-4119-95ca-4351225d84e6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1213 microversion: 2.1 time: 0.188881 Dec 18 21:01:15.263408 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2056/4107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:15 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:15.273268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "01d15494-60fe-499f-88a9-138ebcf661b7"}], "security_groups": [{"name": "tempest-securitygroup--437523205"}], "key_name": "tempest-keypair-845202643", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:15.311442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:15.321630 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-30766f95-2b0e-4c4e-8deb-7633455d940e tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 200 len: 1514 microversion: 2.1 time: 0.559767 Dec 18 21:01:15.325667 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2052/4108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:14 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 1514 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:15.362697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:15.364556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:15.383419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:15.391041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:15.392981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:15.394161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:15.555196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] validate_networks() for [('01d15494-60fe-499f-88a9-138ebcf661b7', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:01:15.929418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:15.946948 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82aefb67-6435-43d8-8095-73e00f500372 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1521 microversion: 2.1 time: 0.586135 Dec 18 21:01:15.947645 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2053/4109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:15 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:15.952947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:15.953567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:15.971367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:15.971822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:15.972817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:15.973441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.055256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:16.066424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:16.068488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:16.069969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e1c66185-2b58-4709-949b-7ba6f6d63d76 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1357 microversion: 2.57 time: 0.121141 Dec 18 21:01:16.070744 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2054/4110] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:15 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1357 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:16.086374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-032b76a0-8df9-49bb-8306-42124f4b7098 req-847dfdeb-4e87-4dc9-b7cc-86c28b57b76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d17b336-2d79-4cfe-a5ef-fa648eec0574", "name": "network-vif-deleted", "tag": "df772871-7061-43d6-b5d3-522b6ef7eef9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:16.088101 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:16.088101 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:16.097833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-032b76a0-8df9-49bb-8306-42124f4b7098 req-847dfdeb-4e87-4dc9-b7cc-86c28b57b76c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:16.098208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-032b76a0-8df9-49bb-8306-42124f4b7098 req-847dfdeb-4e87-4dc9-b7cc-86c28b57b76c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.110587 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-032b76a0-8df9-49bb-8306-42124f4b7098 req-847dfdeb-4e87-4dc9-b7cc-86c28b57b76c service nova] Creating event network-vif-deleted:df772871-7061-43d6-b5d3-522b6ef7eef9 for instance 7d17b336-2d79-4cfe-a5ef-fa648eec0574 on nch1-master-1 Dec 18 21:01:16.115680 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-032b76a0-8df9-49bb-8306-42124f4b7098 req-847dfdeb-4e87-4dc9-b7cc-86c28b57b76c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043530 Dec 18 21:01:16.116678 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2055/4111] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:16.122503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:16.123113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:16.129154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:16.129599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.130733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:16.131155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.160244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] HTTP exception thrown: Action 999 not found Dec 18 21:01:16.160833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Returning 404 to user: Action 999 not found {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:16.161863 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6970ed7-ed84-4628-ac41-80fc10bab0b1 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.044132 Dec 18 21:01:16.162608 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2056/4112] 10.222.0.13 () {58 vars in 1307 bytes} [Sat Dec 18 21:01:16 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be/os-instance-actions/999 => generated 66 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:01:16.167308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:16.168116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:16.174567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:16.175006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.175804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:16.176243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.929293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:01:16.929770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:01:16.930244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:01:16.930836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:01:16.931294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:01:16.942216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:16.943039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.944404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:16.945109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:16.966416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:16.966947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Getting quotas for project 6e12ada67cbd430bbf671d34c0cc74f3. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:01:16.972622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Getting quotas for user 1a062c1000f94164ac8da89a383c22e0 and project 6e12ada67cbd430bbf671d34c0cc74f3. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:01:16.993244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:16.993725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:01:16.997546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:01:16.998108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:17.001894 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a69aeee-e364-4359-ad4d-91b67b5d2dd2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1853 microversion: 2.42 time: 0.835545 Dec 18 21:01:17.003790 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2057/4113] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:16 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1853 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:17.021788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:17.024645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.032604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.033428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.034806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.035463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.067834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bae6ad5c-200a-4623-862d-b72860f31a61 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.802453 Dec 18 21:01:17.073557 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2057/4114] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:15 2021] POST /compute/v2.1/servers => generated 408 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:01:17.080494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48e66ae6-ab08-4cd5-a826-e75a7e8428e4 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '.version_select at 0x7f714e5d5820>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:17.081251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48e66ae6-ab08-4cd5-a826-e75a7e8428e4 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 5586dfed-36c1-4cff-a87b-92adf56dccc4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.088803 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-48e66ae6-ab08-4cd5-a826-e75a7e8428e4 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] HTTP exception thrown: Instance 5586dfed-36c1-4cff-a87b-92adf56dccc4 could not be found. Dec 18 21:01:17.089577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48e66ae6-ab08-4cd5-a826-e75a7e8428e4 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Returning 404 to user: Instance 5586dfed-36c1-4cff-a87b-92adf56dccc4 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:17.091882 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48e66ae6-ab08-4cd5-a826-e75a7e8428e4 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/5586dfed-36c1-4cff-a87b-92adf56dccc4/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.016475 Dec 18 21:01:17.092731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2058/4115] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Dec 18 21:01:17 2021] GET /compute/v2.1/servers/5586dfed-36c1-4cff-a87b-92adf56dccc4/os-instance-actions => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:01:17.100781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:17.101677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.109564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.110274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.111468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.112155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.178834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:01:17.181583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:01:17.181583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:01:17.181583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:01:17.181583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:01:17.350708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.370349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.370787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.373691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.374167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.466525 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b94de6ea-1a85-44e2-ae10-76918eedee05 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "POST /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03/action" status: 202 len: 1138 microversion: 2.57 time: 0.449466 Dec 18 21:01:17.467351 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2058/4116] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Dec 18 21:01:17 2021] POST /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03/action => generated 1138 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Dec 18 21:01:17.473477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:17.474166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: 7d17b336-2d79-4cfe-a5ef-fa648eec0574] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.500280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.502790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.504626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.505084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.541289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] HTTP exception thrown: Instance 7d17b336-2d79-4cfe-a5ef-fa648eec0574 could not be found. Dec 18 21:01:17.541903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Returning 404 to user: Instance 7d17b336-2d79-4cfe-a5ef-fa648eec0574 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:17.542803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2f80fd54-e551-4fe5-a971-bbd040391e03 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574" status: 404 len: 111 microversion: 2.1 time: 0.074027 Dec 18 21:01:17.546556 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2059/4117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:17 2021] GET /compute/v2.1/servers/7d17b336-2d79-4cfe-a5ef-fa648eec0574 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:01:17.560473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a26ed2ea-938d-45cb-bd93-a5e2fc7de7f3 req-1437c71c-9c4f-4d9d-aea6-09c8eea32f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99065c17-efa8-47de-ad99-b21a3541dc5a", "name": "network-vif-deleted", "tag": "eb1e3ece-13e6-4590-918b-eb0ad8dcfedf"}, {"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "fbcf81f3-8b8e-462f-9434-1aafb30b288a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:17.563464 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:17.563464 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:17.583674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a26ed2ea-938d-45cb-bd93-a5e2fc7de7f3 req-1437c71c-9c4f-4d9d-aea6-09c8eea32f27 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.584273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a26ed2ea-938d-45cb-bd93-a5e2fc7de7f3 req-1437c71c-9c4f-4d9d-aea6-09c8eea32f27 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.605289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a26ed2ea-938d-45cb-bd93-a5e2fc7de7f3 req-1437c71c-9c4f-4d9d-aea6-09c8eea32f27 service nova] Creating event network-vif-deleted:eb1e3ece-13e6-4590-918b-eb0ad8dcfedf for instance 99065c17-efa8-47de-ad99-b21a3541dc5a on nch2-master-1 Dec 18 21:01:17.625383 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a26ed2ea-938d-45cb-bd93-a5e2fc7de7f3 req-1437c71c-9c4f-4d9d-aea6-09c8eea32f27 service nova] Creating event network-changed:fbcf81f3-8b8e-462f-9434-1aafb30b288a for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:17.631717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:17.638724 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a26ed2ea-938d-45cb-bd93-a5e2fc7de7f3 req-1437c71c-9c4f-4d9d-aea6-09c8eea32f27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.090888 Dec 18 21:01:17.641801 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2060/4118] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:17 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:17.644610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ada4d35-8b3f-4700-9ef7-d378e1c965e7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1317 microversion: 2.1 time: 0.550472 Dec 18 21:01:17.645407 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2059/4119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:17 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:17.654475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d86914c-156c-4334-9226-4ed40bf09eef tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:17.655206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d86914c-156c-4334-9226-4ed40bf09eef tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.670274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:17.670787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.688204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.690236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.691947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.692399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.769290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:17.926623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5d86914c-156c-4334-9226-4ed40bf09eef tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:17.945434 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-717b49e5-a2aa-479d-9b28-837f98ae65c8 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "DELETE /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 204 len: 0 microversion: 2.1 time: 0.286432 Dec 18 21:01:17.946189 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2060/4120] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:01:17 2021] DELETE /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:01:17.955353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:17.956299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:17.961910 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d86914c-156c-4334-9226-4ed40bf09eef tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1225 microversion: 2.1 time: 0.316352 Dec 18 21:01:17.966022 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2061/4121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:17 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1225 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:17.981380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.981838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.982967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:17.983704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:17.987892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:17.995466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:18.028784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.030970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.033094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.039432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.196043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:18.208650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:18.210551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:18.211800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11938aa0-2607-46c9-a284-d313bf68bb4e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.264340 Dec 18 21:01:18.215008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2061/4122] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:17 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:18.218954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:18.219575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:18.226495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.226960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.227862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.228311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.638353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:18.646174 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f03cc239-2bea-4b90-bd18-13873cf578e9 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1527 microversion: 2.1 time: 0.677880 Dec 18 21:01:18.647390 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2062/4123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:17 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1527 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:18.652336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-677654e7-f3a3-491d-a930-c7912f7c7691 req-467f45ad-20f8-4f55-9daf-1d2198bbf1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c88a02-9467-48b3-a95a-92083533337d", "tag": "5c24945b-9a10-472d-b86a-c65638bdf782"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:18.654698 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:18.654698 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:18.662243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-677654e7-f3a3-491d-a930-c7912f7c7691 req-467f45ad-20f8-4f55-9daf-1d2198bbf1ec service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.663216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-677654e7-f3a3-491d-a930-c7912f7c7691 req-467f45ad-20f8-4f55-9daf-1d2198bbf1ec service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.683098 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-677654e7-f3a3-491d-a930-c7912f7c7691 req-467f45ad-20f8-4f55-9daf-1d2198bbf1ec service nova] Creating event network-changed:5c24945b-9a10-472d-b86a-c65638bdf782 for instance 42c88a02-9467-48b3-a95a-92083533337d on nch2-master-1 Dec 18 21:01:18.689090 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-677654e7-f3a3-491d-a930-c7912f7c7691 req-467f45ad-20f8-4f55-9daf-1d2198bbf1ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040055 Dec 18 21:01:18.690605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2063/4124] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:18.695711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:18.696417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:18.703512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.703968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.705006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.705456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.771260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:18.791102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:18.792982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:18.794237 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d7821da-887e-45ea-afa3-2ae64d4f13f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.580945 Dec 18 21:01:18.805469 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2062/4125] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:18 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:18.904877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:18.905753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:18.913163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.913629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.914468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:18.914914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:18.941845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:19.033769 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b21ef682-745c-4d15-a332-a2427f34cb85 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 204 len: 0 microversion: 2.1 time: 0.134612 Dec 18 21:01:19.038866 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2063/4126] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:01:18 2021] DELETE /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:01:19.047466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:19.048200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:19.057477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.057686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.059664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.060320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.071619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:19.082884 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ef61afb-34ef-44f8-9605-6fd06d556ed7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1317 microversion: 2.1 time: 0.391186 Dec 18 21:01:19.084249 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2064/4127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:18 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:19.090320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:19.091252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:19.098478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.099289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.100351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.101010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.220575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:19.236302 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc75259e-96f8-4056-adf9-1aa46d8a112d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1283 microversion: 2.1 time: 0.197901 Dec 18 21:01:19.243258 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2064/4128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:19 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1283 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:19.248324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:19.249172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:19.256686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.257146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.258404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.258853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.374565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:19.386513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:19.388976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:19.391233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5015e96c-a822-4fd5-851b-aebde1698c04 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.146799 Dec 18 21:01:19.402140 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2065/4129] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:19 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:19.584123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:19.594575 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-241fbcd5-8a53-4ac5-b491-8e628c2c0d5d tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1514 microversion: 2.1 time: 0.508905 Dec 18 21:01:19.595867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2065/4130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:19 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1514 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:19.665345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:19.666146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:19.674018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-47be583f-6b4d-4669-90db-d3b1c24bf0b1 req-ff5acf55-6a6c-4f39-b002-995110839798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "f844557f-eb38-48aa-8a3a-a4ec5d372124"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:19.675829 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:19.675829 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:19.695727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-47be583f-6b4d-4669-90db-d3b1c24bf0b1 req-ff5acf55-6a6c-4f39-b002-995110839798 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.697294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-47be583f-6b4d-4669-90db-d3b1c24bf0b1 req-ff5acf55-6a6c-4f39-b002-995110839798 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.716167 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-47be583f-6b4d-4669-90db-d3b1c24bf0b1 req-ff5acf55-6a6c-4f39-b002-995110839798 service nova] Creating event network-changed:f844557f-eb38-48aa-8a3a-a4ec5d372124 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:19.724142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.724621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.725462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.729744 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-47be583f-6b4d-4669-90db-d3b1c24bf0b1 req-ff5acf55-6a6c-4f39-b002-995110839798 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059282 Dec 18 21:01:19.731516 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2066/4131] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:19.734314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.822026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:19.823734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:19.831829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.832647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:19.833838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:19.835054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:20.264690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832b93ee54244f29be05f54f0eae567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0d854b4dbc4609a90bb655f3adc132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:20.277300 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d3d3de0-bfac-46a4-9a84-fcacadecc7d5 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 200 len: 1527 microversion: 2.1 time: 0.616155 Dec 18 21:01:20.290589 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2066/4132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:19 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 1527 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:20.295747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:20.296682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:20.303277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:20.304051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:20.305098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:20.305770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:20.906484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:20.920876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:20.923232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:20.924970 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a1beb2a6-6288-453d-a3d5-0544a1c5c783 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 1.114775 Dec 18 21:01:20.939542 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2067/4133] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:19 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:20.944846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:20.946592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:20.953393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:20.954072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:20.955145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:20.955745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.119812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:21.128918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fdb5587c-f4d4-4432-b3bb-10134af53727 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1317 microversion: 2.1 time: 0.836771 Dec 18 21:01:21.130018 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2067/4134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:20 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:21.136227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:21.137065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:21.144392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.145061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.146009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.146752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.241543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:21.250618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:21.252460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:21.253647 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f54861f0-841c-4051-aec2-bc45d0176652 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.122426 Dec 18 21:01:21.254214 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2068/4135] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:21 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:21.259562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:21.260363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:21.269113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.269742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.270445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.270871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.461532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:21.469927 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3f5c1c2-50e3-4c27-bc97-7eb53f4e8bd0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1350 microversion: 2.1 time: 0.529060 Dec 18 21:01:21.479484 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2068/4136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:20 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1350 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:21.484392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-45fc4f56-b325-4890-8c7c-a357a6a0b0ca req-a1653ca3-618b-480c-8269-55554c76feee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45482c58-7d4f-4437-97c5-4473a966c9be", "name": "network-vif-deleted", "tag": "c6be3f74-5eea-4881-81d9-59f8a22e72d5"}, {"name": "network-changed", "server_uuid": "e7b77426-cb1b-4748-b580-a4f86c940694", "tag": "f65f78c9-150a-4ed2-95a6-dd167edea818"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:21.486840 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:21.486840 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:21.495929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-45fc4f56-b325-4890-8c7c-a357a6a0b0ca req-a1653ca3-618b-480c-8269-55554c76feee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.496327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-45fc4f56-b325-4890-8c7c-a357a6a0b0ca req-a1653ca3-618b-480c-8269-55554c76feee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.510752 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-45fc4f56-b325-4890-8c7c-a357a6a0b0ca req-a1653ca3-618b-480c-8269-55554c76feee service nova] Creating event network-vif-deleted:c6be3f74-5eea-4881-81d9-59f8a22e72d5 for instance 45482c58-7d4f-4437-97c5-4473a966c9be on nch1-master-1 Dec 18 21:01:21.511408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-45fc4f56-b325-4890-8c7c-a357a6a0b0ca req-a1653ca3-618b-480c-8269-55554c76feee service nova] Creating event network-changed:f65f78c9-150a-4ed2-95a6-dd167edea818 for instance e7b77426-cb1b-4748-b580-a4f86c940694 on nch2-master-1 Dec 18 21:01:21.520850 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-45fc4f56-b325-4890-8c7c-a357a6a0b0ca req-a1653ca3-618b-480c-8269-55554c76feee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040174 Dec 18 21:01:21.522452 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2069/4137] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:21 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:21.528283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:21.529001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] [instance: 45482c58-7d4f-4437-97c5-4473a966c9be] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:21.536779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.537472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.538480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.539091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.557978 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] HTTP exception thrown: Instance 45482c58-7d4f-4437-97c5-4473a966c9be could not be found. Dec 18 21:01:21.558866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] Returning 404 to user: Instance 45482c58-7d4f-4437-97c5-4473a966c9be could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:21.569204 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed55ab28-b957-4366-b322-15fd2099c717 tempest-InstanceActionsNegativeTestJSON-1479033263 tempest-InstanceActionsNegativeTestJSON-1479033263-project] 10.222.0.13 "GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be" status: 404 len: 111 microversion: 2.1 time: 0.036496 Dec 18 21:01:21.569908 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2070/4138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:21 2021] GET /compute/v2.1/servers/45482c58-7d4f-4437-97c5-4473a966c9be => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:01:21.645256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4196dd207ce543d3bdd5f48ae57e156a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b96ca6ed964b6a9db0ed2249251328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:21.654048 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da9f6ad1-8d83-46f9-8a0a-e12c5136eb4c tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 200 len: 1514 microversion: 2.1 time: 0.398446 Dec 18 21:01:21.655190 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2069/4139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:21 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:21.772733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f0e343b9-e0f7-46ac-a276-9b33d10d85d3 req-1d285809-7a86-49ea-ad84-279eb91f7e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "1dc7a401-6ed9-4aec-ba52-1af54a484d85"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:21.773881 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:21.773881 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:21.790329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f0e343b9-e0f7-46ac-a276-9b33d10d85d3 req-1d285809-7a86-49ea-ad84-279eb91f7e39 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.790795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f0e343b9-e0f7-46ac-a276-9b33d10d85d3 req-1d285809-7a86-49ea-ad84-279eb91f7e39 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.820514 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f0e343b9-e0f7-46ac-a276-9b33d10d85d3 req-1d285809-7a86-49ea-ad84-279eb91f7e39 service nova] Creating event network-changed:1dc7a401-6ed9-4aec-ba52-1af54a484d85 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:21.833408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f0e343b9-e0f7-46ac-a276-9b33d10d85d3 req-1d285809-7a86-49ea-ad84-279eb91f7e39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064584 Dec 18 21:01:21.834115 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2071/4140] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:21.945634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:21.948740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:21.962548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.963368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:21.964670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:21.965862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.145748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:22.147077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:22.153849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.154579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.155392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.156003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.650441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:22.658979 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5490cf6a-7bd9-4283-bf92-d8f5bd927512 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1317 microversion: 2.1 time: 0.517308 Dec 18 21:01:22.660182 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2072/4141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:22 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:22.670962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:22.671633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:22.679825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.680496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.681519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.682286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.686408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:22.709609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:22.711842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:22.719710 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-294a889e-89b9-4216-af4e-145def98b5ee tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.775811 Dec 18 21:01:22.722990 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2070/4142] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:21 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:22.743959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:22.744467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:22.764596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.765063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.766394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.767234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.828432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:22.839854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:22.842290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:22.843693 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2770c55-7a2b-4190-a180-d546d7616789 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.178383 Dec 18 21:01:22.857484 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2073/4143] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:22 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:22.862617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:22.863560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] [instance: a12e2896-51c3-4ed6-abc1-fb782a8c9f48] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:22.871754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.875813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.876820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:22.877694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:22.904083 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] HTTP exception thrown: Instance a12e2896-51c3-4ed6-abc1-fb782a8c9f48 could not be found. Dec 18 21:01:22.905467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] Returning 404 to user: Instance a12e2896-51c3-4ed6-abc1-fb782a8c9f48 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:22.906474 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc221ab2-70f0-4f44-b844-ea402842a9b5 tempest-AttachVolumeNegativeTest-997340476 tempest-AttachVolumeNegativeTest-997340476-project] 10.222.0.13 "GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48" status: 404 len: 111 microversion: 2.1 time: 0.047575 Dec 18 21:01:22.911637 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2074/4144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:22 2021] GET /compute/v2.1/servers/a12e2896-51c3-4ed6-abc1-fb782a8c9f48 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:01:23.173803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:23.182522 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ffa3fe1-447a-40ee-8d6c-e634cfff1a02 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1350 microversion: 2.1 time: 0.457830 Dec 18 21:01:23.193840 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2071/4145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:22 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1350 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:23.677652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:23.679305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:23.686411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:23.687227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:23.690034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:23.715052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:23.740516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6a213452-a16b-4f61-921f-583f3845fdec req-305e67a1-c258-4241-8c10-2afd8ab76013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c88a02-9467-48b3-a95a-92083533337d", "name": "network-vif-plugged", "status": "completed", "tag": "5c24945b-9a10-472d-b86a-c65638bdf782"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:23.742378 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:23.742378 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:23.759664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6a213452-a16b-4f61-921f-583f3845fdec req-305e67a1-c258-4241-8c10-2afd8ab76013 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:23.760120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6a213452-a16b-4f61-921f-583f3845fdec req-305e67a1-c258-4241-8c10-2afd8ab76013 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:23.781469 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6a213452-a16b-4f61-921f-583f3845fdec req-305e67a1-c258-4241-8c10-2afd8ab76013 service nova] Creating event network-vif-plugged:5c24945b-9a10-472d-b86a-c65638bdf782 for instance 42c88a02-9467-48b3-a95a-92083533337d on nch2-master-1 Dec 18 21:01:23.791214 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6a213452-a16b-4f61-921f-583f3845fdec req-305e67a1-c258-4241-8c10-2afd8ab76013 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061842 Dec 18 21:01:23.791832 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2072/4146] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:01:23.801947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:23.811115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:23.818189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:23.820168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:23.821699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:23.823633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:24.372343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:24.380556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad738f44-af7a-4812-9bfe-b45e6e8b93a0 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1317 microversion: 2.1 time: 0.707278 Dec 18 21:01:24.381405 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2075/4147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:23 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:24.386350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:24.388012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:24.394104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:24.394915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:24.395823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:24.396341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:24.445494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:24.455447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:24.457096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:24.458399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d979bd3e-b5d5-4ae4-b81a-872094b69310 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.660508 Dec 18 21:01:24.459191 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2073/4148] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:23 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:24.474569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a7422c6f-3012-473f-b68f-fcc79e3378d7 req-d296a166-ee98-494c-bc6d-614d98af5897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12e2896-51c3-4ed6-abc1-fb782a8c9f48", "name": "network-vif-deleted", "tag": "f436640a-8992-4e8c-bdca-8adcc9d844b1"}, {"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "59526aeb-f155-46bf-ba7e-15d8467624a2"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:24.477041 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:24.477041 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:24.487862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a7422c6f-3012-473f-b68f-fcc79e3378d7 req-d296a166-ee98-494c-bc6d-614d98af5897 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:24.488572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a7422c6f-3012-473f-b68f-fcc79e3378d7 req-d296a166-ee98-494c-bc6d-614d98af5897 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:24.507880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a7422c6f-3012-473f-b68f-fcc79e3378d7 req-d296a166-ee98-494c-bc6d-614d98af5897 service nova] Creating event network-vif-deleted:f436640a-8992-4e8c-bdca-8adcc9d844b1 for instance a12e2896-51c3-4ed6-abc1-fb782a8c9f48 on nch2-master-1 Dec 18 21:01:24.508933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a7422c6f-3012-473f-b68f-fcc79e3378d7 req-d296a166-ee98-494c-bc6d-614d98af5897 service nova] Creating event network-changed:59526aeb-f155-46bf-ba7e-15d8467624a2 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:24.518090 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a7422c6f-3012-473f-b68f-fcc79e3378d7 req-d296a166-ee98-494c-bc6d-614d98af5897 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057500 Dec 18 21:01:24.520470 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2074/4149] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:24 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:24.528172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:24.529125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:24.536342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:24.537334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:24.539310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:24.541084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:24.586105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:24.608577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:24.616230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:24.617629 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb2ae5f1-da90-4d31-bcd6-30051bc432a5 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.235068 Dec 18 21:01:24.619958 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2076/4150] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:24 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:25.112186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:25.119762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ffb872ac-ff0d-4ea6-a2cc-1a65f06fd775 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1350 microversion: 2.1 time: 0.597867 Dec 18 21:01:25.128767 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2075/4151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:24 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1350 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:25.356986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5af75dcd-533e-4f42-955c-cd640fdc8ccd tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Calling method '.version_select at 0x7f714eef9ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:25.399093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:25.400763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:25.419134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:25.421423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:25.423577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:25.424948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:25.704730 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5af75dcd-533e-4f42-955c-cd640fdc8ccd tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df/defaults" status: 200 len: 371 microversion: 2.1 time: 0.676349 Dec 18 21:01:25.710545 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2077/4152] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:01:25 2021] GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df/defaults => generated 371 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:01:25.714557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:25.716601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:25.739785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:25.748570 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f0829de-0ada-4151-ad97-38c40bf9e095 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1507 microversion: 2.1 time: 0.354240 Dec 18 21:01:25.749181 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2076/4153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:25 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:25.755871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:25.756318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:25.763243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:25.763706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:25.778719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:25.779625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:25.801459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:25.801924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:25.802775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:25.803219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:25.955335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:25.970691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:25.972815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:25.974315 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-27622ed9-908c-453e-95f5-7a9e68ed982b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.224144 Dec 18 21:01:25.975102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2077/4154] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:25 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:25.989695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-669882e3-cccd-4a10-9e2b-55f2382bad0f tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Calling method '.version_select at 0x7f7161398c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.130819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:26.143899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:26.145447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:26.147370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0dee5644-bdc6-4d7a-aa1c-564966c48ebc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.440228 Dec 18 21:01:26.160767 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2078/4155] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:25 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:26.166596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.167680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:26.176557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.177232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.178338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.178980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.281881 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-669882e3-cccd-4a10-9e2b-55f2382bad0f tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df" status: 200 len: 371 microversion: 2.1 time: 0.305395 Dec 18 21:01:26.289997 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2078/4156] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:25 2021] GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df => generated 371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:26.303167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c06ee2ae-f59b-4edd-9b55-0e86804b4ab0 req-a7c25486-0773-442e-8560-6b795a104f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b77426-cb1b-4748-b580-a4f86c940694", "name": "network-vif-plugged", "status": "completed", "tag": "f65f78c9-150a-4ed2-95a6-dd167edea818"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:26.304830 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.304830 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:26.325169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c06ee2ae-f59b-4edd-9b55-0e86804b4ab0 req-a7c25486-0773-442e-8560-6b795a104f41 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.325794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c06ee2ae-f59b-4edd-9b55-0e86804b4ab0 req-a7c25486-0773-442e-8560-6b795a104f41 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.336458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c06ee2ae-f59b-4edd-9b55-0e86804b4ab0 req-a7c25486-0773-442e-8560-6b795a104f41 service nova] Creating event network-vif-plugged:f65f78c9-150a-4ed2-95a6-dd167edea818 for instance e7b77426-cb1b-4748-b580-a4f86c940694 on nch2-master-1 Dec 18 21:01:26.341740 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c06ee2ae-f59b-4edd-9b55-0e86804b4ab0 req-a7c25486-0773-442e-8560-6b795a104f41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050462 Dec 18 21:01:26.342814 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2079/4157] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:26.348041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.348739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:26.356293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.356481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.357159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.357606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.468684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:26.477986 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43fed09e-b7af-4a7a-8b56-172042f9ada3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1507 microversion: 2.1 time: 0.315852 Dec 18 21:01:26.479125 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2079/4158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:26 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:26.495445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e10ed0c-88a4-4208-9b86-4bee06e4881a tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Calling method '.version_select at 0x7f714ede43a0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.609301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:26.617102 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f28935f-f1ee-4c4c-8db6-7ad5e83b42f4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1350 microversion: 2.1 time: 0.272849 Dec 18 21:01:26.617673 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2080/4159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:26 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1350 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:26.623157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-363d1957-7c36-49f7-8a63-9a88dc2166dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:26.624309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-363d1957-7c36-49f7-8a63-9a88dc2166dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:26.630167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-363d1957-7c36-49f7-8a63-9a88dc2166dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.630659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-363d1957-7c36-49f7-8a63-9a88dc2166dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.634640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-363d1957-7c36-49f7-8a63-9a88dc2166dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.635377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-363d1957-7c36-49f7-8a63-9a88dc2166dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.660218 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e10ed0c-88a4-4208-9b86-4bee06e4881a tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df/defaults" status: 200 len: 371 microversion: 2.1 time: 0.179706 Dec 18 21:01:26.668642 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2080/4160] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:01:26 2021] GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df/defaults => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:26.668642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-66b05ae2-898f-40dc-894a-c2194f9c2306 req-372827d3-c3bb-4957-8fa4-fb86aa17d5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "1f477167-6d29-4a5d-a26d-96bb2271bada"}, {"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:26.668943 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.668943 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:26.676296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-66b05ae2-898f-40dc-894a-c2194f9c2306 req-372827d3-c3bb-4957-8fa4-fb86aa17d5e7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.676746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-66b05ae2-898f-40dc-894a-c2194f9c2306 req-372827d3-c3bb-4957-8fa4-fb86aa17d5e7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.688268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-66b05ae2-898f-40dc-894a-c2194f9c2306 req-372827d3-c3bb-4957-8fa4-fb86aa17d5e7 service nova] Creating event network-changed:1f477167-6d29-4a5d-a26d-96bb2271bada for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:26.688950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-66b05ae2-898f-40dc-894a-c2194f9c2306 req-372827d3-c3bb-4957-8fa4-fb86aa17d5e7 service nova] Creating event network-changed:340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:26.694298 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-66b05ae2-898f-40dc-894a-c2194f9c2306 req-372827d3-c3bb-4957-8fa4-fb86aa17d5e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031660 Dec 18 21:01:26.694800 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2081/4161] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:26 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:26.700361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-059a7aa8-fdb0-47d8-87f6-fbcee03bd358 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Calling method '.version_select at 0x7f714edf0af0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.708713 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-363d1957-7c36-49f7-8a63-9a88dc2166dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "PUT /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1079 microversion: 2.1 time: 0.089821 Dec 18 21:01:26.709410 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2081/4162] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:01:26 2021] PUT /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1079 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:26.725341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.727637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:26.736523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.737234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.739637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:26.740087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:26.811696 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-059a7aa8-fdb0-47d8-87f6-fbcee03bd358 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df" status: 200 len: 371 microversion: 2.1 time: 0.115652 Dec 18 21:01:26.812857 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2082/4163] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:26 2021] GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:26.824635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ac92aac-ed47-48a3-8efc-fbb6303865af tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Calling method '.version_select at 0x7f714edfea60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.919213 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ac92aac-ed47-48a3-8efc-fbb6303865af tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df?user_id=073a758d401343dda8ccee52685986bf" status: 200 len: 371 microversion: 2.1 time: 0.099923 Dec 18 21:01:26.921084 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2083/4164] 10.222.0.13 () {58 vars in 1322 bytes} [Sat Dec 18 21:01:26 2021] GET /compute/v2.1/os-quota-sets/a6b4b2946be6470cbec140a2c207c2df?user_id=073a758d401343dda8ccee52685986bf => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:26.993209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:26.994220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:27.004874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.006754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.009555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.010152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.077655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.088919 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1afc1f04-e6e1-4445-9763-c8cfcb146882 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1505 microversion: 2.1 time: 0.366340 Dec 18 21:01:27.092021 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2082/4165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:26 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:27.111243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:27.112337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:27.120715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.122388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.124253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.125319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.176302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.187172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.193130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.195190 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-863e726c-3ce6-4b71-8f5e-1d7f1d9d50f0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.206050 Dec 18 21:01:27.196000 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2084/4166] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:26 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:27.211751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:27.212558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:27.219278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.219948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.221843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.222482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.576112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.591315 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-257ade2c-95ed-4f8c-bc90-5f0e0bc38653 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1505 microversion: 2.1 time: 0.484231 Dec 18 21:01:27.591913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2083/4167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:27 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:27.612744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:27.614646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:27.622233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.622476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.623547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.624211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.654264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.668465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.669719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:27.671087 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1cd63652-527c-42b4-a5cc-1d9de3afefdf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.462961 Dec 18 21:01:27.671968 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2085/4168] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:27 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:27.677161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:27.677950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:27.685811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.686685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.687699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.688294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.734109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:01:27.735031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:01:27.735966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:01:27.736587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:01:27.737470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:01:27.805550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:27.820316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.820775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.821599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.822050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.850660 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c6751e4-55c0-4f61-8444-f0a50afc3b95 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "POST /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d/action" status: 202 len: 1111 microversion: 2.1 time: 0.243759 Dec 18 21:01:27.851522 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2084/4169] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:27 2021] POST /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d/action => generated 1111 bytes in 245 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 18 21:01:27.865763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:27.866423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:27.873114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.873815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:27.874832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:27.875440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:28.115375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:28.134748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-49e91c9c-bc03-42eb-a687-3f0729319cd1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1539 microversion: 2.1 time: 0.450247 Dec 18 21:01:28.135946 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2086/4170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:27 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1539 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:28.152269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f2305ce-51cc-43eb-a51f-110a8068b7a1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:28.152988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f2305ce-51cc-43eb-a51f-110a8068b7a1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:28.162524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f2305ce-51cc-43eb-a51f-110a8068b7a1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:28.164075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f2305ce-51cc-43eb-a51f-110a8068b7a1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:28.169419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f2305ce-51cc-43eb-a51f-110a8068b7a1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:28.170234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f2305ce-51cc-43eb-a51f-110a8068b7a1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:28.278132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:28.291856 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7eb34428-7efe-40be-a3b6-0f63d9577cbb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.429650 Dec 18 21:01:28.303651 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2085/4171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:27 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:28.307793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:28.308420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:28.315158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:28.315633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:28.316697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:28.317408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:28.326686 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f2305ce-51cc-43eb-a51f-110a8068b7a1 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178290 Dec 18 21:01:28.327487 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2087/4172] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:01:28 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:01:28.407413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:28.420636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:28.422802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:28.424824 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.120538 Dec 18 21:01:28.425948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2086/4173] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:28 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:28.693088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:28.693898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:28.703210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:28.703949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:28.705955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:28.707208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.027776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:29.048211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:29.052971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:29.054711 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.368921 Dec 18 21:01:29.055291 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2088/4174] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:28 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:29.253742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:29.255162 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001501 Dec 18 21:01:29.260430 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2087/4175] 10.222.0.13 () {56 vars in 885 bytes} [Sat Dec 18 21:01:29 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 18 21:01:29.262224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:29.263491 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001837 Dec 18 21:01:29.264120 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2089/4176] 10.222.0.13 () {54 vars in 1034 bytes} [Sat Dec 18 21:01:29 2021] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Dec 18 21:01:29.270688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:29.271789 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3451505-8f66-437f-82ad-4fe623b94b1a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001893 Dec 18 21:01:29.272510 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2088/4177] 10.222.0.13 () {54 vars in 1040 bytes} [Sat Dec 18 21:01:29 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:29.280372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:29.281591 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12129e6c-8675-4b31-8c07-7458b4cdf6d1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001555 Dec 18 21:01:29.285939 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2090/4178] 10.222.0.13 () {56 vars in 885 bytes} [Sat Dec 18 21:01:29 2021] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 18 21:01:29.310087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:29.312213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:29.321603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:29.322405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.324326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:29.325056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.447751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:29.448710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:29.456534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:29.457381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.458481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:29.459338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.799495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:29.809829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:29.811696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:29.812892 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e72118ee-b0c4-4073-9f0f-9fd6d0f98165 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.370943 Dec 18 21:01:29.813472 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2091/4179] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:29 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:29.823016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3712cdcf-2a7c-4dca-bd28-7308df2857eb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:29.824792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3712cdcf-2a7c-4dca-bd28-7308df2857eb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:29.831544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3712cdcf-2a7c-4dca-bd28-7308df2857eb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:29.832131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3712cdcf-2a7c-4dca-bd28-7308df2857eb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.832941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3712cdcf-2a7c-4dca-bd28-7308df2857eb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:29.833406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3712cdcf-2a7c-4dca-bd28-7308df2857eb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.878664 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3712cdcf-2a7c-4dca-bd28-7308df2857eb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.061769 Dec 18 21:01:29.882970 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2092/4180] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:29 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:29.897939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7096b0eb-491d-4149-baab-f730695f64bf req-2106ed3e-2a3b-4fe5-972f-1c3217e1d0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b77426-cb1b-4748-b580-a4f86c940694", "tag": "f65f78c9-150a-4ed2-95a6-dd167edea818"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:29.900563 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:29.900563 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:29.913223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7096b0eb-491d-4149-baab-f730695f64bf req-2106ed3e-2a3b-4fe5-972f-1c3217e1d0a4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:29.913681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7096b0eb-491d-4149-baab-f730695f64bf req-2106ed3e-2a3b-4fe5-972f-1c3217e1d0a4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:29.950508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:29.951467 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7096b0eb-491d-4149-baab-f730695f64bf req-2106ed3e-2a3b-4fe5-972f-1c3217e1d0a4 service nova] Creating event network-changed:f65f78c9-150a-4ed2-95a6-dd167edea818 for instance e7b77426-cb1b-4748-b580-a4f86c940694 on nch2-master-1 Dec 18 21:01:29.958224 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7096b0eb-491d-4149-baab-f730695f64bf req-2106ed3e-2a3b-4fe5-972f-1c3217e1d0a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075317 Dec 18 21:01:29.959698 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2093/4181] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:29.962652 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1aca9fab-c500-4abe-b291-ab5f2cfcc0b7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.656235 Dec 18 21:01:29.963250 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2089/4182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:29 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:30.077112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:30.077824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:30.093098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:30.093098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:30.093299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:30.093789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:30.498323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:30.518447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:30.521251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:30.525953 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3ad5896d-94f5-457b-9582-67ca67b2047f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.453034 Dec 18 21:01:30.530911 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2094/4183] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:30 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:30.834209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:30.835030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:30.849877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:30.850449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:30.851545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:30.852183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:30.891930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07d261ae-4052-465d-b5e1-73fc479be9ff tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:30.893533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07d261ae-4052-465d-b5e1-73fc479be9ff tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:30.908353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d261ae-4052-465d-b5e1-73fc479be9ff tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:30.910831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d261ae-4052-465d-b5e1-73fc479be9ff tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:30.912876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d261ae-4052-465d-b5e1-73fc479be9ff tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:30.918845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d261ae-4052-465d-b5e1-73fc479be9ff tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:30.983452 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07d261ae-4052-465d-b5e1-73fc479be9ff tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.096078 Dec 18 21:01:30.984804 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2095/4184] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:30 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:30.986231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:30.994663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:30.996733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:30.998318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:30.999863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-087c203b-3c1e-4a44-8c92-4b76f4026765 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.171812 Dec 18 21:01:31.010276 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2090/4185] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:30 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:31.010504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:31.016703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:31.017572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:31.018414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:31.019056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:31.233135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:31.247915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d4bdf4e8-5ac4-4457-8363-293d854afdf8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.261168 Dec 18 21:01:31.249400 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2096/4186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:30 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:31.547412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:31.548342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:31.554758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:31.555551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:31.556649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:31.557360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:31.806548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:31.816113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:31.817903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:31.819134 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8521eba0-bcaa-4bc7-8112-4793795186ed tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.276263 Dec 18 21:01:31.819696 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2091/4187] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:31 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:31.996729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-650e2569-ce46-4e8a-b0b7-ee48e322e619 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:31.999396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-650e2569-ce46-4e8a-b0b7-ee48e322e619 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:32.010684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650e2569-ce46-4e8a-b0b7-ee48e322e619 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.011886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650e2569-ce46-4e8a-b0b7-ee48e322e619 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:32.012892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650e2569-ce46-4e8a-b0b7-ee48e322e619 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.024567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:32.026504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:32.034333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650e2569-ce46-4e8a-b0b7-ee48e322e619 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:32.046351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.047113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:32.048456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.049082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:32.122599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-650e2569-ce46-4e8a-b0b7-ee48e322e619 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.131082 Dec 18 21:01:32.123265 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2097/4188] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:31 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:01:32.141596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:32.159070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:32.161263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:32.163481 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef1e8bc8-e1ac-487f-adfd-bcd652383d9e tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.146303 Dec 18 21:01:32.175616 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2092/4189] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:32 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:32.266043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:32.266776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:32.273850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.274485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:32.275292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.275734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:32.437164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:32.445349 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0914d52e-1c91-4d2b-a085-6e7baed271c2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.183939 Dec 18 21:01:32.446222 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2098/4190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:32 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:32.838810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:32.839348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:32.846029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.846528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:32.847336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:32.847797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:33.062070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:33.071308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:33.073073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:33.074032 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-095c3629-653d-462a-b48f-a395867572c6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.239176 Dec 18 21:01:33.085526 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2093/4191] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:32 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:33.135716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-28b6c289-c926-4146-96ef-5b82800739a9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:33.138038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-28b6c289-c926-4146-96ef-5b82800739a9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:33.147780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b6c289-c926-4146-96ef-5b82800739a9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:33.148490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b6c289-c926-4146-96ef-5b82800739a9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:33.149484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b6c289-c926-4146-96ef-5b82800739a9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:33.150127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28b6c289-c926-4146-96ef-5b82800739a9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:33.183819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:33.184481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:33.191775 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-28b6c289-c926-4146-96ef-5b82800739a9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.060953 Dec 18 21:01:33.191975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:33.192300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:33.195698 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2099/4192] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:33 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:33.196123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:33.196768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:33.269217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:33.277337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:33.279223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:33.280411 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b797c30c-543a-4b24-96a6-d9bce0669fee tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.101367 Dec 18 21:01:33.281646 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2094/4193] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:33 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:33.463298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:33.464191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:33.471527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:33.471972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:33.472772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:33.473216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:33.629014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:33.637738 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23e44b73-6453-418b-82ff-d0a8759c97de tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.179004 Dec 18 21:01:33.638331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2100/4194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:33 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:34.093291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:34.093928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:34.102200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.103507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.104491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.105348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.204314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ddad729-a71a-4011-b1c4-0d71031c0a40 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:34.205443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ddad729-a71a-4011-b1c4-0d71031c0a40 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:34.215193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ddad729-a71a-4011-b1c4-0d71031c0a40 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.215915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ddad729-a71a-4011-b1c4-0d71031c0a40 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.216947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ddad729-a71a-4011-b1c4-0d71031c0a40 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.217612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ddad729-a71a-4011-b1c4-0d71031c0a40 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.275904 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ddad729-a71a-4011-b1c4-0d71031c0a40 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.076256 Dec 18 21:01:34.277890 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2101/4195] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:34 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:34.300885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:34.302109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:34.311464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.312328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.313894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.314442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.317022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:34.330736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:34.332633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:34.334020 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-063c4fdf-9d2b-40a3-a9e9-6740ed22f5fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.245052 Dec 18 21:01:34.346816 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2095/4196] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:34 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:34.426504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:34.437091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:34.439514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:34.441026 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1732d14d-8d75-4d80-a667-7af054ff42ef tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.145550 Dec 18 21:01:34.442094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2102/4197] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:34 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:34.655624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:34.656568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:34.665213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.665852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.666965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:34.667574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:34.820757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:34.829564 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2417950f-bb96-4d04-b980-7e0c5f2558a6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.177861 Dec 18 21:01:34.830604 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2096/4198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:34 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:35.287471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf1f514d-d5d7-4e16-8614-d90f8db58f23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:35.288659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf1f514d-d5d7-4e16-8614-d90f8db58f23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:35.297066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1f514d-d5d7-4e16-8614-d90f8db58f23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.297996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1f514d-d5d7-4e16-8614-d90f8db58f23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:35.302091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1f514d-d5d7-4e16-8614-d90f8db58f23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.302590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1f514d-d5d7-4e16-8614-d90f8db58f23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:35.354578 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf1f514d-d5d7-4e16-8614-d90f8db58f23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.070572 Dec 18 21:01:35.355568 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2103/4199] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:35 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:35.363430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:35.364339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:35.371716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.372170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:35.373163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.373778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:35.465784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:35.467911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:35.492192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.492773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:35.493824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.498147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:35.599041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:35.609724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:35.612083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:35.614066 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-accf7314-2836-4825-bc4d-0cb2bafc1884 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.153757 Dec 18 21:01:35.614892 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2104/4200] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:35 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:35.619454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:35.633545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:35.635810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:35.637775 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b921e90-3749-4fc6-b2c1-c7f82d1884c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.288638 Dec 18 21:01:35.638777 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2097/4201] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:35 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:35.846430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:35.846934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:35.853420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.853883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:35.854704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:35.855888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:36.020019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:36.028328 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5097db95-868f-4dbb-845e-db9d25bc5673 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.184544 Dec 18 21:01:36.029993 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2105/4202] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:35 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:36.369557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f05a8b3a-1fff-417b-88d0-7514acd69a7e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:36.370585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f05a8b3a-1fff-417b-88d0-7514acd69a7e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:36.377189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f05a8b3a-1fff-417b-88d0-7514acd69a7e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:36.377648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f05a8b3a-1fff-417b-88d0-7514acd69a7e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:36.378482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f05a8b3a-1fff-417b-88d0-7514acd69a7e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:36.378924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f05a8b3a-1fff-417b-88d0-7514acd69a7e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:36.422993 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f05a8b3a-1fff-417b-88d0-7514acd69a7e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.060971 Dec 18 21:01:36.424244 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2098/4203] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:36 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:36.635063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:36.637033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:36.644979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:36.645413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:36.646292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:36.646740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:36.658431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:36.659021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:36.671281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:36.671762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:36.672557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:36.673005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:36.776863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:36.787676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:36.790710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:36.792282 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0538da84-743d-4161-bd53-d1c680e43fc3 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.162799 Dec 18 21:01:36.793480 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2106/4204] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:36 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:36.909692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:36.919350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:36.924011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:36.925334 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8558b536-c6a6-4db1-aaca-41af5fffd336 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.271478 Dec 18 21:01:36.925908 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2099/4205] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:36 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:37.046604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:37.047532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:37.053721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.054179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:37.055361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.055895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:37.223412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:37.231338 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20c81ae4-9727-40aa-ad88-e44192baba63 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.188762 Dec 18 21:01:37.231917 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2107/4206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:37 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:37.434812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9101a69f-ad56-4d98-a1d6-4446847a33cc tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:37.436472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9101a69f-ad56-4d98-a1d6-4446847a33cc tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:37.444593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9101a69f-ad56-4d98-a1d6-4446847a33cc tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.445339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9101a69f-ad56-4d98-a1d6-4446847a33cc tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:37.446409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9101a69f-ad56-4d98-a1d6-4446847a33cc tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.447061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9101a69f-ad56-4d98-a1d6-4446847a33cc tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:37.492640 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9101a69f-ad56-4d98-a1d6-4446847a33cc tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.062173 Dec 18 21:01:37.494296 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2100/4207] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:37 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:37.814430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:37.814430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:37.826832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.827331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:37.828445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.829432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:37.952049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:37.952773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:37.967313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.967781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:37.968646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:37.969141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:38.196784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:38.211554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:38.215035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:38.217109 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b76f806-7b54-4593-9135-19b1b4d4357d tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.409241 Dec 18 21:01:38.219610 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2108/4208] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:37 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:38.250229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:38.252447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:38.273306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:38.273306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:38.273306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:38.273306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:38.402362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:38.440476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:38.444617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:38.447600 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9083ecd7-6e5e-405f-8ebc-93fc10f0009f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.506154 Dec 18 21:01:38.448383 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2101/4209] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:37 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:38.504816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ca905ef-845c-44ec-906e-af7c58b52980 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:38.506065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ca905ef-845c-44ec-906e-af7c58b52980 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:38.541384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ca905ef-845c-44ec-906e-af7c58b52980 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:38.542282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ca905ef-845c-44ec-906e-af7c58b52980 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:38.546771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ca905ef-845c-44ec-906e-af7c58b52980 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:38.547500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ca905ef-845c-44ec-906e-af7c58b52980 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:38.616810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ca905ef-845c-44ec-906e-af7c58b52980 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.116304 Dec 18 21:01:38.619303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2102/4210] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:38 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:01:38.627462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:38.636740 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b38f98bf-3719-4ac8-a12c-d893f5eafc4f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.392160 Dec 18 21:01:38.637468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2109/4211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:38 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:39.238913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:39.240093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:39.249382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.250300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.251547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.252272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.339084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:39.349517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:39.352128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:39.353554 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f66b2e83-5298-4972-b6c0-6953bff0c0cc tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.120029 Dec 18 21:01:39.354292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2103/4212] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:39 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:39.467448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:39.469306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:39.476509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.477312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.478289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.478915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.627943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3216cc93-6f1b-4565-aca5-6d902afc94ab tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:39.629150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3216cc93-6f1b-4565-aca5-6d902afc94ab tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:39.640798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3216cc93-6f1b-4565-aca5-6d902afc94ab tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.643107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3216cc93-6f1b-4565-aca5-6d902afc94ab tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.644182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3216cc93-6f1b-4565-aca5-6d902afc94ab tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.644877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3216cc93-6f1b-4565-aca5-6d902afc94ab tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.687583 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3216cc93-6f1b-4565-aca5-6d902afc94ab tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.063371 Dec 18 21:01:39.695340 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2104/4213] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:39 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:01:39.702195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:39.702938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:39.722430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.723523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.724769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:39.726111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:39.773095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:39.788506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:39.790127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:39.792007 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e2fa8b6-4f20-42be-8faa-2bccfbe00a3d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.329336 Dec 18 21:01:39.803051 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2110/4214] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:39 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:39.971418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:39.981503 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a406623a-0006-4808-8d94-a259377d78bb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.283729 Dec 18 21:01:39.982244 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2105/4215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:39 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:40.372192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:40.372835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:40.380974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:40.381451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:40.382230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:40.383202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:40.519167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:40.535265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:40.538445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:40.542132 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a8dc0a3c-05cc-48f0-8032-a79facb7849f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.174291 Dec 18 21:01:40.546469 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2111/4216] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:40 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:40.699295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-168aa3de-e4fa-41a4-a370-e28b7d04721c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:40.701010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-168aa3de-e4fa-41a4-a370-e28b7d04721c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:40.719621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-168aa3de-e4fa-41a4-a370-e28b7d04721c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:40.720389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-168aa3de-e4fa-41a4-a370-e28b7d04721c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:40.721437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-168aa3de-e4fa-41a4-a370-e28b7d04721c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:40.722161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-168aa3de-e4fa-41a4-a370-e28b7d04721c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:40.770958 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-168aa3de-e4fa-41a4-a370-e28b7d04721c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 14 microversion: 2.1 time: 0.075918 Dec 18 21:01:40.771812 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2106/4217] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:40 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:01:40.809836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:40.810483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:40.817292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:40.817952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:40.818936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:40.819537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:41.001984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:41.002993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:41.022046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:41.022682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:41.025264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:41.025758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:41.101310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:41.111463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:41.122181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:41.124091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5fc01f43-c5ad-4117-ab83-a6cb2c8d56ea tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.318062 Dec 18 21:01:41.124665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2112/4218] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:40 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:41.273185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:41.281982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f23eede2-ea7c-4e84-9215-8fef7254eab8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.287038 Dec 18 21:01:41.282607 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2107/4219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:40 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:41.576430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:41.577053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:41.584257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:41.584723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:41.585518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:41.585957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:41.650759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:41.665032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:41.666836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:41.668616 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-09f7243e-403a-4331-b855-b970a8037677 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.096594 Dec 18 21:01:41.669191 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2113/4220] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:41 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:41.781091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-afb55de5-2e40-4cd1-83cc-b60c5923ec31 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:41.782032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-afb55de5-2e40-4cd1-83cc-b60c5923ec31 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:41.788833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb55de5-2e40-4cd1-83cc-b60c5923ec31 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:41.789523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb55de5-2e40-4cd1-83cc-b60c5923ec31 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:41.790378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb55de5-2e40-4cd1-83cc-b60c5923ec31 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:41.791003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afb55de5-2e40-4cd1-83cc-b60c5923ec31 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:41.850734 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-afb55de5-2e40-4cd1-83cc-b60c5923ec31 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 8208 microversion: 2.1 time: 0.073180 Dec 18 21:01:41.851868 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2108/4221] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:41 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 8208 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:42.142529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:42.143739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:42.151367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.152439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.153392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.154374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.300029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:42.300952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:42.308411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.309046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.310150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.311134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.416687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:42.425832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:42.427584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:42.428901 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-671c8797-8a34-4c65-a963-8fe38a41df06 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.290943 Dec 18 21:01:42.438445 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2114/4222] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:42 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:42.686292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:42.687583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:42.694939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.695393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.696167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.696605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.791090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:42.801341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:42.812090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:42.813450 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db370e6a-4395-45f1-bb81-a55e979d130b tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.130893 Dec 18 21:01:42.814149 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2115/4223] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:42 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:42.861343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:42.862159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe5bf1fc-132b-4d16-8093-a0a9ba95af2b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:42.863373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe5bf1fc-132b-4d16-8093-a0a9ba95af2b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:42.869004 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f10a7a62-d5cf-4c02-897b-15931fb2e587 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.573341 Dec 18 21:01:42.869833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5bf1fc-132b-4d16-8093-a0a9ba95af2b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.871438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2109/4224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:42 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:42.871749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5bf1fc-132b-4d16-8093-a0a9ba95af2b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.872694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5bf1fc-132b-4d16-8093-a0a9ba95af2b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:42.873211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe5bf1fc-132b-4d16-8093-a0a9ba95af2b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:42.926717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe5bf1fc-132b-4d16-8093-a0a9ba95af2b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 16401 microversion: 2.1 time: 0.068616 Dec 18 21:01:42.927619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2116/4225] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:42 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 16401 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:43.084990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:43.085499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:43.092434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.092897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.094116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.094585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.119965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:43.211432 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b33bafaf-4926-4c4a-b7f4-b522c90c0498 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "DELETE /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 204 len: 0 microversion: 2.32 time: 0.129744 Dec 18 21:01:43.212236 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2110/4226] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:01:43 2021] DELETE /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:01:43.221513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:43.222635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:43.231263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.231725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.232566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.233017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.431755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.442521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.443970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.447988 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd9cd424-1c97-44e1-a570-24a8667c24a3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2949 microversion: 2.32 time: 0.230545 Dec 18 21:01:43.448830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:43.449075 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2117/4227] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:43 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2949 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:43.449931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:43.456613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.457075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.457875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.458351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.695677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.705383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.706957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.708676 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80752f5a-3076-4e22-a2e0-98294dd4b922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.263762 Dec 18 21:01:43.716352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9a398a77-e6c6-49d6-8649-dbb669d2e84c req-6e970006-cd16-468c-9803-36b454a937a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-plugged", "status": "completed", "tag": "1dc7a401-6ed9-4aec-ba52-1af54a484d85"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:43.719208 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2111/4228] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:43 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:43.731594 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:43.731594 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:43.741253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9a398a77-e6c6-49d6-8649-dbb669d2e84c req-6e970006-cd16-468c-9803-36b454a937a2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.741825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9a398a77-e6c6-49d6-8649-dbb669d2e84c req-6e970006-cd16-468c-9803-36b454a937a2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.761555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9a398a77-e6c6-49d6-8649-dbb669d2e84c req-6e970006-cd16-468c-9803-36b454a937a2 service nova] Creating event network-vif-plugged:1dc7a401-6ed9-4aec-ba52-1af54a484d85 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:43.767333 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9a398a77-e6c6-49d6-8649-dbb669d2e84c req-6e970006-cd16-468c-9803-36b454a937a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056468 Dec 18 21:01:43.768525 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2118/4229] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:43.833724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:43.834348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:43.845194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.848000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.850423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.851148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.889044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:43.889839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:43.896321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.896859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.897888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.898594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.948463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.960015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.962175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:43.963356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e75ecb1-02be-4730-bc29-9f6e24fd9c8f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.133842 Dec 18 21:01:43.963917 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2112/4230] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:43 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:43.975651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ac98f3e-c70d-4849-91aa-f902e1d74daf tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:43.976854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ac98f3e-c70d-4849-91aa-f902e1d74daf tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:43.984566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ac98f3e-c70d-4849-91aa-f902e1d74daf tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.985217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ac98f3e-c70d-4849-91aa-f902e1d74daf tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:43.986374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ac98f3e-c70d-4849-91aa-f902e1d74daf tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:43.986997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ac98f3e-c70d-4849-91aa-f902e1d74daf tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:44.035198 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ac98f3e-c70d-4849-91aa-f902e1d74daf tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 16401 microversion: 2.1 time: 0.068650 Dec 18 21:01:44.039875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2113/4231] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:43 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 16401 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:44.116105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:44.125231 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-83e35148-7912-470e-b403-52f2f41bc77c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.240845 Dec 18 21:01:44.125806 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2119/4232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:43 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:44.470871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:44.470871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:44.477424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:44.477878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:44.478702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:44.479139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:44.737938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:44.738736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:44.756087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:44.762034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:44.764054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:44.764756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:44.802382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:44.813286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:44.814939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:44.816517 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3e929cf3-6743-419d-86a1-ffc3a2f7a5e3 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2949 microversion: 2.32 time: 0.352487 Dec 18 21:01:44.829989 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2114/4233] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:44 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2949 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:44.984807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:44.986051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:44.995013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.002453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.006107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.006800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.114703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:45.129531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:45.132489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:45.143292 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8eb88c75-3b96-4393-9fdf-648c68c4fa3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.409927 Dec 18 21:01:45.145814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:45.152141 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2120/4234] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:44 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:45.157206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:45.159267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:45.160727 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d2478d9-8fa2-47b4-8798-f51f1735c706 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.180163 Dec 18 21:01:45.161893 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2115/4235] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:44 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:45.171190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5f30d4aa-ba7e-4d77-baf1-9a9960eecea3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:45.176079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5f30d4aa-ba7e-4d77-baf1-9a9960eecea3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:45.192159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:45.194514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:45.200273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f30d4aa-ba7e-4d77-baf1-9a9960eecea3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.200939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f30d4aa-ba7e-4d77-baf1-9a9960eecea3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.203099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f30d4aa-ba7e-4d77-baf1-9a9960eecea3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.203739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f30d4aa-ba7e-4d77-baf1-9a9960eecea3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.209873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.210376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.216341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.216865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.284851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5f30d4aa-ba7e-4d77-baf1-9a9960eecea3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 16401 microversion: 2.1 time: 0.127938 Dec 18 21:01:45.286282 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2121/4236] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:45 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 16401 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:45.548702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:45.557144 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-14d96d31-49c2-428b-91fd-ff252d9d6b1c tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.393967 Dec 18 21:01:45.559514 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2116/4237] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:45 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:45.800010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-plugged", "status": "completed", "tag": "f1860d8e-c101-497b-93b4-18753b0bd5c6"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-plugged", "status": "completed", "tag": "fbcf81f3-8b8e-462f-9434-1aafb30b288a"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-plugged", "status": "completed", "tag": "59526aeb-f155-46bf-ba7e-15d8467624a2"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-plugged", "status": "completed", "tag": "f844557f-eb38-48aa-8a3a-a4ec5d372124"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-plugged", "status": "completed", "tag": "1f477167-6d29-4a5d-a26d-96bb2271bada"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-plugged", "status": "completed", "tag": "340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:45.802133 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:45.802133 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:45.811635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.812313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.826122 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Creating event network-vif-plugged:f1860d8e-c101-497b-93b4-18753b0bd5c6 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:45.826661 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Creating event network-vif-plugged:fbcf81f3-8b8e-462f-9434-1aafb30b288a for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:45.827348 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Creating event network-vif-plugged:59526aeb-f155-46bf-ba7e-15d8467624a2 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:45.828019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Creating event network-vif-plugged:f844557f-eb38-48aa-8a3a-a4ec5d372124 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:45.828704 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Creating event network-vif-plugged:1f477167-6d29-4a5d-a26d-96bb2271bada for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:45.829401 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] Creating event network-vif-plugged:340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:45.835459 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-84bc8d05-e211-4838-8835-665a97e87f76 req-67f32812-b270-4cda-a743-dbb86397096c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.039440 Dec 18 21:01:45.836406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2122/4238] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:45.856115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:45.857156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:45.864996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.865686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:45.866753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:45.867363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.132686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.142753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.144294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.149093 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da152ede-4dd7-4457-ac0c-b1507856eaef tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2928 microversion: 2.32 time: 0.300168 Dec 18 21:01:46.149677 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2117/4239] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:45 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2928 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:46.171831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:46.172958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:46.181534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:46.182276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:46.186033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.186828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.188203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.189063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.189325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.189793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.194552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.195032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.336299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.348310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.352391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.355914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-367461f8-7c69-4be3-8f7a-95117046b736 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.177639 Dec 18 21:01:46.358569 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2118/4240] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:46 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:46.366286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f858f90-44b5-46f2-96ae-331dd76a5686 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:46.368778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f858f90-44b5-46f2-96ae-331dd76a5686 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:46.377881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f858f90-44b5-46f2-96ae-331dd76a5686 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.378374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f858f90-44b5-46f2-96ae-331dd76a5686 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.379663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f858f90-44b5-46f2-96ae-331dd76a5686 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.380313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f858f90-44b5-46f2-96ae-331dd76a5686 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.544693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.553927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.556119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.557404 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6f10576-0b05-48df-8576-aae3cc571188 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.391114 Dec 18 21:01:46.568900 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2123/4241] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:46 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:46.579316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:46.580130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:46.587933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.588395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.590377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.590831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.607057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f858f90-44b5-46f2-96ae-331dd76a5686 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 16401 microversion: 2.1 time: 0.246953 Dec 18 21:01:46.610633 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2119/4242] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:46 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 16401 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:46.770901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:46.779913 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20d0c2d2-43cf-469c-b039-7c78a37784ed tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.207304 Dec 18 21:01:46.780527 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2124/4243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:46 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:46.838775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ee632968-e600-466a-bfc8-4447221a0dc5 req-b2b04cc0-774f-44ca-8778-0955a1b1320e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-deleted", "tag": "ccb5043d-02af-492d-8f2d-78752159fb84"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:46.841165 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:46.841165 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:46.849941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ee632968-e600-466a-bfc8-4447221a0dc5 req-b2b04cc0-774f-44ca-8778-0955a1b1320e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:46.850649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ee632968-e600-466a-bfc8-4447221a0dc5 req-b2b04cc0-774f-44ca-8778-0955a1b1320e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:46.863391 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ee632968-e600-466a-bfc8-4447221a0dc5 req-b2b04cc0-774f-44ca-8778-0955a1b1320e service nova] Creating event network-vif-deleted:ccb5043d-02af-492d-8f2d-78752159fb84 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 21:01:46.869640 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ee632968-e600-466a-bfc8-4447221a0dc5 req-b2b04cc0-774f-44ca-8778-0955a1b1320e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Dec 18 21:01:46.870999 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2120/4244] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:47.172035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:47.173628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:47.185157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.186005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.189331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.190187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.377107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:47.377733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:47.406637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.407032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.408444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.409316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.462294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.473826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.477589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.479674 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03b8a454-b4c7-48a2-aa11-ba941580b076 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2701 microversion: 2.32 time: 0.311742 Dec 18 21:01:47.480775 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2125/4245] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:47 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2701 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:47.536009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.544893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.546552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.547731 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8effb581-b4f5-4ab9-8289-4cd6f5cd181a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.176260 Dec 18 21:01:47.548523 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2121/4246] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:47 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:47.577025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:47.577626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:47.585515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.586242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.587243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.588573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.618703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df30275d-9373-470e-a7eb-1cd7fe1c2511 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:47.619643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df30275d-9373-470e-a7eb-1cd7fe1c2511 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:47.626871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df30275d-9373-470e-a7eb-1cd7fe1c2511 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.627326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df30275d-9373-470e-a7eb-1cd7fe1c2511 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.629229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df30275d-9373-470e-a7eb-1cd7fe1c2511 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.629965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df30275d-9373-470e-a7eb-1cd7fe1c2511 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.712015 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df30275d-9373-470e-a7eb-1cd7fe1c2511 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.096810 Dec 18 21:01:47.713479 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2122/4247] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:47 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:47.800804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:47.801567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:47.822610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.823102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.829118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:47.829812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:47.860486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.873031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.875068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:47.876510 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b781e825-3eb0-4657-a669-069691f6ff96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1874 microversion: 2.42 time: 0.304485 Dec 18 21:01:47.888090 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2126/4248] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:47 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1874 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:48.109636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:48.118136 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ce016e1c-f56d-41d7-b788-26e8e78208dd tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.324638 Dec 18 21:01:48.119044 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2123/4249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:47 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:48.501985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:48.502680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:48.521168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.522412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:48.523479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.524180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:48.567282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:48.567894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:48.586855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.587323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:48.593356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.593827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:48.728118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:48.739987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:48.742094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:48.743825 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb147f30-0c68-41d4-b666-0cba1ad6f82f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1366 microversion: 2.57 time: 0.180858 Dec 18 21:01:48.758438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2124/4250] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:48 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:48.773452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62ea07f8-923a-4454-8048-add768bd19e8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:48.774808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62ea07f8-923a-4454-8048-add768bd19e8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:48.782714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ea07f8-923a-4454-8048-add768bd19e8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.783517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ea07f8-923a-4454-8048-add768bd19e8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:48.784560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ea07f8-923a-4454-8048-add768bd19e8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.785228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62ea07f8-923a-4454-8048-add768bd19e8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:48.845608 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62ea07f8-923a-4454-8048-add768bd19e8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.085440 Dec 18 21:01:48.846958 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2125/4251] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:48 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:48.860446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:48.871877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:48.873457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:48.877358 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7f57d14-225a-4864-8eac-5db067be2561 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2655 microversion: 2.32 time: 0.379959 Dec 18 21:01:48.882406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2127/4252] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:48 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2655 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:48.919585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:48.920212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:48.938961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.939420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:48.940233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:48.940673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.185275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8dee859e-84dc-474e-a8c4-20da80704573 req-17b91617-d464-47fb-a428-54599c408454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-deleted", "tag": "f1cdb751-5072-47e3-96f0-96e30fe3bc2f"}, {"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-deleted", "tag": "e339efff-5759-4aa7-8925-f9e71e302622"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:49.187561 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:49.187561 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:49.207350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8dee859e-84dc-474e-a8c4-20da80704573 req-17b91617-d464-47fb-a428-54599c408454 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.208167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8dee859e-84dc-474e-a8c4-20da80704573 req-17b91617-d464-47fb-a428-54599c408454 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.238019 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8dee859e-84dc-474e-a8c4-20da80704573 req-17b91617-d464-47fb-a428-54599c408454 service nova] Creating event network-vif-deleted:f1cdb751-5072-47e3-96f0-96e30fe3bc2f for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 21:01:49.239631 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8dee859e-84dc-474e-a8c4-20da80704573 req-17b91617-d464-47fb-a428-54599c408454 service nova] Creating event network-vif-deleted:e339efff-5759-4aa7-8925-f9e71e302622 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 21:01:49.249036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:49.259321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8dee859e-84dc-474e-a8c4-20da80704573 req-17b91617-d464-47fb-a428-54599c408454 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.361825 Dec 18 21:01:49.261834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:49.262711 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2126/4253] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:48 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:49.279045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:49.288448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:49.289413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:49.300477 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d38df79-20b3-4a99-af73-0b57f944794e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2832 microversion: 2.42 time: 0.387826 Dec 18 21:01:49.302435 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2128/4254] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:48 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2832 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:49.308668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.309137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.309947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.310425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.328483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e38d556-f065-44ef-9662-92e8e8233119 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:49.329124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e38d556-f065-44ef-9662-92e8e8233119 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:49.344070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e38d556-f065-44ef-9662-92e8e8233119 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.347191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e38d556-f065-44ef-9662-92e8e8233119 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.348341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e38d556-f065-44ef-9662-92e8e8233119 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.348982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e38d556-f065-44ef-9662-92e8e8233119 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.596830 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e38d556-f065-44ef-9662-92e8e8233119 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.278362 Dec 18 21:01:49.598883 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2129/4255] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Dec 18 21:01:49 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/os-interface => generated 1830 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:49.648802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7d7d6a1f-a75e-4bbc-8aa6-928a7a48a389 req-a3b9e0d7-d954-4ee1-9f1d-d6514039c029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-unplugged", "status": "completed", "tag": "5740d94d-10b4-4d4f-b84a-14e2647f72c7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:49.650718 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:49.650718 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:01:49.674338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7d7d6a1f-a75e-4bbc-8aa6-928a7a48a389 req-a3b9e0d7-d954-4ee1-9f1d-d6514039c029 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.674813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7d7d6a1f-a75e-4bbc-8aa6-928a7a48a389 req-a3b9e0d7-d954-4ee1-9f1d-d6514039c029 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.717047 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7d7d6a1f-a75e-4bbc-8aa6-928a7a48a389 req-a3b9e0d7-d954-4ee1-9f1d-d6514039c029 service nova] Creating event network-vif-unplugged:5740d94d-10b4-4d4f-b84a-14e2647f72c7 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 21:01:49.727874 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7d7d6a1f-a75e-4bbc-8aa6-928a7a48a389 req-a3b9e0d7-d954-4ee1-9f1d-d6514039c029 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082762 Dec 18 21:01:49.728780 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2130/4256] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:01:49.764808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:49.765787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:49.781548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.782393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.783388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.784037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:49.903375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:49.912274 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dfe04b5b-97e1-443b-9010-e3b58c1a4fc8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.648192 Dec 18 21:01:49.919041 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2127/4257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:49 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:49.942467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9f1a590-9876-401e-887d-889cfdf16076 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:49.947830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9f1a590-9876-401e-887d-889cfdf16076 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:49.990701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1a590-9876-401e-887d-889cfdf16076 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:49.991158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1a590-9876-401e-887d-889cfdf16076 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:50.001621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1a590-9876-401e-887d-889cfdf16076 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:50.002196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9f1a590-9876-401e-887d-889cfdf16076 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:50.075930 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9f1a590-9876-401e-887d-889cfdf16076 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.153662 Dec 18 21:01:50.080900 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2128/4258] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:49 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:50.092900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:50.093778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:50.101995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:50.102521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:50.103330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:50.104103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:50.173069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:50.190794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:50.192841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:50.194294 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34aa04e9-accd-461f-a1ec-8b0511f90d94 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1384 microversion: 2.57 time: 0.434063 Dec 18 21:01:50.195352 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2131/4259] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:49 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1384 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:50.466819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:50.479636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:50.481170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:50.482400 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-86fbadd8-f854-41c2-aa24-c53c5c47cdfb tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 2338 microversion: 2.32 time: 0.399056 Dec 18 21:01:50.488892 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2129/4260] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:50 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 2338 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:50.935869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:50.936496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:50.961063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:50.961802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:50.968301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:50.969173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.093661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38fc96d9-9129-4f23-add1-e9053f30c67b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:51.094680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38fc96d9-9129-4f23-add1-e9053f30c67b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:51.112808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38fc96d9-9129-4f23-add1-e9053f30c67b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.113261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38fc96d9-9129-4f23-add1-e9053f30c67b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.115177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38fc96d9-9129-4f23-add1-e9053f30c67b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.117517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38fc96d9-9129-4f23-add1-e9053f30c67b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.200027 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38fc96d9-9129-4f23-add1-e9053f30c67b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.112322 Dec 18 21:01:51.204539 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2130/4261] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:51 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:51.217921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:51.218953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:51.239429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.242497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.243545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.244139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.537839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:51.558678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:51.563741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:51.566800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e7bf56d7-e1b5-41c1-bcdc-b57c7547fb18 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1372 microversion: 2.57 time: 0.356447 Dec 18 21:01:51.570889 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2131/4262] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:51 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:01:51.579435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-dda12aa7-b586-416d-a7d5-7c9baa4907b9 req-0e5c3ad6-1a21-4c02-a0a7-4ac15aa6f318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-deleted", "tag": "bf2508ae-cc73-498d-b496-3c1f2e87f0f4"}, {"server_uuid": "55fd0fac-2094-4078-8aab-480e37ab25dd", "name": "network-vif-deleted", "tag": "5740d94d-10b4-4d4f-b84a-14e2647f72c7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:51.581201 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:51.581201 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:51.592576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dda12aa7-b586-416d-a7d5-7c9baa4907b9 req-0e5c3ad6-1a21-4c02-a0a7-4ac15aa6f318 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.593377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dda12aa7-b586-416d-a7d5-7c9baa4907b9 req-0e5c3ad6-1a21-4c02-a0a7-4ac15aa6f318 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.617427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-dda12aa7-b586-416d-a7d5-7c9baa4907b9 req-0e5c3ad6-1a21-4c02-a0a7-4ac15aa6f318 service nova] Creating event network-vif-deleted:bf2508ae-cc73-498d-b496-3c1f2e87f0f4 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 21:01:51.619496 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-dda12aa7-b586-416d-a7d5-7c9baa4907b9 req-0e5c3ad6-1a21-4c02-a0a7-4ac15aa6f318 service nova] Creating event network-vif-deleted:5740d94d-10b4-4d4f-b84a-14e2647f72c7 for instance 55fd0fac-2094-4078-8aab-480e37ab25dd on nch1-master-1 Dec 18 21:01:51.633425 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-dda12aa7-b586-416d-a7d5-7c9baa4907b9 req-0e5c3ad6-1a21-4c02-a0a7-4ac15aa6f318 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059650 Dec 18 21:01:51.640129 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2132/4263] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:51 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:01:51.649896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:51.651282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:51.659670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.660140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.661318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.661889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.707341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:51.707806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:51.708266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lazy-loading 'fault' on Instance uuid 55fd0fac-2094-4078-8aab-480e37ab25dd {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:01:51.804041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:51.813690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:51.815942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9073865992504246b9d1699da089c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405bfbeb7b7d47c48b706aa32c6702bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:51.817412 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd2c7c20-7c70-4d35-8df8-daa46e8276be tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 200 len: 1610 microversion: 2.32 time: 0.175243 Dec 18 21:01:51.817993 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2133/4264] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:51 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 1610 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:51.922125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:51.932305 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c140294-6351-49f9-ac46-859e485d433f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 1.000963 Dec 18 21:01:51.934038 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2132/4265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:50 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:52.213515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3fb0cdfe-7b18-4a34-a7f7-f9d0645a781f tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:52.215745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3fb0cdfe-7b18-4a34-a7f7-f9d0645a781f tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:52.225450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb0cdfe-7b18-4a34-a7f7-f9d0645a781f tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.226769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb0cdfe-7b18-4a34-a7f7-f9d0645a781f tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.228482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb0cdfe-7b18-4a34-a7f7-f9d0645a781f tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.229414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fb0cdfe-7b18-4a34-a7f7-f9d0645a781f tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.278535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3fb0cdfe-7b18-4a34-a7f7-f9d0645a781f tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.070848 Dec 18 21:01:52.282305 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2134/4266] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:52 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:52.447574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40db1d08-35b7-4b7d-a255-090c08bb45ac tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:52.448491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-84402986-ecd3-4508-9ce7-578112331112 req-aa88b579-ba1c-481d-a84a-63a6b9e151e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "tag": "f1860d8e-c101-497b-93b4-18753b0bd5c6"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:52.449749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40db1d08-35b7-4b7d-a255-090c08bb45ac tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:52.450113 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:52.450113 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:01:52.459194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40db1d08-35b7-4b7d-a255-090c08bb45ac tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.460850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40db1d08-35b7-4b7d-a255-090c08bb45ac tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.462121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40db1d08-35b7-4b7d-a255-090c08bb45ac tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.462819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40db1d08-35b7-4b7d-a255-090c08bb45ac tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.463693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-84402986-ecd3-4508-9ce7-578112331112 req-aa88b579-ba1c-481d-a84a-63a6b9e151e7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.464666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-84402986-ecd3-4508-9ce7-578112331112 req-aa88b579-ba1c-481d-a84a-63a6b9e151e7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.499847 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-84402986-ecd3-4508-9ce7-578112331112 req-aa88b579-ba1c-481d-a84a-63a6b9e151e7 service nova] Creating event network-changed:f1860d8e-c101-497b-93b4-18753b0bd5c6 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:01:52.515379 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-84402986-ecd3-4508-9ce7-578112331112 req-aa88b579-ba1c-481d-a84a-63a6b9e151e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071062 Dec 18 21:01:52.516017 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2135/4267] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:01:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:01:52.536763 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40db1d08-35b7-4b7d-a255-090c08bb45ac tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.090775 Dec 18 21:01:52.543436 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2133/4268] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:01:52 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:52.594898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:52.600366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:52.612970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.612970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.614844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.616220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.716878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:52.725034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:52.726717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:52.727922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e371eba2-a259-4479-af7a-edb4ab2cd81f tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1357 microversion: 2.57 time: 0.141981 Dec 18 21:01:52.728681 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2136/4269] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:52 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:52.754726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:52.755360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:52.768608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.769465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.770842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.771954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.802606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:01:52.837478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:52.838096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:52.847797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.850545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.851640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.857851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.901211 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] HTTP exception thrown: Instance 55fd0fac-2094-4078-8aab-480e37ab25dd could not be found. Dec 18 21:01:52.902195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Returning 404 to user: Instance 55fd0fac-2094-4078-8aab-480e37ab25dd could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:52.903049 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c989cdb-5971-4a3d-84ae-71c7a7fd4124 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 404 len: 111 microversion: 2.32 time: 0.070023 Dec 18 21:01:52.905045 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2137/4270] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:52 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:01:52.912972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4516183-2e89-4c0d-81ff-88f0eb99f6dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '.version_select at 0x7f714e5d54c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:52.936974 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb4db163-9ffa-4fb3-a4f1-b4196b329b0a tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "DELETE /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 204 len: 0 microversion: 2.57 time: 0.188600 Dec 18 21:01:52.942191 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2134/4271] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:01:52 2021] DELETE /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:01:52.942446 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4516183-2e89-4c0d-81ff-88f0eb99f6dd tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201310450" status: 204 len: 0 microversion: 2.32 time: 0.033286 Dec 18 21:01:52.948134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2138/4272] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 21:01:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201310450 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:01:52.955333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:52.955960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:52.963743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:52.964557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:52.972463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.973168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.975804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.975804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.980691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.982317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:52.986501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:52.986970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:53.105989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:53.118734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:53.120510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:53.126161 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac316b84-8423-4076-b816-ea2ec789dfb8 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1363 microversion: 2.57 time: 0.181050 Dec 18 21:01:53.126851 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2135/4273] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:52 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:53.248766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:53.262810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-815b5226-166c-4d49-a514-31657b2b8cf7 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.312760 Dec 18 21:01:53.263891 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2139/4274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:52 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:53.293491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-80f2ea09-8753-4f74-aced-897e296a6d58 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:53.295036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-80f2ea09-8753-4f74-aced-897e296a6d58 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:53.343088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80f2ea09-8753-4f74-aced-897e296a6d58 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:53.344272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80f2ea09-8753-4f74-aced-897e296a6d58 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:53.347419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80f2ea09-8753-4f74-aced-897e296a6d58 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:53.348445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80f2ea09-8753-4f74-aced-897e296a6d58 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:53.401662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-80f2ea09-8753-4f74-aced-897e296a6d58 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.113085 Dec 18 21:01:53.402689 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2136/4275] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:53 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:53.551026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bdd4c72-0a8a-411d-89c6-29be4ff769e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:53.553268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bdd4c72-0a8a-411d-89c6-29be4ff769e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:53.570607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c72-0a8a-411d-89c6-29be4ff769e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:53.571713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c72-0a8a-411d-89c6-29be4ff769e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:53.574294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c72-0a8a-411d-89c6-29be4ff769e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:53.575138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c72-0a8a-411d-89c6-29be4ff769e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:53.653488 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bdd4c72-0a8a-411d-89c6-29be4ff769e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.108125 Dec 18 21:01:53.654196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2140/4276] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:01:53 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:54.145705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:54.146713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:54.161108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.161569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.162435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.163883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.281406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:54.285676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:54.289464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:54.305409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:54.308143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.308600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.310781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d04306b7d24e96bfb99a2707d24695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3feffe1ea94b838e64069470ea9862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:54.312264 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-91f3196c-b3da-42ea-8b94-fc43c57f9cf0 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 200 len: 1363 microversion: 2.57 time: 0.170847 Dec 18 21:01:54.313382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.315115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.317018 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2137/4277] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:54 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:01:54.415282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aec2daed-47f6-4907-a5f4-6743572a1023 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:54.417268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aec2daed-47f6-4907-a5f4-6743572a1023 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:54.425762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aec2daed-47f6-4907-a5f4-6743572a1023 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.426893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aec2daed-47f6-4907-a5f4-6743572a1023 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.428252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aec2daed-47f6-4907-a5f4-6743572a1023 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.428884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aec2daed-47f6-4907-a5f4-6743572a1023 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.482787 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aec2daed-47f6-4907-a5f4-6743572a1023 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.072811 Dec 18 21:01:54.489022 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2138/4278] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:54 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:01:54.550540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:54.566096 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c89d3fb-a6ef-48d4-8092-f2f403df08d2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.289293 Dec 18 21:01:54.572260 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2141/4279] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:54 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:54.666139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-10c13947-641e-4d9c-8755-cbbf643dbe24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:54.667677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-10c13947-641e-4d9c-8755-cbbf643dbe24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:54.675670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10c13947-641e-4d9c-8755-cbbf643dbe24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.676384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10c13947-641e-4d9c-8755-cbbf643dbe24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.677341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10c13947-641e-4d9c-8755-cbbf643dbe24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:54.677966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10c13947-641e-4d9c-8755-cbbf643dbe24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:54.729203 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-10c13947-641e-4d9c-8755-cbbf643dbe24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.068152 Dec 18 21:01:54.730883 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2139/4280] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:01:54 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:55.335831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:55.337162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] [instance: feba4c00-a0ad-401a-8174-bd55799f5f03] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:55.346279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.347086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.348434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.349251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.372901 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] HTTP exception thrown: Instance feba4c00-a0ad-401a-8174-bd55799f5f03 could not be found. Dec 18 21:01:55.373884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] Returning 404 to user: Instance feba4c00-a0ad-401a-8174-bd55799f5f03 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:55.375300 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-90a233a7-0ddf-440d-bebd-e0d5a7de2f95 tempest-ServerShowV257Test-263529082 tempest-ServerShowV257Test-263529082-project] 10.222.0.13 "GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03" status: 404 len: 111 microversion: 2.57 time: 0.043542 Dec 18 21:01:55.380219 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2142/4281] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:55 2021] GET /compute/v2.1/servers/feba4c00-a0ad-401a-8174-bd55799f5f03 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:01:55.500621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95749972-f159-464d-9c32-b2823737c14a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:55.511606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95749972-f159-464d-9c32-b2823737c14a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:55.521255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95749972-f159-464d-9c32-b2823737c14a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.522769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95749972-f159-464d-9c32-b2823737c14a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.525057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95749972-f159-464d-9c32-b2823737c14a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.525575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95749972-f159-464d-9c32-b2823737c14a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.585623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:55.586497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:55.601903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.603928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.605240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.606030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.612373 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95749972-f159-464d-9c32-b2823737c14a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.119914 Dec 18 21:01:55.624468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2140/4282] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:55 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:55.744681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58eb607e-edb3-4ea4-b255-e23fdf6f54b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:55.747373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58eb607e-edb3-4ea4-b255-e23fdf6f54b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:55.772275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58eb607e-edb3-4ea4-b255-e23fdf6f54b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.775653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58eb607e-edb3-4ea4-b255-e23fdf6f54b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.780646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58eb607e-edb3-4ea4-b255-e23fdf6f54b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:55.782773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58eb607e-edb3-4ea4-b255-e23fdf6f54b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:55.910288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58eb607e-edb3-4ea4-b255-e23fdf6f54b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.171782 Dec 18 21:01:55.911412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2141/4283] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:01:55 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:56.010968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:56.018855 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5030616c-e24a-4d65-8166-82e52ee1a7d9 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.439020 Dec 18 21:01:56.019445 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2143/4284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:55 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:56.628597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1cfa43db-8a54-4112-8bde-0f01be44fa28 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:56.630405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1cfa43db-8a54-4112-8bde-0f01be44fa28 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:56.644614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cfa43db-8a54-4112-8bde-0f01be44fa28 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:56.645890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cfa43db-8a54-4112-8bde-0f01be44fa28 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:56.650422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cfa43db-8a54-4112-8bde-0f01be44fa28 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:56.652274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cfa43db-8a54-4112-8bde-0f01be44fa28 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:56.743783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1cfa43db-8a54-4112-8bde-0f01be44fa28 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.119998 Dec 18 21:01:56.745619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2142/4285] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:56 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:56.921889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2680d4ed-53a2-42cf-b287-0c968efa7b0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:56.923234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2680d4ed-53a2-42cf-b287-0c968efa7b0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:56.934804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2680d4ed-53a2-42cf-b287-0c968efa7b0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:56.935253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2680d4ed-53a2-42cf-b287-0c968efa7b0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:56.936074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2680d4ed-53a2-42cf-b287-0c968efa7b0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:56.947049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2680d4ed-53a2-42cf-b287-0c968efa7b0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.031640 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2680d4ed-53a2-42cf-b287-0c968efa7b0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.113620 Dec 18 21:01:57.032661 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2144/4286] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:01:56 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:57.038291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:57.039690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:57.049287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.050115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.051168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.051990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.224396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:57.233054 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46ece0f3-315b-4cd7-88f7-1e2144788ee2 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.200082 Dec 18 21:01:57.233776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2143/4287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:57 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:57.759333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0ce8622f-7720-434d-bfee-f98f3004c33c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:57.763840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:57.764442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:57.766845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0ce8622f-7720-434d-bfee-f98f3004c33c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:57.778195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ce8622f-7720-434d-bfee-f98f3004c33c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.778687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ce8622f-7720-434d-bfee-f98f3004c33c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.781090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.781540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.782351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.783296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ce8622f-7720-434d-bfee-f98f3004c33c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.783735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ce8622f-7720-434d-bfee-f98f3004c33c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.786211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.806594 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] HTTP exception thrown: Instance 55fd0fac-2094-4078-8aab-480e37ab25dd could not be found. Dec 18 21:01:57.808654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Returning 404 to user: Instance 55fd0fac-2094-4078-8aab-480e37ab25dd could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:57.809843 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-92d267da-3b13-4991-8059-2dbe291bfdc0 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "DELETE /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 404 len: 111 microversion: 2.32 time: 0.067537 Dec 18 21:01:57.811738 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2145/4288] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:01:57 2021] DELETE /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:01:57.820303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:57.821334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] [instance: 55fd0fac-2094-4078-8aab-480e37ab25dd] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:57.829106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.829860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.830874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:57.831322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:57.837857 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0ce8622f-7720-434d-bfee-f98f3004c33c tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.083992 Dec 18 21:01:57.843736 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2144/4289] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:57 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:57.851863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] HTTP exception thrown: Instance 55fd0fac-2094-4078-8aab-480e37ab25dd could not be found. Dec 18 21:01:57.852736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] Returning 404 to user: Instance 55fd0fac-2094-4078-8aab-480e37ab25dd could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:01:57.853811 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8d835c5f-335b-49b0-9cfa-59cf02ba3f56 tempest-TaggedBootDevicesTest-22902861 tempest-TaggedBootDevicesTest-22902861-project] 10.222.0.13 "GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd" status: 404 len: 111 microversion: 2.32 time: 0.037975 Dec 18 21:01:57.854634 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2146/4290] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:01:57 2021] GET /compute/v2.1/servers/55fd0fac-2094-4078-8aab-480e37ab25dd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:01:58.043046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dfc7861d-e631-4939-8aba-c2b93b984655 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:58.044084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dfc7861d-e631-4939-8aba-c2b93b984655 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:58.052115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfc7861d-e631-4939-8aba-c2b93b984655 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:58.052649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfc7861d-e631-4939-8aba-c2b93b984655 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:58.053543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfc7861d-e631-4939-8aba-c2b93b984655 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:58.053991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfc7861d-e631-4939-8aba-c2b93b984655 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:58.101687 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dfc7861d-e631-4939-8aba-c2b93b984655 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.062783 Dec 18 21:01:58.102422 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2145/4291] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:01:58 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:58.262331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:58.263502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:58.270804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:58.271261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:58.272095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:58.272526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:58.475488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:58.485156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-06ae6d65-6120-4baa-b03d-b889b3c25afb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.237325 Dec 18 21:01:58.486178 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2147/4292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:58 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:58.851127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d28ad4f-90f2-4c96-9333-fab25b87676e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:58.852352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d28ad4f-90f2-4c96-9333-fab25b87676e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:58.860560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d28ad4f-90f2-4c96-9333-fab25b87676e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:58.861020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d28ad4f-90f2-4c96-9333-fab25b87676e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:58.861857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d28ad4f-90f2-4c96-9333-fab25b87676e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:58.862397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d28ad4f-90f2-4c96-9333-fab25b87676e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:58.905674 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d28ad4f-90f2-4c96-9333-fab25b87676e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.059070 Dec 18 21:01:58.906709 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2146/4293] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:58 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:01:59.124111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-63f274c9-dc13-47e2-a631-38de3c5fe88e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:59.125043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-63f274c9-dc13-47e2-a631-38de3c5fe88e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:59.132056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63f274c9-dc13-47e2-a631-38de3c5fe88e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:59.132516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63f274c9-dc13-47e2-a631-38de3c5fe88e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:59.133374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63f274c9-dc13-47e2-a631-38de3c5fe88e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:59.133824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-63f274c9-dc13-47e2-a631-38de3c5fe88e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:59.192191 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-63f274c9-dc13-47e2-a631-38de3c5fe88e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.074246 Dec 18 21:01:59.193001 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2148/4294] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:01:59 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:01:59.506780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:01:59.507735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:59.517239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:59.517741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:59.518664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:59.519419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:59.697352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:01:59.709919 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-62587daa-8dd4-4cba-b7d4-cd856d2de786 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1516 microversion: 2.1 time: 0.206808 Dec 18 21:01:59.723555 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2147/4295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:59 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:01:59.919014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71c42ac3-769f-4f00-a94f-3edc17b6c175 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:01:59.920034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71c42ac3-769f-4f00-a94f-3edc17b6c175 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:01:59.927461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c42ac3-769f-4f00-a94f-3edc17b6c175 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:59.928166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c42ac3-769f-4f00-a94f-3edc17b6c175 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:59.928974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c42ac3-769f-4f00-a94f-3edc17b6c175 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:01:59.929428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71c42ac3-769f-4f00-a94f-3edc17b6c175 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:01:59.969954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71c42ac3-769f-4f00-a94f-3edc17b6c175 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 24567 microversion: 2.1 time: 0.055453 Dec 18 21:01:59.970926 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2149/4296] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:01:59 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:00.204870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-19096721-dc2b-4c0a-9cfc-83ac8a5d73b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:00.206544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-19096721-dc2b-4c0a-9cfc-83ac8a5d73b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:00.233999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19096721-dc2b-4c0a-9cfc-83ac8a5d73b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:00.234725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19096721-dc2b-4c0a-9cfc-83ac8a5d73b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:00.236385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19096721-dc2b-4c0a-9cfc-83ac8a5d73b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:00.238351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19096721-dc2b-4c0a-9cfc-83ac8a5d73b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:00.326104 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-19096721-dc2b-4c0a-9cfc-83ac8a5d73b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.124815 Dec 18 21:02:00.327667 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2148/4297] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:00 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:00.730828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:00.731795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:00.739493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:00.740200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:00.741558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:00.742055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:00.925978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:00.935061 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1b52f25-7228-44d3-bd5f-b16efda92093 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1522 microversion: 2.1 time: 0.208766 Dec 18 21:02:00.936397 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2150/4298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:00 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:00.984000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1d8d701-6fc2-432e-b322-748861cd291b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:00.985336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1d8d701-6fc2-432e-b322-748861cd291b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:00.993556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d701-6fc2-432e-b322-748861cd291b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:00.994468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d701-6fc2-432e-b322-748861cd291b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:00.995657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d701-6fc2-432e-b322-748861cd291b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:00.996373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d701-6fc2-432e-b322-748861cd291b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:01.078356 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1d8d701-6fc2-432e-b322-748861cd291b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.100743 Dec 18 21:02:01.080305 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2149/4299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:00 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:01.341494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecd3e65c-be62-4a47-bb15-2cea44a45ef2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:01.343644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecd3e65c-be62-4a47-bb15-2cea44a45ef2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:01.360765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd3e65c-be62-4a47-bb15-2cea44a45ef2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:01.361227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd3e65c-be62-4a47-bb15-2cea44a45ef2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:01.362100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd3e65c-be62-4a47-bb15-2cea44a45ef2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:01.362577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd3e65c-be62-4a47-bb15-2cea44a45ef2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:01.412200 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecd3e65c-be62-4a47-bb15-2cea44a45ef2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.078506 Dec 18 21:02:01.413246 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2151/4300] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:01 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:01.953565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:01.954311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:01.966794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:01.967559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:01.968541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:01.969244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:02.094585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3167fd2-c3ab-4a71-ad4f-05838bd3b350 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:02.099093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3167fd2-c3ab-4a71-ad4f-05838bd3b350 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:02.108420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3167fd2-c3ab-4a71-ad4f-05838bd3b350 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:02.109031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3167fd2-c3ab-4a71-ad4f-05838bd3b350 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:02.110691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3167fd2-c3ab-4a71-ad4f-05838bd3b350 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:02.111224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3167fd2-c3ab-4a71-ad4f-05838bd3b350 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:02.169647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:02.173793 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3167fd2-c3ab-4a71-ad4f-05838bd3b350 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.084525 Dec 18 21:02:02.176641 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2152/4301] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:02 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:02.193761 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaa6295a-e531-4f7e-8ea5-66d556051b59 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1522 microversion: 2.1 time: 0.244364 Dec 18 21:02:02.194821 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2150/4302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:01 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:02.426561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a0a2d87f-2e84-4124-897d-2053dd5ae463 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:02.427693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a0a2d87f-2e84-4124-897d-2053dd5ae463 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:02.435201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0a2d87f-2e84-4124-897d-2053dd5ae463 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:02.435661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0a2d87f-2e84-4124-897d-2053dd5ae463 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:02.436479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0a2d87f-2e84-4124-897d-2053dd5ae463 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:02.436927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a0a2d87f-2e84-4124-897d-2053dd5ae463 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:02.496013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a0a2d87f-2e84-4124-897d-2053dd5ae463 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 14 microversion: 2.42 time: 0.075063 Dec 18 21:02:02.499783 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2153/4303] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:02 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:03.187719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5ab31ba-082c-4af7-9029-e7cd9a749c6e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:03.193232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c5ab31ba-082c-4af7-9029-e7cd9a749c6e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:03.211459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5ab31ba-082c-4af7-9029-e7cd9a749c6e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.212227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5ab31ba-082c-4af7-9029-e7cd9a749c6e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.212543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:03.213457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:03.214570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5ab31ba-082c-4af7-9029-e7cd9a749c6e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.215282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5ab31ba-082c-4af7-9029-e7cd9a749c6e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.227015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.227465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.229518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.232304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.273840 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5ab31ba-082c-4af7-9029-e7cd9a749c6e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.090753 Dec 18 21:02:03.275033 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2151/4304] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:03 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:03.455757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:03.464399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec59338d-e392-4295-9c17-30eea4a49033 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1507 microversion: 2.1 time: 0.256064 Dec 18 21:02:03.465184 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2154/4305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:03 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:03.483454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:03.484418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:03.494541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.496721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.498421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.499117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.510529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-535f9d84-e09f-4de4-806b-57d67309b238 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:03.511420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-535f9d84-e09f-4de4-806b-57d67309b238 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:03.529028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f9d84-e09f-4de4-806b-57d67309b238 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.529541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f9d84-e09f-4de4-806b-57d67309b238 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.535866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f9d84-e09f-4de4-806b-57d67309b238 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.536362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-535f9d84-e09f-4de4-806b-57d67309b238 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.626468 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-535f9d84-e09f-4de4-806b-57d67309b238 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 8205 microversion: 2.42 time: 0.122419 Dec 18 21:02:03.627152 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2155/4306] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:03 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 8205 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:03.824400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:03.840710 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4402d613-2554-4029-ae27-ba386de9af2a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 200 len: 1507 microversion: 2.1 time: 0.363006 Dec 18 21:02:03.853055 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2152/4307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:03 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:03.860167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:03.861203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:03.881046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.882684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.884227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:03.887119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:03.973917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:02:04.152464 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b0eee99c-4777-4938-bc0a-620bcacd59ea tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 204 len: 0 microversion: 2.1 time: 0.297307 Dec 18 21:02:04.167745 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2156/4308] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:02:03 2021] DELETE /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:04.289974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-49cb50c7-4ef1-43a6-986c-461f6eaaf169 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:04.290932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-49cb50c7-4ef1-43a6-986c-461f6eaaf169 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:04.305626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49cb50c7-4ef1-43a6-986c-461f6eaaf169 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:04.306620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49cb50c7-4ef1-43a6-986c-461f6eaaf169 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:04.307776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49cb50c7-4ef1-43a6-986c-461f6eaaf169 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:04.308217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49cb50c7-4ef1-43a6-986c-461f6eaaf169 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:04.355342 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-49cb50c7-4ef1-43a6-986c-461f6eaaf169 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.073380 Dec 18 21:02:04.356012 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2153/4309] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:04 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:04.441865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1505779501", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "d6e4e95e-eb3d-4204-ba23-6134021d7916"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:04.523183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] validate_networks() for [('d6e4e95e-eb3d-4204-ba23-6134021d7916', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:02:04.639778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d85a996d-473d-44ac-b903-e9e8d103c1e4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:04.641173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d85a996d-473d-44ac-b903-e9e8d103c1e4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:04.653283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d85a996d-473d-44ac-b903-e9e8d103c1e4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:04.654881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d85a996d-473d-44ac-b903-e9e8d103c1e4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:04.655931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d85a996d-473d-44ac-b903-e9e8d103c1e4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:04.661974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d85a996d-473d-44ac-b903-e9e8d103c1e4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:04.778007 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d85a996d-473d-44ac-b903-e9e8d103c1e4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 16385 microversion: 2.42 time: 0.142604 Dec 18 21:02:04.782611 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2154/4310] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:04 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 16385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:05.275075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:02:05.276554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:02:05.277249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:02:05.277727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:02:05.278388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:02:05.287347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:05.288098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:05.289202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:05.289646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:05.309600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Getting quotas for project 653558ed3d3248ea8f07a3066b6c3d88. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:02:05.314929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Getting quotas for user 54121b5d80d64c4796889183c5197853 and project 653558ed3d3248ea8f07a3066b6c3d88. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:02:05.328192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:02:05.330741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:02:05.369497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cbf7d183-8abb-4eda-a588-4406dd7d0359 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:05.371707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cbf7d183-8abb-4eda-a588-4406dd7d0359 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:05.390873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbf7d183-8abb-4eda-a588-4406dd7d0359 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:05.391363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbf7d183-8abb-4eda-a588-4406dd7d0359 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:05.393245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbf7d183-8abb-4eda-a588-4406dd7d0359 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:05.393701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbf7d183-8abb-4eda-a588-4406dd7d0359 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:05.421170 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ebc60c5-93bb-4e4c-8d33-ae132f820588 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983559 Dec 18 21:02:05.422006 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2157/4311] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:02:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:02:05.437847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-747b8bff-4a4d-4e4d-b4f8-37fa81a544f6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:05.438903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-747b8bff-4a4d-4e4d-b4f8-37fa81a544f6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:05.488343 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cbf7d183-8abb-4eda-a588-4406dd7d0359 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.124145 Dec 18 21:02:05.492371 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2155/4312] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:05 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:05.521215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-747b8bff-4a4d-4e4d-b4f8-37fa81a544f6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:05.531261 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-747b8bff-4a4d-4e4d-b4f8-37fa81a544f6 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1218 microversion: 2.1 time: 0.101010 Dec 18 21:02:05.531903 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2158/4313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:05 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:02:05.779345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-5eb17de3-de83-42f4-a627-f13704bb3438 req-e94e90a7-5635-4f46-a0a2-071548f48dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c88a02-9467-48b3-a95a-92083533337d", "name": "network-vif-plugged", "status": "completed", "tag": "5c24945b-9a10-472d-b86a-c65638bdf782"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:05.791288 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:05.791288 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:02:05.798785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83ab3aac-0f73-4f4d-82da-2bbe8ea47da5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:05.802442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83ab3aac-0f73-4f4d-82da-2bbe8ea47da5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:05.820022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5eb17de3-de83-42f4-a627-f13704bb3438 req-e94e90a7-5635-4f46-a0a2-071548f48dd5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:05.821590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ab3aac-0f73-4f4d-82da-2bbe8ea47da5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:05.822748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ab3aac-0f73-4f4d-82da-2bbe8ea47da5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:05.823918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5eb17de3-de83-42f4-a627-f13704bb3438 req-e94e90a7-5635-4f46-a0a2-071548f48dd5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:05.825336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ab3aac-0f73-4f4d-82da-2bbe8ea47da5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:05.827162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ab3aac-0f73-4f4d-82da-2bbe8ea47da5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:05.852773 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-5eb17de3-de83-42f4-a627-f13704bb3438 req-e94e90a7-5635-4f46-a0a2-071548f48dd5 service nova] Creating event network-vif-plugged:5c24945b-9a10-472d-b86a-c65638bdf782 for instance 42c88a02-9467-48b3-a95a-92083533337d on nch2-master-1 Dec 18 21:02:05.858791 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-5eb17de3-de83-42f4-a627-f13704bb3438 req-e94e90a7-5635-4f46-a0a2-071548f48dd5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096183 Dec 18 21:02:05.860766 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2156/4314] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:02:05.889519 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83ab3aac-0f73-4f4d-82da-2bbe8ea47da5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 16385 microversion: 2.42 time: 0.101258 Dec 18 21:02:05.894769 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2159/4315] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:05 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 16385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:06.503852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1db8e33e-7860-45fc-8ec1-b625f8651b15 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:06.505761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1db8e33e-7860-45fc-8ec1-b625f8651b15 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:06.517291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1db8e33e-7860-45fc-8ec1-b625f8651b15 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:06.518768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1db8e33e-7860-45fc-8ec1-b625f8651b15 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:06.520417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1db8e33e-7860-45fc-8ec1-b625f8651b15 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:06.521451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1db8e33e-7860-45fc-8ec1-b625f8651b15 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:06.551402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:06.553239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:06.570974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:06.571740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:06.573465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:06.575340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:06.612832 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1db8e33e-7860-45fc-8ec1-b625f8651b15 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.106715 Dec 18 21:02:06.615666 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2157/4316] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:06 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:06.697488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:06.708466 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-14609a67-7584-40ed-8e49-9dd88c10c99f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1222 microversion: 2.1 time: 0.162466 Dec 18 21:02:06.720691 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2160/4317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:06 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:06.909643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c91ddc2-8fdd-40cc-9b9b-f63a4ce3d4d7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:06.911020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1c91ddc2-8fdd-40cc-9b9b-f63a4ce3d4d7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:06.939414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c91ddc2-8fdd-40cc-9b9b-f63a4ce3d4d7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:06.951466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c91ddc2-8fdd-40cc-9b9b-f63a4ce3d4d7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:06.952909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c91ddc2-8fdd-40cc-9b9b-f63a4ce3d4d7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:06.954697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c91ddc2-8fdd-40cc-9b9b-f63a4ce3d4d7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:07.044090 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c91ddc2-8fdd-40cc-9b9b-f63a4ce3d4d7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 16385 microversion: 2.42 time: 0.143558 Dec 18 21:02:07.044090 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2158/4318] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:06 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 16385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:07.063279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-54647b90-096b-444d-bcb8-ae84ae70343a req-64c9ca86-544c-4357-b402-d57eb1f6b7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c88a02-9467-48b3-a95a-92083533337d", "name": "network-vif-deleted", "tag": "5c24945b-9a10-472d-b86a-c65638bdf782"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:07.065207 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:07.065207 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:02:07.074709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-54647b90-096b-444d-bcb8-ae84ae70343a req-64c9ca86-544c-4357-b402-d57eb1f6b7c3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:07.076445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-54647b90-096b-444d-bcb8-ae84ae70343a req-64c9ca86-544c-4357-b402-d57eb1f6b7c3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:07.093702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-54647b90-096b-444d-bcb8-ae84ae70343a req-64c9ca86-544c-4357-b402-d57eb1f6b7c3 service nova] Creating event network-vif-deleted:5c24945b-9a10-472d-b86a-c65638bdf782 for instance 42c88a02-9467-48b3-a95a-92083533337d on nch2-master-1 Dec 18 21:02:07.100744 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-54647b90-096b-444d-bcb8-ae84ae70343a req-64c9ca86-544c-4357-b402-d57eb1f6b7c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046011 Dec 18 21:02:07.101739 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2161/4319] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:02:07.628537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b083efe-2840-400f-92cf-9dc853f21ea7 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:07.630120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b083efe-2840-400f-92cf-9dc853f21ea7 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:07.652599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b083efe-2840-400f-92cf-9dc853f21ea7 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:07.653059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b083efe-2840-400f-92cf-9dc853f21ea7 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:07.653874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b083efe-2840-400f-92cf-9dc853f21ea7 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:07.654339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b083efe-2840-400f-92cf-9dc853f21ea7 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:07.727376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:07.728306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:07.740336 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b083efe-2840-400f-92cf-9dc853f21ea7 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.116582 Dec 18 21:02:07.746776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2159/4320] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:07 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:07.754406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:07.756194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:07.759547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:07.761799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:07.907958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:07.918989 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6308a28a-a4e5-4d27-accc-a72806c0e442 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1276 microversion: 2.1 time: 0.197214 Dec 18 21:02:07.920928 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2162/4321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:07 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:02:08.058440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cf741fe-30b9-4f54-9f2a-57b0e9a985b1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:08.059481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cf741fe-30b9-4f54-9f2a-57b0e9a985b1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:08.067037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf741fe-30b9-4f54-9f2a-57b0e9a985b1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:08.067806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf741fe-30b9-4f54-9f2a-57b0e9a985b1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:08.068851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf741fe-30b9-4f54-9f2a-57b0e9a985b1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:08.069522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cf741fe-30b9-4f54-9f2a-57b0e9a985b1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:08.124067 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cf741fe-30b9-4f54-9f2a-57b0e9a985b1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 16385 microversion: 2.42 time: 0.073261 Dec 18 21:02:08.128896 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2160/4322] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:08 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 16385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:08.752832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45203019-1490-4e6f-82e8-8f3a302cf505 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:08.754157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45203019-1490-4e6f-82e8-8f3a302cf505 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:08.762318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45203019-1490-4e6f-82e8-8f3a302cf505 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:08.763031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45203019-1490-4e6f-82e8-8f3a302cf505 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:08.764162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45203019-1490-4e6f-82e8-8f3a302cf505 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:08.764847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45203019-1490-4e6f-82e8-8f3a302cf505 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:08.833331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45203019-1490-4e6f-82e8-8f3a302cf505 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.083845 Dec 18 21:02:08.841247 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2163/4323] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:08 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:08.938601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:08.940182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:08.953243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:08.955535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:08.958161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:08.959609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:09.142201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b79bedd1-f579-4642-9f04-2695ac66e380 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:09.143503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b79bedd1-f579-4642-9f04-2695ac66e380 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:09.158952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b79bedd1-f579-4642-9f04-2695ac66e380 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:09.162585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b79bedd1-f579-4642-9f04-2695ac66e380 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:09.165681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b79bedd1-f579-4642-9f04-2695ac66e380 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:09.167624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b79bedd1-f579-4642-9f04-2695ac66e380 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:09.268809 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b79bedd1-f579-4642-9f04-2695ac66e380 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.135776 Dec 18 21:02:09.270281 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2164/4324] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:09 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:09.280393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:09.291973 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-592faefd-ead7-41c6-95f7-932b2da72b3a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1318 microversion: 2.1 time: 0.357625 Dec 18 21:02:09.295994 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2161/4325] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:08 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:09.852621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64fdcfb6-72db-4c2c-937e-e03ca5c3b186 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:09.854558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64fdcfb6-72db-4c2c-937e-e03ca5c3b186 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:09.865669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64fdcfb6-72db-4c2c-937e-e03ca5c3b186 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:09.874149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64fdcfb6-72db-4c2c-937e-e03ca5c3b186 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:09.875926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64fdcfb6-72db-4c2c-937e-e03ca5c3b186 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:09.876590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64fdcfb6-72db-4c2c-937e-e03ca5c3b186 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:09.946469 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64fdcfb6-72db-4c2c-937e-e03ca5c3b186 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.102450 Dec 18 21:02:09.950099 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2165/4326] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:09 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:10.048683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-165f24b2-7ed8-4cf8-93cc-559369fdd2f9 req-e232494c-1e21-4000-b2c3-9bea72351f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa4b3a2-31da-4bab-a701-6ace555f90a6", "tag": "fc604f11-f233-4aba-8228-e4d182d18996"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:10.052330 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:10.052330 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:02:10.282616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-36c98f83-a2d8-43af-9921-2303b28b0455 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:10.284472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-36c98f83-a2d8-43af-9921-2303b28b0455 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:10.299305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36c98f83-a2d8-43af-9921-2303b28b0455 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:10.302824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36c98f83-a2d8-43af-9921-2303b28b0455 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:10.307909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36c98f83-a2d8-43af-9921-2303b28b0455 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:10.311261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36c98f83-a2d8-43af-9921-2303b28b0455 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:10.415163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-36c98f83-a2d8-43af-9921-2303b28b0455 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.130131 Dec 18 21:02:10.417151 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2166/4327] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:10 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:10.424402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:10.425880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:10.435216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:10.435962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:10.437196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:10.437810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:10.439536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-165f24b2-7ed8-4cf8-93cc-559369fdd2f9 req-e232494c-1e21-4000-b2c3-9bea72351f9e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:10.440218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-165f24b2-7ed8-4cf8-93cc-559369fdd2f9 req-e232494c-1e21-4000-b2c3-9bea72351f9e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:10.455862 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-165f24b2-7ed8-4cf8-93cc-559369fdd2f9 req-e232494c-1e21-4000-b2c3-9bea72351f9e service nova] Creating event network-changed:fc604f11-f233-4aba-8228-e4d182d18996 for instance caa4b3a2-31da-4bab-a701-6ace555f90a6 on nch1-master-1 Dec 18 21:02:10.462820 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-165f24b2-7ed8-4cf8-93cc-559369fdd2f9 req-e232494c-1e21-4000-b2c3-9bea72351f9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417949 Dec 18 21:02:10.464475 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2162/4328] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:02:10.697412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:10.708941 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a6a93502-82b4-4131-b181-ed43b88f9bd8 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1318 microversion: 2.1 time: 0.286644 Dec 18 21:02:10.718864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2167/4329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:10 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:10.962656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a627541-e421-489e-8906-c3fc5d0e7bc2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:10.964615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a627541-e421-489e-8906-c3fc5d0e7bc2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:10.972738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a627541-e421-489e-8906-c3fc5d0e7bc2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:10.973592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a627541-e421-489e-8906-c3fc5d0e7bc2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:10.974764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a627541-e421-489e-8906-c3fc5d0e7bc2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:10.975472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a627541-e421-489e-8906-c3fc5d0e7bc2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:11.024560 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a627541-e421-489e-8906-c3fc5d0e7bc2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.067577 Dec 18 21:02:11.030183 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2163/4330] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:10 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:11.428703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8791b030-22ad-492d-ba42-40286ff9fffb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:11.429863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8791b030-22ad-492d-ba42-40286ff9fffb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:11.452874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8791b030-22ad-492d-ba42-40286ff9fffb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:11.453411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8791b030-22ad-492d-ba42-40286ff9fffb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:11.457140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8791b030-22ad-492d-ba42-40286ff9fffb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:11.458148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8791b030-22ad-492d-ba42-40286ff9fffb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:11.540145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8791b030-22ad-492d-ba42-40286ff9fffb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.112352 Dec 18 21:02:11.542489 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2168/4331] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:11 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:11.732006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:11.732777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:11.742408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:11.742875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:11.743706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:11.744126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:11.918696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:11.926827 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c049d85d-2f86-41c6-8f61-904642d7f74a tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1318 microversion: 2.1 time: 0.200334 Dec 18 21:02:11.934515 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2164/4332] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:11 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:12.039768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-818d0437-99cf-4a87-ac7d-85fc64f98515 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:12.040814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-818d0437-99cf-4a87-ac7d-85fc64f98515 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:12.054065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-818d0437-99cf-4a87-ac7d-85fc64f98515 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:12.054937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-818d0437-99cf-4a87-ac7d-85fc64f98515 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:12.056164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-818d0437-99cf-4a87-ac7d-85fc64f98515 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:12.056788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-818d0437-99cf-4a87-ac7d-85fc64f98515 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:12.126546 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-818d0437-99cf-4a87-ac7d-85fc64f98515 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.092176 Dec 18 21:02:12.127817 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2169/4333] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:12 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:12.552807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8008d6c9-852a-45c1-92e6-5dd7a3c5e894 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:12.553844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8008d6c9-852a-45c1-92e6-5dd7a3c5e894 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:12.564053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8008d6c9-852a-45c1-92e6-5dd7a3c5e894 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:12.566225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8008d6c9-852a-45c1-92e6-5dd7a3c5e894 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:12.568332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8008d6c9-852a-45c1-92e6-5dd7a3c5e894 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:12.570013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8008d6c9-852a-45c1-92e6-5dd7a3c5e894 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:12.658907 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8008d6c9-852a-45c1-92e6-5dd7a3c5e894 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.108890 Dec 18 21:02:12.667601 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2165/4334] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:12 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:12.954129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:12.955891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:12.966018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:12.968932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:12.970576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:12.972524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:13.141325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2df1ee78-ffc4-4929-9c9f-4b24b688c056 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:13.142960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2df1ee78-ffc4-4929-9c9f-4b24b688c056 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:13.152624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df1ee78-ffc4-4929-9c9f-4b24b688c056 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:13.153371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df1ee78-ffc4-4929-9c9f-4b24b688c056 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:13.154498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df1ee78-ffc4-4929-9c9f-4b24b688c056 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:13.155173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2df1ee78-ffc4-4929-9c9f-4b24b688c056 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:13.243469 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2df1ee78-ffc4-4929-9c9f-4b24b688c056 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.106693 Dec 18 21:02:13.250541 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2166/4335] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:13 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:13.381765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:13.389721 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f6d93100-53c4-4616-975d-733c61316590 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1318 microversion: 2.1 time: 0.448259 Dec 18 21:02:13.402071 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2170/4336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:12 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:13.674878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-997e83bd-3f26-4565-a8ae-6804b770492f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:13.676159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-997e83bd-3f26-4565-a8ae-6804b770492f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:13.689794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997e83bd-3f26-4565-a8ae-6804b770492f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:13.691361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997e83bd-3f26-4565-a8ae-6804b770492f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:13.692782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997e83bd-3f26-4565-a8ae-6804b770492f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:13.694702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997e83bd-3f26-4565-a8ae-6804b770492f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:13.782080 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-997e83bd-3f26-4565-a8ae-6804b770492f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.111712 Dec 18 21:02:13.782787 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2167/4337] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:13 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:14.256135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e889acfe-f9b8-4158-80ae-9bea4c385e69 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:14.257842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e889acfe-f9b8-4158-80ae-9bea4c385e69 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:14.266232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e889acfe-f9b8-4158-80ae-9bea4c385e69 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:14.266980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e889acfe-f9b8-4158-80ae-9bea4c385e69 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:14.268603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e889acfe-f9b8-4158-80ae-9bea4c385e69 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:14.269702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e889acfe-f9b8-4158-80ae-9bea4c385e69 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:14.323791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e889acfe-f9b8-4158-80ae-9bea4c385e69 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.071971 Dec 18 21:02:14.325241 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2171/4338] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:14 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:14.410416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:14.410886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:14.435064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:14.436205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:14.437987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:14.438588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:14.609683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:14.618734 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-370e78d8-889d-48c3-b51f-897d9928ae04 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1318 microversion: 2.1 time: 0.212654 Dec 18 21:02:14.620235 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2168/4339] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:14 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:14.795202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e88233b7-93fe-4c2f-add4-d535235af8fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:14.796382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e88233b7-93fe-4c2f-add4-d535235af8fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:14.805953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e88233b7-93fe-4c2f-add4-d535235af8fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:14.806678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e88233b7-93fe-4c2f-add4-d535235af8fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:14.808349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e88233b7-93fe-4c2f-add4-d535235af8fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:14.809189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e88233b7-93fe-4c2f-add4-d535235af8fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:14.863126 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e88233b7-93fe-4c2f-add4-d535235af8fd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.073053 Dec 18 21:02:14.864032 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2172/4340] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:14 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:15.335595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44a1c287-e1d1-4af3-ba9a-fb25419c505d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:15.336782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-44a1c287-e1d1-4af3-ba9a-fb25419c505d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:15.344667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44a1c287-e1d1-4af3-ba9a-fb25419c505d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:15.345138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44a1c287-e1d1-4af3-ba9a-fb25419c505d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:15.346092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44a1c287-e1d1-4af3-ba9a-fb25419c505d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:15.346615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44a1c287-e1d1-4af3-ba9a-fb25419c505d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:15.392648 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44a1c287-e1d1-4af3-ba9a-fb25419c505d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.061060 Dec 18 21:02:15.396963 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2169/4341] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:15 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:15.640436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:15.645549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:15.672125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:15.672790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:15.676947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:15.677779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:15.805393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-27248768-e932-4c4c-bdd9-62d84b883a0b req-2087452b-13d7-4d71-8353-bd29c1b7bb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa4b3a2-31da-4bab-a701-6ace555f90a6", "name": "network-vif-plugged", "status": "completed", "tag": "fc604f11-f233-4aba-8228-e4d182d18996"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:15.808388 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:15.808388 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:02:15.839747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-27248768-e932-4c4c-bdd9-62d84b883a0b req-2087452b-13d7-4d71-8353-bd29c1b7bb8d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:15.842280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-27248768-e932-4c4c-bdd9-62d84b883a0b req-2087452b-13d7-4d71-8353-bd29c1b7bb8d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:15.881713 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-27248768-e932-4c4c-bdd9-62d84b883a0b req-2087452b-13d7-4d71-8353-bd29c1b7bb8d service nova] Creating event network-vif-plugged:fc604f11-f233-4aba-8228-e4d182d18996 for instance caa4b3a2-31da-4bab-a701-6ace555f90a6 on nch1-master-1 Dec 18 21:02:15.894858 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-27248768-e932-4c4c-bdd9-62d84b883a0b req-2087452b-13d7-4d71-8353-bd29c1b7bb8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092977 Dec 18 21:02:15.898145 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2170/4342] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:02:15.912328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ebf8c698-aeec-40ab-b675-604d65a31515 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:15.919586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ebf8c698-aeec-40ab-b675-604d65a31515 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:15.942760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebf8c698-aeec-40ab-b675-604d65a31515 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:15.944918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebf8c698-aeec-40ab-b675-604d65a31515 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:15.960832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebf8c698-aeec-40ab-b675-604d65a31515 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:15.963643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebf8c698-aeec-40ab-b675-604d65a31515 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:15.980397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:15.991279 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f21ca997-5a14-4dee-8aa3-f80a78dede1f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1318 microversion: 2.1 time: 0.358027 Dec 18 21:02:15.992090 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2173/4343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:15 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:16.043203 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ebf8c698-aeec-40ab-b675-604d65a31515 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.142405 Dec 18 21:02:16.044744 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2171/4344] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:15 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:16.406378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0c02dec2-38b0-47b0-99fb-a2867598070b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:16.407560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0c02dec2-38b0-47b0-99fb-a2867598070b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:16.416255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c02dec2-38b0-47b0-99fb-a2867598070b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:16.417031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c02dec2-38b0-47b0-99fb-a2867598070b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:16.418054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c02dec2-38b0-47b0-99fb-a2867598070b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:16.418721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0c02dec2-38b0-47b0-99fb-a2867598070b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:16.472651 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0c02dec2-38b0-47b0-99fb-a2867598070b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.071841 Dec 18 21:02:16.478359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2174/4345] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:16 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:17.012118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:17.014111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:17.024509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:17.025819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:17.027429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:17.028060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:17.056566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57435224-7147-4f89-9dd8-04c2c9dfb480 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:17.059454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57435224-7147-4f89-9dd8-04c2c9dfb480 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:17.073370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57435224-7147-4f89-9dd8-04c2c9dfb480 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:17.073818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57435224-7147-4f89-9dd8-04c2c9dfb480 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:17.075780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57435224-7147-4f89-9dd8-04c2c9dfb480 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:17.076476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57435224-7147-4f89-9dd8-04c2c9dfb480 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:17.137135 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57435224-7147-4f89-9dd8-04c2c9dfb480 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.084703 Dec 18 21:02:17.138633 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2175/4346] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:17 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:17.223675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:17.233905 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a08557d-ee2a-46ce-b4f6-50cc5d50ce07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1318 microversion: 2.1 time: 0.227075 Dec 18 21:02:17.234757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2172/4347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:17 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:17.486739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6aa3b60-a856-4e69-bc7a-68af710b86e5 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:17.487741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6aa3b60-a856-4e69-bc7a-68af710b86e5 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:17.495924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6aa3b60-a856-4e69-bc7a-68af710b86e5 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:17.496386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6aa3b60-a856-4e69-bc7a-68af710b86e5 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:17.497426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6aa3b60-a856-4e69-bc7a-68af710b86e5 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:17.497876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6aa3b60-a856-4e69-bc7a-68af710b86e5 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:17.557655 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6aa3b60-a856-4e69-bc7a-68af710b86e5 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.074331 Dec 18 21:02:17.558892 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2176/4348] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:17 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:18.149718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5214c0f-8ad8-4c10-822b-22febffcf31d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:18.151234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5214c0f-8ad8-4c10-822b-22febffcf31d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:18.159657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5214c0f-8ad8-4c10-822b-22febffcf31d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.160130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5214c0f-8ad8-4c10-822b-22febffcf31d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.161017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5214c0f-8ad8-4c10-822b-22febffcf31d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.161770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5214c0f-8ad8-4c10-822b-22febffcf31d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.211634 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5214c0f-8ad8-4c10-822b-22febffcf31d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.066005 Dec 18 21:02:18.213750 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2173/4349] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:18 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:18.251420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:18.253237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:18.261085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.261778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.262635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.263340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.431758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:18.445046 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2648c54-4965-42bf-a1e6-6f1642f684fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1508 microversion: 2.1 time: 0.197948 Dec 18 21:02:18.456582 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2177/4350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:18 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:18.464587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:18.465238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:18.472351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.472839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.473831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.474457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.547669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1486402905", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": "none"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:18.645119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:02:18.645682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:02:18.646346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:02:18.647103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:02:18.647779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:02:18.668282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.669691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.670780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.671544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.698192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Getting quotas for project 02953ea763ef4ddeb43c836d85986809. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:02:18.699826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:18.705724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Getting quotas for user e18391d5b5ae43d3b9b3cc8d61b27de1 and project 02953ea763ef4ddeb43c836d85986809. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:02:18.710607 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89f85237-c70c-48c8-ba54-ad5cd932eaba tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1508 microversion: 2.1 time: 0.252388 Dec 18 21:02:18.711911 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2178/4351] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:18 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:02:18.721956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f69bdbf7-946b-4b2e-948a-db40bdc8ea36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:18.723833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f69bdbf7-946b-4b2e-948a-db40bdc8ea36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:18.727422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:02:18.730177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:02:18.734159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f69bdbf7-946b-4b2e-948a-db40bdc8ea36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.735160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f69bdbf7-946b-4b2e-948a-db40bdc8ea36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.736130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f69bdbf7-946b-4b2e-948a-db40bdc8ea36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.736734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f69bdbf7-946b-4b2e-948a-db40bdc8ea36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.789388 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f69bdbf7-946b-4b2e-948a-db40bdc8ea36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.075981 Dec 18 21:02:18.794164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2179/4352] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:18 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:18.811947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-365b996f-d18b-4f0c-a4fb-0dfb5a8bab07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:18.813242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-365b996f-d18b-4f0c-a4fb-0dfb5a8bab07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:18.818011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3441a9ff-6b1d-4b82-8667-385fe747b606 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.506566 Dec 18 21:02:18.818725 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2174/4353] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:02:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 21:02:18.840192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-365b996f-d18b-4f0c-a4fb-0dfb5a8bab07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.844836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-365b996f-d18b-4f0c-a4fb-0dfb5a8bab07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.845750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-365b996f-d18b-4f0c-a4fb-0dfb5a8bab07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:18.846205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-365b996f-d18b-4f0c-a4fb-0dfb5a8bab07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:18.848727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-373dffef-9f56-48c4-a2b9-052d7ef5a381 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:18.849400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-373dffef-9f56-48c4-a2b9-052d7ef5a381 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:18.973511 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-365b996f-d18b-4f0c-a4fb-0dfb5a8bab07 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "PUT /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1080 microversion: 2.1 time: 0.177104 Dec 18 21:02:18.975370 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2180/4354] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:02:18 2021] PUT /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1080 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:18.996878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:18.997492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:19.005411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-373dffef-9f56-48c4-a2b9-052d7ef5a381 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:19.016351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.016800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.017619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.018066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.023352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-373dffef-9f56-48c4-a2b9-052d7ef5a381 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:19.025798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-373dffef-9f56-48c4-a2b9-052d7ef5a381 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:19.027971 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-373dffef-9f56-48c4-a2b9-052d7ef5a381 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1278 microversion: 2.54 time: 0.190406 Dec 18 21:02:19.040506 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2175/4355] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:18 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:19.225363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18cf34d0-9df2-4597-9d28-ceafa20f6811 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:19.226688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18cf34d0-9df2-4597-9d28-ceafa20f6811 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:19.236928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cf34d0-9df2-4597-9d28-ceafa20f6811 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.237391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cf34d0-9df2-4597-9d28-ceafa20f6811 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.238218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cf34d0-9df2-4597-9d28-ceafa20f6811 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.244959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cf34d0-9df2-4597-9d28-ceafa20f6811 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.295105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:19.303986 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a635aedc-c11b-444c-8d24-c95b61a1af49 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1506 microversion: 2.1 time: 0.317547 Dec 18 21:02:19.305132 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2181/4356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:18 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:19.313837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18cf34d0-9df2-4597-9d28-ceafa20f6811 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.092196 Dec 18 21:02:19.315352 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2176/4357] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:19 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:19.323335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:19.324295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:19.332072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.332942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.333990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.334656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.539929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:19.549221 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-805be49e-5068-4a86-885e-63798068f188 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1506 microversion: 2.1 time: 0.231884 Dec 18 21:02:19.567918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-17b71fd3-659c-466c-babe-fb531a14ce94 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:19.569830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-17b71fd3-659c-466c-babe-fb531a14ce94 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:19.570920 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2182/4358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:19 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:19.581222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17b71fd3-659c-466c-babe-fb531a14ce94 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.581714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17b71fd3-659c-466c-babe-fb531a14ce94 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.582819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17b71fd3-659c-466c-babe-fb531a14ce94 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.593724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-17b71fd3-659c-466c-babe-fb531a14ce94 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.679730 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-17b71fd3-659c-466c-babe-fb531a14ce94 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "PUT /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1082 microversion: 2.1 time: 0.116882 Dec 18 21:02:19.680553 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2177/4359] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:02:19 2021] PUT /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1082 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:19.696583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:19.697287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:19.706797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.707626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.708849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.709931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.807032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d70c9ca-f0c1-4559-8bce-250ffddfcac0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:19.808496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2d70c9ca-f0c1-4559-8bce-250ffddfcac0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:19.828966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d70c9ca-f0c1-4559-8bce-250ffddfcac0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.830384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d70c9ca-f0c1-4559-8bce-250ffddfcac0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.831584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d70c9ca-f0c1-4559-8bce-250ffddfcac0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.832261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d70c9ca-f0c1-4559-8bce-250ffddfcac0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.892858 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d70c9ca-f0c1-4559-8bce-250ffddfcac0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.090307 Dec 18 21:02:19.894066 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2178/4360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:19 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:19.953435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:19.964269 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1aabc819-10d2-4095-8546-31a0f245fb8b tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1508 microversion: 2.1 time: 0.273288 Dec 18 21:02:19.968851 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2183/4361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:19 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:19.983491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:19.985790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:19.995177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.996187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:19.998205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:19.999013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.053767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:20.054509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:20.064709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.064709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.064967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.065439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.175528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:20.188450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:20.193788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:20.198324 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18b2822d-ef14-47d2-a7a7-cb510b622fcc tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1330 microversion: 2.54 time: 0.150537 Dec 18 21:02:20.199722 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2184/4362] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:20 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1330 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:20.302440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:20.330965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac799afa-3f32-4fb7-bd73-a6246eb636ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:20.333219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac799afa-3f32-4fb7-bd73-a6246eb636ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:20.347099 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad111dfb-685a-4b9e-9c3c-d34b253e4268 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1508 microversion: 2.1 time: 0.365461 Dec 18 21:02:20.348199 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2179/4363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:19 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:20.352821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac799afa-3f32-4fb7-bd73-a6246eb636ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.354841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac799afa-3f32-4fb7-bd73-a6246eb636ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.358426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac799afa-3f32-4fb7-bd73-a6246eb636ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.359911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac799afa-3f32-4fb7-bd73-a6246eb636ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.368666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:20.373163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:20.395147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.403132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.404300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.405120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.481166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac799afa-3f32-4fb7-bd73-a6246eb636ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.158595 Dec 18 21:02:20.486133 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2185/4364] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:20 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:20.489189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:02:20.619111 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-85fb0242-5382-43b4-91c7-7b56ad8fc05f tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 204 len: 0 microversion: 2.1 time: 0.255970 Dec 18 21:02:20.620470 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2180/4365] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:02:20 2021] DELETE /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:02:20.630786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:20.631395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:20.640014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.640430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.641395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.641960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.671835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:02:20.733278 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.compute.api [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Instance is already in deleting state, ignoring this request Dec 18 21:02:20.735198 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d98dd3a1-59c5-4fa4-86e3-4dcc3eb7df31 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 204 len: 0 microversion: 2.1 time: 0.108654 Dec 18 21:02:20.736096 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2186/4366] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:02:20 2021] DELETE /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:20.745724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:20.746538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:20.754568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.755266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.756629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.757223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.907286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-69cdb16d-fcc6-452a-8806-83f499bbbd6b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:20.908211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-69cdb16d-fcc6-452a-8806-83f499bbbd6b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:20.915237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69cdb16d-fcc6-452a-8806-83f499bbbd6b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.916268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69cdb16d-fcc6-452a-8806-83f499bbbd6b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.917297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69cdb16d-fcc6-452a-8806-83f499bbbd6b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:20.918082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69cdb16d-fcc6-452a-8806-83f499bbbd6b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:20.924867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:20.938973 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06253306-6427-4cdf-bd16-ef2e8c873326 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1514 microversion: 2.1 time: 0.197788 Dec 18 21:02:20.940195 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2181/4367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:20 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:20.973251 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-69cdb16d-fcc6-452a-8806-83f499bbbd6b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.069484 Dec 18 21:02:20.977111 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2187/4368] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:20 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:21.220933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:21.222087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:21.230451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:21.231572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:21.232661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:21.233374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:21.324295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:21.335184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:21.337486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:21.339602 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4468e79c-9db0-464a-82bf-93bdd3738c02 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1336 microversion: 2.54 time: 0.123743 Dec 18 21:02:21.340470 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2182/4369] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:21 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:21.499876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b6cb4621-b1b2-4aaf-b485-647ff906d5cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:21.503141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b6cb4621-b1b2-4aaf-b485-647ff906d5cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:21.519437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cb4621-b1b2-4aaf-b485-647ff906d5cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:21.523273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cb4621-b1b2-4aaf-b485-647ff906d5cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:21.529050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cb4621-b1b2-4aaf-b485-647ff906d5cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:21.529707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6cb4621-b1b2-4aaf-b485-647ff906d5cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:21.622004 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b6cb4621-b1b2-4aaf-b485-647ff906d5cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.126170 Dec 18 21:02:21.627879 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2188/4370] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:21 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:21.957665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:21.959806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:21.973209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:21.976480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:21.978125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:21.987096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c54dbb88-4e71-4f5c-b38f-9b39934b5c48 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:21.988795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c54dbb88-4e71-4f5c-b38f-9b39934b5c48 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:21.996174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:22.010486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54dbb88-4e71-4f5c-b38f-9b39934b5c48 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:22.011727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54dbb88-4e71-4f5c-b38f-9b39934b5c48 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:22.014230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54dbb88-4e71-4f5c-b38f-9b39934b5c48 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:22.014922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c54dbb88-4e71-4f5c-b38f-9b39934b5c48 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:22.107366 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c54dbb88-4e71-4f5c-b38f-9b39934b5c48 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.125285 Dec 18 21:02:22.112954 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2189/4371] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:21 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:22.273762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:22.283584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c72fd3c0-5b33-4edd-8860-59b6d357b3b3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1514 microversion: 2.1 time: 0.330551 Dec 18 21:02:22.284822 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2183/4372] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:21 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:22.363811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:22.364833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:22.374010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:22.374791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:22.376279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:22.377133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:22.460257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:22.471231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:22.473171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:22.474340 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9de7f96d-117f-4a68-85bb-7eb32d1d630e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1336 microversion: 2.54 time: 0.118311 Dec 18 21:02:22.475118 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2190/4373] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:22 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:22.636219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ed12daa-d46f-427b-9e51-c4908bd1ec0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:22.638891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2ed12daa-d46f-427b-9e51-c4908bd1ec0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:22.646230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed12daa-d46f-427b-9e51-c4908bd1ec0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:22.646842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed12daa-d46f-427b-9e51-c4908bd1ec0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:22.647664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed12daa-d46f-427b-9e51-c4908bd1ec0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:22.648382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed12daa-d46f-427b-9e51-c4908bd1ec0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:22.706752 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ed12daa-d46f-427b-9e51-c4908bd1ec0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.075027 Dec 18 21:02:22.717879 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2184/4374] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:22 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:23.123505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9702b0f-dfc1-440a-8936-4bf66cc2d75a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:23.125081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9702b0f-dfc1-440a-8936-4bf66cc2d75a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:23.136379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9702b0f-dfc1-440a-8936-4bf66cc2d75a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.137346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9702b0f-dfc1-440a-8936-4bf66cc2d75a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.138544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9702b0f-dfc1-440a-8936-4bf66cc2d75a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.139164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9702b0f-dfc1-440a-8936-4bf66cc2d75a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.192780 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9702b0f-dfc1-440a-8936-4bf66cc2d75a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.075430 Dec 18 21:02:23.193872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2191/4375] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:23 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:23.227560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7b28478e-f11b-43a6-a53f-bfd514d01069 req-8e139190-bc42-4da6-be37-2168b6366973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa4b3a2-31da-4bab-a701-6ace555f90a6", "name": "network-vif-deleted", "tag": "fc604f11-f233-4aba-8228-e4d182d18996"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:23.230204 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:23.230204 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:02:23.248560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7b28478e-f11b-43a6-a53f-bfd514d01069 req-8e139190-bc42-4da6-be37-2168b6366973 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.249258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7b28478e-f11b-43a6-a53f-bfd514d01069 req-8e139190-bc42-4da6-be37-2168b6366973 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.270302 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7b28478e-f11b-43a6-a53f-bfd514d01069 req-8e139190-bc42-4da6-be37-2168b6366973 service nova] Creating event network-vif-deleted:fc604f11-f233-4aba-8228-e4d182d18996 for instance caa4b3a2-31da-4bab-a701-6ace555f90a6 on nch1-master-1 Dec 18 21:02:23.277668 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7b28478e-f11b-43a6-a53f-bfd514d01069 req-8e139190-bc42-4da6-be37-2168b6366973 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054701 Dec 18 21:02:23.284085 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2185/4376] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:02:23.302118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:23.303273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:23.311184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.311709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.313068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.313654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.362370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.363027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.363675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lazy-loading 'fault' on Instance uuid caa4b3a2-31da-4bab-a701-6ace555f90a6 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:02:23.412334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54121b5d80d64c4796889183c5197853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653558ed3d3248ea8f07a3066b6c3d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:23.422242 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48c65f2a-f134-4a30-9ae9-5d13ccd8c7fb tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 200 len: 1308 microversion: 2.1 time: 0.124823 Dec 18 21:02:23.426409 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2192/4377] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:23 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:23.497906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:23.499048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:23.507767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.508736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.509912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.510622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.598137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:23.609305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:23.611019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:23.612599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b495a7f-ffb3-486c-9b78-57ebc33edeb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1357 microversion: 2.54 time: 0.120020 Dec 18 21:02:23.613166 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2186/4378] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:23 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1357 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:23.637923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f136f47-d4a9-4a3c-bf94-aa9dc880bd5b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Action: 'create', calling method: .version_select at 0x7f714e58e3a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1245268190"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:23.657241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-9f136f47-d4a9-4a3c-bf94-aa9dc880bd5b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Getting quotas for project 02953ea763ef4ddeb43c836d85986809. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:02:23.663372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-9f136f47-d4a9-4a3c-bf94-aa9dc880bd5b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Getting quotas for user e18391d5b5ae43d3b9b3cc8d61b27de1 and project 02953ea763ef4ddeb43c836d85986809. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:02:23.731796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98ad6b7b-8356-4f8a-ab2e-755afddf909b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:23.744503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-98ad6b7b-8356-4f8a-ab2e-755afddf909b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:23.762404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98ad6b7b-8356-4f8a-ab2e-755afddf909b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.763136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98ad6b7b-8356-4f8a-ab2e-755afddf909b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.764285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98ad6b7b-8356-4f8a-ab2e-755afddf909b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:23.764900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98ad6b7b-8356-4f8a-ab2e-755afddf909b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:23.843570 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98ad6b7b-8356-4f8a-ab2e-755afddf909b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.121533 Dec 18 21:02:23.848486 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2187/4379] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:23 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:24.205507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2c0f35b-f417-47bd-9394-77b7469825d8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:24.206853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d2c0f35b-f417-47bd-9394-77b7469825d8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.242090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2c0f35b-f417-47bd-9394-77b7469825d8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.246765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2c0f35b-f417-47bd-9394-77b7469825d8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.247938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2c0f35b-f417-47bd-9394-77b7469825d8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.248458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2c0f35b-f417-47bd-9394-77b7469825d8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.298895 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2c0f35b-f417-47bd-9394-77b7469825d8 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.097110 Dec 18 21:02:24.303120 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2188/4380] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:24 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:24.356911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-9f136f47-d4a9-4a3c-bf94-aa9dc880bd5b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Getting quotas for project 02953ea763ef4ddeb43c836d85986809. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:02:24.363833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-9f136f47-d4a9-4a3c-bf94-aa9dc880bd5b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Getting quotas for user e18391d5b5ae43d3b9b3cc8d61b27de1 and project 02953ea763ef4ddeb43c836d85986809. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:02:24.381048 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f136f47-d4a9-4a3c-bf94-aa9dc880bd5b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.54 time: 0.749333 Dec 18 21:02:24.381935 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2193/4381] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Dec 18 21:02:23 2021] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 751 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:02:24.393716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1245268190", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:24.395689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.403775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.404261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.405362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.405834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.440854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:24.441852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: caa4b3a2-31da-4bab-a701-6ace555f90a6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.448823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.449506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.451108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.452707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.469197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] HTTP exception thrown: Instance caa4b3a2-31da-4bab-a701-6ace555f90a6 could not be found. Dec 18 21:02:24.469520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Returning 404 to user: Instance caa4b3a2-31da-4bab-a701-6ace555f90a6 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:24.470470 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2c59cbc-4880-4309-9755-14da3509e9d3 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6" status: 404 len: 111 microversion: 2.1 time: 0.033993 Dec 18 21:02:24.471554 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2194/4382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:24 2021] GET /compute/v2.1/servers/caa4b3a2-31da-4bab-a701-6ace555f90a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:02:24.484205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:24.487023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.497013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.497935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.499094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.499624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.504869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:02:24.505557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:02:24.506237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:02:24.506854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:02:24.508201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:02:24.524116 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] HTTP exception thrown: Instance 42c88a02-9467-48b3-a95a-92083533337d could not be found. Dec 18 21:02:24.524986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Returning 404 to user: Instance 42c88a02-9467-48b3-a95a-92083533337d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:24.526973 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1185552a-0503-4217-93d4-962972cb0f72 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 404 len: 111 microversion: 2.1 time: 0.046574 Dec 18 21:02:24.527633 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2195/4383] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:02:24 2021] DELETE /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:24.542364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:24.543887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 42c88a02-9467-48b3-a95a-92083533337d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.553719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.554874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.556725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.557992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.576419 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] HTTP exception thrown: Instance 42c88a02-9467-48b3-a95a-92083533337d could not be found. Dec 18 21:02:24.577340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Returning 404 to user: Instance 42c88a02-9467-48b3-a95a-92083533337d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:24.578544 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d87be80-7b95-4f13-88df-1677b1298e02 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d" status: 404 len: 111 microversion: 2.1 time: 0.045642 Dec 18 21:02:24.579668 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2196/4384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:24 2021] GET /compute/v2.1/servers/42c88a02-9467-48b3-a95a-92083533337d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:02:24.588171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:24.589177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.596668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.597380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.598291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.598905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.617826 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] HTTP exception thrown: Instance 99065c17-efa8-47de-ad99-b21a3541dc5a could not be found. Dec 18 21:02:24.618482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Returning 404 to user: Instance 99065c17-efa8-47de-ad99-b21a3541dc5a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:24.621455 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01338512-59d3-42c7-ab24-2fa2d5d94a61 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 404 len: 111 microversion: 2.1 time: 0.035438 Dec 18 21:02:24.621455 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2197/4385] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:02:24 2021] DELETE /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:24.622339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.629457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.630204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.631015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:24.631423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.632112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.632481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] [instance: 99065c17-efa8-47de-ad99-b21a3541dc5a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.643377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.644045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.645174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.646224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.668057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] HTTP exception thrown: Instance 99065c17-efa8-47de-ad99-b21a3541dc5a could not be found. Dec 18 21:02:24.668746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] Returning 404 to user: Instance 99065c17-efa8-47de-ad99-b21a3541dc5a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:24.669680 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-12c6b9de-b1d8-4186-ba6c-540069150c98 tempest-ServerDiskConfigTestJSON-723679004 tempest-ServerDiskConfigTestJSON-723679004-project] 10.222.0.13 "GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a" status: 404 len: 111 microversion: 2.1 time: 0.044999 Dec 18 21:02:24.670304 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2198/4386] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:24 2021] GET /compute/v2.1/servers/99065c17-efa8-47de-ad99-b21a3541dc5a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:24.679463 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c582ff47-274a-4a87-9784-d956a7c3c396 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "POST /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003/action" status: 202 len: 1140 microversion: 2.54 time: 0.290448 Dec 18 21:02:24.680745 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2189/4387] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Dec 18 21:02:24 2021] POST /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003/action => generated 1140 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Dec 18 21:02:24.701265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:24.702585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.709589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.710053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.710925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.711381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.859541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a763fc67-2b27-49fb-86f3-ea52f70de2cb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:24.861639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a763fc67-2b27-49fb-86f3-ea52f70de2cb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:24.870404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a763fc67-2b27-49fb-86f3-ea52f70de2cb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.871894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a763fc67-2b27-49fb-86f3-ea52f70de2cb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.872939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a763fc67-2b27-49fb-86f3-ea52f70de2cb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:24.873554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a763fc67-2b27-49fb-86f3-ea52f70de2cb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:24.906578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:24.918014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:24.920111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:24.921587 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6710d02a-45a0-49d2-ab0a-ee5aa403a06e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.228293 Dec 18 21:02:24.922520 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2199/4388] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:24 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:24.953506 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a763fc67-2b27-49fb-86f3-ea52f70de2cb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.099760 Dec 18 21:02:24.954812 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2190/4389] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:24 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:25.311018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-68d951f5-8817-4057-9dd8-67b80fc5789e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:25.312108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-68d951f5-8817-4057-9dd8-67b80fc5789e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:25.324761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68d951f5-8817-4057-9dd8-67b80fc5789e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:25.326857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68d951f5-8817-4057-9dd8-67b80fc5789e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:25.327777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68d951f5-8817-4057-9dd8-67b80fc5789e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:25.329346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68d951f5-8817-4057-9dd8-67b80fc5789e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:25.405103 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-68d951f5-8817-4057-9dd8-67b80fc5789e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.098502 Dec 18 21:02:25.405755 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2200/4390] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:25 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:25.951474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:25.953835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:25.963899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:25.964364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:25.965567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:25.965706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f004eadb-19e2-437f-9837-56298ddc64f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:25.965998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:25.966743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f004eadb-19e2-437f-9837-56298ddc64f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:25.977897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f004eadb-19e2-437f-9837-56298ddc64f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:25.980164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f004eadb-19e2-437f-9837-56298ddc64f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:25.981545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f004eadb-19e2-437f-9837-56298ddc64f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:25.982478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f004eadb-19e2-437f-9837-56298ddc64f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:26.044722 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f004eadb-19e2-437f-9837-56298ddc64f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.083066 Dec 18 21:02:26.046935 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2201/4391] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:25 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:26.090226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:26.099240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:26.101838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:26.103081 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ea8dae8-67fb-4766-8253-0458a0a25a2d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.164726 Dec 18 21:02:26.104361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2191/4392] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:25 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:26.422945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c95caeaa-c852-4992-bcea-3a9999123049 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:26.425235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c95caeaa-c852-4992-bcea-3a9999123049 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:26.433378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c95caeaa-c852-4992-bcea-3a9999123049 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:26.433851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c95caeaa-c852-4992-bcea-3a9999123049 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:26.434702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c95caeaa-c852-4992-bcea-3a9999123049 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:26.435117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c95caeaa-c852-4992-bcea-3a9999123049 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:26.491904 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c95caeaa-c852-4992-bcea-3a9999123049 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.076136 Dec 18 21:02:26.495096 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2202/4393] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:26 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:27.060738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5d688a8-3c74-4bda-9a72-b9760461942a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:27.060738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c5d688a8-3c74-4bda-9a72-b9760461942a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:27.068835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5d688a8-3c74-4bda-9a72-b9760461942a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:27.069235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5d688a8-3c74-4bda-9a72-b9760461942a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:27.070048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5d688a8-3c74-4bda-9a72-b9760461942a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:27.070524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5d688a8-3c74-4bda-9a72-b9760461942a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:27.124232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:27.125313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:27.129184 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5d688a8-3c74-4bda-9a72-b9760461942a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.074963 Dec 18 21:02:27.133043 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2192/4394] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:27 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:27.136680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:27.137171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:27.138031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:27.138502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:27.208324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:27.222032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:27.223820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:27.226395 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e091ffc5-7a82-46b2-bbdd-4fedbd2e0da5 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.106676 Dec 18 21:02:27.227504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2203/4395] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:27 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:27.509034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68df3dce-2993-4228-9aa4-0912c858189b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:27.510815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68df3dce-2993-4228-9aa4-0912c858189b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:27.519874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68df3dce-2993-4228-9aa4-0912c858189b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:27.520777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68df3dce-2993-4228-9aa4-0912c858189b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:27.521989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68df3dce-2993-4228-9aa4-0912c858189b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:27.522789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68df3dce-2993-4228-9aa4-0912c858189b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:27.614470 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68df3dce-2993-4228-9aa4-0912c858189b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.111119 Dec 18 21:02:27.615797 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2193/4396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:27 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:28.142131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f9562a92-ab5f-42a5-86aa-4371929b25f9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:28.143107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f9562a92-ab5f-42a5-86aa-4371929b25f9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:28.155070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9562a92-ab5f-42a5-86aa-4371929b25f9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:28.155554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9562a92-ab5f-42a5-86aa-4371929b25f9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:28.156397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9562a92-ab5f-42a5-86aa-4371929b25f9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:28.156852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9562a92-ab5f-42a5-86aa-4371929b25f9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:28.230485 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f9562a92-ab5f-42a5-86aa-4371929b25f9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.089238 Dec 18 21:02:28.231581 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2204/4397] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:28 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:28.250728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:28.253157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:28.266791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:28.267868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:28.269051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:28.269703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:28.470905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:28.482345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:28.484137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:28.487519 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b03a742-1370-47f4-a507-9778fd4ab2f8 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.243875 Dec 18 21:02:28.490790 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2194/4398] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:28 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:28.630601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8682ffe1-350b-422d-898d-b01be5eb81fb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:28.631679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8682ffe1-350b-422d-898d-b01be5eb81fb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:28.643619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8682ffe1-350b-422d-898d-b01be5eb81fb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:28.652141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8682ffe1-350b-422d-898d-b01be5eb81fb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:28.652978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8682ffe1-350b-422d-898d-b01be5eb81fb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:28.653491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8682ffe1-350b-422d-898d-b01be5eb81fb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:28.729569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8682ffe1-350b-422d-898d-b01be5eb81fb tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.103092 Dec 18 21:02:28.734800 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2205/4399] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:28 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:29.250158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a718ec05-9deb-4d0b-a282-9aac8b8a80cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:29.253441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a718ec05-9deb-4d0b-a282-9aac8b8a80cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:29.263479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a718ec05-9deb-4d0b-a282-9aac8b8a80cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:29.264557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a718ec05-9deb-4d0b-a282-9aac8b8a80cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:29.266091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a718ec05-9deb-4d0b-a282-9aac8b8a80cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:29.266840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a718ec05-9deb-4d0b-a282-9aac8b8a80cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:29.358307 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a718ec05-9deb-4d0b-a282-9aac8b8a80cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.116586 Dec 18 21:02:29.363055 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2195/4400] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:29 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:29.514543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:29.515452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:29.525054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:29.525759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:29.526783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:29.527491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:29.651022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:29.660042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:29.663040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:29.664463 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-975e5430-a749-47df-9c66-ce8f7cf1acb1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.160768 Dec 18 21:02:29.665202 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2196/4401] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:29 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:29.690546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-620765658", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5cdc9825-bcb7-44d9-924b-34cb288e7a9b"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:29.741962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a9ab234-8ff4-45b8-98d7-cc2e781ddaa9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:29.742951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a9ab234-8ff4-45b8-98d7-cc2e781ddaa9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:29.781700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] validate_networks() for [('5cdc9825-bcb7-44d9-924b-34cb288e7a9b', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:02:29.784283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9ab234-8ff4-45b8-98d7-cc2e781ddaa9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:29.784916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9ab234-8ff4-45b8-98d7-cc2e781ddaa9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:29.789382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9ab234-8ff4-45b8-98d7-cc2e781ddaa9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:29.793671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9ab234-8ff4-45b8-98d7-cc2e781ddaa9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:29.855238 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a9ab234-8ff4-45b8-98d7-cc2e781ddaa9 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.117223 Dec 18 21:02:29.855986 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2197/4402] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:29 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:30.252496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:02:30.253270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:02:30.253940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:02:30.254561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:02:30.255160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:02:30.265567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.266031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.266885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.267338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.287266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Getting quotas for project a437811487424144a39cf7205f4646fb. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:02:30.293454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Getting quotas for user 026afcda165f437cbd8dc3a854a14c95 and project a437811487424144a39cf7205f4646fb. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:02:30.308152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:02:30.311573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:02:30.371849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c2e1632-cb58-4aac-aa14-21939420f5bb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:30.372566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8c2e1632-cb58-4aac-aa14-21939420f5bb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:30.388454 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ff0ec29f-ac02-4b3d-a082-825e4358e010 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.080154 Dec 18 21:02:30.389121 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2206/4403] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:02:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 21:02:30.389240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c2e1632-cb58-4aac-aa14-21939420f5bb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.389962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c2e1632-cb58-4aac-aa14-21939420f5bb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.391168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c2e1632-cb58-4aac-aa14-21939420f5bb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.391787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c2e1632-cb58-4aac-aa14-21939420f5bb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.403808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8299b55-97ec-4428-944e-0391ef3dcab0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:30.404647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f8299b55-97ec-4428-944e-0391ef3dcab0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:30.495659 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8c2e1632-cb58-4aac-aa14-21939420f5bb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.128254 Dec 18 21:02:30.496629 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2198/4404] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:30 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:30.507620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f8299b55-97ec-4428-944e-0391ef3dcab0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:30.518604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f8299b55-97ec-4428-944e-0391ef3dcab0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:30.520234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f8299b55-97ec-4428-944e-0391ef3dcab0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:30.521482 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8299b55-97ec-4428-944e-0391ef3dcab0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1258 microversion: 2.21 time: 0.126127 Dec 18 21:02:30.526395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2207/4405] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:30 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1258 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:30.690997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:30.692088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:30.701565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.702555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.709331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.710313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.842918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:30.862842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:30.867334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:30.873612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da4ad640-6d39-4beb-bf29-e59796289d50 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.186204 Dec 18 21:02:30.875409 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2199/4406] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:30 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:30.887063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d80e5d2-d653-4c89-af30-373fe1659c23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:30.889808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7d80e5d2-d653-4c89-af30-373fe1659c23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:30.908251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d80e5d2-d653-4c89-af30-373fe1659c23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.909125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d80e5d2-d653-4c89-af30-373fe1659c23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.911077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d80e5d2-d653-4c89-af30-373fe1659c23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:30.911830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d80e5d2-d653-4c89-af30-373fe1659c23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:30.967084 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7d80e5d2-d653-4c89-af30-373fe1659c23 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.102143 Dec 18 21:02:30.968503 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2208/4407] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:30 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:31.508571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12ca4165-9f48-466f-992e-cc2a051bf09a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:31.511434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-12ca4165-9f48-466f-992e-cc2a051bf09a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:31.527611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12ca4165-9f48-466f-992e-cc2a051bf09a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:31.533671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12ca4165-9f48-466f-992e-cc2a051bf09a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:31.536214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12ca4165-9f48-466f-992e-cc2a051bf09a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:31.536823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12ca4165-9f48-466f-992e-cc2a051bf09a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:31.542638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:31.543535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:31.559420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:31.560365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:31.563115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:31.564123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:31.603070 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12ca4165-9f48-466f-992e-cc2a051bf09a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.099314 Dec 18 21:02:31.605968 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2200/4408] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:31 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:31.723395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:31.737284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:31.742122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:31.746344 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f37f863-2fdd-4b94-b7c4-f39588bf7725 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1310 microversion: 2.21 time: 0.208735 Dec 18 21:02:31.747257 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2209/4409] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:31 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1310 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:31.894672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:31.895448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:31.905415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:31.905888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:31.907226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:31.907865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:31.980014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f3c288c-12ac-4414-98ed-97d38bf54c71 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:31.981865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f3c288c-12ac-4414-98ed-97d38bf54c71 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:31.996493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f3c288c-12ac-4414-98ed-97d38bf54c71 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:31.998777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f3c288c-12ac-4414-98ed-97d38bf54c71 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:32.001607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f3c288c-12ac-4414-98ed-97d38bf54c71 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:32.002521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f3c288c-12ac-4414-98ed-97d38bf54c71 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:32.034301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:32.043702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:32.046628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:32.048503 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b36e13f-c76a-477d-9fda-8fbcc85e2eb7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.159969 Dec 18 21:02:32.049635 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2201/4410] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:31 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:32.062061 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f3c288c-12ac-4414-98ed-97d38bf54c71 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.085689 Dec 18 21:02:32.063089 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2210/4411] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:31 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:32.617438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e18997bd-c0e5-445c-becb-da7462d206a0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:32.627540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e18997bd-c0e5-445c-becb-da7462d206a0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:32.641836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18997bd-c0e5-445c-becb-da7462d206a0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:32.649398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18997bd-c0e5-445c-becb-da7462d206a0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:32.652162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18997bd-c0e5-445c-becb-da7462d206a0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:32.652824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18997bd-c0e5-445c-becb-da7462d206a0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:32.737369 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e18997bd-c0e5-445c-becb-da7462d206a0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.123771 Dec 18 21:02:32.742361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2202/4412] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:32 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:32.767958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:32.769025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:32.785941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:32.786357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:32.787188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:32.792393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.074017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:33.075176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:33.083670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:33.084491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.085605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:33.086293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.134887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:33.151247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:33.155993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:33.162233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-354244ce-cf95-4bed-9771-4b0c4c73d717 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1358 microversion: 2.21 time: 0.399153 Dec 18 21:02:33.163957 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2211/4413] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:32 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1358 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:33.172488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16ab0618-0b8b-49ca-8e36-50422cb19e79 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:33.174660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-16ab0618-0b8b-49ca-8e36-50422cb19e79 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:33.184362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16ab0618-0b8b-49ca-8e36-50422cb19e79 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:33.185637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16ab0618-0b8b-49ca-8e36-50422cb19e79 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.187289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16ab0618-0b8b-49ca-8e36-50422cb19e79 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:33.188048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16ab0618-0b8b-49ca-8e36-50422cb19e79 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.263901 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-16ab0618-0b8b-49ca-8e36-50422cb19e79 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.097965 Dec 18 21:02:33.264968 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2212/4414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:33 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:33.292862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:33.315906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:33.317635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:33.319708 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1775b3e8-b420-4e10-ac73-57e6f021ccea tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.253655 Dec 18 21:02:33.325268 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2203/4415] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:33 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:33.751301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66fb6325-4014-401e-aa98-9b8140677abe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:33.752772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66fb6325-4014-401e-aa98-9b8140677abe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:33.770071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66fb6325-4014-401e-aa98-9b8140677abe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:33.770559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66fb6325-4014-401e-aa98-9b8140677abe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.771367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66fb6325-4014-401e-aa98-9b8140677abe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:33.771808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66fb6325-4014-401e-aa98-9b8140677abe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.856471 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66fb6325-4014-401e-aa98-9b8140677abe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.109871 Dec 18 21:02:33.860392 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2213/4416] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:33 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:33.865370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-0978000c-ffdf-4b42-a06a-e87958d233e0 req-defa709e-7914-49d4-a5ba-fd7db7e86826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbeab8db-c94f-4f17-b0d6-98b9b9c81288", "tag": "31dbff86-71a4-402c-a5c6-7a6662676263"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:33.871315 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:33.871315 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:02:33.882061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0978000c-ffdf-4b42-a06a-e87958d233e0 req-defa709e-7914-49d4-a5ba-fd7db7e86826 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:33.882833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0978000c-ffdf-4b42-a06a-e87958d233e0 req-defa709e-7914-49d4-a5ba-fd7db7e86826 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:33.898287 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-0978000c-ffdf-4b42-a06a-e87958d233e0 req-defa709e-7914-49d4-a5ba-fd7db7e86826 service nova] Creating event network-changed:31dbff86-71a4-402c-a5c6-7a6662676263 for instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 on nch2-master-1 Dec 18 21:02:33.906036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-0978000c-ffdf-4b42-a06a-e87958d233e0 req-defa709e-7914-49d4-a5ba-fd7db7e86826 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044533 Dec 18 21:02:33.908036 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2204/4417] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:02:34.182955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:34.185418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:34.193928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.194836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.196116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.196795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.277513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5bdee3cc-c6e9-4bf7-b351-b3eb38c2d912 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:34.278770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5bdee3cc-c6e9-4bf7-b351-b3eb38c2d912 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:34.288995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bdee3cc-c6e9-4bf7-b351-b3eb38c2d912 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.290024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bdee3cc-c6e9-4bf7-b351-b3eb38c2d912 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.291770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bdee3cc-c6e9-4bf7-b351-b3eb38c2d912 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.292820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bdee3cc-c6e9-4bf7-b351-b3eb38c2d912 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.367493 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5bdee3cc-c6e9-4bf7-b351-b3eb38c2d912 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.093991 Dec 18 21:02:34.375093 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2205/4418] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:34 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:34.395278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:34.396054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:34.405859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.406373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.408167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.409655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.465797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:34.474680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:34.487148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:34.488282 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-772501bf-a17e-4123-a92d-e3647dac8cee tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1358 microversion: 2.21 time: 0.310513 Dec 18 21:02:34.489041 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2214/4419] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:34 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:34.521803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:34.533938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:34.537340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:34.537340 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e1586e6f-d8bb-4512-975a-57877c46de04 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.160406 Dec 18 21:02:34.551079 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2206/4420] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:34 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:34.876203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d31bc798-bce7-4e3e-baa3-b1fff5ab9d70 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:34.877321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d31bc798-bce7-4e3e-baa3-b1fff5ab9d70 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:34.896473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d31bc798-bce7-4e3e-baa3-b1fff5ab9d70 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.899399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d31bc798-bce7-4e3e-baa3-b1fff5ab9d70 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.902407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d31bc798-bce7-4e3e-baa3-b1fff5ab9d70 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:34.904241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d31bc798-bce7-4e3e-baa3-b1fff5ab9d70 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:34.970031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d31bc798-bce7-4e3e-baa3-b1fff5ab9d70 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.100699 Dec 18 21:02:34.972179 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2215/4421] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:34 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:35.383282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c59db3a6-d52d-4313-a8b4-099accb8d3c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:35.384983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c59db3a6-d52d-4313-a8b4-099accb8d3c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:35.394514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59db3a6-d52d-4313-a8b4-099accb8d3c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:35.395073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59db3a6-d52d-4313-a8b4-099accb8d3c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:35.396030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59db3a6-d52d-4313-a8b4-099accb8d3c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:35.396842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c59db3a6-d52d-4313-a8b4-099accb8d3c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:35.452152 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c59db3a6-d52d-4313-a8b4-099accb8d3c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.073654 Dec 18 21:02:35.453251 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2207/4422] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:35 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:35.515716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:35.518170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:35.540411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:35.540964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:35.542303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:35.543496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:35.560508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:35.562711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:35.575976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:35.576807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:35.577802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:35.578778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:35.655455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:35.670827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:35.675351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:35.678586 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1956aeed-3906-4162-87f2-06fba984e24a tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.125862 Dec 18 21:02:35.679547 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2208/4423] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:35 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:35.754243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:35.763776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:35.765822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:35.767078 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-229b3a44-454f-4540-a03c-7c8bc0b4636b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1358 microversion: 2.21 time: 0.263628 Dec 18 21:02:35.777906 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2216/4424] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:35 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:35.988785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-28bfef5f-6462-4436-9fc2-b2b29ebc5c48 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:35.990836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-28bfef5f-6462-4436-9fc2-b2b29ebc5c48 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:36.000563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bfef5f-6462-4436-9fc2-b2b29ebc5c48 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.001564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bfef5f-6462-4436-9fc2-b2b29ebc5c48 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.002737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bfef5f-6462-4436-9fc2-b2b29ebc5c48 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.004727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bfef5f-6462-4436-9fc2-b2b29ebc5c48 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.062391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-28bfef5f-6462-4436-9fc2-b2b29ebc5c48 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.079762 Dec 18 21:02:36.066753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2209/4425] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:35 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:36.465812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19f91abb-8690-462a-8fd4-1c772e16fb51 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:36.467265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19f91abb-8690-462a-8fd4-1c772e16fb51 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:36.476874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f91abb-8690-462a-8fd4-1c772e16fb51 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.476874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f91abb-8690-462a-8fd4-1c772e16fb51 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.477786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f91abb-8690-462a-8fd4-1c772e16fb51 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.478544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f91abb-8690-462a-8fd4-1c772e16fb51 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.526557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19f91abb-8690-462a-8fd4-1c772e16fb51 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.065604 Dec 18 21:02:36.528107 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2217/4426] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:36 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:36.700525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:36.702054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:36.711530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.713469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.714594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.715262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.787419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:36.789366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:36.801729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.802562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.803801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:36.804628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:36.821263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:36.833145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:36.834769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:36.836145 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a8d3f48-bca1-4ab6-b195-04899e828d99 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.141144 Dec 18 21:02:36.846331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2210/4427] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:36 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:37.028363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:37.037868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:37.039474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:37.041413 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d34b41f7-5d33-4648-85e9-68efabd6444b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1358 microversion: 2.21 time: 0.259420 Dec 18 21:02:37.042536 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2218/4428] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:36 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:37.075765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b0c61be-1f80-4c34-8ea7-8fa7119fd3bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:37.076796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b0c61be-1f80-4c34-8ea7-8fa7119fd3bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:37.084699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b0c61be-1f80-4c34-8ea7-8fa7119fd3bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:37.085418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b0c61be-1f80-4c34-8ea7-8fa7119fd3bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:37.086503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b0c61be-1f80-4c34-8ea7-8fa7119fd3bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:37.087069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b0c61be-1f80-4c34-8ea7-8fa7119fd3bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:37.141978 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b0c61be-1f80-4c34-8ea7-8fa7119fd3bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.070125 Dec 18 21:02:37.143253 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2211/4429] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:37 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:37.539856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-863cd5d4-ca9c-4fd4-81ea-7effad9e1c36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:37.541398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-863cd5d4-ca9c-4fd4-81ea-7effad9e1c36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:37.552066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-863cd5d4-ca9c-4fd4-81ea-7effad9e1c36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:37.552556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-863cd5d4-ca9c-4fd4-81ea-7effad9e1c36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:37.553693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-863cd5d4-ca9c-4fd4-81ea-7effad9e1c36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:37.553807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-863cd5d4-ca9c-4fd4-81ea-7effad9e1c36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:37.604791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-863cd5d4-ca9c-4fd4-81ea-7effad9e1c36 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.068172 Dec 18 21:02:37.605512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2219/4430] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:37 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:37.857148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:37.857889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:37.871641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:37.872168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:37.873764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:37.875320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:38.016121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:38.026661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:38.028760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:38.030540 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3f19820f-524e-47dc-991a-92fae601d115 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.179383 Dec 18 21:02:38.031410 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2212/4431] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:37 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:38.061750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:38.062567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:38.070398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:38.072556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:38.073715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:38.074702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:38.156262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-262e841f-b5a5-4a98-94cb-1a52ee63aa87 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:38.158163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-262e841f-b5a5-4a98-94cb-1a52ee63aa87 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:38.168030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262e841f-b5a5-4a98-94cb-1a52ee63aa87 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:38.168794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262e841f-b5a5-4a98-94cb-1a52ee63aa87 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:38.170813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262e841f-b5a5-4a98-94cb-1a52ee63aa87 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:38.171452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-262e841f-b5a5-4a98-94cb-1a52ee63aa87 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:38.233357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-262e841f-b5a5-4a98-94cb-1a52ee63aa87 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.081550 Dec 18 21:02:38.234602 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2213/4432] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:38 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:38.619932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d19806d-97bc-4394-861c-7959da604166 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:38.621391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1d19806d-97bc-4394-861c-7959da604166 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:38.628877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:38.641826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:38.644065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d19806d-97bc-4394-861c-7959da604166 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:38.644518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d19806d-97bc-4394-861c-7959da604166 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:38.645342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d19806d-97bc-4394-861c-7959da604166 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:38.645809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d19806d-97bc-4394-861c-7959da604166 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:38.651569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:38.653557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2e9ca6c6-ad05-4b36-baaa-0ac6236b5a3b tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1358 microversion: 2.21 time: 0.595927 Dec 18 21:02:38.654062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2220/4433] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:38 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1358 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:38.702998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d19806d-97bc-4394-861c-7959da604166 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.088667 Dec 18 21:02:38.704864 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2214/4434] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:38 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:39.051158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:39.052248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:39.060760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.061446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.062690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.063263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.191222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:39.226012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:39.230930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:39.232997 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-628380fa-f74c-4a26-a277-21d61be3f0f9 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.186085 Dec 18 21:02:39.234286 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2221/4435] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:39 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:39.246716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53d17a5b-f51c-47ce-948f-e8890019b9a4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:39.248010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53d17a5b-f51c-47ce-948f-e8890019b9a4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:39.266301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d17a5b-f51c-47ce-948f-e8890019b9a4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.267128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d17a5b-f51c-47ce-948f-e8890019b9a4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.268232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d17a5b-f51c-47ce-948f-e8890019b9a4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.269296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53d17a5b-f51c-47ce-948f-e8890019b9a4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.320760 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53d17a5b-f51c-47ce-948f-e8890019b9a4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.079123 Dec 18 21:02:39.323126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2215/4436] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:39 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:39.675910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:39.676625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:39.698780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.699752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.700777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.703448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.718375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce5666b8-6c7a-4cad-814c-e29c6a64614d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:39.720488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce5666b8-6c7a-4cad-814c-e29c6a64614d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:39.748965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5666b8-6c7a-4cad-814c-e29c6a64614d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.753641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5666b8-6c7a-4cad-814c-e29c6a64614d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.755636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5666b8-6c7a-4cad-814c-e29c6a64614d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:39.756269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5666b8-6c7a-4cad-814c-e29c6a64614d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:39.828004 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce5666b8-6c7a-4cad-814c-e29c6a64614d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.114608 Dec 18 21:02:39.829403 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2216/4437] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:39 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:40.066009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:40.080383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:40.083129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:40.085092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21c12813-8389-4b52-b423-6f973b3855b8 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1358 microversion: 2.21 time: 0.416090 Dec 18 21:02:40.097287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2222/4438] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:39 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:40.211085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9e9aef64-e8ac-43fe-a087-bae1f31848c7 req-c7eb6701-5c9f-4cda-9420-24980e1e2746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbeab8db-c94f-4f17-b0d6-98b9b9c81288", "name": "network-vif-plugged", "status": "completed", "tag": "31dbff86-71a4-402c-a5c6-7a6662676263"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:40.213438 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:40.213438 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:02:40.222056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9e9aef64-e8ac-43fe-a087-bae1f31848c7 req-c7eb6701-5c9f-4cda-9420-24980e1e2746 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:40.222539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9e9aef64-e8ac-43fe-a087-bae1f31848c7 req-c7eb6701-5c9f-4cda-9420-24980e1e2746 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:40.235007 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9e9aef64-e8ac-43fe-a087-bae1f31848c7 req-c7eb6701-5c9f-4cda-9420-24980e1e2746 service nova] Creating event network-vif-plugged:31dbff86-71a4-402c-a5c6-7a6662676263 for instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 on nch2-master-1 Dec 18 21:02:40.241126 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9e9aef64-e8ac-43fe-a087-bae1f31848c7 req-c7eb6701-5c9f-4cda-9420-24980e1e2746 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224204 Dec 18 21:02:40.241991 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2217/4439] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:02:40.252683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:40.253597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:40.261341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:40.262185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:40.263280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:40.265488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:40.335818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04c9a9d1-4118-42bf-8bf3-3dec3a98a3da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:40.337025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04c9a9d1-4118-42bf-8bf3-3dec3a98a3da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:40.347343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04c9a9d1-4118-42bf-8bf3-3dec3a98a3da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:40.347903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04c9a9d1-4118-42bf-8bf3-3dec3a98a3da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:40.348916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04c9a9d1-4118-42bf-8bf3-3dec3a98a3da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:40.349705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04c9a9d1-4118-42bf-8bf3-3dec3a98a3da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:40.393078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:40.397905 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04c9a9d1-4118-42bf-8bf3-3dec3a98a3da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.066647 Dec 18 21:02:40.398619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2218/4440] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:40 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:40.412854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:40.418139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:40.421374 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5055e6f7-e559-4fbf-b8c3-1d78b4fec886 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.169222 Dec 18 21:02:40.434290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2223/4441] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:40 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:40.840488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0d52abf3-7364-4181-a84a-e9c1745f2b0e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:40.841545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0d52abf3-7364-4181-a84a-e9c1745f2b0e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:40.851862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d52abf3-7364-4181-a84a-e9c1745f2b0e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:40.852727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d52abf3-7364-4181-a84a-e9c1745f2b0e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:40.855275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d52abf3-7364-4181-a84a-e9c1745f2b0e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:40.856223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d52abf3-7364-4181-a84a-e9c1745f2b0e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:40.938670 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0d52abf3-7364-4181-a84a-e9c1745f2b0e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.100319 Dec 18 21:02:40.940785 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2219/4442] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:40 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:41.105966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:41.106872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:41.116866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.117321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:41.118121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.118663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:41.367947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:41.377960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:41.379468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:41.380978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3965c52c-dac8-4a49-b761-9ec290bb94d3 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1358 microversion: 2.21 time: 0.280339 Dec 18 21:02:41.382102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2224/4443] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:41 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:41.411010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-416c68f5-9790-4dcf-90de-a917453ed5e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:41.412398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-416c68f5-9790-4dcf-90de-a917453ed5e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:41.421610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-416c68f5-9790-4dcf-90de-a917453ed5e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.422456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-416c68f5-9790-4dcf-90de-a917453ed5e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:41.423549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-416c68f5-9790-4dcf-90de-a917453ed5e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.424083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-416c68f5-9790-4dcf-90de-a917453ed5e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:41.442440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:41.443569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:41.464876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.465342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:41.466469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.467102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:41.514770 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-416c68f5-9790-4dcf-90de-a917453ed5e6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.108730 Dec 18 21:02:41.516162 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2220/4444] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:41 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:41.555863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:41.569641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:41.574210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:41.575873 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1bfad097-edff-4ac0-9473-3ae8b80621c7 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.138813 Dec 18 21:02:41.576591 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2225/4445] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:41 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:41.953931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e1e499b6-ef59-4ab5-8ae4-972b8a75cb14 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:41.955404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e1e499b6-ef59-4ab5-8ae4-972b8a75cb14 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:41.966364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1e499b6-ef59-4ab5-8ae4-972b8a75cb14 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.966826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1e499b6-ef59-4ab5-8ae4-972b8a75cb14 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:41.967909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1e499b6-ef59-4ab5-8ae4-972b8a75cb14 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:41.968371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1e499b6-ef59-4ab5-8ae4-972b8a75cb14 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.039193 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e1e499b6-ef59-4ab5-8ae4-972b8a75cb14 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.090043 Dec 18 21:02:42.046973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2221/4446] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:41 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:42.403170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:42.403772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:42.422572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.423038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.424066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.426243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.528940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3a61d6b4-e0ae-4e21-8974-4fcd2c4cd051 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:42.530229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3a61d6b4-e0ae-4e21-8974-4fcd2c4cd051 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:42.546693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a61d6b4-e0ae-4e21-8974-4fcd2c4cd051 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.547519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a61d6b4-e0ae-4e21-8974-4fcd2c4cd051 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.549340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a61d6b4-e0ae-4e21-8974-4fcd2c4cd051 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.550836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a61d6b4-e0ae-4e21-8974-4fcd2c4cd051 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.651192 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3a61d6b4-e0ae-4e21-8974-4fcd2c4cd051 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.124844 Dec 18 21:02:42.664178 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2222/4447] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:42 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:42.683615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:42.684548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:42.709861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.710835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.715555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.717024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.732750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:42.743366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:42.748413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:42.750198 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b771e5f-cb9e-4295-91d9-b714c0dbca36 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1552 microversion: 2.21 time: 0.352043 Dec 18 21:02:42.752582 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2226/4448] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:42 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1552 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:42.777766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:42.778931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:42.794098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.794857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.795680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.796359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.832525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:02:42.914993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:42.928755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:42.930765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:42.935037 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0c75e0d-ac9d-4c08-b591-fee7ac695120 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.268029 Dec 18 21:02:42.949051 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2223/4449] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:42 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:42.971175 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6bb6082e-c52f-428d-b6ee-4d1da92c5489 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 204 len: 0 microversion: 2.21 time: 0.195489 Dec 18 21:02:42.973410 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2227/4450] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:02:42 2021] DELETE /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:02:42.984018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:42.985236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:42.992128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.992847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:42.994484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:42.995176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:43.056708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1570174-67de-412c-8a57-42b39e55a702 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:43.058601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1570174-67de-412c-8a57-42b39e55a702 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:43.087163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1570174-67de-412c-8a57-42b39e55a702 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:43.088614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1570174-67de-412c-8a57-42b39e55a702 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:43.091762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1570174-67de-412c-8a57-42b39e55a702 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:43.095460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1570174-67de-412c-8a57-42b39e55a702 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:43.182756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1570174-67de-412c-8a57-42b39e55a702 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.131811 Dec 18 21:02:43.187655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2228/4451] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:43 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:43.242219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:43.258093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:43.260507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:43.261805 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6bbd6e38-3166-426a-a55a-4fdec926ccc0 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1558 microversion: 2.21 time: 0.282965 Dec 18 21:02:43.265412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2224/4452] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:42 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1558 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:43.671249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8be8af37-0d29-4d7d-ab1c-d49899e6bafb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:43.673369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8be8af37-0d29-4d7d-ab1c-d49899e6bafb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:43.694758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8be8af37-0d29-4d7d-ab1c-d49899e6bafb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:43.695156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8be8af37-0d29-4d7d-ab1c-d49899e6bafb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:43.698934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8be8af37-0d29-4d7d-ab1c-d49899e6bafb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:43.701194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8be8af37-0d29-4d7d-ab1c-d49899e6bafb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:43.784273 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8be8af37-0d29-4d7d-ab1c-d49899e6bafb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.118103 Dec 18 21:02:43.785838 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2229/4453] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:43 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:43.956742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:43.964263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:43.975669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:43.980115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:43.981266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:43.981937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:44.090768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:44.114931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:44.117214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:44.119987 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5437e04-5dc1-43a6-8242-c3d61c5a8179 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.167190 Dec 18 21:02:44.120579 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2225/4454] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:43 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:44.199070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1741d39d-7f27-4b15-8c43-6b1377bfefde tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:44.200866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1741d39d-7f27-4b15-8c43-6b1377bfefde tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:44.215789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1741d39d-7f27-4b15-8c43-6b1377bfefde tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:44.216439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1741d39d-7f27-4b15-8c43-6b1377bfefde tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:44.217430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1741d39d-7f27-4b15-8c43-6b1377bfefde tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:44.218040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1741d39d-7f27-4b15-8c43-6b1377bfefde tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:44.282079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:44.283153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:44.283825 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1741d39d-7f27-4b15-8c43-6b1377bfefde tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.092221 Dec 18 21:02:44.284847 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2230/4455] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:44 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:44.292591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:44.294449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:44.295884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:44.296781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:44.741882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:44.759976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:44.761680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:44.762950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e87148d6-6fde-49a1-9bc4-ebebaf8fd490 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1558 microversion: 2.21 time: 0.487019 Dec 18 21:02:44.763615 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2226/4456] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:44 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1558 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:44.800705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa7e198b-434d-4c6e-a11b-39269a003596 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:44.802594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa7e198b-434d-4c6e-a11b-39269a003596 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:44.818930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa7e198b-434d-4c6e-a11b-39269a003596 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:44.819840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa7e198b-434d-4c6e-a11b-39269a003596 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:44.821640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa7e198b-434d-4c6e-a11b-39269a003596 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:44.822406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa7e198b-434d-4c6e-a11b-39269a003596 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:44.892844 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa7e198b-434d-4c6e-a11b-39269a003596 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.093505 Dec 18 21:02:44.892844 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2231/4457] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:44 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:45.142006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:45.142912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:45.163644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.164615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.167210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.168014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.297785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5e2625b-affc-409f-917d-2b83c9b41a10 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:45.299120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5e2625b-affc-409f-917d-2b83c9b41a10 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:45.310096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5e2625b-affc-409f-917d-2b83c9b41a10 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.310632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5e2625b-affc-409f-917d-2b83c9b41a10 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.311375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5e2625b-affc-409f-917d-2b83c9b41a10 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.313619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5e2625b-affc-409f-917d-2b83c9b41a10 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.346190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:45.363205 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5e2625b-affc-409f-917d-2b83c9b41a10 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.069202 Dec 18 21:02:45.364880 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2232/4458] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:45 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:45.368656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:45.371045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:45.372899 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-960f174f-ddb2-41be-80fe-4151bc980087 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.236964 Dec 18 21:02:45.374443 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2227/4459] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:45 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:45.561932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-49dbd8e5-3348-473f-8b01-544023bd2b04 req-25d69616-889a-485e-9d93-a002694f6550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbeab8db-c94f-4f17-b0d6-98b9b9c81288", "name": "network-vif-deleted", "tag": "31dbff86-71a4-402c-a5c6-7a6662676263"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:45.564243 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:45.564243 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:02:45.574639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-49dbd8e5-3348-473f-8b01-544023bd2b04 req-25d69616-889a-485e-9d93-a002694f6550 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.575371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-49dbd8e5-3348-473f-8b01-544023bd2b04 req-25d69616-889a-485e-9d93-a002694f6550 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.592569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-49dbd8e5-3348-473f-8b01-544023bd2b04 req-25d69616-889a-485e-9d93-a002694f6550 service nova] Creating event network-vif-deleted:31dbff86-71a4-402c-a5c6-7a6662676263 for instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 on nch2-master-1 Dec 18 21:02:45.598227 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-49dbd8e5-3348-473f-8b01-544023bd2b04 req-25d69616-889a-485e-9d93-a002694f6550 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040518 Dec 18 21:02:45.599110 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2233/4460] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:02:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:02:45.781240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:45.781907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:45.789061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.789550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.790731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.791428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.828448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.829344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.830040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lazy-loading 'fault' on Instance uuid cbeab8db-c94f-4f17-b0d6-98b9b9c81288 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:02:45.910058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d665c4e5-1d40-4df6-b85c-2e0ec5051403 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:45.910987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d665c4e5-1d40-4df6-b85c-2e0ec5051403 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:45.927325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d665c4e5-1d40-4df6-b85c-2e0ec5051403 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.928385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d665c4e5-1d40-4df6-b85c-2e0ec5051403 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.929487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d665c4e5-1d40-4df6-b85c-2e0ec5051403 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:45.930236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d665c4e5-1d40-4df6-b85c-2e0ec5051403 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:45.936659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:45.972747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:45.977835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '026afcda165f437cbd8dc3a854a14c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a437811487424144a39cf7205f4646fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:45.995112 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66dadb7f-bcb6-40cf-8e24-906171d96809 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 200 len: 1348 microversion: 2.21 time: 0.215579 Dec 18 21:02:45.996704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2228/4461] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:45 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 1348 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:46.001580 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d665c4e5-1d40-4df6-b85c-2e0ec5051403 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.097579 Dec 18 21:02:46.007664 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2234/4462] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:45 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:46.376831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7aeddaf2-8b29-43a2-9250-34400ee61ead tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:46.378621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7aeddaf2-8b29-43a2-9250-34400ee61ead tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:46.393351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:46.395204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:46.399935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aeddaf2-8b29-43a2-9250-34400ee61ead tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:46.410829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aeddaf2-8b29-43a2-9250-34400ee61ead tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:46.411980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aeddaf2-8b29-43a2-9250-34400ee61ead tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:46.414812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:46.416099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7aeddaf2-8b29-43a2-9250-34400ee61ead tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:46.419483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:46.420339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:46.421077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:46.490558 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7aeddaf2-8b29-43a2-9250-34400ee61ead tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.118036 Dec 18 21:02:46.491615 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2229/4463] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:46 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:46.582393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:46.594136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:46.596299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:46.597730 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bc5c900-8938-4baa-bf08-65a5d28b400e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.208579 Dec 18 21:02:46.599208 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2235/4464] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:46 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:47.020596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:47.021912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:47.022670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f955db6b-6458-4927-a3ac-af0dac5830ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:47.028400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f955db6b-6458-4927-a3ac-af0dac5830ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:47.037688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f955db6b-6458-4927-a3ac-af0dac5830ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.039672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.040610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.041663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.042530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f955db6b-6458-4927-a3ac-af0dac5830ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.043234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.044327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f955db6b-6458-4927-a3ac-af0dac5830ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.049550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f955db6b-6458-4927-a3ac-af0dac5830ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.075297 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] HTTP exception thrown: Instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 could not be found. Dec 18 21:02:47.076393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Returning 404 to user: Instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:47.081868 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c8e4ce0-7b37-4e73-9d47-5d18ac047b99 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 404 len: 111 microversion: 2.21 time: 0.066401 Dec 18 21:02:47.083009 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2236/4465] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:47 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:02:47.099878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ebb3c77a-7bd0-4657-8444-3715fb79e389 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '.version_select at 0x7f714f70c430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:47.100683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ebb3c77a-7bd0-4657-8444-3715fb79e389 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:47.108274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebb3c77a-7bd0-4657-8444-3715fb79e389 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.108744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebb3c77a-7bd0-4657-8444-3715fb79e389 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.109571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebb3c77a-7bd0-4657-8444-3715fb79e389 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.110023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebb3c77a-7bd0-4657-8444-3715fb79e389 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.120001 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f955db6b-6458-4927-a3ac-af0dac5830ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.107961 Dec 18 21:02:47.121630 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2230/4466] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:47 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:47.222281 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ebb3c77a-7bd0-4657-8444-3715fb79e389 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.135115 Dec 18 21:02:47.223523 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2237/4467] 10.222.0.13 () {60 vars in 1336 bytes} [Sat Dec 18 21:02:47 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288/os-instance-actions => generated 611 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:47.240963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:47.241705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:47.249978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.250919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.252029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.252838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.278925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] HTTP exception thrown: Instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 could not be found. Dec 18 21:02:47.279544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Returning 404 to user: Instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:47.280415 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68e71412-174a-49f8-94b2-2d44b4a8bcf9 tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 404 len: 111 microversion: 2.21 time: 0.043661 Dec 18 21:02:47.281555 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2231/4468] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:02:47 2021] DELETE /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:02:47.290125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:47.291144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] [instance: cbeab8db-c94f-4f17-b0d6-98b9b9c81288] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:47.299091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.299557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.300375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.301010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.320132 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] HTTP exception thrown: Instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 could not be found. Dec 18 21:02:47.320999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] Returning 404 to user: Instance cbeab8db-c94f-4f17-b0d6-98b9b9c81288 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:02:47.323184 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba9d6e1a-8aac-48dd-a5d9-2c57e1b75fdc tempest-InstanceActionsV221TestJSON-1704088634 tempest-InstanceActionsV221TestJSON-1704088634-project] 10.222.0.13 "GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288" status: 404 len: 111 microversion: 2.21 time: 0.037142 Dec 18 21:02:47.327964 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2238/4469] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:47 2021] GET /compute/v2.1/servers/cbeab8db-c94f-4f17-b0d6-98b9b9c81288 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:02:47.504236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac1fce59-5fbc-4210-8029-8c7696cbd086 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:47.505263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ac1fce59-5fbc-4210-8029-8c7696cbd086 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:47.519237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac1fce59-5fbc-4210-8029-8c7696cbd086 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.520643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac1fce59-5fbc-4210-8029-8c7696cbd086 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.523174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac1fce59-5fbc-4210-8029-8c7696cbd086 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.525434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac1fce59-5fbc-4210-8029-8c7696cbd086 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.591498 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac1fce59-5fbc-4210-8029-8c7696cbd086 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.090348 Dec 18 21:02:47.594758 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2232/4470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:47 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:47.620502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:47.621385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:47.631702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.635876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.638163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:47.642374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:47.804358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:47.815941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:47.818213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:47.819780 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b40d470-efe6-4439-9978-0eea19777a4b tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.205378 Dec 18 21:02:47.820751 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2239/4471] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:47 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:48.132825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-157380df-fa87-4d73-95dc-10b646f64716 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:48.133761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-157380df-fa87-4d73-95dc-10b646f64716 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:48.142508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-157380df-fa87-4d73-95dc-10b646f64716 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:48.143281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-157380df-fa87-4d73-95dc-10b646f64716 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:48.145114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-157380df-fa87-4d73-95dc-10b646f64716 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:48.145835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-157380df-fa87-4d73-95dc-10b646f64716 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:48.212925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-157380df-fa87-4d73-95dc-10b646f64716 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.083706 Dec 18 21:02:48.214423 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2233/4472] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:48 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:48.605519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d186082-48a6-46a4-bd88-2ab76f14ce98 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:48.607120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0d186082-48a6-46a4-bd88-2ab76f14ce98 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:48.622818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d186082-48a6-46a4-bd88-2ab76f14ce98 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:48.623571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d186082-48a6-46a4-bd88-2ab76f14ce98 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:48.624656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d186082-48a6-46a4-bd88-2ab76f14ce98 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:48.625374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d186082-48a6-46a4-bd88-2ab76f14ce98 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:48.684250 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d186082-48a6-46a4-bd88-2ab76f14ce98 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.082407 Dec 18 21:02:48.685131 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2240/4473] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:48 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:48.839871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:48.841291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:48.855623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:48.856227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:48.860186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:48.860726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:49.015560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:49.029835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:49.032335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:49.033907 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53b4e6d0-7b15-4d1d-a303-92e622744cba tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.198428 Dec 18 21:02:49.049023 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2234/4474] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:48 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:49.233659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b631f185-9cc8-41e8-b2f8-93de969783ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:49.235883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b631f185-9cc8-41e8-b2f8-93de969783ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:49.248920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b631f185-9cc8-41e8-b2f8-93de969783ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:49.249680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b631f185-9cc8-41e8-b2f8-93de969783ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:49.251957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b631f185-9cc8-41e8-b2f8-93de969783ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:49.253426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b631f185-9cc8-41e8-b2f8-93de969783ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:49.325589 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b631f185-9cc8-41e8-b2f8-93de969783ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.102060 Dec 18 21:02:49.330400 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2241/4475] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:49 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:49.698619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9b25b23-af0f-49e5-ab5a-08274de2d821 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:49.699713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9b25b23-af0f-49e5-ab5a-08274de2d821 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:49.713047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9b25b23-af0f-49e5-ab5a-08274de2d821 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:49.713536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9b25b23-af0f-49e5-ab5a-08274de2d821 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:49.714382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9b25b23-af0f-49e5-ab5a-08274de2d821 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:49.714953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9b25b23-af0f-49e5-ab5a-08274de2d821 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:49.823849 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9b25b23-af0f-49e5-ab5a-08274de2d821 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.129807 Dec 18 21:02:49.826966 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2235/4476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:49 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:50.059032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:50.059802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:50.078307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:50.078810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:50.079624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:50.080092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:50.205956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:50.219119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:50.221164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:50.222807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67d2fdd6-a712-441f-8b2b-4600afa96c79 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.169964 Dec 18 21:02:50.223668 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2242/4477] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:50 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:50.341371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c9c6ddd-72cf-45a9-a7b0-91ede1a2da01 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:50.358355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c9c6ddd-72cf-45a9-a7b0-91ede1a2da01 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:50.372601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c9c6ddd-72cf-45a9-a7b0-91ede1a2da01 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:50.373524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c9c6ddd-72cf-45a9-a7b0-91ede1a2da01 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:50.374617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c9c6ddd-72cf-45a9-a7b0-91ede1a2da01 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:50.375855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c9c6ddd-72cf-45a9-a7b0-91ede1a2da01 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:50.438125 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c9c6ddd-72cf-45a9-a7b0-91ede1a2da01 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.102963 Dec 18 21:02:50.442599 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2236/4478] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:50 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:50.838708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7eab1316-9fd0-4f74-a0b2-4786d24aaa8d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:50.839725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7eab1316-9fd0-4f74-a0b2-4786d24aaa8d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:50.853300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eab1316-9fd0-4f74-a0b2-4786d24aaa8d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:50.856143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eab1316-9fd0-4f74-a0b2-4786d24aaa8d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:50.857537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eab1316-9fd0-4f74-a0b2-4786d24aaa8d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:50.857994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7eab1316-9fd0-4f74-a0b2-4786d24aaa8d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:50.942406 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7eab1316-9fd0-4f74-a0b2-4786d24aaa8d tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.107566 Dec 18 21:02:50.943497 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2243/4479] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:50 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:51.243702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:51.244475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:51.263183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:51.263882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:51.264711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:51.265165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:51.406387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:51.421427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:51.426384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:51.428334 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a6bfa94-b91b-4882-b557-cb1971f88bae tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.189089 Dec 18 21:02:51.429604 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2237/4480] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:51 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:51.455265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0256dca2-b67b-42ef-aa6f-652d54301b96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:51.455773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0256dca2-b67b-42ef-aa6f-652d54301b96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:51.463854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0256dca2-b67b-42ef-aa6f-652d54301b96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:51.464718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0256dca2-b67b-42ef-aa6f-652d54301b96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:51.465823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0256dca2-b67b-42ef-aa6f-652d54301b96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:51.466613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0256dca2-b67b-42ef-aa6f-652d54301b96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:51.518429 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0256dca2-b67b-42ef-aa6f-652d54301b96 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.068682 Dec 18 21:02:51.520098 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2244/4481] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:51 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:02:51.957137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d47d3b34-d93e-45c6-bcdc-fdca0ab87c19 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:51.957137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d47d3b34-d93e-45c6-bcdc-fdca0ab87c19 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:51.977180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d47d3b34-d93e-45c6-bcdc-fdca0ab87c19 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:51.977896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d47d3b34-d93e-45c6-bcdc-fdca0ab87c19 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:51.980176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d47d3b34-d93e-45c6-bcdc-fdca0ab87c19 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:51.982031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d47d3b34-d93e-45c6-bcdc-fdca0ab87c19 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:52.045612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d47d3b34-d93e-45c6-bcdc-fdca0ab87c19 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.094895 Dec 18 21:02:52.049648 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2238/4482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:51 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:52.449985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:52.451093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:52.465335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:52.468226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:52.470596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:52.471474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:52.534153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d3194eb-22d7-42ba-96b3-b6c394dbb588 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:52.538227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1d3194eb-22d7-42ba-96b3-b6c394dbb588 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:52.560620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3194eb-22d7-42ba-96b3-b6c394dbb588 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:52.562512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3194eb-22d7-42ba-96b3-b6c394dbb588 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:52.563690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3194eb-22d7-42ba-96b3-b6c394dbb588 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:52.564367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3194eb-22d7-42ba-96b3-b6c394dbb588 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:52.634533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:52.641423 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d3194eb-22d7-42ba-96b3-b6c394dbb588 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.110730 Dec 18 21:02:52.643799 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2239/4483] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:52 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:52.655021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:52.666487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:52.668069 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e2aeeee-c4f6-49c0-8bfc-96e46152f31d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.222829 Dec 18 21:02:52.668659 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2245/4484] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:52 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:53.058828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b43bb27-c152-4c52-8bd6-4df93ac7da3e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:53.059864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b43bb27-c152-4c52-8bd6-4df93ac7da3e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:53.075515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b43bb27-c152-4c52-8bd6-4df93ac7da3e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:53.076035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b43bb27-c152-4c52-8bd6-4df93ac7da3e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:53.079799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b43bb27-c152-4c52-8bd6-4df93ac7da3e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:53.080604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b43bb27-c152-4c52-8bd6-4df93ac7da3e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:53.174524 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b43bb27-c152-4c52-8bd6-4df93ac7da3e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.120271 Dec 18 21:02:53.175389 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2240/4485] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:53 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:53.625590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-257131610", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "dd20398e-7d65-482f-a9be-ce0f72eac974"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:53.656960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc6eb752-6133-4aba-8aad-a902c804379f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:53.658277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc6eb752-6133-4aba-8aad-a902c804379f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:53.685174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc6eb752-6133-4aba-8aad-a902c804379f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:53.685831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc6eb752-6133-4aba-8aad-a902c804379f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:53.687403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc6eb752-6133-4aba-8aad-a902c804379f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:53.689779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc6eb752-6133-4aba-8aad-a902c804379f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:53.734006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] validate_networks() for [('dd20398e-7d65-482f-a9be-ce0f72eac974', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:02:53.786590 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc6eb752-6133-4aba-8aad-a902c804379f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.134659 Dec 18 21:02:53.788023 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2241/4486] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:53 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:53.803861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:53.806650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:53.825506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:53.825971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:53.828907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:53.830724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:54.237415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:54.247652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:54.249347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:54.250585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5934c5dd-f6ff-42f4-874b-9ba5198cad2f tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.459762 Dec 18 21:02:54.251696 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2242/4487] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:53 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:54.257032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ed9d73d-d7a7-45e3-9be5-2b8b7cddc27a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:54.257945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3ed9d73d-d7a7-45e3-9be5-2b8b7cddc27a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:54.265702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ed9d73d-d7a7-45e3-9be5-2b8b7cddc27a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:54.266460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ed9d73d-d7a7-45e3-9be5-2b8b7cddc27a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:54.267463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ed9d73d-d7a7-45e3-9be5-2b8b7cddc27a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:54.268111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ed9d73d-d7a7-45e3-9be5-2b8b7cddc27a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:54.349241 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3ed9d73d-d7a7-45e3-9be5-2b8b7cddc27a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.093251 Dec 18 21:02:54.350303 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2243/4488] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:54 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:54.678086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:02:54.678704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:02:54.679626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:02:54.680199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:02:54.680849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:02:54.691255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:54.692193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:54.693271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:54.694024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:54.723496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Getting quotas for project f161cef6f2864c7e8c2d183d1a22107e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:02:54.731252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Getting quotas for user 015cce270f514b67a30f46bf31195933 and project f161cef6f2864c7e8c2d183d1a22107e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:02:54.744014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:02:54.746883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:02:54.804465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c503fcc-238b-4c2e-b124-6e960082326c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:54.808103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8c503fcc-238b-4c2e-b124-6e960082326c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:54.826014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c503fcc-238b-4c2e-b124-6e960082326c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:54.827857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c503fcc-238b-4c2e-b124-6e960082326c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:54.831224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c503fcc-238b-4c2e-b124-6e960082326c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:54.833503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c503fcc-238b-4c2e-b124-6e960082326c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:54.835103 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d1424608-cd9c-4384-a614-cd1b08bcec7a tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563210 Dec 18 21:02:54.837307 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2246/4489] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:02:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:02:54.851016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-221076c8-3a0a-4603-8a64-94ea7546d919 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:54.852312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-221076c8-3a0a-4603-8a64-94ea7546d919 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:54.933173 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8c503fcc-238b-4c2e-b124-6e960082326c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.136539 Dec 18 21:02:54.933910 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2244/4490] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:54 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:54.981297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-221076c8-3a0a-4603-8a64-94ea7546d919 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:54.988049 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-221076c8-3a0a-4603-8a64-94ea7546d919 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1215 microversion: 2.1 time: 0.143306 Dec 18 21:02:54.988646 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2247/4491] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:54 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:55.272688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:55.273472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:55.285354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:55.286319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:55.287741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:55.288235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:55.361829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2924333-75c6-4465-be84-a3342ffe57ed tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:55.364101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2924333-75c6-4465-be84-a3342ffe57ed tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:55.373381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2924333-75c6-4465-be84-a3342ffe57ed tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:55.374019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2924333-75c6-4465-be84-a3342ffe57ed tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:55.375473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2924333-75c6-4465-be84-a3342ffe57ed tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:55.376287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2924333-75c6-4465-be84-a3342ffe57ed tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:55.418948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:55.428321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2924333-75c6-4465-be84-a3342ffe57ed tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.070436 Dec 18 21:02:55.429805 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2248/4492] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:55 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:02:55.452758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:55.455538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:55.457118 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e3c59d1-d919-4e20-92b3-d5fe1033ce71 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.190104 Dec 18 21:02:55.458312 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2245/4493] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:55 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:55.948956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7243c210-b735-474d-9732-0c23f9baa069 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:55.953523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7243c210-b735-474d-9732-0c23f9baa069 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:55.965985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7243c210-b735-474d-9732-0c23f9baa069 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:55.966776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7243c210-b735-474d-9732-0c23f9baa069 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:55.968663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7243c210-b735-474d-9732-0c23f9baa069 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:55.969503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7243c210-b735-474d-9732-0c23f9baa069 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:56.007542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:56.008886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:56.025485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:56.029663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:56.030860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:56.031056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:56.051726 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7243c210-b735-474d-9732-0c23f9baa069 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.110696 Dec 18 21:02:56.052709 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2249/4494] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:55 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:56.188618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:56.198541 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ce5f7c6-fcfc-426e-9ae3-5e3caaf8b005 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1267 microversion: 2.1 time: 0.195210 Dec 18 21:02:56.204940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2246/4495] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:56 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:02:56.447184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-880ae1be-1046-4e32-aaa8-5302bf226355 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:56.448940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-880ae1be-1046-4e32-aaa8-5302bf226355 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:56.476172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:56.476911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:56.482007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-880ae1be-1046-4e32-aaa8-5302bf226355 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:56.484937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-880ae1be-1046-4e32-aaa8-5302bf226355 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:56.486142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-880ae1be-1046-4e32-aaa8-5302bf226355 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:56.487300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-880ae1be-1046-4e32-aaa8-5302bf226355 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:56.487503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:56.491110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:56.492808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:56.495037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:56.605013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-880ae1be-1046-4e32-aaa8-5302bf226355 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.166812 Dec 18 21:02:56.624599 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2250/4496] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:56 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:56.810338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:56.826460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:56.832419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:56.838927 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d4972c73-c546-4d9f-b21c-34b05c4be78e tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1409 microversion: 2.54 time: 0.366153 Dec 18 21:02:56.842290 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2247/4497] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:56 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1409 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:57.070316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2847dc51-6dc2-435e-988d-dbae2c0d00a6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:57.073959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2847dc51-6dc2-435e-988d-dbae2c0d00a6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:57.096778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2847dc51-6dc2-435e-988d-dbae2c0d00a6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.104416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2847dc51-6dc2-435e-988d-dbae2c0d00a6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:57.105615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2847dc51-6dc2-435e-988d-dbae2c0d00a6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.109196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2847dc51-6dc2-435e-988d-dbae2c0d00a6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:57.177690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2847dc51-6dc2-435e-988d-dbae2c0d00a6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 24573 microversion: 2.42 time: 0.113001 Dec 18 21:02:57.186418 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2251/4498] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:57 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 24573 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:57.231034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:57.232029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:57.253604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.254774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:57.255991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.257225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:57.388051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:57.398410 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93d8bc92-3a4e-4579-9d2a-fb310540a16f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1273 microversion: 2.1 time: 0.179690 Dec 18 21:02:57.406119 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2248/4499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:57 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:57.633425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e64a8fb6-04c0-4649-a155-567a8e69c3d0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:57.635371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e64a8fb6-04c0-4649-a155-567a8e69c3d0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:57.653550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e64a8fb6-04c0-4649-a155-567a8e69c3d0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.672207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e64a8fb6-04c0-4649-a155-567a8e69c3d0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:57.673337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e64a8fb6-04c0-4649-a155-567a8e69c3d0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.675131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e64a8fb6-04c0-4649-a155-567a8e69c3d0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:57.827527 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e64a8fb6-04c0-4649-a155-567a8e69c3d0 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.198001 Dec 18 21:02:57.835593 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2252/4500] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:57 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:57.859356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:57.859991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:57.871270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.871727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:57.878183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:57.878706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:58.130099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:58.139155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:58.140696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:58.141925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-916177e7-34f5-4f69-b14c-df8ac99641a1 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1415 microversion: 2.54 time: 0.288852 Dec 18 21:02:58.152224 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2249/4501] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:57 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1415 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:02:58.192361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6b924e4-7f3a-4d23-bdc9-4cd5321e067c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:58.193997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6b924e4-7f3a-4d23-bdc9-4cd5321e067c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:58.211009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6b924e4-7f3a-4d23-bdc9-4cd5321e067c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:58.211476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6b924e4-7f3a-4d23-bdc9-4cd5321e067c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:58.212337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6b924e4-7f3a-4d23-bdc9-4cd5321e067c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:58.215802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6b924e4-7f3a-4d23-bdc9-4cd5321e067c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:58.331181 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6b924e4-7f3a-4d23-bdc9-4cd5321e067c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 32602 microversion: 2.42 time: 0.143140 Dec 18 21:02:58.342467 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2253/4502] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:58 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 32602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:58.423224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:58.423929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:58.436993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:58.437481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:58.440873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:58.441341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:58.841500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07b3cd39-9109-48cd-84cd-838aa7666a43 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:58.843245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07b3cd39-9109-48cd-84cd-838aa7666a43 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:58.859824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07b3cd39-9109-48cd-84cd-838aa7666a43 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:58.864819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07b3cd39-9109-48cd-84cd-838aa7666a43 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:58.866869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07b3cd39-9109-48cd-84cd-838aa7666a43 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:58.867841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07b3cd39-9109-48cd-84cd-838aa7666a43 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:58.963956 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07b3cd39-9109-48cd-84cd-838aa7666a43 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.127266 Dec 18 21:02:58.964528 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2254/4503] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:58 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:02:58.966880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:58.975487 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55bae784-77c6-4b26-8934-b1f6a57fbf44 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1315 microversion: 2.1 time: 0.556198 Dec 18 21:02:58.976084 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2250/4504] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:58 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:59.163330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:02:59.165375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:59.179130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:59.180327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:59.183298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:59.185407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:59.355038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ad7aff5-b8f2-4ae5-8c85-82922d3653d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:59.355981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ad7aff5-b8f2-4ae5-8c85-82922d3653d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:59.368416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ad7aff5-b8f2-4ae5-8c85-82922d3653d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:59.368873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ad7aff5-b8f2-4ae5-8c85-82922d3653d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:59.370331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ad7aff5-b8f2-4ae5-8c85-82922d3653d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:59.370746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ad7aff5-b8f2-4ae5-8c85-82922d3653d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:59.472075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ad7aff5-b8f2-4ae5-8c85-82922d3653d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 32602 microversion: 2.42 time: 0.122247 Dec 18 21:02:59.476042 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2251/4505] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:02:59 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 32602 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:02:59.878159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:59.892367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:59.894892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:02:59.897105 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecd806c8-02d7-4961-bfc5-c53d03be06f3 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1415 microversion: 2.54 time: 0.738016 Dec 18 21:02:59.897935 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2255/4506] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:02:59 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1415 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:02:59.976119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-543c624c-b06b-4edc-ac08-9525d7789de2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:02:59.978022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-543c624c-b06b-4edc-ac08-9525d7789de2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:02:59.987005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-543c624c-b06b-4edc-ac08-9525d7789de2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:59.987713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-543c624c-b06b-4edc-ac08-9525d7789de2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:59.988766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-543c624c-b06b-4edc-ac08-9525d7789de2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:02:59.989439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-543c624c-b06b-4edc-ac08-9525d7789de2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:02:59.998600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:00.000049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:00.011073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:00.011535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:00.012348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:00.012790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:00.038722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-543c624c-b06b-4edc-ac08-9525d7789de2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.066380 Dec 18 21:03:00.046195 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2252/4507] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:02:59 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:00.448583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:00.467682 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50baf4f9-44fa-41f1-997d-91c0224063e8 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1315 microversion: 2.1 time: 0.466982 Dec 18 21:03:00.469474 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2256/4508] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:02:59 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:00.484726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c7365b7-4414-4147-b570-f13382bd0b37 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:00.485675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c7365b7-4414-4147-b570-f13382bd0b37 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:00.493879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c7365b7-4414-4147-b570-f13382bd0b37 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:00.494564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c7365b7-4414-4147-b570-f13382bd0b37 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:00.495795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c7365b7-4414-4147-b570-f13382bd0b37 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:00.496410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c7365b7-4414-4147-b570-f13382bd0b37 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:00.554186 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c7365b7-4414-4147-b570-f13382bd0b37 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 32602 microversion: 2.42 time: 0.073617 Dec 18 21:03:00.556385 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2253/4509] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:00 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 32602 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:00.916951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:00.918417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:00.925989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:00.926608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:00.927932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:00.928820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.047899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-66f6277c-80f4-405c-8e15-2f7f40bf2522 req-6c833757-b6d2-421e-91a6-3bf4aced5bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef67420-4d8c-4a20-8059-2fb29eb553ce", "tag": "b37b2a49-b715-488f-b585-88dd2a37c534"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:01.049750 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:01.049750 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:03:01.059475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-66f6277c-80f4-405c-8e15-2f7f40bf2522 req-6c833757-b6d2-421e-91a6-3bf4aced5bd8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.060301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-66f6277c-80f4-405c-8e15-2f7f40bf2522 req-6c833757-b6d2-421e-91a6-3bf4aced5bd8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.074155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-66f6277c-80f4-405c-8e15-2f7f40bf2522 req-6c833757-b6d2-421e-91a6-3bf4aced5bd8 service nova] Creating event network-changed:b37b2a49-b715-488f-b585-88dd2a37c534 for instance 3ef67420-4d8c-4a20-8059-2fb29eb553ce on nch2-master-1 Dec 18 21:03:01.080540 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-66f6277c-80f4-405c-8e15-2f7f40bf2522 req-6c833757-b6d2-421e-91a6-3bf4aced5bd8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036543 Dec 18 21:03:01.081141 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2254/4510] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:01.086405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b1fde36-4f5d-4fca-9367-5543c3c825c3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:01.089487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b1fde36-4f5d-4fca-9367-5543c3c825c3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:01.094138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:01.097677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1fde36-4f5d-4fca-9367-5543c3c825c3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.098517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1fde36-4f5d-4fca-9367-5543c3c825c3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.099540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1fde36-4f5d-4fca-9367-5543c3c825c3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.100077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1fde36-4f5d-4fca-9367-5543c3c825c3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.110827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:01.116399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:01.117668 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9076e0b5-2c82-4a88-91b9-2b18aab7cbfb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1400 microversion: 2.54 time: 0.205427 Dec 18 21:03:01.122830 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2257/4511] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:03:00 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1400 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:03:01.142900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c2a930d4-64be-44aa-bd35-015fb579beb2 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '.version_select at 0x7f714ef15af0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:01.160147 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b1fde36-4f5d-4fca-9367-5543c3c825c3 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.076493 Dec 18 21:03:01.160734 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2255/4512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:01 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:01.185468 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c2a930d4-64be-44aa-bd35-015fb579beb2 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1245268190" status: 204 len: 0 microversion: 2.54 time: 0.046887 Dec 18 21:03:01.186295 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2258/4513] 10.222.0.13 () {60 vars in 1318 bytes} [Sat Dec 18 21:03:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1245268190 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:03:01.201923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:01.202521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:01.214552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.215182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.217036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.218011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.265959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:03:01.471962 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d81e0abb-6105-45b5-9988-165bc68ae1c0 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 204 len: 0 microversion: 2.54 time: 0.270746 Dec 18 21:03:01.474044 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2256/4514] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:03:01 2021] DELETE /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:03:01.492154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:01.493136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:01.517606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.520771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:01.522229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.523637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:01.526995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.529396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.550130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.550615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.553935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.556281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.693054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:01.705251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:01.707328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:01.708923 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f561cfcf-20fd-49ef-a759-1d51fcb2519d tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1406 microversion: 2.54 time: 0.228964 Dec 18 21:03:01.722741 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2259/4515] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:03:01 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:03:01.729190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80009b8a-67a9-4f6e-8ad2-e3524bf3556b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:01.730587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80009b8a-67a9-4f6e-8ad2-e3524bf3556b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:01.741563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80009b8a-67a9-4f6e-8ad2-e3524bf3556b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.747245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80009b8a-67a9-4f6e-8ad2-e3524bf3556b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.748525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80009b8a-67a9-4f6e-8ad2-e3524bf3556b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:01.749244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80009b8a-67a9-4f6e-8ad2-e3524bf3556b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:01.824025 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80009b8a-67a9-4f6e-8ad2-e3524bf3556b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 32602 microversion: 2.42 time: 0.099607 Dec 18 21:03:01.828681 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2260/4516] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:01 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 32602 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:02.055295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:02.067676 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9be805c9-5109-4344-af54-c75c03cbfb00 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1315 microversion: 2.1 time: 0.563392 Dec 18 21:03:02.069612 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2257/4517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:01 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:02.174990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49e07b7b-df30-453c-96ae-6bfec5ca87fe tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:02.176056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-49e07b7b-df30-453c-96ae-6bfec5ca87fe tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:02.184479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49e07b7b-df30-453c-96ae-6bfec5ca87fe tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:02.185088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49e07b7b-df30-453c-96ae-6bfec5ca87fe tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:02.186284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49e07b7b-df30-453c-96ae-6bfec5ca87fe tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:02.186442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49e07b7b-df30-453c-96ae-6bfec5ca87fe tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:02.247522 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49e07b7b-df30-453c-96ae-6bfec5ca87fe tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.078752 Dec 18 21:03:02.254618 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2261/4518] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:02 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:02.729944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:02.731563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:02.759841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:02.760929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:02.762120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:02.763316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:02.839911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5d433145-49d2-4fcc-86d0-9d5c31db6a92 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:02.841053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5d433145-49d2-4fcc-86d0-9d5c31db6a92 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:02.858179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d433145-49d2-4fcc-86d0-9d5c31db6a92 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:02.858673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d433145-49d2-4fcc-86d0-9d5c31db6a92 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:02.866138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d433145-49d2-4fcc-86d0-9d5c31db6a92 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:02.866750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d433145-49d2-4fcc-86d0-9d5c31db6a92 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:02.918500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:02.952778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:02.966834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18391d5b5ae43d3b9b3cc8d61b27de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02953ea763ef4ddeb43c836d85986809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:02.968151 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-757b922a-4ebb-4880-9e2a-19c9fdde2029 tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 200 len: 1406 microversion: 2.54 time: 0.242980 Dec 18 21:03:02.976605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2258/4519] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:03:02 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:03:03.025409 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5d433145-49d2-4fcc-86d0-9d5c31db6a92 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 32602 microversion: 2.42 time: 0.189632 Dec 18 21:03:03.026976 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2262/4520] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:02 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 32602 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:03.087965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:03.088602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:03.098594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:03.100145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:03.101211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:03.101898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:03.261127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ca4be10-8f9d-4c30-8185-b5d9fdb8071b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:03.262153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ca4be10-8f9d-4c30-8185-b5d9fdb8071b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:03.270705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ca4be10-8f9d-4c30-8185-b5d9fdb8071b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:03.271167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ca4be10-8f9d-4c30-8185-b5d9fdb8071b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:03.272151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ca4be10-8f9d-4c30-8185-b5d9fdb8071b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:03.272772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ca4be10-8f9d-4c30-8185-b5d9fdb8071b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:03.330793 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ca4be10-8f9d-4c30-8185-b5d9fdb8071b tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.073695 Dec 18 21:03:03.335351 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2263/4521] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:03 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:03.999422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:04.000871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] [instance: af4544a8-0641-4f92-8ab4-4555de141003] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:04.020879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:04.024388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:04.025471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:04.025991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:04.033414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:04.041213 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-205eb22c-429d-470e-841f-a22471a056e5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1315 microversion: 2.1 time: 0.958490 Dec 18 21:03:04.042791 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2259/4522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:03 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:04.065319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-513f34ed-f256-4417-b5aa-a196ccea1c0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:04.066307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-513f34ed-f256-4417-b5aa-a196ccea1c0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:04.080207 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] HTTP exception thrown: Instance af4544a8-0641-4f92-8ab4-4555de141003 could not be found. Dec 18 21:03:04.081169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] Returning 404 to user: Instance af4544a8-0641-4f92-8ab4-4555de141003 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:03:04.082045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-513f34ed-f256-4417-b5aa-a196ccea1c0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:04.082968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-513f34ed-f256-4417-b5aa-a196ccea1c0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:04.083342 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ab6e39c-675a-4ac9-aba7-c2464eba42fb tempest-ServerShowV254Test-655464592 tempest-ServerShowV254Test-655464592-project] 10.222.0.13 "GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003" status: 404 len: 111 microversion: 2.54 time: 0.089980 Dec 18 21:03:04.084372 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2264/4523] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:03:03 2021] GET /compute/v2.1/servers/af4544a8-0641-4f92-8ab4-4555de141003 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:03:04.104224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-513f34ed-f256-4417-b5aa-a196ccea1c0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:04.105931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-513f34ed-f256-4417-b5aa-a196ccea1c0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:04.189243 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-513f34ed-f256-4417-b5aa-a196ccea1c0d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.130583 Dec 18 21:03:04.190660 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2260/4524] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:04 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:04.354341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecde4966-d53d-449a-acb5-facab677e1f2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:04.356031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecde4966-d53d-449a-acb5-facab677e1f2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:04.377218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecde4966-d53d-449a-acb5-facab677e1f2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:04.377694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecde4966-d53d-449a-acb5-facab677e1f2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:04.386806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecde4966-d53d-449a-acb5-facab677e1f2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:04.387365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecde4966-d53d-449a-acb5-facab677e1f2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:04.527846 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecde4966-d53d-449a-acb5-facab677e1f2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.184885 Dec 18 21:03:04.528964 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2265/4525] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:04 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:05.061883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:05.064268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:05.089080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:05.089634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:05.093721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:05.095673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:05.202836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3cfbc3f-da87-4432-87c9-aa89d96d9beb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:05.204242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a3cfbc3f-da87-4432-87c9-aa89d96d9beb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:05.216483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3cfbc3f-da87-4432-87c9-aa89d96d9beb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:05.216958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3cfbc3f-da87-4432-87c9-aa89d96d9beb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:05.218571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3cfbc3f-da87-4432-87c9-aa89d96d9beb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:05.219549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3cfbc3f-da87-4432-87c9-aa89d96d9beb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:05.332303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3cfbc3f-da87-4432-87c9-aa89d96d9beb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.131659 Dec 18 21:03:05.339559 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2266/4526] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:05 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:05.522607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:05.543678 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39a6e303-3f59-49bc-baa2-29cd7b8894c4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1315 microversion: 2.1 time: 0.487165 Dec 18 21:03:05.544419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24b3c09b-3670-4b0a-94fd-0327b19301c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:05.545461 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2261/4527] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:05 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:05.545769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-24b3c09b-3670-4b0a-94fd-0327b19301c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:05.568908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24b3c09b-3670-4b0a-94fd-0327b19301c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:05.569420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24b3c09b-3670-4b0a-94fd-0327b19301c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:05.570287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24b3c09b-3670-4b0a-94fd-0327b19301c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:05.570728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24b3c09b-3670-4b0a-94fd-0327b19301c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:05.624909 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24b3c09b-3670-4b0a-94fd-0327b19301c6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.086695 Dec 18 21:03:05.631802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2267/4528] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:05 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:03:06.351112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2802e2ae-9d0e-4b0e-97f4-f0f0aa6a2bb6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:06.355655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2802e2ae-9d0e-4b0e-97f4-f0f0aa6a2bb6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:06.372282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2802e2ae-9d0e-4b0e-97f4-f0f0aa6a2bb6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:06.372742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2802e2ae-9d0e-4b0e-97f4-f0f0aa6a2bb6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:06.373634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2802e2ae-9d0e-4b0e-97f4-f0f0aa6a2bb6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:06.374098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2802e2ae-9d0e-4b0e-97f4-f0f0aa6a2bb6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:06.491387 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2802e2ae-9d0e-4b0e-97f4-f0f0aa6a2bb6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.146696 Dec 18 21:03:06.494824 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2262/4529] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:06 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:06.568474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:06.571373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:06.591145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:06.592767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:06.595464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:06.596895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:06.650687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd19dfd6-d58b-4522-92c9-cb549202d154 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:06.652321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dd19dfd6-d58b-4522-92c9-cb549202d154 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:06.669339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd19dfd6-d58b-4522-92c9-cb549202d154 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:06.671097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd19dfd6-d58b-4522-92c9-cb549202d154 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:06.672529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd19dfd6-d58b-4522-92c9-cb549202d154 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:06.674107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd19dfd6-d58b-4522-92c9-cb549202d154 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:06.755358 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd19dfd6-d58b-4522-92c9-cb549202d154 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.115707 Dec 18 21:03:06.756030 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2263/4530] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:06 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:07.199834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:07.207353 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ad32495-a9c9-49b5-a328-cb5041bd5cf4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1315 microversion: 2.1 time: 0.647841 Dec 18 21:03:07.210715 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2268/4531] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:06 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:07.511378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd98ec3f-b062-4cb6-ba62-77ff3a6b7b28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:07.515824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd98ec3f-b062-4cb6-ba62-77ff3a6b7b28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:07.535105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd98ec3f-b062-4cb6-ba62-77ff3a6b7b28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:07.536260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd98ec3f-b062-4cb6-ba62-77ff3a6b7b28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:07.539439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd98ec3f-b062-4cb6-ba62-77ff3a6b7b28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:07.540785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd98ec3f-b062-4cb6-ba62-77ff3a6b7b28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:07.630907 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd98ec3f-b062-4cb6-ba62-77ff3a6b7b28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.126453 Dec 18 21:03:07.633333 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2264/4532] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:07 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:07.768059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7aefb6f1-0a77-42c5-a380-9b6a421e9e82 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:07.769022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7aefb6f1-0a77-42c5-a380-9b6a421e9e82 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:07.789391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aefb6f1-0a77-42c5-a380-9b6a421e9e82 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:07.790788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aefb6f1-0a77-42c5-a380-9b6a421e9e82 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:07.791776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aefb6f1-0a77-42c5-a380-9b6a421e9e82 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:07.792566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7aefb6f1-0a77-42c5-a380-9b6a421e9e82 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:07.876121 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7aefb6f1-0a77-42c5-a380-9b6a421e9e82 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.111537 Dec 18 21:03:07.877308 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2269/4533] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:07 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:08.037733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c9c1ef8c-3642-4ad7-b273-ce746c2afac8 req-8734a28f-8c75-40e0-8027-fca4b50293a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef67420-4d8c-4a20-8059-2fb29eb553ce", "name": "network-vif-plugged", "status": "completed", "tag": "b37b2a49-b715-488f-b585-88dd2a37c534"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:08.049935 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:08.049935 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:03:08.064414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c9c1ef8c-3642-4ad7-b273-ce746c2afac8 req-8734a28f-8c75-40e0-8027-fca4b50293a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:08.065292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c9c1ef8c-3642-4ad7-b273-ce746c2afac8 req-8734a28f-8c75-40e0-8027-fca4b50293a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:08.088797 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c9c1ef8c-3642-4ad7-b273-ce746c2afac8 req-8734a28f-8c75-40e0-8027-fca4b50293a0 service nova] Creating event network-vif-plugged:b37b2a49-b715-488f-b585-88dd2a37c534 for instance 3ef67420-4d8c-4a20-8059-2fb29eb553ce on nch2-master-1 Dec 18 21:03:08.096515 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c9c1ef8c-3642-4ad7-b273-ce746c2afac8 req-8734a28f-8c75-40e0-8027-fca4b50293a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070222 Dec 18 21:03:08.101680 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2265/4534] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:08.228846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:08.229550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:08.240028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:08.241870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:08.243365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:08.247927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:08.651733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3341e048-3d85-4ab3-bd4e-c96bceb75354 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:08.654983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:08.655885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3341e048-3d85-4ab3-bd4e-c96bceb75354 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:08.666563 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2fb59c4-96e9-4ab2-9b44-d63f9f6fd17f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1315 microversion: 2.1 time: 0.442279 Dec 18 21:03:08.673124 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2270/4535] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:08 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:08.673651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3341e048-3d85-4ab3-bd4e-c96bceb75354 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:08.674760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3341e048-3d85-4ab3-bd4e-c96bceb75354 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:08.676475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3341e048-3d85-4ab3-bd4e-c96bceb75354 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:08.679364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3341e048-3d85-4ab3-bd4e-c96bceb75354 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:08.777495 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3341e048-3d85-4ab3-bd4e-c96bceb75354 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.131835 Dec 18 21:03:08.782652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2266/4536] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:08 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:03:08.888383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25a77929-1510-41ac-aa44-69923d24e6d2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:08.889669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25a77929-1510-41ac-aa44-69923d24e6d2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:08.900748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25a77929-1510-41ac-aa44-69923d24e6d2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:08.902096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25a77929-1510-41ac-aa44-69923d24e6d2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:08.903128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25a77929-1510-41ac-aa44-69923d24e6d2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:08.903741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25a77929-1510-41ac-aa44-69923d24e6d2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:08.951726 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25a77929-1510-41ac-aa44-69923d24e6d2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 32640 microversion: 2.1 time: 0.066664 Dec 18 21:03:08.957891 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2271/4537] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:08 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 32640 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:09.531824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a2021b65-cc50-4eba-9932-75538840a731 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714ed52280>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:09.689187 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a2021b65-cc50-4eba-9932-75538840a731 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c2059a83-33dc-4ab3-90a2-459bbc5a74e3" status: 200 len: 343 microversion: 2.1 time: 0.165995 Dec 18 21:03:09.695786 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2267/4538] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:03:09 2021] GET /compute/v2.1/os-volumes/c2059a83-33dc-4ab3-90a2-459bbc5a74e3 => generated 343 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:09.696411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:09.696411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:09.788375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:09.791196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:09.792724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee779ba7-3d05-4973-a96b-5fd18206b1f7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:09.794184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee779ba7-3d05-4973-a96b-5fd18206b1f7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:09.796597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:09.800196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:09.825495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee779ba7-3d05-4973-a96b-5fd18206b1f7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:09.826175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee779ba7-3d05-4973-a96b-5fd18206b1f7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:09.834295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee779ba7-3d05-4973-a96b-5fd18206b1f7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:09.843232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee779ba7-3d05-4973-a96b-5fd18206b1f7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:09.954312 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee779ba7-3d05-4973-a96b-5fd18206b1f7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.166450 Dec 18 21:03:09.956297 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2268/4539] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:09 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:03:09.967995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7a17db3-c59a-468a-b6c3-947afa6153b6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:09.970984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7a17db3-c59a-468a-b6c3-947afa6153b6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:09.999025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7a17db3-c59a-468a-b6c3-947afa6153b6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:09.999352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7a17db3-c59a-468a-b6c3-947afa6153b6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.000177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7a17db3-c59a-468a-b6c3-947afa6153b6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.000618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7a17db3-c59a-468a-b6c3-947afa6153b6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.081435 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7a17db3-c59a-468a-b6c3-947afa6153b6 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action" status: 200 len: 40794 microversion: 2.1 time: 0.117635 Dec 18 21:03:10.094498 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2269/4540] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:09 2021] POST /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694/action => generated 40794 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:03:10.293266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:10.303802 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8148f125-6375-4231-97ed-584de0054506 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1503 microversion: 2.1 time: 0.617223 Dec 18 21:03:10.307706 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2272/4541] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:09 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:10.328030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d040685-19d2-48c4-99c1-c1fc4e25009f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:10.328786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d040685-19d2-48c4-99c1-c1fc4e25009f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:10.362166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d040685-19d2-48c4-99c1-c1fc4e25009f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.366929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d040685-19d2-48c4-99c1-c1fc4e25009f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.369731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d040685-19d2-48c4-99c1-c1fc4e25009f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.371298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d040685-19d2-48c4-99c1-c1fc4e25009f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.562166 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d040685-19d2-48c4-99c1-c1fc4e25009f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.235622 Dec 18 21:03:10.566443 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2270/4542] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Dec 18 21:03:10 2021] DELETE /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce/os-server-password => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:03:10.579144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fe8ce15-a13c-428a-bada-19e90e2e37a5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:10.579644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fe8ce15-a13c-428a-bada-19e90e2e37a5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:10.591955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fe8ce15-a13c-428a-bada-19e90e2e37a5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.593446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fe8ce15-a13c-428a-bada-19e90e2e37a5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.596200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fe8ce15-a13c-428a-bada-19e90e2e37a5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.596832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fe8ce15-a13c-428a-bada-19e90e2e37a5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.656193 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fe8ce15-a13c-428a-bada-19e90e2e37a5 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.083288 Dec 18 21:03:10.658570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2273/4543] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:03:10 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce/os-server-password => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:03:10.670742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:10.671329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:10.684243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.684707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.685530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.685967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.764913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:03:10.870893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:10.871867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:10.888018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.889683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.891912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:10.893687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:10.957857 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae44e9a4-2e83-4189-97de-151fc838d926 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 204 len: 0 microversion: 2.1 time: 0.291534 Dec 18 21:03:10.964278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:03:10.978145 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2271/4544] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:03:10 2021] DELETE /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:03:10.987800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-edab3758-f6f9-43b7-a503-105d2a3d8466 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:10.989193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-edab3758-f6f9-43b7-a503-105d2a3d8466 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:11.001175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-edab3758-f6f9-43b7-a503-105d2a3d8466 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:11.001972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-edab3758-f6f9-43b7-a503-105d2a3d8466 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:11.003071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-edab3758-f6f9-43b7-a503-105d2a3d8466 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:11.003761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-edab3758-f6f9-43b7-a503-105d2a3d8466 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:11.075697 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-edab3758-f6f9-43b7-a503-105d2a3d8466 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.094617 Dec 18 21:03:11.077288 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2272/4545] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:10 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:11.087974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:11.090567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:11.121980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:11.122642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:11.124493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:11.125189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:11.142024 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b69506c2-6f82-4b09-90ce-95213642931e tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 204 len: 0 microversion: 2.1 time: 0.275997 Dec 18 21:03:11.143283 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2274/4546] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:03:10 2021] DELETE /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:03:11.155757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:11.156874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:11.168646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:11.169392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:11.170563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:11.173991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:11.763471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:11.775642 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f22260a8-e192-440a-9b5c-ff7c321470b1 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1509 microversion: 2.1 time: 0.696896 Dec 18 21:03:11.786536 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2273/4547] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:11 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1509 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:11.793082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20a5a7eb-7334-4a9d-8e62-5ebae1f7cabc tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f715c0dd4c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:11.840151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:11.845612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20a5a7eb-7334-4a9d-8e62-5ebae1f7cabc tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/69926e98-bbee-4546-8e54-ad520f803bb7" status: 200 len: 343 microversion: 2.1 time: 0.057584 Dec 18 21:03:11.846817 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2274/4548] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:03:11 2021] GET /compute/v2.1/os-volumes/69926e98-bbee-4546-8e54-ad520f803bb7 => generated 343 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:11.848768 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbd856f0-a810-43d9-b4be-e15556e52082 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1664 microversion: 2.1 time: 0.700912 Dec 18 21:03:11.849705 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2275/4549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:11 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1664 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:12.089330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dbc3db49-9d47-41da-8a8e-fe60353e81ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:12.092606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dbc3db49-9d47-41da-8a8e-fe60353e81ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:12.117315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbc3db49-9d47-41da-8a8e-fe60353e81ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:12.118091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbc3db49-9d47-41da-8a8e-fe60353e81ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:12.119134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbc3db49-9d47-41da-8a8e-fe60353e81ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:12.119759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbc3db49-9d47-41da-8a8e-fe60353e81ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:12.199049 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dbc3db49-9d47-41da-8a8e-fe60353e81ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.111670 Dec 18 21:03:12.200264 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2275/4550] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:12 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:12.793145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:12.793694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:12.800960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:12.801851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:12.802942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:12.803676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:12.873128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:12.874393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:12.890925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:12.891413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:12.892563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:12.893023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:13.206362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:13.215782 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9af7c7c0-8a9d-4191-8f17-bac280e9265f tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1509 microversion: 2.1 time: 0.426619 Dec 18 21:03:13.216684 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2276/4551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:12 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:13.229865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a834caa8-a4e1-49ce-91af-5caeb3474b41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:13.231469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a834caa8-a4e1-49ce-91af-5caeb3474b41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:13.238630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a834caa8-a4e1-49ce-91af-5caeb3474b41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:13.239097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a834caa8-a4e1-49ce-91af-5caeb3474b41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:13.239905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a834caa8-a4e1-49ce-91af-5caeb3474b41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:13.240350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a834caa8-a4e1-49ce-91af-5caeb3474b41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:13.300318 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a834caa8-a4e1-49ce-91af-5caeb3474b41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.081344 Dec 18 21:03:13.301684 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2277/4552] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:13 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:13.335476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:13.344304 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b0370b98-3b46-4975-b77d-f44ff8385da2 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1664 microversion: 2.1 time: 0.475576 Dec 18 21:03:13.345284 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2276/4553] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:12 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1664 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:13.353429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bbcd84b-5aad-458f-a0bc-17a7613c6310 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714ebaf160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:13.407953 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1bbcd84b-5aad-458f-a0bc-17a7613c6310 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8c64b82f-6510-48f7-af58-62a58468754b" status: 200 len: 342 microversion: 2.1 time: 0.061485 Dec 18 21:03:13.408614 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2278/4554] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:03:13 2021] GET /compute/v2.1/os-volumes/8c64b82f-6510-48f7-af58-62a58468754b => generated 342 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:13.420212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a5cbdc0-be6a-483b-a8ac-0dd76dba035e tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f715c44c0d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:13.511572 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a5cbdc0-be6a-483b-a8ac-0dd76dba035e tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1011 microversion: 2.1 time: 0.094780 Dec 18 21:03:13.512627 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2277/4555] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 21:03:13 2021] GET /compute/v2.1/os-volumes => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:13.527446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ee5a87f-d184-44b7-8999-9ad0033028f4 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714fb508b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:13.616581 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ee5a87f-d184-44b7-8999-9ad0033028f4 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 678 microversion: 2.1 time: 0.094468 Dec 18 21:03:13.624580 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2279/4556] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 21:03:13 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 678 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:13.630513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1594ae51-4081-477b-8c40-439d2e671a4f tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f71613098b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:13.728442 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1594ae51-4081-477b-8c40-439d2e671a4f tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1011 microversion: 2.1 time: 0.102949 Dec 18 21:03:13.729177 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2278/4557] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 21:03:13 2021] GET /compute/v2.1/os-volumes => generated 1011 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:03:13.741044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4199be2c-6b07-4d3b-9438-adda43abb333 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714f5f7c10>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:13.839299 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4199be2c-6b07-4d3b-9438-adda43abb333 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.102267 Dec 18 21:03:13.839881 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2280/4558] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Dec 18 21:03:13 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:13.851715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5bc054cb-a238-44e3-a249-e82f9891ad90 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714f6ff700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:14.018972 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5bc054cb-a238-44e3-a249-e82f9891ad90 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 678 microversion: 2.1 time: 0.170837 Dec 18 21:03:14.019844 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2281/4559] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 21:03:13 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:03:14.033290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49d837bf-3543-4091-a133-276385f46a34 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714fc89f70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:14.160194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49d837bf-3543-4091-a133-276385f46a34 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1011 microversion: 2.1 time: 0.130590 Dec 18 21:03:14.161110 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2282/4560] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 21:03:14 2021] GET /compute/v2.1/os-volumes/detail => generated 1011 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:14.173381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b120116c-8e6e-491c-8fde-911e0da70c97 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714f9bb940>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:14.174767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-67e04623-7ce3-42d9-9c70-2a8dd90ec9a3 req-d3643899-5647-4ee1-95a9-5b574bcad409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef67420-4d8c-4a20-8059-2fb29eb553ce", "name": "network-vif-deleted", "tag": "b37b2a49-b715-488f-b585-88dd2a37c534"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:14.176602 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:14.176602 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:03:14.190162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-67e04623-7ce3-42d9-9c70-2a8dd90ec9a3 req-d3643899-5647-4ee1-95a9-5b574bcad409 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.190648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-67e04623-7ce3-42d9-9c70-2a8dd90ec9a3 req-d3643899-5647-4ee1-95a9-5b574bcad409 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.206613 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-67e04623-7ce3-42d9-9c70-2a8dd90ec9a3 req-d3643899-5647-4ee1-95a9-5b574bcad409 service nova] Creating event network-vif-deleted:b37b2a49-b715-488f-b585-88dd2a37c534 for instance 3ef67420-4d8c-4a20-8059-2fb29eb553ce on nch2-master-1 Dec 18 21:03:14.213679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-67e04623-7ce3-42d9-9c70-2a8dd90ec9a3 req-d3643899-5647-4ee1-95a9-5b574bcad409 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399669 Dec 18 21:03:14.214918 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2279/4561] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:03:14.256066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:14.262116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:14.284595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.285054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.285910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.298172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.373233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.373712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.374665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lazy-loading 'fault' on Instance uuid 3ef67420-4d8c-4a20-8059-2fb29eb553ce {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:03:14.408371 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b120116c-8e6e-491c-8fde-911e0da70c97 tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.239465 Dec 18 21:03:14.409053 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2283/4562] 10.222.0.13 () {58 vars in 1187 bytes} [Sat Dec 18 21:03:14 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:14.414770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f7f3f15-ad6c-4f22-8dff-e46d8dd6bf50 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:14.416081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f7f3f15-ad6c-4f22-8dff-e46d8dd6bf50 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:14.454927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f7f3f15-ad6c-4f22-8dff-e46d8dd6bf50 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.456282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f7f3f15-ad6c-4f22-8dff-e46d8dd6bf50 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.458708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f7f3f15-ad6c-4f22-8dff-e46d8dd6bf50 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.462108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f7f3f15-ad6c-4f22-8dff-e46d8dd6bf50 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.540962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015cce270f514b67a30f46bf31195933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f161cef6f2864c7e8c2d183d1a22107e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:14.548986 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e998931a-ed1c-45a5-a01d-5b32f63a8ce4 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 200 len: 1305 microversion: 2.1 time: 0.313828 Dec 18 21:03:14.549573 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2280/4563] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:14 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 1305 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:14.559100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:14.560065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:14.568639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.569358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.570465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:14.571724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:14.576270 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f7f3f15-ad6c-4f22-8dff-e46d8dd6bf50 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.165730 Dec 18 21:03:14.577137 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2284/4564] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:14 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:14.586951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-734a4072-4640-4e2b-b0b9-9e75fbc1776a tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] Calling method '.version_select at 0x7f714f44cf70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:14.698745 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-734a4072-4640-4e2b-b0b9-9e75fbc1776a tempest-VolumesTestJSON-1445677590 tempest-VolumesTestJSON-1445677590-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1011 microversion: 2.1 time: 0.115610 Dec 18 21:03:14.699504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2285/4565] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 21:03:14 2021] GET /compute/v2.1/os-volumes/detail => generated 1011 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:14.755153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:14.769766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a2fecd7f-32ce-46fd-9a4a-9cef4810c6a4 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1597 microversion: 2.1 time: 0.215915 Dec 18 21:03:14.779005 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2281/4566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:14 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:15.577794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:15.584543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] [instance: 3ef67420-4d8c-4a20-8059-2fb29eb553ce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:15.588764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3cd4cd9a-2aa1-4dc8-9596-4efd706b71c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:15.590418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3cd4cd9a-2aa1-4dc8-9596-4efd706b71c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:15.596538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:15.599208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:15.602161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:15.603319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cd4cd9a-2aa1-4dc8-9596-4efd706b71c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:15.603627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:15.606943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cd4cd9a-2aa1-4dc8-9596-4efd706b71c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:15.608186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cd4cd9a-2aa1-4dc8-9596-4efd706b71c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:15.608840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cd4cd9a-2aa1-4dc8-9596-4efd706b71c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:15.657628 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] HTTP exception thrown: Instance 3ef67420-4d8c-4a20-8059-2fb29eb553ce could not be found. Dec 18 21:03:15.658595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] Returning 404 to user: Instance 3ef67420-4d8c-4a20-8059-2fb29eb553ce could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:03:15.660137 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38e1d97c-42ba-4d7d-adef-ef9dd3bd9297 tempest-ServerPasswordTestJSON-506501272 tempest-ServerPasswordTestJSON-506501272-project] 10.222.0.13 "GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce" status: 404 len: 111 microversion: 2.1 time: 0.096038 Dec 18 21:03:15.664955 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2286/4567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:15 2021] GET /compute/v2.1/servers/3ef67420-4d8c-4a20-8059-2fb29eb553ce => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:03:15.692140 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3cd4cd9a-2aa1-4dc8-9596-4efd706b71c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.106888 Dec 18 21:03:15.693604 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2282/4568] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:15 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:15.752182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-606547fa-3f62-462a-bb1b-1ac194e261bd req-23768a91-fd8a-41b8-9d8f-1e9ea4ed01c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b77426-cb1b-4748-b580-a4f86c940694", "name": "network-vif-deleted", "tag": "f65f78c9-150a-4ed2-95a6-dd167edea818"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:15.759653 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:15.759653 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:03:15.793050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:15.793763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:15.803705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-606547fa-3f62-462a-bb1b-1ac194e261bd req-23768a91-fd8a-41b8-9d8f-1e9ea4ed01c4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:15.803964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:15.804271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:15.805597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:15.806232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:15.810147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-606547fa-3f62-462a-bb1b-1ac194e261bd req-23768a91-fd8a-41b8-9d8f-1e9ea4ed01c4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:15.843621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-606547fa-3f62-462a-bb1b-1ac194e261bd req-23768a91-fd8a-41b8-9d8f-1e9ea4ed01c4 service nova] Creating event network-vif-deleted:f65f78c9-150a-4ed2-95a6-dd167edea818 for instance e7b77426-cb1b-4748-b580-a4f86c940694 on nch2-master-1 Dec 18 21:03:15.859173 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-606547fa-3f62-462a-bb1b-1ac194e261bd req-23768a91-fd8a-41b8-9d8f-1e9ea4ed01c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112544 Dec 18 21:03:15.877216 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2287/4569] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:15.904696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a062c1000f94164ac8da89a383c22e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12ada67cbd430bbf671d34c0cc74f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:15.915316 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-060303f8-17f5-46b4-9d29-a7f23ea7f787 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 200 len: 1310 microversion: 2.1 time: 0.131318 Dec 18 21:03:15.917232 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2283/4570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:15 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 1310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:03:16.707341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a65ca26e-4818-4fbc-96f0-35c4edcd4e03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:16.708550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a65ca26e-4818-4fbc-96f0-35c4edcd4e03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:16.729510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a65ca26e-4818-4fbc-96f0-35c4edcd4e03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:16.730212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a65ca26e-4818-4fbc-96f0-35c4edcd4e03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:16.732844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a65ca26e-4818-4fbc-96f0-35c4edcd4e03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:16.734080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a65ca26e-4818-4fbc-96f0-35c4edcd4e03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:16.876072 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a65ca26e-4818-4fbc-96f0-35c4edcd4e03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.172904 Dec 18 21:03:16.884597 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2288/4571] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:16 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:16.934303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:16.937191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] [instance: e7b77426-cb1b-4748-b580-a4f86c940694] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:16.954871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:16.955519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:16.956671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:16.957193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:16.990861 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] HTTP exception thrown: Instance e7b77426-cb1b-4748-b580-a4f86c940694 could not be found. Dec 18 21:03:16.991697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Returning 404 to user: Instance e7b77426-cb1b-4748-b580-a4f86c940694 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:03:16.993337 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3571967e-db08-4f06-9164-741cd2786884 tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694" status: 404 len: 111 microversion: 2.1 time: 0.063956 Dec 18 21:03:16.994707 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2284/4572] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:16 2021] GET /compute/v2.1/servers/e7b77426-cb1b-4748-b580-a4f86c940694 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:03:17.012394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c942eb2a-4756-4ecf-9329-f5489209799a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] Calling method '.version_select at 0x7f714f7cc700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:17.050756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c942eb2a-4756-4ecf-9329-f5489209799a tempest-ServersTestFqdnHostnames-2002426305 tempest-ServersTestFqdnHostnames-2002426305-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845202643" status: 202 len: 0 microversion: 2.1 time: 0.051053 Dec 18 21:03:17.051757 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2289/4573] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 21:03:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845202643 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:17.892353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b50e0b30-e615-4885-afb4-369cc066d34e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:17.893598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b50e0b30-e615-4885-afb4-369cc066d34e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:17.908356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50e0b30-e615-4885-afb4-369cc066d34e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:17.909151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50e0b30-e615-4885-afb4-369cc066d34e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:17.910155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50e0b30-e615-4885-afb4-369cc066d34e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:17.912179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50e0b30-e615-4885-afb4-369cc066d34e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:17.997629 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b50e0b30-e615-4885-afb4-369cc066d34e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.107496 Dec 18 21:03:17.999066 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2285/4574] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:17 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:19.009827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-79d5d1ac-b7ec-4f96-8844-a8ee0ff790b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:19.011776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-79d5d1ac-b7ec-4f96-8844-a8ee0ff790b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:19.022066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79d5d1ac-b7ec-4f96-8844-a8ee0ff790b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:19.024389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79d5d1ac-b7ec-4f96-8844-a8ee0ff790b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:19.026738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79d5d1ac-b7ec-4f96-8844-a8ee0ff790b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:19.028365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79d5d1ac-b7ec-4f96-8844-a8ee0ff790b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:19.116879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-79d5d1ac-b7ec-4f96-8844-a8ee0ff790b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.111528 Dec 18 21:03:19.118101 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2290/4575] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:19 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:20.131200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1be27f44-1960-447d-98a7-c41bc99ec0da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:20.134445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1be27f44-1960-447d-98a7-c41bc99ec0da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:20.154296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1be27f44-1960-447d-98a7-c41bc99ec0da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:20.156844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1be27f44-1960-447d-98a7-c41bc99ec0da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:20.162916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1be27f44-1960-447d-98a7-c41bc99ec0da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:20.169157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1be27f44-1960-447d-98a7-c41bc99ec0da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:20.268109 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1be27f44-1960-447d-98a7-c41bc99ec0da tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.142270 Dec 18 21:03:20.279044 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2286/4576] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:20 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:21.292801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a648fe86-33aa-4916-9d29-2e5bd440d471 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:21.293743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a648fe86-33aa-4916-9d29-2e5bd440d471 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:21.307811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a648fe86-33aa-4916-9d29-2e5bd440d471 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:21.308268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a648fe86-33aa-4916-9d29-2e5bd440d471 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:21.311240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a648fe86-33aa-4916-9d29-2e5bd440d471 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:21.313857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a648fe86-33aa-4916-9d29-2e5bd440d471 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:21.405051 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a648fe86-33aa-4916-9d29-2e5bd440d471 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.116885 Dec 18 21:03:21.406827 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2291/4577] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:21 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:22.427099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aa0d3ac2-8938-41c8-a19c-eda42d0fef85 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:22.428848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa0d3ac2-8938-41c8-a19c-eda42d0fef85 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:22.474216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa0d3ac2-8938-41c8-a19c-eda42d0fef85 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:22.474802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa0d3ac2-8938-41c8-a19c-eda42d0fef85 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:22.475644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa0d3ac2-8938-41c8-a19c-eda42d0fef85 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:22.479521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa0d3ac2-8938-41c8-a19c-eda42d0fef85 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:22.567555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aa0d3ac2-8938-41c8-a19c-eda42d0fef85 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.147971 Dec 18 21:03:22.580714 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2287/4578] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:22 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:23.588878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d56dc316-2678-4afe-a507-d89ccf4828dc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:23.590006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d56dc316-2678-4afe-a507-d89ccf4828dc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:23.606014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d56dc316-2678-4afe-a507-d89ccf4828dc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:23.608805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d56dc316-2678-4afe-a507-d89ccf4828dc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:23.611783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d56dc316-2678-4afe-a507-d89ccf4828dc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:23.612468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d56dc316-2678-4afe-a507-d89ccf4828dc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:23.704980 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d56dc316-2678-4afe-a507-d89ccf4828dc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.120517 Dec 18 21:03:23.706175 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2292/4579] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:23 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:24.720985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81ba3856-c286-4707-9068-ac3aa1767068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:24.722023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81ba3856-c286-4707-9068-ac3aa1767068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:24.735934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ba3856-c286-4707-9068-ac3aa1767068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:24.737599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ba3856-c286-4707-9068-ac3aa1767068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:24.738504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ba3856-c286-4707-9068-ac3aa1767068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:24.740132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81ba3856-c286-4707-9068-ac3aa1767068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:24.818728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81ba3856-c286-4707-9068-ac3aa1767068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.103893 Dec 18 21:03:24.823942 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2288/4580] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:24 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:25.832933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec09ccee-79d7-49bb-a39c-e052c7d5a218 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:25.834747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec09ccee-79d7-49bb-a39c-e052c7d5a218 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:25.857138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec09ccee-79d7-49bb-a39c-e052c7d5a218 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:25.857997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec09ccee-79d7-49bb-a39c-e052c7d5a218 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:25.859108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec09ccee-79d7-49bb-a39c-e052c7d5a218 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:25.859783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec09ccee-79d7-49bb-a39c-e052c7d5a218 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:25.956910 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec09ccee-79d7-49bb-a39c-e052c7d5a218 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.128636 Dec 18 21:03:25.958062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2293/4581] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:25 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:26.969752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd42623f-f654-4c94-923a-eafd77dc8c04 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:26.970798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd42623f-f654-4c94-923a-eafd77dc8c04 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:26.988037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd42623f-f654-4c94-923a-eafd77dc8c04 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:26.988494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd42623f-f654-4c94-923a-eafd77dc8c04 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:26.989314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd42623f-f654-4c94-923a-eafd77dc8c04 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:26.989759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd42623f-f654-4c94-923a-eafd77dc8c04 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:27.069717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd42623f-f654-4c94-923a-eafd77dc8c04 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.103810 Dec 18 21:03:27.074012 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2289/4582] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:26 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:28.085342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-445a490b-5a9f-4e05-9014-03efe312a549 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:28.085342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-445a490b-5a9f-4e05-9014-03efe312a549 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:28.107633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-445a490b-5a9f-4e05-9014-03efe312a549 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:28.108092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-445a490b-5a9f-4e05-9014-03efe312a549 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:28.109115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-445a490b-5a9f-4e05-9014-03efe312a549 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:28.109568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-445a490b-5a9f-4e05-9014-03efe312a549 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:28.183897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-445a490b-5a9f-4e05-9014-03efe312a549 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.105646 Dec 18 21:03:28.188206 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2294/4583] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:28 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:29.203124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4778efa3-e1c6-4b5a-af8e-17ef0f01f9a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:29.205062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4778efa3-e1c6-4b5a-af8e-17ef0f01f9a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:29.228112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4778efa3-e1c6-4b5a-af8e-17ef0f01f9a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:29.231300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4778efa3-e1c6-4b5a-af8e-17ef0f01f9a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:29.232331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4778efa3-e1c6-4b5a-af8e-17ef0f01f9a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:29.240148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4778efa3-e1c6-4b5a-af8e-17ef0f01f9a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:29.335417 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4778efa3-e1c6-4b5a-af8e-17ef0f01f9a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.141734 Dec 18 21:03:29.337548 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2290/4584] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:29 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:30.350667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2e33604-21da-45c6-9ad2-d768e95baf67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:30.352882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2e33604-21da-45c6-9ad2-d768e95baf67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:30.361002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2e33604-21da-45c6-9ad2-d768e95baf67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:30.362083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2e33604-21da-45c6-9ad2-d768e95baf67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:30.363077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2e33604-21da-45c6-9ad2-d768e95baf67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:30.363877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2e33604-21da-45c6-9ad2-d768e95baf67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:30.452165 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2e33604-21da-45c6-9ad2-d768e95baf67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.103898 Dec 18 21:03:30.453896 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2295/4585] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:30 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:31.468351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaa85c55-bc94-4faf-a713-b7514968248e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:31.469443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaa85c55-bc94-4faf-a713-b7514968248e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:31.490488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa85c55-bc94-4faf-a713-b7514968248e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:31.490959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa85c55-bc94-4faf-a713-b7514968248e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:31.491789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa85c55-bc94-4faf-a713-b7514968248e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:31.502962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa85c55-bc94-4faf-a713-b7514968248e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:31.646355 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaa85c55-bc94-4faf-a713-b7514968248e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.185253 Dec 18 21:03:31.647377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2291/4586] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:31 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:32.660091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b8bdd416-ba11-481e-8f4c-cce9483e6082 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:32.661245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b8bdd416-ba11-481e-8f4c-cce9483e6082 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:32.672649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8bdd416-ba11-481e-8f4c-cce9483e6082 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:32.673297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8bdd416-ba11-481e-8f4c-cce9483e6082 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:32.674194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8bdd416-ba11-481e-8f4c-cce9483e6082 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:32.674562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8bdd416-ba11-481e-8f4c-cce9483e6082 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:32.758121 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b8bdd416-ba11-481e-8f4c-cce9483e6082 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.102228 Dec 18 21:03:32.759596 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2296/4587] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:32 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:33.776410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6dc10fc-b151-47c3-92dd-9b598c3ffd5a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:33.778128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6dc10fc-b151-47c3-92dd-9b598c3ffd5a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:33.795438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6dc10fc-b151-47c3-92dd-9b598c3ffd5a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:33.795888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6dc10fc-b151-47c3-92dd-9b598c3ffd5a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:33.797253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6dc10fc-b151-47c3-92dd-9b598c3ffd5a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:33.797863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6dc10fc-b151-47c3-92dd-9b598c3ffd5a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:33.893787 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6dc10fc-b151-47c3-92dd-9b598c3ffd5a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.126252 Dec 18 21:03:33.899802 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2292/4588] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:33 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:34.141198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-857168464", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "02107735-1e4a-434f-a377-a881410f569a"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:34.259482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] validate_networks() for [('02107735-1e4a-434f-a377-a881410f569a', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:03:35.085367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1607639631", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb97ef06-3d0b-442a-856c-1db8f276297a"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:35.173405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] validate_networks() for [('cb97ef06-3d0b-442a-856c-1db8f276297a', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:03:35.203571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:03:35.204115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:03:35.204484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:03:35.205115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:03:35.205714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:03:35.225071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:35.225794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:35.226884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:35.227519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:35.265429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:03:35.282199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for user 0a98795bdb7447c5b2a4930173b3c56d and project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:03:35.307806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:03:35.310330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:03:35.425742 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-146a92d2-74a0-4342-ac1b-b6390cbe1309 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510772 Dec 18 21:03:35.431835 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2297/4589] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:03:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:03:35.459910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc482f06-336a-48a6-afaf-675a43accd2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:35.465557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc482f06-336a-48a6-afaf-675a43accd2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:35.480621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc482f06-336a-48a6-afaf-675a43accd2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:35.481106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc482f06-336a-48a6-afaf-675a43accd2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:35.481924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc482f06-336a-48a6-afaf-675a43accd2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:35.482405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc482f06-336a-48a6-afaf-675a43accd2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:35.564197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc482f06-336a-48a6-afaf-675a43accd2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.120719 Dec 18 21:03:35.576021 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2298/4590] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:35 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:35.593538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1dc39e5b-ac95-4a8a-8427-dbfa66331d77 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:35.594476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1dc39e5b-ac95-4a8a-8427-dbfa66331d77 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:35.761505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1dc39e5b-ac95-4a8a-8427-dbfa66331d77 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:35.772290 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1dc39e5b-ac95-4a8a-8427-dbfa66331d77 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1214 microversion: 2.1 time: 0.193383 Dec 18 21:03:35.775519 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2299/4591] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:35 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:36.589095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3cfa3e3-d580-4f23-8f4d-ecd9b0243761 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:36.590220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3cfa3e3-d580-4f23-8f4d-ecd9b0243761 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:36.609377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3cfa3e3-d580-4f23-8f4d-ecd9b0243761 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:36.615793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3cfa3e3-d580-4f23-8f4d-ecd9b0243761 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:36.617072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3cfa3e3-d580-4f23-8f4d-ecd9b0243761 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:36.617740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3cfa3e3-d580-4f23-8f4d-ecd9b0243761 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:36.751767 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3cfa3e3-d580-4f23-8f4d-ecd9b0243761 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.167891 Dec 18 21:03:36.760863 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2300/4592] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:36 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:36.793403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:36.794500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:36.810435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:36.812103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:36.814706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:36.815646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:36.993245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:37.001762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ad097b4-2a0d-4b6c-b391-3a28e93d551e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1266 microversion: 2.1 time: 0.213869 Dec 18 21:03:37.014629 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2301/4593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:36 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:37.643882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:03:37.644383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:03:37.645180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:03:37.645541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:03:37.646049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:03:37.664581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:37.665447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:37.669067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:37.670068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:37.755455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Getting quotas for project 4b037c54b761428db4df46b975b70574. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:03:37.767865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-42c1d677-d0b5-4a6d-b612-be4e42f4f3fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:37.768857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-42c1d677-d0b5-4a6d-b612-be4e42f4f3fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:37.769719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Getting quotas for user 0012ccb14865485192056087c9926493 and project 4b037c54b761428db4df46b975b70574. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:03:37.785020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42c1d677-d0b5-4a6d-b612-be4e42f4f3fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:37.785857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42c1d677-d0b5-4a6d-b612-be4e42f4f3fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:37.789102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42c1d677-d0b5-4a6d-b612-be4e42f4f3fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:37.790227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42c1d677-d0b5-4a6d-b612-be4e42f4f3fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:37.804310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:03:37.810722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:03:37.886442 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-42c1d677-d0b5-4a6d-b612-be4e42f4f3fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.122071 Dec 18 21:03:37.888039 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2302/4594] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:37 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:37.920727 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-29ef60c6-696f-47e6-9cf8-80da1ddf4275 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.243696 Dec 18 21:03:37.923943 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2293/4595] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:03:34 2021] POST /compute/v2.1/servers => generated 383 bytes in 3248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:03:37.949019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5e10a70-d60c-4a04-8332-fd3c597e51c7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:37.951445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5e10a70-d60c-4a04-8332-fd3c597e51c7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:38.019106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:38.020172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:38.038326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:38.038897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:38.042183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:38.042800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:38.249114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c5e10a70-d60c-4a04-8332-fd3c597e51c7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:38.257130 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5e10a70-d60c-4a04-8332-fd3c597e51c7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1223 microversion: 2.1 time: 0.320638 Dec 18 21:03:38.260607 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2303/4596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:37 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1223 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:38.295924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:38.315225 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e1280585-d663-4059-8e9c-0bbf0d950973 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1272 microversion: 2.1 time: 0.292059 Dec 18 21:03:38.316943 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2294/4597] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:38 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:03:38.906184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-353ffa12-fd31-42cb-b694-74911465d738 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:38.909444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-353ffa12-fd31-42cb-b694-74911465d738 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:38.933841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353ffa12-fd31-42cb-b694-74911465d738 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:38.934748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353ffa12-fd31-42cb-b694-74911465d738 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:38.938566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353ffa12-fd31-42cb-b694-74911465d738 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:38.939405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-353ffa12-fd31-42cb-b694-74911465d738 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:39.018791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-353ffa12-fd31-42cb-b694-74911465d738 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.123386 Dec 18 21:03:39.026199 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2304/4598] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:38 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:39.284694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:39.287511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:39.312523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:39.313403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:39.315345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:39.318613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:39.338029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:39.338902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:39.364564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:39.365114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:39.365840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:39.368019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:39.615410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:39.633235 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-20c68b53-a777-4f23-94ab-96b8aaa44b8c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1275 microversion: 2.1 time: 0.352314 Dec 18 21:03:39.648184 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2295/4599] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:39 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1275 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:40.033654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aefb0e24-dd29-47bb-881c-d3a4dd8f198c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:40.034826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aefb0e24-dd29-47bb-881c-d3a4dd8f198c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:40.047912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aefb0e24-dd29-47bb-881c-d3a4dd8f198c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:40.048407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aefb0e24-dd29-47bb-881c-d3a4dd8f198c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:40.051321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aefb0e24-dd29-47bb-881c-d3a4dd8f198c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:40.051794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aefb0e24-dd29-47bb-881c-d3a4dd8f198c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:40.128071 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aefb0e24-dd29-47bb-881c-d3a4dd8f198c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.098578 Dec 18 21:03:40.130025 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2296/4600] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:40 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:03:40.580496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:40.593350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e8e5780-19c2-4af1-81c7-7ed681fab014 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 1.261394 Dec 18 21:03:40.603532 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2305/4601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:39 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:40.654836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:40.656495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:40.668062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:40.668452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:40.669266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:40.669713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:40.897658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:40.911929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-be23390a-9777-4160-b4a8-1b2aa6331d21 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1281 microversion: 2.1 time: 0.262688 Dec 18 21:03:40.922064 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2297/4602] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:40 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:41.148916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-55c18285-8758-43e5-bcd7-662f6329f15a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:41.151290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-55c18285-8758-43e5-bcd7-662f6329f15a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:41.169894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55c18285-8758-43e5-bcd7-662f6329f15a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:41.170744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55c18285-8758-43e5-bcd7-662f6329f15a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:41.171914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55c18285-8758-43e5-bcd7-662f6329f15a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:41.173012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-55c18285-8758-43e5-bcd7-662f6329f15a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:41.254679 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-55c18285-8758-43e5-bcd7-662f6329f15a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.116810 Dec 18 21:03:41.255391 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2306/4603] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:41 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:41.616247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:41.617155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:41.629819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:41.630655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:41.631537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:41.631992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:41.929830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:41.930581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:41.945461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:41.945917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:41.946761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:41.947208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:42.151742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:42.160039 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81b9d4b3-336b-4a92-bc0e-191314e12b9c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1281 microversion: 2.1 time: 0.234749 Dec 18 21:03:42.170339 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2307/4604] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:41 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1281 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:03:42.268524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3575eabd-1241-4b8b-8e7a-12dd09db29e9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:42.269654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3575eabd-1241-4b8b-8e7a-12dd09db29e9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:42.288287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3575eabd-1241-4b8b-8e7a-12dd09db29e9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:42.289303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3575eabd-1241-4b8b-8e7a-12dd09db29e9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:42.290121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3575eabd-1241-4b8b-8e7a-12dd09db29e9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:42.290600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3575eabd-1241-4b8b-8e7a-12dd09db29e9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:42.358363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3575eabd-1241-4b8b-8e7a-12dd09db29e9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.093848 Dec 18 21:03:42.362400 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2308/4605] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:42 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:42.424131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:42.435430 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a65ea35e-ba16-4abb-90b6-ca730cefc392 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.827280 Dec 18 21:03:42.435967 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2298/4606] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:41 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:43.033333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-bed1fe48-da30-4926-a4cb-f4da386d7ae0 req-616acc83-6588-44a0-a30b-a3304413586d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1fea17-a56f-4df5-b5a7-0a1243877fbf", "tag": "b126fb76-0c7b-45e0-b71c-c5080f666418"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:43.035820 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:43.035820 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:03:43.057388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-bed1fe48-da30-4926-a4cb-f4da386d7ae0 req-616acc83-6588-44a0-a30b-a3304413586d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:43.057874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-bed1fe48-da30-4926-a4cb-f4da386d7ae0 req-616acc83-6588-44a0-a30b-a3304413586d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:43.083087 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-bed1fe48-da30-4926-a4cb-f4da386d7ae0 req-616acc83-6588-44a0-a30b-a3304413586d service nova] Creating event network-changed:b126fb76-0c7b-45e0-b71c-c5080f666418 for instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf on nch1-master-1 Dec 18 21:03:43.091749 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-bed1fe48-da30-4926-a4cb-f4da386d7ae0 req-616acc83-6588-44a0-a30b-a3304413586d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060844 Dec 18 21:03:43.095771 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2309/4607] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:43.177488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:43.178376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:43.197941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:43.199506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:43.203753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:43.204644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:43.379115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e9fcfaa-b5ad-4b5a-9662-8f22e80eb317 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:43.381251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e9fcfaa-b5ad-4b5a-9662-8f22e80eb317 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:43.413050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9fcfaa-b5ad-4b5a-9662-8f22e80eb317 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:43.416433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9fcfaa-b5ad-4b5a-9662-8f22e80eb317 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:43.419103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9fcfaa-b5ad-4b5a-9662-8f22e80eb317 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:43.420737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e9fcfaa-b5ad-4b5a-9662-8f22e80eb317 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:43.523454 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e9fcfaa-b5ad-4b5a-9662-8f22e80eb317 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.156953 Dec 18 21:03:43.524794 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2310/4608] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:43 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:43.533416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:43.534134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:43.551752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:43.552229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:43.553050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:43.553501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:43.794506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:43.805958 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3def4da0-8b91-4937-ae21-523ec5c1096b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.631377 Dec 18 21:03:43.821863 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2299/4609] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:43 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:44.117849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:44.129253 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ef86945-dce0-4f52-84cf-060f10e6a58e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.602499 Dec 18 21:03:44.130908 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2311/4610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:43 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:44.550963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-502c9a49-437c-4c10-8d03-9ce0b13620fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:44.558055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-502c9a49-437c-4c10-8d03-9ce0b13620fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:44.586439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502c9a49-437c-4c10-8d03-9ce0b13620fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:44.593503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502c9a49-437c-4c10-8d03-9ce0b13620fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:44.597597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502c9a49-437c-4c10-8d03-9ce0b13620fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:44.602509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502c9a49-437c-4c10-8d03-9ce0b13620fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:44.684954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-502c9a49-437c-4c10-8d03-9ce0b13620fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.153153 Dec 18 21:03:44.685868 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2300/4611] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:44 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:44.823874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:44.824563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:44.837384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:44.837748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:44.858709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:44.859388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:45.148309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:45.149141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:45.156251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:45.156718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:45.157531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:45.157968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:45.293309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:45.303141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd28b960-bf95-4d85-827f-c0fa91d055a3 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.483432 Dec 18 21:03:45.306330 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2312/4612] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:44 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:45.687206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:45.698912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e0cd078-ff42-48da-b769-835d429b8405 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:45.700937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e0cd078-ff42-48da-b769-835d429b8405 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:45.712691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e0cd078-ff42-48da-b769-835d429b8405 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:45.713685 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da6bdadc-d359-432f-850a-2ca37d0ff580 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.570174 Dec 18 21:03:45.738628 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2301/4613] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:45 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:45.739429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e0cd078-ff42-48da-b769-835d429b8405 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:45.741880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e0cd078-ff42-48da-b769-835d429b8405 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:45.742787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e0cd078-ff42-48da-b769-835d429b8405 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:45.793703 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e0cd078-ff42-48da-b769-835d429b8405 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.099756 Dec 18 21:03:45.802437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2313/4614] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:45 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:46.323114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:46.324380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:46.335522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:46.336205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:46.337206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:46.337976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:46.658244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:46.671608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92defd9a-0b0c-4066-8c70-ef9e45e79605 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.352362 Dec 18 21:03:46.672788 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2302/4615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:46 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:46.734929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:46.736301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:46.752748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:46.754698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:46.760393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:46.761117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:46.809501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c34b27b-0b7f-48a0-95e1-aebdfd7df357 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:46.810647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c34b27b-0b7f-48a0-95e1-aebdfd7df357 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:46.822151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c34b27b-0b7f-48a0-95e1-aebdfd7df357 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:46.822652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c34b27b-0b7f-48a0-95e1-aebdfd7df357 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:46.823478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c34b27b-0b7f-48a0-95e1-aebdfd7df357 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:46.823928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c34b27b-0b7f-48a0-95e1-aebdfd7df357 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:46.894047 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c34b27b-0b7f-48a0-95e1-aebdfd7df357 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.088600 Dec 18 21:03:46.894792 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2303/4616] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:46 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:03:47.096291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ca00da4c-218e-401b-b858-41c20938dc6c req-c9afd1a4-d064-4c35-a177-b67daa7b61da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66babd8d-06b0-4cb2-8e2e-d37c5e1aae25", "tag": "0cf1d658-7c84-403d-9a60-9404b627e728"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:47.098186 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:47.098186 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:03:47.107244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:47.113905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ca00da4c-218e-401b-b858-41c20938dc6c req-c9afd1a4-d064-4c35-a177-b67daa7b61da service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:47.116154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ca00da4c-218e-401b-b858-41c20938dc6c req-c9afd1a4-d064-4c35-a177-b67daa7b61da service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:47.119808 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5cc9760-4477-451c-bba0-fa4e37c34d83 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.387473 Dec 18 21:03:47.121256 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2314/4617] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:46 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:47.155866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ca00da4c-218e-401b-b858-41c20938dc6c req-c9afd1a4-d064-4c35-a177-b67daa7b61da service nova] Creating event network-changed:0cf1d658-7c84-403d-9a60-9404b627e728 for instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 on nch2-master-1 Dec 18 21:03:47.168077 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ca00da4c-218e-401b-b858-41c20938dc6c req-c9afd1a4-d064-4c35-a177-b67daa7b61da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076150 Dec 18 21:03:47.172044 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2304/4618] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:47.691410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:47.693018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:47.709413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:47.711780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:47.717252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:47.723453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:47.909633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf687424-48b8-4dba-98a0-c9ec06e1d275 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:47.910867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf687424-48b8-4dba-98a0-c9ec06e1d275 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:47.924982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf687424-48b8-4dba-98a0-c9ec06e1d275 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:47.930201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf687424-48b8-4dba-98a0-c9ec06e1d275 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:47.931844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf687424-48b8-4dba-98a0-c9ec06e1d275 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:47.935337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf687424-48b8-4dba-98a0-c9ec06e1d275 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:48.035245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:48.052621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3216aed-7348-457f-a118-786631e6df1b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.366026 Dec 18 21:03:48.055259 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2315/4619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:47 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:48.061288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf687424-48b8-4dba-98a0-c9ec06e1d275 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.157428 Dec 18 21:03:48.062233 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2305/4620] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:47 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:03:48.145141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:48.148303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:48.164587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:48.165870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:48.167379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:48.168692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:48.436671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:48.450536 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fa12701-d8df-41d9-b027-ab0cfbd6ec27 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.316971 Dec 18 21:03:48.451802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2316/4621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:48 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:49.074723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e881d07e-2e59-44bd-9847-c9206b56ea7a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:49.075416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:49.075807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:49.075916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e881d07e-2e59-44bd-9847-c9206b56ea7a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:49.083616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e881d07e-2e59-44bd-9847-c9206b56ea7a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:49.084313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e881d07e-2e59-44bd-9847-c9206b56ea7a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:49.086663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e881d07e-2e59-44bd-9847-c9206b56ea7a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:49.087320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e881d07e-2e59-44bd-9847-c9206b56ea7a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:49.093139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:49.093767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:49.095263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:49.097100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:49.164529 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e881d07e-2e59-44bd-9847-c9206b56ea7a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.092571 Dec 18 21:03:49.166963 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2317/4622] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:49 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:49.460504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:49.470501 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-406d7873-0564-4976-8030-8f18e5414caf tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.400982 Dec 18 21:03:49.471847 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2306/4623] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:49 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:49.482621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:49.484996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:49.499177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:49.500617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:49.501755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:49.502641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:49.775462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:49.802634 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75cc3366-5b46-4d96-9c57-3a859ff93448 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.334765 Dec 18 21:03:49.804564 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2318/4624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:49 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:50.177911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-960087ae-e13a-4d6e-94d8-0bbd41e551ec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:50.179804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-960087ae-e13a-4d6e-94d8-0bbd41e551ec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:50.192998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960087ae-e13a-4d6e-94d8-0bbd41e551ec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:50.199970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960087ae-e13a-4d6e-94d8-0bbd41e551ec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:50.201437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960087ae-e13a-4d6e-94d8-0bbd41e551ec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:50.202067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960087ae-e13a-4d6e-94d8-0bbd41e551ec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:50.262647 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-960087ae-e13a-4d6e-94d8-0bbd41e551ec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.088504 Dec 18 21:03:50.267394 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2307/4625] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:50 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:50.488246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:50.489471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:50.505948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:50.506813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:50.508874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:50.511366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:50.837634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:50.841028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:50.847372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:50.866103 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39a74f09-a356-4d73-9d8d-73aa80c14aa0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.381984 Dec 18 21:03:50.876258 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2319/4626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:50 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:50.878803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:50.881458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:50.884921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:50.887350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:51.231376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:51.245681 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c95f6cc1-1f28-45d5-9d59-9f63e31a7bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.426420 Dec 18 21:03:51.250787 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2308/4627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:50 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:51.279736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1fefac0b-c90f-4790-a620-3ef6dda15617 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:51.280674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1fefac0b-c90f-4790-a620-3ef6dda15617 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:51.292591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fefac0b-c90f-4790-a620-3ef6dda15617 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:51.293053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fefac0b-c90f-4790-a620-3ef6dda15617 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:51.301285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-bbb62021-43bd-4c30-96a2-dd7a01a387d5 req-19e6211a-72b9-45b7-a149-be7aa45b7215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1fea17-a56f-4df5-b5a7-0a1243877fbf", "name": "network-vif-plugged", "status": "completed", "tag": "b126fb76-0c7b-45e0-b71c-c5080f666418"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:51.305003 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:51.305003 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:03:51.318395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fefac0b-c90f-4790-a620-3ef6dda15617 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:51.320977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fefac0b-c90f-4790-a620-3ef6dda15617 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:51.326154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bbb62021-43bd-4c30-96a2-dd7a01a387d5 req-19e6211a-72b9-45b7-a149-be7aa45b7215 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:51.326644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bbb62021-43bd-4c30-96a2-dd7a01a387d5 req-19e6211a-72b9-45b7-a149-be7aa45b7215 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:51.373636 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-bbb62021-43bd-4c30-96a2-dd7a01a387d5 req-19e6211a-72b9-45b7-a149-be7aa45b7215 service nova] Creating event network-vif-plugged:b126fb76-0c7b-45e0-b71c-c5080f666418 for instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf on nch1-master-1 Dec 18 21:03:51.399366 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-bbb62021-43bd-4c30-96a2-dd7a01a387d5 req-19e6211a-72b9-45b7-a149-be7aa45b7215 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102340 Dec 18 21:03:51.401928 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2309/4628] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:51.425092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1fefac0b-c90f-4790-a620-3ef6dda15617 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.148497 Dec 18 21:03:51.427950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2320/4629] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:51 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:51.890683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:51.891386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:51.909868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:51.910393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:51.911222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:51.911669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:52.268389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:52.269953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:52.276171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:52.284077 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-129fc6fe-7d18-4769-9642-0f57037a808c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.397494 Dec 18 21:03:52.287820 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2310/4630] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:51 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:52.290188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:52.293218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:52.295582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:52.296637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:52.437378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-244da12c-bf77-4865-8171-a4fe8aaef9e8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:52.438335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-244da12c-bf77-4865-8171-a4fe8aaef9e8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:52.467478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-244da12c-bf77-4865-8171-a4fe8aaef9e8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:52.468618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-244da12c-bf77-4865-8171-a4fe8aaef9e8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:52.469667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-244da12c-bf77-4865-8171-a4fe8aaef9e8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:52.470865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-244da12c-bf77-4865-8171-a4fe8aaef9e8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:52.540615 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-244da12c-bf77-4865-8171-a4fe8aaef9e8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.106763 Dec 18 21:03:52.549209 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2311/4631] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:52 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:03:52.714219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:52.732809 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8db8be53-61eb-459e-9af8-c26e2b92f7dd tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1314 microversion: 2.1 time: 0.471696 Dec 18 21:03:52.745249 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2321/4632] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:52 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:03:53.307373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:53.309487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:53.321115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:53.322429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:53.323578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:53.324428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:53.521583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:53.534771 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03faf539-eaa0-400f-95d6-f51c9e25a4ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.232726 Dec 18 21:03:53.535388 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2312/4633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:53 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:53.558812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97ac00d4-e412-4e16-8487-5ed5d4e9222a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:53.560510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97ac00d4-e412-4e16-8487-5ed5d4e9222a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:53.574460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97ac00d4-e412-4e16-8487-5ed5d4e9222a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:53.575651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97ac00d4-e412-4e16-8487-5ed5d4e9222a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:53.576818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97ac00d4-e412-4e16-8487-5ed5d4e9222a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:53.577432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97ac00d4-e412-4e16-8487-5ed5d4e9222a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:53.639813 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97ac00d4-e412-4e16-8487-5ed5d4e9222a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.085186 Dec 18 21:03:53.641946 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2322/4634] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:53 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:53.753434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:53.755173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:53.763958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:53.764923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:53.766177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:53.766813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:54.104920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:54.112984 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e47e182-861f-4490-8a37-073b2db0bdd1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1500 microversion: 2.1 time: 0.366071 Dec 18 21:03:54.113587 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2313/4635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:53 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1500 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:54.131533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:54.132188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:54.139431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:54.140405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:54.141405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:54.142021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:54.179631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:03:54.362812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d14ad9d-b418-4dbf-ab02-e2c00f41becf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 204 len: 0 microversion: 2.1 time: 0.234870 Dec 18 21:03:54.365178 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2323/4636] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:03:54 2021] DELETE /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:03:54.374013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:54.374999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:54.386179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:54.386951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:54.388097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:54.388787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:54.513983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-833dfe59-1dd1-4965-9a3c-16af58147aef req-0236f970-400e-4316-a028-2124e094c92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66babd8d-06b0-4cb2-8e2e-d37c5e1aae25", "name": "network-vif-plugged", "status": "completed", "tag": "0cf1d658-7c84-403d-9a60-9404b627e728"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:54.515890 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:54.515890 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:03:54.533789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-833dfe59-1dd1-4965-9a3c-16af58147aef req-0236f970-400e-4316-a028-2124e094c92d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:54.541749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-833dfe59-1dd1-4965-9a3c-16af58147aef req-0236f970-400e-4316-a028-2124e094c92d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:54.579864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-833dfe59-1dd1-4965-9a3c-16af58147aef req-0236f970-400e-4316-a028-2124e094c92d service nova] Creating event network-vif-plugged:0cf1d658-7c84-403d-9a60-9404b627e728 for instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 on nch2-master-1 Dec 18 21:03:54.602363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-833dfe59-1dd1-4965-9a3c-16af58147aef req-0236f970-400e-4316-a028-2124e094c92d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091639 Dec 18 21:03:54.604085 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2324/4637] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:03:54.643988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:54.648259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:54.670207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:54.672656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:54.676966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:54.677947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:55.331799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:55.346858 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0b825b6-648b-47f1-b9d9-8d08c3d5ffc2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1506 microversion: 2.1 time: 0.977405 Dec 18 21:03:55.351311 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2314/4638] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:54 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1506 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:55.358542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9bf3288b-239d-4fac-9c1f-380421f5e842 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:55.359932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9bf3288b-239d-4fac-9c1f-380421f5e842 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:55.366322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bf3288b-239d-4fac-9c1f-380421f5e842 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:55.367127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bf3288b-239d-4fac-9c1f-380421f5e842 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:55.368119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bf3288b-239d-4fac-9c1f-380421f5e842 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:55.368556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9bf3288b-239d-4fac-9c1f-380421f5e842 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:55.404484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:55.413666 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aaa6d5db-36df-42f9-97f0-24e4d7213fd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1323 microversion: 2.1 time: 0.806164 Dec 18 21:03:55.416871 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2325/4639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:54 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1323 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:55.468760 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9bf3288b-239d-4fac-9c1f-380421f5e842 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.115146 Dec 18 21:03:55.475704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2315/4640] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:55 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:56.365267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:56.365919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:56.384182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:56.384652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:56.385472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:56.386089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:56.430304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:56.431119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:56.438481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:56.439199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:56.440170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:56.440783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:56.916585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:56.926772 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-edf13bb2-2ffa-4771-96b2-07d0578ed48f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1506 microversion: 2.1 time: 0.565802 Dec 18 21:03:56.928188 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2326/4641] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:56 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:56.935828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1efcb36-3c2f-472a-b9d1-93f9d4b1d658 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:56.937151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1efcb36-3c2f-472a-b9d1-93f9d4b1d658 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:56.945301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1efcb36-3c2f-472a-b9d1-93f9d4b1d658 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:56.946006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1efcb36-3c2f-472a-b9d1-93f9d4b1d658 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:56.947156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1efcb36-3c2f-472a-b9d1-93f9d4b1d658 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:56.947770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1efcb36-3c2f-472a-b9d1-93f9d4b1d658 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:57.000837 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1efcb36-3c2f-472a-b9d1-93f9d4b1d658 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.071126 Dec 18 21:03:57.001510 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2327/4642] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:56 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:57.007868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:57.017577 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-820ab74b-7a73-430d-828f-224544dc640b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1519 microversion: 2.1 time: 0.591159 Dec 18 21:03:57.018605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2316/4643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:56 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1519 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:03:57.040652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:57.042034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:57.052487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:57.053143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:57.054957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:57.055948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:57.082988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lazy-loading 'flavor' on Instance uuid 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:03:57.204197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1577364f-8d50-4e2c-9e08-57b1939e45ef tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action" status: 200 len: 32 microversion: 2.1 time: 0.170436 Dec 18 21:03:57.226131 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2328/4644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:03:57 2021] POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:03:57.232216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:57.233071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:57.243461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:57.244157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:57.247496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:57.248588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:57.435345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-9cdec65c-8857-401f-9931-12854d3721d5 req-9da0bd7f-042d-4acf-b55e-8354b7168d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1fea17-a56f-4df5-b5a7-0a1243877fbf", "name": "network-vif-deleted", "tag": "b126fb76-0c7b-45e0-b71c-c5080f666418"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:57.443690 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:57.443690 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:03:57.468142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9cdec65c-8857-401f-9931-12854d3721d5 req-9da0bd7f-042d-4acf-b55e-8354b7168d0a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:57.468743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9cdec65c-8857-401f-9931-12854d3721d5 req-9da0bd7f-042d-4acf-b55e-8354b7168d0a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:57.488134 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9cdec65c-8857-401f-9931-12854d3721d5 req-9da0bd7f-042d-4acf-b55e-8354b7168d0a service nova] Creating event network-vif-deleted:b126fb76-0c7b-45e0-b71c-c5080f666418 for instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf on nch1-master-1 Dec 18 21:03:57.499178 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-9cdec65c-8857-401f-9931-12854d3721d5 req-9da0bd7f-042d-4acf-b55e-8354b7168d0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068794 Dec 18 21:03:57.499657 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2329/4645] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:03:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:03:57.876174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:57.886885 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a34ff25-fb3a-4ca9-9ca5-4d73c760cd39 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.658631 Dec 18 21:03:57.887683 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2317/4646] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:57 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:57.949877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:57.951976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:57.983233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:57.983741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:57.987148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:57.987679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:58.016458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6ae5b71-9690-4725-8d6a-f3b6e7297adf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:58.017965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6ae5b71-9690-4725-8d6a-f3b6e7297adf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:58.034550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6ae5b71-9690-4725-8d6a-f3b6e7297adf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:58.035008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6ae5b71-9690-4725-8d6a-f3b6e7297adf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:58.036006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6ae5b71-9690-4725-8d6a-f3b6e7297adf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:58.036559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6ae5b71-9690-4725-8d6a-f3b6e7297adf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:58.138890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:58.141190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:58.141929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lazy-loading 'fault' on Instance uuid ba1fea17-a56f-4df5-b5a7-0a1243877fbf {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:03:58.167955 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6ae5b71-9690-4725-8d6a-f3b6e7297adf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.157745 Dec 18 21:03:58.173200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2318/4647] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:58 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:58.250069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:58.258520 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-be2c8f70-fba7-4218-96f5-55c40c0d46a1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 200 len: 1304 microversion: 2.1 time: 0.317212 Dec 18 21:03:58.261291 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2330/4648] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:57 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 1304 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:03:58.906630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:58.907705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:58.948752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:58.950812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:58.952950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:58.952950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:59.180131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ca68f70-4346-4679-b8d1-44b5162d77c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:59.181053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4ca68f70-4346-4679-b8d1-44b5162d77c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:59.189191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca68f70-4346-4679-b8d1-44b5162d77c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:59.189656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca68f70-4346-4679-b8d1-44b5162d77c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:59.199039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca68f70-4346-4679-b8d1-44b5162d77c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:59.199801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca68f70-4346-4679-b8d1-44b5162d77c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:59.295558 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ca68f70-4346-4679-b8d1-44b5162d77c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.115760 Dec 18 21:03:59.299841 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2331/4649] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:03:59 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:03:59.305694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:03:59.314605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:03:59.335248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:59.335713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:59.336531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:03:59.336976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:03:59.389139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf could not be found. Dec 18 21:03:59.398706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:03:59.400103 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9687d75e-7ecd-4c40-9625-c8efac3bb90d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 404 len: 111 microversion: 2.1 time: 0.101898 Dec 18 21:03:59.401210 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2332/4650] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:59 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:03:59.612829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-239374167", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "02107735-1e4a-434f-a377-a881410f569a"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:03:59.719192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] validate_networks() for [('02107735-1e4a-434f-a377-a881410f569a', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:03:59.876278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:03:59.886144 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2bb1871-e776-4f13-b56e-ac947fa39d29 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.985112 Dec 18 21:03:59.887483 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2319/4651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:03:58 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:00.307754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ffd9de69-c9e2-4a5b-ad6a-a7fa5172d545 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:00.308767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ffd9de69-c9e2-4a5b-ad6a-a7fa5172d545 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:00.323995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffd9de69-c9e2-4a5b-ad6a-a7fa5172d545 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:00.325553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffd9de69-c9e2-4a5b-ad6a-a7fa5172d545 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:00.327181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffd9de69-c9e2-4a5b-ad6a-a7fa5172d545 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:00.327829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffd9de69-c9e2-4a5b-ad6a-a7fa5172d545 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:00.378924 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ffd9de69-c9e2-4a5b-ad6a-a7fa5172d545 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.074603 Dec 18 21:04:00.380397 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2320/4652] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:00 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:00.903134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:00.903912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:00.913992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:00.918887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:00.920004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:00.920468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:01.629880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:01.657468 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5bcc066e-2728-4cd2-8de2-aa07a4ebe7d6 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.748252 Dec 18 21:04:01.659794 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2321/4653] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:00 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:01.682689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e3167469-8340-4b38-970f-1b38199bda0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:01.685268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e3167469-8340-4b38-970f-1b38199bda0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:01.693074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3167469-8340-4b38-970f-1b38199bda0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:01.693740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3167469-8340-4b38-970f-1b38199bda0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:01.695606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3167469-8340-4b38-970f-1b38199bda0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:01.696240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3167469-8340-4b38-970f-1b38199bda0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:01.847196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:04:01.847672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:04:01.848082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:04:01.848483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:04:01.848891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:04:01.862526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e3167469-8340-4b38-970f-1b38199bda0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.195529 Dec 18 21:04:01.866581 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2322/4654] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:01 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:01.869426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:01.869876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:01.881005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:01.881892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:01.949681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:04:01.979458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for user 0a98795bdb7447c5b2a4930173b3c56d and project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:04:02.031053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:04:02.033567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:04:02.132719 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0eadecc6-8d8d-4270-95a1-ae788d36b47b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.523869 Dec 18 21:04:02.136222 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2333/4655] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:03:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:04:02.144154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1be6ef7-cec9-4459-aa93-0a1bbf06b0e0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:02.145465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1be6ef7-cec9-4459-aa93-0a1bbf06b0e0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:02.275202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b1be6ef7-cec9-4459-aa93-0a1bbf06b0e0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:02.282197 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1be6ef7-cec9-4459-aa93-0a1bbf06b0e0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1214 microversion: 2.1 time: 0.142208 Dec 18 21:04:02.292910 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2323/4656] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:02 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:02.678531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:02.680404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:02.695392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:02.695843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:02.701064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:02.702345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:02.885170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74b811fd-9691-46c5-8ff1-d6d2a2ec2a9c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:02.888259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74b811fd-9691-46c5-8ff1-d6d2a2ec2a9c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:02.913694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74b811fd-9691-46c5-8ff1-d6d2a2ec2a9c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:02.916466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74b811fd-9691-46c5-8ff1-d6d2a2ec2a9c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:02.920405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74b811fd-9691-46c5-8ff1-d6d2a2ec2a9c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:02.921126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74b811fd-9691-46c5-8ff1-d6d2a2ec2a9c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:03.014077 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74b811fd-9691-46c5-8ff1-d6d2a2ec2a9c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.140586 Dec 18 21:04:03.015030 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2324/4657] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:02 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:03.179159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:03.200299 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6815f43d-ed9e-4e21-b391-6bb31016816f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.525363 Dec 18 21:04:03.205834 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2334/4658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:02 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:03.304702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:03.305430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:03.339496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:03.339966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:03.340787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:03.341233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:03.585945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:03.593929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-067814a5-703c-4a97-88dd-5e6c2127d851 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1210 microversion: 2.1 time: 0.297999 Dec 18 21:04:03.599343 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2325/4659] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:03 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1210 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:04.027337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-91828019-91a4-4673-9248-ece65b2763fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:04.028633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-91828019-91a4-4673-9248-ece65b2763fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:04.044309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91828019-91a4-4673-9248-ece65b2763fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:04.047253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91828019-91a4-4673-9248-ece65b2763fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:04.057971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91828019-91a4-4673-9248-ece65b2763fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:04.058733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91828019-91a4-4673-9248-ece65b2763fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:04.177869 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-91828019-91a4-4673-9248-ece65b2763fa tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.154286 Dec 18 21:04:04.178905 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2335/4660] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:04 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:04.221606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:04.222929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:04.237215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:04.238052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:04.239166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:04.243183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:04.619920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:04.621530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:04.642456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:04.643022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:04.643880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:04.644330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:04.956574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:04.965618 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb1e6e37-8efc-4f24-b5b8-1d0e6138f0c9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1272 microversion: 2.1 time: 0.352535 Dec 18 21:04:04.979171 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2336/4661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:04 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:05.192270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71312cca-ee36-4273-86ee-d2538258daa3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:05.193401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71312cca-ee36-4273-86ee-d2538258daa3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:05.222127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71312cca-ee36-4273-86ee-d2538258daa3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:05.222831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71312cca-ee36-4273-86ee-d2538258daa3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:05.223924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71312cca-ee36-4273-86ee-d2538258daa3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:05.224546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71312cca-ee36-4273-86ee-d2538258daa3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:05.326509 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71312cca-ee36-4273-86ee-d2538258daa3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.137991 Dec 18 21:04:05.333077 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2337/4662] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:05 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:05.560563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:05.572722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d106cb0b-96c0-4e25-8e8e-bd6f2dbc809b tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 1.355384 Dec 18 21:04:05.588619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2326/4663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:04 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:05.989103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:05.992560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:06.016547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:06.018151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:06.019470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:06.021501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:06.351333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a3df2d6-989e-4a0d-8906-26706c01f665 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:06.354093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a3df2d6-989e-4a0d-8906-26706c01f665 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:06.378577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a3df2d6-989e-4a0d-8906-26706c01f665 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:06.379462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a3df2d6-989e-4a0d-8906-26706c01f665 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:06.381067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a3df2d6-989e-4a0d-8906-26706c01f665 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:06.382888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a3df2d6-989e-4a0d-8906-26706c01f665 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:06.474637 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a3df2d6-989e-4a0d-8906-26706c01f665 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.136421 Dec 18 21:04:06.477393 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2327/4664] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:06 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:06.595227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:06.597216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:06.608180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:06.608640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:06.609455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:06.609898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:07.579988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:07.588337 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44b26d28-5bfc-478f-9dd0-8fb9f614d51a tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.997083 Dec 18 21:04:07.593042 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2328/4665] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:06 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:07.603896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-dfd96f9a-8772-43bb-8921-18ddab54e8e1 req-677c584f-c0eb-4fff-b258-5cd53f770439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f80750d-04f9-46f2-b3b7-d72d0e49b146", "tag": "309681a5-f8a2-4bff-8d44-369a9f3c89b4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:07.607658 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:07.607658 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:04:07.633191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-dfd96f9a-8772-43bb-8921-18ddab54e8e1 req-677c584f-c0eb-4fff-b258-5cd53f770439 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:07.633682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-dfd96f9a-8772-43bb-8921-18ddab54e8e1 req-677c584f-c0eb-4fff-b258-5cd53f770439 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:07.644444 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-dfd96f9a-8772-43bb-8921-18ddab54e8e1 req-677c584f-c0eb-4fff-b258-5cd53f770439 service nova] Creating event network-changed:309681a5-f8a2-4bff-8d44-369a9f3c89b4 for instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 on nch1-master-1 Dec 18 21:04:07.656060 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-dfd96f9a-8772-43bb-8921-18ddab54e8e1 req-677c584f-c0eb-4fff-b258-5cd53f770439 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061767 Dec 18 21:04:07.657044 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2329/4666] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:07.665890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e3282abb-2d34-4012-a34a-4b61bc9b7c0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:07.667312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e3282abb-2d34-4012-a34a-4b61bc9b7c0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:07.676106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3282abb-2d34-4012-a34a-4b61bc9b7c0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:07.676758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3282abb-2d34-4012-a34a-4b61bc9b7c0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:07.677729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3282abb-2d34-4012-a34a-4b61bc9b7c0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:07.678926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e3282abb-2d34-4012-a34a-4b61bc9b7c0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:07.705429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:07.739194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d948e65-6168-45de-a573-43a3bc1dcaad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1314 microversion: 2.1 time: 1.750241 Dec 18 21:04:07.741263 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2338/4667] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:05 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1314 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:07.786446 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e3282abb-2d34-4012-a34a-4b61bc9b7c0a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.127540 Dec 18 21:04:07.788639 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2330/4668] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:07 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:08.605822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:08.607186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:08.619483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:08.621476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:08.623795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:08.625243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:08.758777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:08.760305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:08.779028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:08.781492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:08.784078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:08.784542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:09.316131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:09.329803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9045cf69-a82c-4df8-a751-ab60ed88098d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1314 microversion: 2.1 time: 0.575223 Dec 18 21:04:09.335042 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2331/4669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:08 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:09.348229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f8092ac-1092-4a01-ba74-3cdf26f39390 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:09.353095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:09.363715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f8092ac-1092-4a01-ba74-3cdf26f39390 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:09.370068 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d8a0321a-ce98-4133-9231-821c953bdfbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.763139 Dec 18 21:04:09.371600 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2339/4670] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:08 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:09.390583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f8092ac-1092-4a01-ba74-3cdf26f39390 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:09.391054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f8092ac-1092-4a01-ba74-3cdf26f39390 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:09.391822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f8092ac-1092-4a01-ba74-3cdf26f39390 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:09.392271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f8092ac-1092-4a01-ba74-3cdf26f39390 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:09.465843 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f8092ac-1092-4a01-ba74-3cdf26f39390 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.128697 Dec 18 21:04:09.466726 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2332/4671] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:09 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:10.351757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:10.352656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:10.396393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:10.397941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:10.409434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:10.415054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:10.417904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:10.419781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:10.432663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:10.433005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:10.433837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:10.442683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:11.407904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:11.421985 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-364513cc-e7ec-40e7-8433-5942de03d114 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 1.034263 Dec 18 21:04:11.422984 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2333/4672] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:10 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:11.427736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ab692f6-bfc1-430b-8fb0-114a1c243bb8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:11.434472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ab692f6-bfc1-430b-8fb0-114a1c243bb8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:11.450078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab692f6-bfc1-430b-8fb0-114a1c243bb8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:11.450677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab692f6-bfc1-430b-8fb0-114a1c243bb8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:11.451520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab692f6-bfc1-430b-8fb0-114a1c243bb8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:11.452061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ab692f6-bfc1-430b-8fb0-114a1c243bb8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:11.479414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:11.488154 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d634a2b-0f8e-42d8-bc19-7c11cbb572ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1314 microversion: 2.1 time: 1.142990 Dec 18 21:04:11.492325 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2340/4673] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:10 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1314 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:11.558614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ab692f6-bfc1-430b-8fb0-114a1c243bb8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.134102 Dec 18 21:04:11.559616 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2334/4674] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:11 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:12.446124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:12.446843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:12.495012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:12.495593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:12.497805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:12.500142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:12.508992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:12.509714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:12.537900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:12.538528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:12.550861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:12.551462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:12.955883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:12.966364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ae78bf1-6e50-491e-bba6-f70c6bd323ce tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.529334 Dec 18 21:04:12.970380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2341/4675] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:12 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:12.983862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-464b40f8-657a-421c-a3d1-78db2f58b203 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:12.986773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-464b40f8-657a-421c-a3d1-78db2f58b203 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:13.007242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-464b40f8-657a-421c-a3d1-78db2f58b203 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:13.010743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-464b40f8-657a-421c-a3d1-78db2f58b203 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:13.013490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-464b40f8-657a-421c-a3d1-78db2f58b203 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:13.015089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-464b40f8-657a-421c-a3d1-78db2f58b203 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:13.131629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-464b40f8-657a-421c-a3d1-78db2f58b203 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.156864 Dec 18 21:04:13.135083 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2342/4676] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:12 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:13.239383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:13.252237 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c877052-d2ab-4217-9505-5e22722b3895 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1314 microversion: 2.1 time: 0.747496 Dec 18 21:04:13.270406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2335/4677] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:12 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:13.986949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:13.987665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:14.007366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:14.007828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:14.008796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:14.009232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:14.153574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c29466df-2de0-4474-bf72-46878e5a8749 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:14.155753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c29466df-2de0-4474-bf72-46878e5a8749 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:14.174225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29466df-2de0-4474-bf72-46878e5a8749 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:14.175320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29466df-2de0-4474-bf72-46878e5a8749 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:14.178865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29466df-2de0-4474-bf72-46878e5a8749 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:14.184259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c29466df-2de0-4474-bf72-46878e5a8749 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:14.271514 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c29466df-2de0-4474-bf72-46878e5a8749 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.128395 Dec 18 21:04:14.273490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2336/4678] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:14 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:14.282875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:14.293934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:14.311184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:14.311658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:14.312493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:14.312941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:14.510182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:14.526625 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-02df8294-3d31-47b3-bf9e-07216dd9a982 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.543749 Dec 18 21:04:14.527363 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2343/4679] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:13 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:14.621702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:14.634048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a048cd33-af66-48f9-b801-293bdb90ed69 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1314 microversion: 2.1 time: 0.353962 Dec 18 21:04:14.634721 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2337/4680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:14 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:15.295399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-86d3c497-cd54-4704-8be0-22f44395af54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:15.299980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-86d3c497-cd54-4704-8be0-22f44395af54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:15.336203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86d3c497-cd54-4704-8be0-22f44395af54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:15.337079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86d3c497-cd54-4704-8be0-22f44395af54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:15.338125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86d3c497-cd54-4704-8be0-22f44395af54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:15.338835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86d3c497-cd54-4704-8be0-22f44395af54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:15.428184 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-86d3c497-cd54-4704-8be0-22f44395af54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.146021 Dec 18 21:04:15.429911 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2344/4681] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:15 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:15.546619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:15.547338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:15.569756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:15.576616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:15.578584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:15.579238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:15.653740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:15.656421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:15.666093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:15.666636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:15.668123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:15.668573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:16.254702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:16.277752 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67bb9036-7e70-4cdc-9ef5-a50fe636af2c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.729974 Dec 18 21:04:16.281374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2338/4682] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:15 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:16.416625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:16.423524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6ba99ee3-b8b2-4cb6-bba3-ad303c4e1d78 req-8a65e076-8c03-494d-a55e-d067f1453598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f80750d-04f9-46f2-b3b7-d72d0e49b146", "name": "network-vif-plugged", "status": "completed", "tag": "309681a5-f8a2-4bff-8d44-369a9f3c89b4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:16.425811 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:16.425811 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:04:16.430999 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fe837b07-2a39-45ea-b848-f1aefb576c6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1314 microversion: 2.1 time: 0.782686 Dec 18 21:04:16.431618 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2345/4683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:15 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:16.443293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6ba99ee3-b8b2-4cb6-bba3-ad303c4e1d78 req-8a65e076-8c03-494d-a55e-d067f1453598 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:16.444465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6ba99ee3-b8b2-4cb6-bba3-ad303c4e1d78 req-8a65e076-8c03-494d-a55e-d067f1453598 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:16.449036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-475bd102-817a-463d-a5ca-f7859ec96c53 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:16.450361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-475bd102-817a-463d-a5ca-f7859ec96c53 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:16.459630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-475bd102-817a-463d-a5ca-f7859ec96c53 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:16.462018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-475bd102-817a-463d-a5ca-f7859ec96c53 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:16.463264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-475bd102-817a-463d-a5ca-f7859ec96c53 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:16.463793 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6ba99ee3-b8b2-4cb6-bba3-ad303c4e1d78 req-8a65e076-8c03-494d-a55e-d067f1453598 service nova] Creating event network-vif-plugged:309681a5-f8a2-4bff-8d44-369a9f3c89b4 for instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 on nch1-master-1 Dec 18 21:04:16.464183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-475bd102-817a-463d-a5ca-f7859ec96c53 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:16.481511 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6ba99ee3-b8b2-4cb6-bba3-ad303c4e1d78 req-8a65e076-8c03-494d-a55e-d067f1453598 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060756 Dec 18 21:04:16.484863 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2339/4684] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:16.525505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-475bd102-817a-463d-a5ca-f7859ec96c53 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.075278 Dec 18 21:04:16.527295 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2346/4685] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:16 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:17.302226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:17.304255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:17.312674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:17.313966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:17.316637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:17.317527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:17.449528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:17.450800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:17.481755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:17.484471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:17.489331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:17.491382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:17.870234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:17.903801 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9a9a6aa9-5ac2-4e3a-88b6-40ecda887967 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.605741 Dec 18 21:04:17.914113 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2340/4686] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:17 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:17.918700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2243c870-2512-479c-a7de-c3f1ce345c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:17.919752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2243c870-2512-479c-a7de-c3f1ce345c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:17.957027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2243c870-2512-479c-a7de-c3f1ce345c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:17.958167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2243c870-2512-479c-a7de-c3f1ce345c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:17.960535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2243c870-2512-479c-a7de-c3f1ce345c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:17.961021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2243c870-2512-479c-a7de-c3f1ce345c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:18.078480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2243c870-2512-479c-a7de-c3f1ce345c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.169888 Dec 18 21:04:18.080219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2341/4687] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:17 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:18.161366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:18.181564 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1fc075b5-5eef-4424-bfeb-8cd4903627fe tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1314 microversion: 2.1 time: 0.736504 Dec 18 21:04:18.203256 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2347/4688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:17 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:18.925109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:18.926983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:18.938862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:18.939753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:18.940958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:18.941638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:19.094847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ece13df-eaa6-4fc6-a2ad-2e87b4183c36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:19.096064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ece13df-eaa6-4fc6-a2ad-2e87b4183c36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:19.107160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ece13df-eaa6-4fc6-a2ad-2e87b4183c36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:19.107613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ece13df-eaa6-4fc6-a2ad-2e87b4183c36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:19.108777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ece13df-eaa6-4fc6-a2ad-2e87b4183c36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:19.109440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ece13df-eaa6-4fc6-a2ad-2e87b4183c36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:19.171587 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ece13df-eaa6-4fc6-a2ad-2e87b4183c36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.082651 Dec 18 21:04:19.173574 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2348/4689] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:19 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:19.201692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:19.202955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:19.211784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:19.212238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:19.213531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:19.214093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:19.719988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:19.732565 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b943753-27b3-4aa2-9a24-a786d3af2ce2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.814249 Dec 18 21:04:19.734352 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2342/4690] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:18 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:19.798302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:19.809674 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39b80a4b-5265-4e3f-96f5-bcb943df815b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1500 microversion: 2.1 time: 0.612569 Dec 18 21:04:19.813617 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2349/4691] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:19 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1500 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:20.184525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7ac2b95-8b20-4714-b7cf-f4a8f4a8b94b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:20.185464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7ac2b95-8b20-4714-b7cf-f4a8f4a8b94b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:20.238449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7ac2b95-8b20-4714-b7cf-f4a8f4a8b94b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:20.243258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7ac2b95-8b20-4714-b7cf-f4a8f4a8b94b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:20.247828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7ac2b95-8b20-4714-b7cf-f4a8f4a8b94b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:20.251171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7ac2b95-8b20-4714-b7cf-f4a8f4a8b94b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:20.391267 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7ac2b95-8b20-4714-b7cf-f4a8f4a8b94b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.204929 Dec 18 21:04:20.397154 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2343/4692] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:20 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:20.753277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:20.754507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:20.783376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:20.785520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:20.788086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:20.792073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:21.265621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:21.276478 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d8be9ec-50fb-4393-bf29-5e15e5b852f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.529514 Dec 18 21:04:21.279011 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2350/4693] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:20 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:21.405208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77919171-0d65-42af-aeba-2549c5475f36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:21.406318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77919171-0d65-42af-aeba-2549c5475f36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:21.420078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77919171-0d65-42af-aeba-2549c5475f36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:21.420608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77919171-0d65-42af-aeba-2549c5475f36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:21.421434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77919171-0d65-42af-aeba-2549c5475f36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:21.422775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77919171-0d65-42af-aeba-2549c5475f36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:21.511162 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-77919171-0d65-42af-aeba-2549c5475f36 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.110108 Dec 18 21:04:21.512884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2344/4694] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:21 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:21.651180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbf7eaf2-c408-4d24-9a0e-9cee7a2427a8"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:21.652616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:21.669646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:21.672749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:21.674743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:21.678966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:22.267137 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c6ddf35-c2aa-45b3-9948-6661c7720db4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617325 Dec 18 21:04:22.267818 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2351/4695] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:04:21 2021] POST /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:22.298862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:22.300207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:22.329213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:22.331747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:22.333311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:22.338756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:22.527954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45b77594-26a9-4af6-91dd-6ccad79e7323 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:22.529113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45b77594-26a9-4af6-91dd-6ccad79e7323 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:22.545788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45b77594-26a9-4af6-91dd-6ccad79e7323 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:22.547747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45b77594-26a9-4af6-91dd-6ccad79e7323 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:22.548744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45b77594-26a9-4af6-91dd-6ccad79e7323 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:22.549173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45b77594-26a9-4af6-91dd-6ccad79e7323 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:22.647604 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45b77594-26a9-4af6-91dd-6ccad79e7323 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.126235 Dec 18 21:04:22.661310 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2352/4696] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:22 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:22.918613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:22.935990 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01056f0a-92e3-4c61-8c9d-538f5664ccd7 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.642808 Dec 18 21:04:22.937481 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2345/4697] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:22 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:23.672869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1293d9e9-7c72-401e-8c90-c964ae3a1de3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:23.674093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1293d9e9-7c72-401e-8c90-c964ae3a1de3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:23.697956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1293d9e9-7c72-401e-8c90-c964ae3a1de3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:23.700242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1293d9e9-7c72-401e-8c90-c964ae3a1de3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:23.701126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1293d9e9-7c72-401e-8c90-c964ae3a1de3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:23.704878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1293d9e9-7c72-401e-8c90-c964ae3a1de3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:23.804754 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1293d9e9-7c72-401e-8c90-c964ae3a1de3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.136872 Dec 18 21:04:23.811682 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2353/4698] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:23 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:23.954983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:23.956246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:23.965604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:23.966751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:23.967870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:23.968525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:24.343997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:24.357410 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a39d099-6f79-4c6b-af84-0e0aa6c21f8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.403865 Dec 18 21:04:24.370063 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2346/4699] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:23 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:24.819864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da4bebc1-d9b4-432c-9daf-2f8ccd910103 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:24.821602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da4bebc1-d9b4-432c-9daf-2f8ccd910103 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:24.840871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da4bebc1-d9b4-432c-9daf-2f8ccd910103 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:24.843416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da4bebc1-d9b4-432c-9daf-2f8ccd910103 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:24.845421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da4bebc1-d9b4-432c-9daf-2f8ccd910103 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:24.847583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da4bebc1-d9b4-432c-9daf-2f8ccd910103 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:24.948468 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da4bebc1-d9b4-432c-9daf-2f8ccd910103 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.133893 Dec 18 21:04:24.955947 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2354/4700] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:24 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:25.375879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:25.377363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:25.394716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:25.396821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:25.398784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:25.401734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:25.804658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:25.805400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:25.813223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:25.813850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:25.821818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:25.822634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:25.885141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:04:25.997940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:26.009839 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-616f6363-d0e3-4e40-aee9-35bcb83d4bfa tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1525 microversion: 2.1 time: 0.639113 Dec 18 21:04:26.014569 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2347/4701] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:25 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1525 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:26.029660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-451903f6-f7d4-4e13-99cf-1018076cada9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:26.030653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-451903f6-f7d4-4e13-99cf-1018076cada9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:26.040595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451903f6-f7d4-4e13-99cf-1018076cada9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:26.042486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451903f6-f7d4-4e13-99cf-1018076cada9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:26.045199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451903f6-f7d4-4e13-99cf-1018076cada9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:26.045721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451903f6-f7d4-4e13-99cf-1018076cada9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:26.062489 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-91208390-48b0-4372-b481-52b69dc5a49f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 204 len: 0 microversion: 2.1 time: 0.261832 Dec 18 21:04:26.063085 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2355/4702] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:04:25 2021] DELETE /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:04:26.077367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:26.078082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:26.090466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:26.090956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:26.091774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:26.092220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:26.130226 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-451903f6-f7d4-4e13-99cf-1018076cada9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.114324 Dec 18 21:04:26.131474 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2348/4703] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:26 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:26.901776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:26.913989 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb942bc4-6461-49fa-993d-0241c46e4297 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1552 microversion: 2.1 time: 0.846264 Dec 18 21:04:26.916005 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2356/4704] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:26 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1552 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:27.036260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:27.038797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:27.049550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:27.050245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:27.051536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:27.052066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:27.144423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-241bdd98-4ced-40cf-808d-966f24a70a90 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:27.145424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-241bdd98-4ced-40cf-808d-966f24a70a90 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:27.155370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241bdd98-4ced-40cf-808d-966f24a70a90 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:27.155830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241bdd98-4ced-40cf-808d-966f24a70a90 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:27.156628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241bdd98-4ced-40cf-808d-966f24a70a90 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:27.157066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-241bdd98-4ced-40cf-808d-966f24a70a90 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:27.209746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-241bdd98-4ced-40cf-808d-966f24a70a90 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.068908 Dec 18 21:04:27.210692 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2357/4705] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:27 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:27.542483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:27.561963 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0747318c-1dbe-4edc-963e-b4fb2c5f61f2 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1505 microversion: 2.1 time: 0.530466 Dec 18 21:04:27.565428 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2349/4706] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:27 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:27.584711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da2990ed-aefc-496a-a102-d9f38050f44d tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'create', calling method: .version_select at 0x7f714eb641f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1899241350", "description": "tempest-description-1721248255"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:27.937731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:27.939245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:27.951696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:27.953135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:27.954122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:27.954797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:27.981645 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da2990ed-aefc-496a-a102-d9f38050f44d tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.402679 Dec 18 21:04:27.982273 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2358/4707] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Dec 18 21:04:27 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:27.994686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1899241350"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:27.996341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:28.010894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:28.013637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:28.014811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:28.015331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:28.257896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:28.268878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.network.security_group_api [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Adding security group 85da10aa-9a0b-4f65-abee-6ab4407610a7 to port 0cf1d658-7c84-403d-9a60-9404b627e728 Dec 18 21:04:28.269130 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf0f23ac-b067-40cd-b137-dde7217874f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1552 microversion: 2.1 time: 0.340687 Dec 18 21:04:28.272341 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2350/4708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:27 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1552 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:28.282514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51175eea-a308-4f73-8bdc-a9ca1e849f42 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:28.284869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51175eea-a308-4f73-8bdc-a9ca1e849f42 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:28.299371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51175eea-a308-4f73-8bdc-a9ca1e849f42 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:28.299834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51175eea-a308-4f73-8bdc-a9ca1e849f42 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:28.300902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51175eea-a308-4f73-8bdc-a9ca1e849f42 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:28.304717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51175eea-a308-4f73-8bdc-a9ca1e849f42 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:28.356546 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51175eea-a308-4f73-8bdc-a9ca1e849f42 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.081020 Dec 18 21:04:28.358270 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2351/4709] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:28 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:28.997951 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0415ed01-5890-4628-8a11-475b846bbcbb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action" status: 202 len: 0 microversion: 2.1 time: 1.008223 Dec 18 21:04:29.000209 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2359/4710] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:04:27 2021] POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:29.009412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1899241350"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:29.010043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:29.028615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c6964341-ea32-4574-9360-8d32e44719e7 req-79c2c4a4-6182-49a5-9b73-5bda555553ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66babd8d-06b0-4cb2-8e2e-d37c5e1aae25", "tag": "0cf1d658-7c84-403d-9a60-9404b627e728"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:29.031284 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:29.031284 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:04:29.042562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:29.043867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:29.046929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:29.049893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:29.050840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c6964341-ea32-4574-9360-8d32e44719e7 req-79c2c4a4-6182-49a5-9b73-5bda555553ad service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:29.055451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c6964341-ea32-4574-9360-8d32e44719e7 req-79c2c4a4-6182-49a5-9b73-5bda555553ad service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:29.100929 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c6964341-ea32-4574-9360-8d32e44719e7 req-79c2c4a4-6182-49a5-9b73-5bda555553ad service nova] Creating event network-changed:0cf1d658-7c84-403d-9a60-9404b627e728 for instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 on nch2-master-1 Dec 18 21:04:29.115602 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c6964341-ea32-4574-9360-8d32e44719e7 req-79c2c4a4-6182-49a5-9b73-5bda555553ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091747 Dec 18 21:04:29.123207 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2360/4711] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:04:29.289498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:29.290529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:29.300836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:29.301580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:29.304811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:29.308318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:29.640449 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.network.security_group_api [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Removing security group 85da10aa-9a0b-4f65-abee-6ab4407610a7 from port 0cf1d658-7c84-403d-9a60-9404b627e728 Dec 18 21:04:30.076749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:30.091473 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-43115fb2-2c7e-448b-9c8d-abf9f037ec08 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1552 microversion: 2.1 time: 0.805997 Dec 18 21:04:30.093977 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2361/4712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:29 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1552 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:30.112454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bc13c34-3092-4ac4-b08d-3ca613571b47 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:30.113520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bc13c34-3092-4ac4-b08d-3ca613571b47 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:30.133290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc13c34-3092-4ac4-b08d-3ca613571b47 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:30.134606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc13c34-3092-4ac4-b08d-3ca613571b47 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:30.137204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc13c34-3092-4ac4-b08d-3ca613571b47 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:30.138108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc13c34-3092-4ac4-b08d-3ca613571b47 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:30.236720 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bc13c34-3092-4ac4-b08d-3ca613571b47 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.141393 Dec 18 21:04:30.239426 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2362/4713] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:30 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:30.943757 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-becc3b10-0b45-4a24-8101-0f2ffd606b5c tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action" status: 202 len: 0 microversion: 2.1 time: 1.938363 Dec 18 21:04:30.946593 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2352/4714] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:04:29 2021] POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action => generated 0 bytes in 1942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:30.988570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccaaa0f8-90d6-4270-bdaa-144b987afcb8 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'create', calling method: .version_select at 0x7f714f70c820>, body: {"pool": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:31.010790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d15ae5af-3107-4bae-9047-32d5f2f09219 req-d93a5cf2-d0cd-487d-9891-57b3d8f4ba68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f80750d-04f9-46f2-b3b7-d72d0e49b146", "name": "network-vif-deleted", "tag": "309681a5-f8a2-4bff-8d44-369a9f3c89b4"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:31.040510 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:31.040510 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:04:31.074034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d15ae5af-3107-4bae-9047-32d5f2f09219 req-d93a5cf2-d0cd-487d-9891-57b3d8f4ba68 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:31.075098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d15ae5af-3107-4bae-9047-32d5f2f09219 req-d93a5cf2-d0cd-487d-9891-57b3d8f4ba68 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:31.091952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d15ae5af-3107-4bae-9047-32d5f2f09219 req-d93a5cf2-d0cd-487d-9891-57b3d8f4ba68 service nova] Creating event network-vif-deleted:309681a5-f8a2-4bff-8d44-369a9f3c89b4 for instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 on nch1-master-1 Dec 18 21:04:31.099967 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d15ae5af-3107-4bae-9047-32d5f2f09219 req-d93a5cf2-d0cd-487d-9891-57b3d8f4ba68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119815 Dec 18 21:04:31.100830 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2353/4715] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:31.118571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:31.120445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:31.135321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:31.136295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:31.137331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:31.137983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:31.655098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:31.705307 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-63787171-5630-4f86-8000-155d7d52d8e3 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 200 len: 1345 microversion: 2.1 time: 0.593962 Dec 18 21:04:31.707250 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2354/4716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:31 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 1345 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:31.716422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c7e51b99-47ac-4966-aee4-bf96d1a973b3 req-4550fda2-cead-4cf8-870a-708a1a545708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66babd8d-06b0-4cb2-8e2e-d37c5e1aae25", "tag": "0cf1d658-7c84-403d-9a60-9404b627e728"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:31.719329 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:31.719329 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:04:31.734496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c7e51b99-47ac-4966-aee4-bf96d1a973b3 req-4550fda2-cead-4cf8-870a-708a1a545708 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:31.735453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c7e51b99-47ac-4966-aee4-bf96d1a973b3 req-4550fda2-cead-4cf8-870a-708a1a545708 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:31.781428 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c7e51b99-47ac-4966-aee4-bf96d1a973b3 req-4550fda2-cead-4cf8-870a-708a1a545708 service nova] Creating event network-changed:0cf1d658-7c84-403d-9a60-9404b627e728 for instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 on nch2-master-1 Dec 18 21:04:31.821627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c7e51b99-47ac-4966-aee4-bf96d1a973b3 req-4550fda2-cead-4cf8-870a-708a1a545708 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111780 Dec 18 21:04:31.822542 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2355/4717] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:31.840087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9c8687e-48b7-42f5-9277-32eb104ad9d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:31.840361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9c8687e-48b7-42f5-9277-32eb104ad9d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:31.855304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8687e-48b7-42f5-9277-32eb104ad9d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:31.855776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8687e-48b7-42f5-9277-32eb104ad9d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:31.856601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8687e-48b7-42f5-9277-32eb104ad9d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:31.857048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9c8687e-48b7-42f5-9277-32eb104ad9d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:31.936461 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9c8687e-48b7-42f5-9277-32eb104ad9d9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.112621 Dec 18 21:04:31.940554 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2356/4718] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:31 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:32.723712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:32.726792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:32.745206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:32.748556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:32.751030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:32.754387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:32.805614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. Dec 18 21:04:32.806346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:04:32.807524 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f86777aa-5ac5-415c-8404-64adaacc85f7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 404 len: 111 microversion: 2.1 time: 0.088424 Dec 18 21:04:32.808605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2357/4719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:32 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:04:32.956702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fc56d070-b55c-46c6-b3ce-21b938c16734 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:32.958175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fc56d070-b55c-46c6-b3ce-21b938c16734 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:32.973800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc56d070-b55c-46c6-b3ce-21b938c16734 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:32.975658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc56d070-b55c-46c6-b3ce-21b938c16734 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:32.976804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc56d070-b55c-46c6-b3ce-21b938c16734 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:32.977719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc56d070-b55c-46c6-b3ce-21b938c16734 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:33.077068 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fc56d070-b55c-46c6-b3ce-21b938c16734 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.124970 Dec 18 21:04:33.078226 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2358/4720] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:32 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:33.089885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:33.090966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:33.100384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:33.101800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:33.102864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:33.103606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:33.121859 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. Dec 18 21:04:33.122780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:04:33.123789 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e612f59-4ac6-4e3e-910b-71092bd2b79d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044100 Dec 18 21:04:33.124530 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2359/4721] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:04:33 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:04:33.310699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1798988152", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "02107735-1e4a-434f-a377-a881410f569a"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:33.394748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] validate_networks() for [('02107735-1e4a-434f-a377-a881410f569a', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:04:35.351683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:04:35.352819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:04:35.353524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:04:35.354144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:04:35.354758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:04:35.372514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:35.373557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:35.377169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:35.377889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:35.442508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:04:35.460435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for user 0a98795bdb7447c5b2a4930173b3c56d and project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:04:35.511844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:04:35.523111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:04:35.712408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1dfddf89-62db-48eb-89c2-c9f077c7018a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408367 Dec 18 21:04:35.715317 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2360/4722] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:04:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:04:35.728612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aeffd357-dba8-4f3a-8fcc-a2626a1a540d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:35.731125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aeffd357-dba8-4f3a-8fcc-a2626a1a540d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:35.744326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aeffd357-dba8-4f3a-8fcc-a2626a1a540d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:35.766504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aeffd357-dba8-4f3a-8fcc-a2626a1a540d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:35.768343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aeffd357-dba8-4f3a-8fcc-a2626a1a540d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:35.773688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aeffd357-dba8-4f3a-8fcc-a2626a1a540d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:35.851038 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aeffd357-dba8-4f3a-8fcc-a2626a1a540d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.133423 Dec 18 21:04:35.851810 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2361/4723] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:35 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:35.858668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59eac70d-2706-4f0f-b87b-90a206e14c96 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:35.859784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-59eac70d-2706-4f0f-b87b-90a206e14c96 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:36.040437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-59eac70d-2706-4f0f-b87b-90a206e14c96 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:36.049295 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59eac70d-2706-4f0f-b87b-90a206e14c96 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e" status: 200 len: 1215 microversion: 2.1 time: 0.196044 Dec 18 21:04:36.050038 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2362/4724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:35 2021] GET /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:36.068026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3930ac1b-6267-4f5b-80f4-662bcbc36e05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:36.068528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3930ac1b-6267-4f5b-80f4-662bcbc36e05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:36.087327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3930ac1b-6267-4f5b-80f4-662bcbc36e05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:04:36.301534 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccaaa0f8-90d6-4270-bdaa-144b987afcb8 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.348094 Dec 18 21:04:36.302498 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2363/4725] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Dec 18 21:04:30 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:36.314171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.147"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:36.315442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:36.322760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:36.323245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:36.324059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:36.324505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:36.368158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Acquired lock "refresh_cache-66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 21:04:36.478243 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.scheduler.client.report [None req-3930ac1b-6267-4f5b-80f4-662bcbc36e05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Deleted allocations for instance 8ca18aeb-fcff-41f1-828d-ad9aeea7139e Dec 18 21:04:36.484597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-3930ac1b-6267-4f5b-80f4-662bcbc36e05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] Instance Mapping does not exist while attempting local delete cleanup. Dec 18 21:04:36.485621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3930ac1b-6267-4f5b-80f4-662bcbc36e05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e" status: 204 len: 0 microversion: 2.1 time: 0.421663 Dec 18 21:04:36.486230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2363/4726] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:04:36 2021] DELETE /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:04:36.502345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be4bf0a4-0ee4-4ebd-9432-2e423d22ebae tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:36.503210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-be4bf0a4-0ee4-4ebd-9432-2e423d22ebae tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:36.520098 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-be4bf0a4-0ee4-4ebd-9432-2e423d22ebae tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 8ca18aeb-fcff-41f1-828d-ad9aeea7139e could not be found. Dec 18 21:04:36.520757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be4bf0a4-0ee4-4ebd-9432-2e423d22ebae tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 8ca18aeb-fcff-41f1-828d-ad9aeea7139e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:04:36.522701 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-be4bf0a4-0ee4-4ebd-9432-2e423d22ebae tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e" status: 404 len: 111 microversion: 2.1 time: 0.030519 Dec 18 21:04:36.524132 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2364/4727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:36 2021] GET /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:04:36.706343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1223993015", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "02107735-1e4a-434f-a377-a881410f569a"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:36.808423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] validate_networks() for [('02107735-1e4a-434f-a377-a881410f569a', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:04:38.697882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:04:38.698515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:04:38.698830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:04:38.699249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:04:38.699671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:04:38.728340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:38.738179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:38.746645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:38.747144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:38.790772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:04:38.806268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for user 0a98795bdb7447c5b2a4930173b3c56d and project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:04:38.833603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:04:38.841121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:04:38.904668 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-89d3809a-4039-4d50-b337-13cae1574732 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202200 Dec 18 21:04:38.911799 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2365/4728] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:04:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:04:38.917215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be42f293-061b-4ba0-ad26-2271c2239c24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:38.918561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-be42f293-061b-4ba0-ad26-2271c2239c24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:38.926181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be42f293-061b-4ba0-ad26-2271c2239c24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:38.926938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be42f293-061b-4ba0-ad26-2271c2239c24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:38.929372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be42f293-061b-4ba0-ad26-2271c2239c24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:38.930100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be42f293-061b-4ba0-ad26-2271c2239c24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:39.000076 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-be42f293-061b-4ba0-ad26-2271c2239c24 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.086648 Dec 18 21:04:39.001242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2366/4729] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:38 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:39.007967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-16573d29-8a93-46df-a7f0-f23eb6b2f561 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:39.012617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-16573d29-8a93-46df-a7f0-f23eb6b2f561 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:39.198327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-16573d29-8a93-46df-a7f0-f23eb6b2f561 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:39.214750 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-16573d29-8a93-46df-a7f0-f23eb6b2f561 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1215 microversion: 2.1 time: 0.212215 Dec 18 21:04:39.228074 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2367/4730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:39 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:40.012679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ed5b8e1-ad50-43ff-8532-104b9bfe8b6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:40.014003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ed5b8e1-ad50-43ff-8532-104b9bfe8b6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:40.022505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ed5b8e1-ad50-43ff-8532-104b9bfe8b6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:40.035519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ed5b8e1-ad50-43ff-8532-104b9bfe8b6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:40.037257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ed5b8e1-ad50-43ff-8532-104b9bfe8b6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:40.037826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Building network info cache for instance {{(pid=140732) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 21:04:40.044699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ed5b8e1-ad50-43ff-8532-104b9bfe8b6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:40.178545 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ed5b8e1-ad50-43ff-8532-104b9bfe8b6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.169287 Dec 18 21:04:40.180918 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2368/4731] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:40 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:40.193071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b78b3a1a-3ed2-416a-848c-4c6469d30e87 req-a91ef5ce-303e-4d7a-8c2e-26a6afa356e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66babd8d-06b0-4cb2-8e2e-d37c5e1aae25", "tag": "0cf1d658-7c84-403d-9a60-9404b627e728"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:40.198336 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:40.198336 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:04:40.218943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b78b3a1a-3ed2-416a-848c-4c6469d30e87 req-a91ef5ce-303e-4d7a-8c2e-26a6afa356e1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:40.221097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b78b3a1a-3ed2-416a-848c-4c6469d30e87 req-a91ef5ce-303e-4d7a-8c2e-26a6afa356e1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:40.252915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b78b3a1a-3ed2-416a-848c-4c6469d30e87 req-a91ef5ce-303e-4d7a-8c2e-26a6afa356e1 service nova] Creating event network-changed:0cf1d658-7c84-403d-9a60-9404b627e728 for instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 on nch2-master-1 Dec 18 21:04:40.269815 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b78b3a1a-3ed2-416a-848c-4c6469d30e87 req-a91ef5ce-303e-4d7a-8c2e-26a6afa356e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087145 Dec 18 21:04:40.273817 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2369/4732] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:40.289994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:40.302177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:40.322127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:40.325416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:40.328247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:40.331496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:40.545206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:40.553645 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-872e6094-ecf2-4b03-a4cb-a5603f195faf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1211 microversion: 2.1 time: 0.278170 Dec 18 21:04:40.568908 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2370/4733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:40 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1211 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:41.193514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d0c3010-04a4-48c7-a945-9941c7b03701 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:41.194706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d0c3010-04a4-48c7-a945-9941c7b03701 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:41.236797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d0c3010-04a4-48c7-a945-9941c7b03701 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:41.243318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d0c3010-04a4-48c7-a945-9941c7b03701 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:41.245288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d0c3010-04a4-48c7-a945-9941c7b03701 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:41.255649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d0c3010-04a4-48c7-a945-9941c7b03701 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:41.330778 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d0c3010-04a4-48c7-a945-9941c7b03701 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.142301 Dec 18 21:04:41.332281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2371/4734] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:41 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:41.577948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:41.579011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:41.597370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:41.601015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:41.602116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:41.602770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:41.837010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:41.846122 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4cab869-3c0d-4434-9099-a609fcbcdd6b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1267 microversion: 2.1 time: 0.273233 Dec 18 21:04:41.846758 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2372/4735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:41 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:42.345480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b97d74d8-a3e1-466c-b04c-c609649a9aeb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:42.351063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b97d74d8-a3e1-466c-b04c-c609649a9aeb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:42.371283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b97d74d8-a3e1-466c-b04c-c609649a9aeb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:42.373890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b97d74d8-a3e1-466c-b04c-c609649a9aeb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:42.375270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b97d74d8-a3e1-466c-b04c-c609649a9aeb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:42.377843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b97d74d8-a3e1-466c-b04c-c609649a9aeb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:42.445586 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b97d74d8-a3e1-466c-b04c-c609649a9aeb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.104084 Dec 18 21:04:42.447125 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2373/4736] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:42 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:42.532598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Updating instance_info_cache with network_info: [{"id": "0cf1d658-7c84-403d-9a60-9404b627e728", "address": "fa:16:3e:02:2d:41", "network": {"id": "cb97ef06-3d0b-442a-856c-1db8f276297a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1923215030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b037c54b761428db4df46b975b70574", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap0cf1d658-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140732) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 21:04:42.550030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Releasing lock "refresh_cache-66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" {{(pid=140732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 21:04:42.551036 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ff4a2846-f0a4-4699-aaaf-cefbe500d828 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action" status: 202 len: 0 microversion: 2.1 time: 6.240723 Dec 18 21:04:42.551641 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2364/4737] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:04:36 2021] POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action => generated 0 bytes in 6242 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Dec 18 21:04:42.561956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.147"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:42.866496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:42.867138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:42.879558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:42.880375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:42.881498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:42.882172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:43.295311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:43.306555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:43.307612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:43.308871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:43.309518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:43.315867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:43.329615 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-61fb29fd-6f60-4876-92f0-34b8d11baab5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1273 microversion: 2.1 time: 0.464840 Dec 18 21:04:43.330661 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2365/4738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:42 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1273 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:43.458769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-febf6df0-e5df-477f-aa65-8666f1013b19 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:43.460015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-febf6df0-e5df-477f-aa65-8666f1013b19 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:43.473042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-febf6df0-e5df-477f-aa65-8666f1013b19 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:43.473940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-febf6df0-e5df-477f-aa65-8666f1013b19 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:43.475017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-febf6df0-e5df-477f-aa65-8666f1013b19 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:43.478694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-febf6df0-e5df-477f-aa65-8666f1013b19 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:43.570691 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-febf6df0-e5df-477f-aa65-8666f1013b19 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.115631 Dec 18 21:04:43.571895 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2366/4739] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:43 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:43.688632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Acquired lock "refresh_cache-66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 21:04:44.351160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:44.352793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:44.363478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:44.363959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:44.364811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:44.371285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:44.597199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:44.605933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29aa4cdf-3b4b-458a-b4be-1f5be7fa10e5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1273 microversion: 2.1 time: 0.262086 Dec 18 21:04:44.610435 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2367/4740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:44 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:44.622382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fba97dff-a5b6-4a0d-aad8-c2b99ea2d0a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:44.625059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fba97dff-a5b6-4a0d-aad8-c2b99ea2d0a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:44.658317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fba97dff-a5b6-4a0d-aad8-c2b99ea2d0a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:44.660099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fba97dff-a5b6-4a0d-aad8-c2b99ea2d0a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:44.661160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fba97dff-a5b6-4a0d-aad8-c2b99ea2d0a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:44.661928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fba97dff-a5b6-4a0d-aad8-c2b99ea2d0a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:44.761730 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fba97dff-a5b6-4a0d-aad8-c2b99ea2d0a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.145379 Dec 18 21:04:44.762432 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2368/4741] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:44 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:45.637702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:45.638487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:45.684871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:45.692999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:45.700097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:45.702519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:45.876416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Building network info cache for instance {{(pid=140731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 18 21:04:46.446011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:46.453783 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7bb9d90d-7546-4dd6-b303-eac3f783a662 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.820098 Dec 18 21:04:46.463370 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2369/4742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:45 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:46.478211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb288e71-1142-4c57-b759-b14343ec4b5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:46.479541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb288e71-1142-4c57-b759-b14343ec4b5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:46.486050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb288e71-1142-4c57-b759-b14343ec4b5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:46.486862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb288e71-1142-4c57-b759-b14343ec4b5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:46.487896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb288e71-1142-4c57-b759-b14343ec4b5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:46.488567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb288e71-1142-4c57-b759-b14343ec4b5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:46.555328 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb288e71-1142-4c57-b759-b14343ec4b5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.090467 Dec 18 21:04:46.556324 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2370/4743] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:46 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:46.562088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-48f705ed-2a14-4993-bf9c-12c67ac9db52 req-4516992c-980d-487e-aff3-660644616025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66babd8d-06b0-4cb2-8e2e-d37c5e1aae25", "tag": "0cf1d658-7c84-403d-9a60-9404b627e728"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:46.565042 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:46.565042 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:04:46.575961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-48f705ed-2a14-4993-bf9c-12c67ac9db52 req-4516992c-980d-487e-aff3-660644616025 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:46.576633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-48f705ed-2a14-4993-bf9c-12c67ac9db52 req-4516992c-980d-487e-aff3-660644616025 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:46.593847 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-48f705ed-2a14-4993-bf9c-12c67ac9db52 req-4516992c-980d-487e-aff3-660644616025 service nova] Creating event network-changed:0cf1d658-7c84-403d-9a60-9404b627e728 for instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 on nch2-master-1 Dec 18 21:04:46.600240 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-48f705ed-2a14-4993-bf9c-12c67ac9db52 req-4516992c-980d-487e-aff3-660644616025 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042264 Dec 18 21:04:46.601322 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2371/4744] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:46.898745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] Calling method '.version_select at 0x7f716132eb80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:46.899806 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:46.899806 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:04:46.901379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:46.901835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:46.941552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:46.942865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:46.983655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:46.984229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:46.994800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0ca65605-59c2-439f-bca2-6417872ffa0b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1543418362-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.391801 Dec 18 21:04:47.001015 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2372/4745] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 21:04:46 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:47.014147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-fb2d1a6d-bec1-4809-bb34-0e853aa52e11 req-0461cc29-3c03-4957-900d-0f8218245dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7488031b-21d1-4bf2-a8fe-baa195bfbaa5", "tag": "d6333a5a-affa-48cd-b5d2-09b57546245d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:47.016138 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:47.016138 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:04:47.038224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fb2d1a6d-bec1-4809-bb34-0e853aa52e11 req-0461cc29-3c03-4957-900d-0f8218245dc8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:47.039068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fb2d1a6d-bec1-4809-bb34-0e853aa52e11 req-0461cc29-3c03-4957-900d-0f8218245dc8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:47.066204 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-fb2d1a6d-bec1-4809-bb34-0e853aa52e11 req-0461cc29-3c03-4957-900d-0f8218245dc8 service nova] Creating event network-changed:d6333a5a-affa-48cd-b5d2-09b57546245d for instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 on nch1-master-1 Dec 18 21:04:47.080124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-fb2d1a6d-bec1-4809-bb34-0e853aa52e11 req-0461cc29-3c03-4957-900d-0f8218245dc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077479 Dec 18 21:04:47.081195 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2373/4746] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:47.481085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:47.481858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:47.494086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:47.494590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:47.495434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:47.495887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:48.200810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:48.209572 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b0dcee0f-7689-410b-8c3e-6eb174ec6c0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.733111 Dec 18 21:04:48.210160 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2374/4747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:47 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:48.217802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59334feb-ddfa-4602-9db8-258a0d31744e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:48.218635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-59334feb-ddfa-4602-9db8-258a0d31744e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:48.226653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59334feb-ddfa-4602-9db8-258a0d31744e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:48.227444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59334feb-ddfa-4602-9db8-258a0d31744e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:48.228165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59334feb-ddfa-4602-9db8-258a0d31744e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:48.228876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59334feb-ddfa-4602-9db8-258a0d31744e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:48.288497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Updating instance_info_cache with network_info: [{"id": "0cf1d658-7c84-403d-9a60-9404b627e728", "address": "fa:16:3e:02:2d:41", "network": {"id": "cb97ef06-3d0b-442a-856c-1db8f276297a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1923215030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b037c54b761428db4df46b975b70574", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap0cf1d658-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 21:04:48.304353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Releasing lock "refresh_cache-66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" {{(pid=140731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 21:04:48.305099 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59334feb-ddfa-4602-9db8-258a0d31744e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.091176 Dec 18 21:04:48.305896 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2375/4748] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:48 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:48.307766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8841d510-fae7-4662-be31-cb13c6966b70 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action" status: 202 len: 0 microversion: 2.1 time: 5.750746 Dec 18 21:04:48.311958 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2374/4749] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:04:42 2021] POST /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25/action => generated 0 bytes in 5756 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 18 21:04:48.322309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c06b4f2e-95ad-48e9-9331-476c5008004d tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '.version_select at 0x7f7161392700>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:49.226617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:49.228514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:49.249984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.250915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:49.252081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.252897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:49.282850 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c06b4f2e-95ad-48e9-9331-476c5008004d tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/35f79737-1de2-4df6-b609-433524270b73" status: 202 len: 0 microversion: 2.1 time: 0.969474 Dec 18 21:04:49.285354 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2376/4750] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:04:48 2021] DELETE /compute/v2.1/os-floating-ips/35f79737-1de2-4df6-b609-433524270b73 => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:49.293846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-77aabaf5-6362-4c91-b5b5-f149a1e4522f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '.version_select at 0x7f714fc73ca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:49.547916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:49.556880 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47b08257-1207-40a2-b7c1-155bf1f09c9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.334460 Dec 18 21:04:49.557905 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2375/4751] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:49 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:49.564360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-30fd673f-8db0-41ea-9343-14f36ea2d06e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:49.566494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-30fd673f-8db0-41ea-9343-14f36ea2d06e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:49.574443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30fd673f-8db0-41ea-9343-14f36ea2d06e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.575091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30fd673f-8db0-41ea-9343-14f36ea2d06e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:49.575990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30fd673f-8db0-41ea-9343-14f36ea2d06e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.577293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30fd673f-8db0-41ea-9343-14f36ea2d06e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:49.622353 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-30fd673f-8db0-41ea-9343-14f36ea2d06e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.062839 Dec 18 21:04:49.623174 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2376/4752] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:49 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:49.674859 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-77aabaf5-6362-4c91-b5b5-f149a1e4522f tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/85da10aa-9a0b-4f65-abee-6ab4407610a7" status: 202 len: 0 microversion: 2.1 time: 0.384241 Dec 18 21:04:49.675570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2377/4753] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:04:49 2021] DELETE /compute/v2.1/os-security-groups/85da10aa-9a0b-4f65-abee-6ab4407610a7 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:49.684905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:49.685489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:49.693516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.694470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:49.695479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.696094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:49.729863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:04:49.849212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-451957f6-338f-43e0-bffb-e4ebdec5af8e tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 204 len: 0 microversion: 2.1 time: 0.167475 Dec 18 21:04:49.849829 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2377/4754] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:04:49 2021] DELETE /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:04:49.857773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:49.858704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:49.866506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.867083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:49.867988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:49.868540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:50.020936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:50.028746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98d8a4f3-2f47-469b-90ea-986a091ea9d4 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1511 microversion: 2.1 time: 0.174589 Dec 18 21:04:50.030905 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2378/4755] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:49 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:04:50.580568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:50.581609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:50.591794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:50.593699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:50.594832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:50.595282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:50.635209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-273a3131-2312-4abf-892e-d047487923a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:50.636819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-273a3131-2312-4abf-892e-d047487923a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:50.644285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a3131-2312-4abf-892e-d047487923a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:50.644961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a3131-2312-4abf-892e-d047487923a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:50.646597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a3131-2312-4abf-892e-d047487923a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:50.647204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-273a3131-2312-4abf-892e-d047487923a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:50.699303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-273a3131-2312-4abf-892e-d047487923a7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.067471 Dec 18 21:04:50.701256 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2379/4756] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:50 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:50.921898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:50.929751 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-faeb0efe-b112-4576-9087-4cf188ce39e2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.359221 Dec 18 21:04:50.930707 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2378/4757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:50 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:51.050868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:51.052601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:51.064747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:51.066694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:51.068197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:51.069120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:51.470426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:51.481873 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5fa0c738-6480-4504-b14e-7102442c07fb tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1511 microversion: 2.1 time: 0.438065 Dec 18 21:04:51.506438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2380/4758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:51 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:51.720628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07db9876-bec1-4cab-8050-c24b2d9d04fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:51.721801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07db9876-bec1-4cab-8050-c24b2d9d04fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:51.743582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07db9876-bec1-4cab-8050-c24b2d9d04fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:51.744178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07db9876-bec1-4cab-8050-c24b2d9d04fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:51.745062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07db9876-bec1-4cab-8050-c24b2d9d04fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:51.745505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07db9876-bec1-4cab-8050-c24b2d9d04fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:51.806346 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07db9876-bec1-4cab-8050-c24b2d9d04fe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.097521 Dec 18 21:04:51.813228 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2379/4759] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:51 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:51.948465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:51.949853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:51.964202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:51.965914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:51.967865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:51.970017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:52.466959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:52.486756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e534dd6-3340-4ebb-9199-04a036c854a5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.542169 Dec 18 21:04:52.490054 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2381/4760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:51 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:52.508268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:52.509539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:52.524896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:52.525794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:52.527604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:52.528799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:52.822618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-401ab63c-d046-45b8-b666-f8e49bd7de07 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:52.824916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-401ab63c-d046-45b8-b666-f8e49bd7de07 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:52.834376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-401ab63c-d046-45b8-b666-f8e49bd7de07 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:52.835116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-401ab63c-d046-45b8-b666-f8e49bd7de07 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:52.836145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-401ab63c-d046-45b8-b666-f8e49bd7de07 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:52.836812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-401ab63c-d046-45b8-b666-f8e49bd7de07 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:52.900531 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-401ab63c-d046-45b8-b666-f8e49bd7de07 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.083420 Dec 18 21:04:52.904051 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2382/4761] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:52 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:53.146155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0012ccb14865485192056087c9926493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037c54b761428db4df46b975b70574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:53.159909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86e28495-5a5a-45df-99d2-1caf82260783 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 200 len: 1511 microversion: 2.1 time: 0.661447 Dec 18 21:04:53.175879 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2380/4762] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:52 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 1511 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:53.385097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b9b6b536-2ef9-46c3-b848-69d896063b71 req-f87628a4-09d8-4830-a09b-54bac9ce37fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66babd8d-06b0-4cb2-8e2e-d37c5e1aae25", "name": "network-vif-deleted", "tag": "0cf1d658-7c84-403d-9a60-9404b627e728"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:53.391761 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:53.391761 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:04:53.414997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9b6b536-2ef9-46c3-b848-69d896063b71 req-f87628a4-09d8-4830-a09b-54bac9ce37fa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:53.415793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b9b6b536-2ef9-46c3-b848-69d896063b71 req-f87628a4-09d8-4830-a09b-54bac9ce37fa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:53.438941 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b9b6b536-2ef9-46c3-b848-69d896063b71 req-f87628a4-09d8-4830-a09b-54bac9ce37fa service nova] Creating event network-vif-deleted:0cf1d658-7c84-403d-9a60-9404b627e728 for instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 on nch2-master-1 Dec 18 21:04:53.455572 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b9b6b536-2ef9-46c3-b848-69d896063b71 req-f87628a4-09d8-4830-a09b-54bac9ce37fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080605 Dec 18 21:04:53.456438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2383/4763] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:53.510121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:53.511338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:53.545965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:53.546766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:53.550289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:53.550927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:53.916230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-06f5c96c-0186-48eb-bd0a-fdc7fc6dea29 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:53.917522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-06f5c96c-0186-48eb-bd0a-fdc7fc6dea29 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:53.927887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06f5c96c-0186-48eb-bd0a-fdc7fc6dea29 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:53.929009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06f5c96c-0186-48eb-bd0a-fdc7fc6dea29 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:53.930035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06f5c96c-0186-48eb-bd0a-fdc7fc6dea29 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:53.930661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06f5c96c-0186-48eb-bd0a-fdc7fc6dea29 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:54.004155 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-06f5c96c-0186-48eb-bd0a-fdc7fc6dea29 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.092842 Dec 18 21:04:54.006724 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2384/4764] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:53 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:04:54.190392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:54.192890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] [instance: 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:54.208749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:54.211561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:54.215588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:54.216226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:54.244933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] HTTP exception thrown: Instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 could not be found. Dec 18 21:04:54.246101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] Returning 404 to user: Instance 66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:04:54.259626 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82bef152-899e-4e14-9cdc-b523d0558fc0 tempest-ServerRescueTestJSONUnderV235-1001053277 tempest-ServerRescueTestJSONUnderV235-1001053277-project] 10.222.0.13 "GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25" status: 404 len: 111 microversion: 2.1 time: 0.083040 Dec 18 21:04:54.261904 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2385/4765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:54 2021] GET /compute/v2.1/servers/66babd8d-06b0-4cb2-8e2e-d37c5e1aae25 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:04:54.359736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:54.376650 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e4a81d2-cbfd-46f3-962b-22974d84a983 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.872410 Dec 18 21:04:54.378942 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2381/4766] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:53 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:55.017143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4b980974-6a1e-4567-8fd6-26d63be1a85a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:55.018749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b980974-6a1e-4567-8fd6-26d63be1a85a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:55.026542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b980974-6a1e-4567-8fd6-26d63be1a85a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:55.027271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b980974-6a1e-4567-8fd6-26d63be1a85a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:55.028278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b980974-6a1e-4567-8fd6-26d63be1a85a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:55.028892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b980974-6a1e-4567-8fd6-26d63be1a85a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:55.083026 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4b980974-6a1e-4567-8fd6-26d63be1a85a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.069144 Dec 18 21:04:55.084650 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2386/4767] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:55 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:55.394959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:55.395621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:55.411572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:55.413805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:55.415344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:55.416254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:55.941525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:55.956499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a48e04f-b697-4114-b5e0-886188a91c25 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.565027 Dec 18 21:04:55.966877 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2382/4768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:55 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:56.096207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8599cd5b-08bd-4219-9a38-b149e73c23bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:56.099202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8599cd5b-08bd-4219-9a38-b149e73c23bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:56.115479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8599cd5b-08bd-4219-9a38-b149e73c23bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:56.116216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8599cd5b-08bd-4219-9a38-b149e73c23bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:56.117246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8599cd5b-08bd-4219-9a38-b149e73c23bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:56.123700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8599cd5b-08bd-4219-9a38-b149e73c23bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:56.219421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8599cd5b-08bd-4219-9a38-b149e73c23bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.127213 Dec 18 21:04:56.221092 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2387/4769] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:56 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:56.695395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4bc2a96b-e0f5-422a-80f5-3526028c8058 req-56292758-8a26-48ba-8298-d6e521283f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7488031b-21d1-4bf2-a8fe-baa195bfbaa5", "name": "network-vif-plugged", "status": "completed", "tag": "d6333a5a-affa-48cd-b5d2-09b57546245d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:56.697653 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:04:56.697653 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:04:56.720330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4bc2a96b-e0f5-422a-80f5-3526028c8058 req-56292758-8a26-48ba-8298-d6e521283f4c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:56.724755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4bc2a96b-e0f5-422a-80f5-3526028c8058 req-56292758-8a26-48ba-8298-d6e521283f4c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:56.753304 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4bc2a96b-e0f5-422a-80f5-3526028c8058 req-56292758-8a26-48ba-8298-d6e521283f4c service nova] Creating event network-vif-plugged:d6333a5a-affa-48cd-b5d2-09b57546245d for instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 on nch1-master-1 Dec 18 21:04:56.767598 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4bc2a96b-e0f5-422a-80f5-3526028c8058 req-56292758-8a26-48ba-8298-d6e521283f4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076905 Dec 18 21:04:56.774504 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2383/4770] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:04:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:04:56.983375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:56.984094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:56.997654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:56.998123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:56.998980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:56.999432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:57.238195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d89e6f89-c8c4-419b-ae43-8f33abfffa7b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:57.240029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d89e6f89-c8c4-419b-ae43-8f33abfffa7b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:57.249438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d89e6f89-c8c4-419b-ae43-8f33abfffa7b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:57.250363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d89e6f89-c8c4-419b-ae43-8f33abfffa7b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:57.251995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d89e6f89-c8c4-419b-ae43-8f33abfffa7b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:57.252770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d89e6f89-c8c4-419b-ae43-8f33abfffa7b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:57.323695 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d89e6f89-c8c4-419b-ae43-8f33abfffa7b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.091765 Dec 18 21:04:57.326878 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2384/4771] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:57 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:57.599604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:57.609815 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7cff1768-181c-4d31-b4cc-a9caf9103723 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.631409 Dec 18 21:04:57.620678 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2388/4772] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:56 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:58.339016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7879587-e080-4945-b3e4-8c2661f26ba9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:58.340043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7879587-e080-4945-b3e4-8c2661f26ba9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:58.354398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7879587-e080-4945-b3e4-8c2661f26ba9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:58.355162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7879587-e080-4945-b3e4-8c2661f26ba9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:58.356161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7879587-e080-4945-b3e4-8c2661f26ba9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:58.356782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7879587-e080-4945-b3e4-8c2661f26ba9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:58.447227 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7879587-e080-4945-b3e4-8c2661f26ba9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.111805 Dec 18 21:04:58.449826 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2385/4773] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:58 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:04:58.628475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:04:58.630990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:58.640619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:58.641315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:58.643863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:58.644545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:59.028404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:04:59.057246 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2d9377e-25bb-4dd4-b6ad-1e09e8a71fec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1315 microversion: 2.1 time: 0.433526 Dec 18 21:04:59.070896 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2389/4774] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:04:58 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:04:59.462548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4dd73ac3-35c9-46c5-a827-ab9074a7d197 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:04:59.464271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4dd73ac3-35c9-46c5-a827-ab9074a7d197 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:04:59.471597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dd73ac3-35c9-46c5-a827-ab9074a7d197 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:59.472375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dd73ac3-35c9-46c5-a827-ab9074a7d197 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:59.473711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dd73ac3-35c9-46c5-a827-ab9074a7d197 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:04:59.474737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dd73ac3-35c9-46c5-a827-ab9074a7d197 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:04:59.527825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4dd73ac3-35c9-46c5-a827-ab9074a7d197 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.069775 Dec 18 21:04:59.534796 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2386/4775] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:04:59 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:00.075904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:00.077128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:00.091708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.092445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:00.093929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.094739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:00.545809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b94db25-65b4-4d4e-9fec-4abf8016a5a9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:00.547632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b94db25-65b4-4d4e-9fec-4abf8016a5a9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:00.567105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b94db25-65b4-4d4e-9fec-4abf8016a5a9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.568323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b94db25-65b4-4d4e-9fec-4abf8016a5a9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:00.569161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b94db25-65b4-4d4e-9fec-4abf8016a5a9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.569813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b94db25-65b4-4d4e-9fec-4abf8016a5a9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:00.593768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:00.601829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bdc1ae1-b2df-4ec4-897c-0546ac1fe028 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1501 microversion: 2.1 time: 0.529511 Dec 18 21:05:00.609204 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2390/4776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:00 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1501 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:00.629316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2dead92-9820-47f5-a6c2-51609347f6a8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:00.630687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2dead92-9820-47f5-a6c2-51609347f6a8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:00.640606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2dead92-9820-47f5-a6c2-51609347f6a8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.644739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2dead92-9820-47f5-a6c2-51609347f6a8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:00.645955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2dead92-9820-47f5-a6c2-51609347f6a8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.646665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2dead92-9820-47f5-a6c2-51609347f6a8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:00.675659 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b94db25-65b4-4d4e-9fec-4abf8016a5a9 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.133735 Dec 18 21:05:00.681983 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2387/4777] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:00 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:00.811284 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2dead92-9820-47f5-a6c2-51609347f6a8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5/action" status: 202 len: 0 microversion: 2.1 time: 0.185724 Dec 18 21:05:00.813393 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2391/4778] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:05:00 2021] POST /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:00.823611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:00.824623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:00.841252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.842163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:00.843388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:00.845003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:01.689664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12f47452-cebd-4e0a-8da8-85075149a54b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:01.690736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-12f47452-cebd-4e0a-8da8-85075149a54b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:01.703710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f47452-cebd-4e0a-8da8-85075149a54b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:01.711089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f47452-cebd-4e0a-8da8-85075149a54b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:01.712226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f47452-cebd-4e0a-8da8-85075149a54b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:01.712842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12f47452-cebd-4e0a-8da8-85075149a54b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:01.787412 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-12f47452-cebd-4e0a-8da8-85075149a54b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.100401 Dec 18 21:05:01.793572 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2392/4779] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:01 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:01.823602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:01.840567 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18786737-c930-4e62-933d-a8a3ee8fd967 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1506 microversion: 2.1 time: 1.021566 Dec 18 21:05:01.841745 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2388/4780] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:00 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1506 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:02.808590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc6270d2-a47b-4440-ab81-95a119ca3fa7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:02.810649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc6270d2-a47b-4440-ab81-95a119ca3fa7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:02.834777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6270d2-a47b-4440-ab81-95a119ca3fa7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:02.835567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6270d2-a47b-4440-ab81-95a119ca3fa7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:02.836842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6270d2-a47b-4440-ab81-95a119ca3fa7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:02.838228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6270d2-a47b-4440-ab81-95a119ca3fa7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:02.858454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:02.859260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:02.872305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:02.873800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:02.875265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:02.876504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:02.922007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc6270d2-a47b-4440-ab81-95a119ca3fa7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.119706 Dec 18 21:05:02.923024 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2393/4781] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:02 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:03.270893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:03.283482 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d425c150-d45a-4e99-ac00-463610b3b1e7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1486 microversion: 2.1 time: 0.428928 Dec 18 21:05:03.284190 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2389/4782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:02 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1486 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:03.303838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:03.305532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:03.312756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:03.314217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:03.315373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:03.316199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:03.357472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:05:03.496002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecbd9ceb-bb5a-4eda-8e62-03d144de0d45 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 204 len: 0 microversion: 2.1 time: 0.196465 Dec 18 21:05:03.500940 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2394/4783] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:05:03 2021] DELETE /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:05:03.509636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:03.510279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:03.522588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:03.523148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:03.523965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:03.524405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:03.914947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:03.920322 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-996606b0-09a4-40d4-b76d-4ef36b8b6f94 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1492 microversion: 2.1 time: 0.414943 Dec 18 21:05:03.933215 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2390/4784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:03 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1492 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:03.934581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc62f1f7-e605-4ae8-a8ff-66b134359d41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:03.935621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc62f1f7-e605-4ae8-a8ff-66b134359d41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:03.951859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc62f1f7-e605-4ae8-a8ff-66b134359d41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:03.951991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc62f1f7-e605-4ae8-a8ff-66b134359d41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:03.952709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc62f1f7-e605-4ae8-a8ff-66b134359d41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:03.953143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc62f1f7-e605-4ae8-a8ff-66b134359d41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:04.030967 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc62f1f7-e605-4ae8-a8ff-66b134359d41 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.098832 Dec 18 21:05:04.043530 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2395/4785] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:03 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:04.939326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:04.940976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:04.950904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:04.951385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:04.952380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:04.952820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:05.047848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a537d2a6-3a6b-40a5-bb9a-b36d8d461c17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:05.049666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a537d2a6-3a6b-40a5-bb9a-b36d8d461c17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:05.061712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a537d2a6-3a6b-40a5-bb9a-b36d8d461c17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:05.062768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a537d2a6-3a6b-40a5-bb9a-b36d8d461c17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:05.063875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a537d2a6-3a6b-40a5-bb9a-b36d8d461c17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:05.064498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a537d2a6-3a6b-40a5-bb9a-b36d8d461c17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:05.119928 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a537d2a6-3a6b-40a5-bb9a-b36d8d461c17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.077945 Dec 18 21:05:05.120618 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2396/4786] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:05 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:05.304558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:05.313568 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-94e3faea-025c-4701-99a3-6c5ad35f7de8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1492 microversion: 2.1 time: 0.378585 Dec 18 21:05:05.314856 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2391/4787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:04 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1492 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:06.132770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fb9f082-b502-4dd1-912b-222025836233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:06.134514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fb9f082-b502-4dd1-912b-222025836233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:06.142638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb9f082-b502-4dd1-912b-222025836233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:06.143413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb9f082-b502-4dd1-912b-222025836233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:06.144389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb9f082-b502-4dd1-912b-222025836233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:06.144671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb9f082-b502-4dd1-912b-222025836233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:06.214358 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fb9f082-b502-4dd1-912b-222025836233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.082303 Dec 18 21:05:06.215691 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2397/4788] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:06 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:06.333752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:06.334478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:06.344379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:06.344840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:06.346847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:06.347484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:06.720585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:06.740838 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c579840-adb0-461e-9f69-35cd8660e9a9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1492 microversion: 2.1 time: 0.413300 Dec 18 21:05:06.741554 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2392/4789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:06 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1492 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:07.250757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98a51e90-20aa-4eb4-af89-9d03227ad92b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:07.250757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-98a51e90-20aa-4eb4-af89-9d03227ad92b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:07.270243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98a51e90-20aa-4eb4-af89-9d03227ad92b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:07.270744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98a51e90-20aa-4eb4-af89-9d03227ad92b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:07.274228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98a51e90-20aa-4eb4-af89-9d03227ad92b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:07.274723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98a51e90-20aa-4eb4-af89-9d03227ad92b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:07.373178 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98a51e90-20aa-4eb4-af89-9d03227ad92b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.144654 Dec 18 21:05:07.380874 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2398/4790] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:07 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:07.421719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-dc682d49-a3c4-4423-8945-e1a0f925b075 req-6a82ec68-db04-498a-9423-9d73e5e53d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7488031b-21d1-4bf2-a8fe-baa195bfbaa5", "name": "network-vif-deleted", "tag": "d6333a5a-affa-48cd-b5d2-09b57546245d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:07.427373 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:05:07.427373 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:05:07.467371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-dc682d49-a3c4-4423-8945-e1a0f925b075 req-6a82ec68-db04-498a-9423-9d73e5e53d27 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:07.469765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-dc682d49-a3c4-4423-8945-e1a0f925b075 req-6a82ec68-db04-498a-9423-9d73e5e53d27 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:07.509083 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-dc682d49-a3c4-4423-8945-e1a0f925b075 req-6a82ec68-db04-498a-9423-9d73e5e53d27 service nova] Creating event network-vif-deleted:d6333a5a-affa-48cd-b5d2-09b57546245d for instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 on nch1-master-1 Dec 18 21:05:07.516665 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-dc682d49-a3c4-4423-8945-e1a0f925b075 req-6a82ec68-db04-498a-9423-9d73e5e53d27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103177 Dec 18 21:05:07.517524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2393/4791] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:05:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:05:07.757813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:07.759674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:07.774969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:07.775635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:07.776577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:07.777153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:07.872210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:07.872673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:07.873178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lazy-loading 'fault' on Instance uuid 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:08.232000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:08.240739 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6859c812-b74b-442d-8d37-9aa83f0eef6e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 200 len: 1305 microversion: 2.1 time: 0.486154 Dec 18 21:05:08.244952 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2399/4792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:07 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 1305 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:08.391364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c4b55f1-03bf-4421-9e94-c40cbf78b988 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:08.392572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1c4b55f1-03bf-4421-9e94-c40cbf78b988 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:08.404825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c4b55f1-03bf-4421-9e94-c40cbf78b988 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:08.405605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c4b55f1-03bf-4421-9e94-c40cbf78b988 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:08.407894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c4b55f1-03bf-4421-9e94-c40cbf78b988 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:08.408552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c4b55f1-03bf-4421-9e94-c40cbf78b988 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:08.470571 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c4b55f1-03bf-4421-9e94-c40cbf78b988 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.084263 Dec 18 21:05:08.476006 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2394/4793] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:08 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:09.259053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:09.259674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:09.269014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:09.269489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:09.270876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:09.271655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:09.317827 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 could not be found. Dec 18 21:05:09.318453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:05:09.319298 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70fdc950-0f7d-4107-8f37-d4e15eb9aaa6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 404 len: 111 microversion: 2.1 time: 0.064152 Dec 18 21:05:09.319865 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2400/4794] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:09 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:05:09.484091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e3a95fa-5ad4-4ae9-a1b4-cb79185242a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:09.485836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7e3a95fa-5ad4-4ae9-a1b4-cb79185242a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:09.499659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e3a95fa-5ad4-4ae9-a1b4-cb79185242a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:09.500170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e3a95fa-5ad4-4ae9-a1b4-cb79185242a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:09.506871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e3a95fa-5ad4-4ae9-a1b4-cb79185242a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:09.507135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e3a95fa-5ad4-4ae9-a1b4-cb79185242a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:09.532342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-311742411", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "02107735-1e4a-434f-a377-a881410f569a"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:09.624877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] validate_networks() for [('02107735-1e4a-434f-a377-a881410f569a', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:05:09.626184 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7e3a95fa-5ad4-4ae9-a1b4-cb79185242a8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.145899 Dec 18 21:05:09.627495 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2395/4795] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:09 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:10.640811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2931de3e-40ec-4c7f-a8fd-98bbbd20fa3e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:10.642934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2931de3e-40ec-4c7f-a8fd-98bbbd20fa3e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:10.653470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2931de3e-40ec-4c7f-a8fd-98bbbd20fa3e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:10.654102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2931de3e-40ec-4c7f-a8fd-98bbbd20fa3e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:10.655069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2931de3e-40ec-4c7f-a8fd-98bbbd20fa3e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:10.655653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2931de3e-40ec-4c7f-a8fd-98bbbd20fa3e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:10.724703 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2931de3e-40ec-4c7f-a8fd-98bbbd20fa3e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.088602 Dec 18 21:05:10.726273 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2396/4796] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:10 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:10.875216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:05:10.875697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:05:10.877396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:05:10.878870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:05:10.880247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:05:10.910725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:10.915281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:10.919546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:10.923160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:10.960396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:05:10.970194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for user 0a98795bdb7447c5b2a4930173b3c56d and project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:05:10.987474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:05:10.993267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:05:11.104369 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4bd242de-c33b-4d01-b974-e997af7f5deb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572077 Dec 18 21:05:11.107042 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2401/4797] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:05:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:05:11.121871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6c3976f3-2448-4f49-9c6f-d12819546326 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:11.123250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6c3976f3-2448-4f49-9c6f-d12819546326 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:11.303640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6c3976f3-2448-4f49-9c6f-d12819546326 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:11.324335 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6c3976f3-2448-4f49-9c6f-d12819546326 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1214 microversion: 2.1 time: 0.210458 Dec 18 21:05:11.326842 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2397/4798] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:11 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:11.745494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dcb3394d-a6bd-4131-9fbc-2b12f4bb9e63 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:11.750341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dcb3394d-a6bd-4131-9fbc-2b12f4bb9e63 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:11.781003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcb3394d-a6bd-4131-9fbc-2b12f4bb9e63 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:11.784473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcb3394d-a6bd-4131-9fbc-2b12f4bb9e63 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:11.787859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcb3394d-a6bd-4131-9fbc-2b12f4bb9e63 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:11.788892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcb3394d-a6bd-4131-9fbc-2b12f4bb9e63 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:11.890476 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dcb3394d-a6bd-4131-9fbc-2b12f4bb9e63 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.151340 Dec 18 21:05:11.899991 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2402/4799] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:11 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:12.342170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:12.342847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:12.355460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:12.356413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:12.358068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:12.359226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:12.523994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:12.531522 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bdda8e36-2562-4188-8da5-a05598a3719d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1266 microversion: 2.1 time: 0.193037 Dec 18 21:05:12.536479 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2398/4800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:12 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:12.907702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82706f8b-4382-4f94-8011-c89f83147abb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:12.908799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82706f8b-4382-4f94-8011-c89f83147abb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:12.918104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82706f8b-4382-4f94-8011-c89f83147abb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:12.918518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82706f8b-4382-4f94-8011-c89f83147abb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:12.919335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82706f8b-4382-4f94-8011-c89f83147abb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:12.919780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82706f8b-4382-4f94-8011-c89f83147abb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:12.975216 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82706f8b-4382-4f94-8011-c89f83147abb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.073189 Dec 18 21:05:12.976076 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2403/4801] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:12 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:13.553427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:13.554501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:13.573097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:13.573848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:13.574848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:13.575682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:13.688012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1066970709", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "61751535-154f-43e5-aa8b-ae2d40f188eb"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:13.699093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:13.715971 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32dfd067-3f02-4858-b50d-d7e638b42241 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1272 microversion: 2.1 time: 0.166689 Dec 18 21:05:13.719455 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2404/4802] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:13 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:13.766156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] validate_networks() for [('61751535-154f-43e5-aa8b-ae2d40f188eb', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:05:13.987704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4955765f-c6c0-4dc7-a418-9265702a0d40 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:13.991587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4955765f-c6c0-4dc7-a418-9265702a0d40 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:14.011647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4955765f-c6c0-4dc7-a418-9265702a0d40 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:14.012332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4955765f-c6c0-4dc7-a418-9265702a0d40 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:14.013419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4955765f-c6c0-4dc7-a418-9265702a0d40 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:14.014041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4955765f-c6c0-4dc7-a418-9265702a0d40 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:14.075014 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4955765f-c6c0-4dc7-a418-9265702a0d40 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.091108 Dec 18 21:05:14.076309 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2405/4803] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:13 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:14.352214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:05:14.352903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:05:14.353603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:05:14.354782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:05:14.355391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:05:14.366646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:14.367371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:14.368629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:14.369491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:14.392125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Getting quotas for project a7fbf6906e5d404c916ff274e95066ba. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:05:14.398182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Getting quotas for user 1715a99625764d63a18f2191e297ae1d and project a7fbf6906e5d404c916ff274e95066ba. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:05:14.415098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:05:14.418948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:05:14.475194 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-425f692c-c2d5-45ff-bb64-9033098d12f7 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.995122 Dec 18 21:05:14.476374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2399/4804] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:05:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 21:05:14.486650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0f4adb9-416e-4b2c-9fbf-0e02e09edb9e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:14.487531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0f4adb9-416e-4b2c-9fbf-0e02e09edb9e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:14.582144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0f4adb9-416e-4b2c-9fbf-0e02e09edb9e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:14.594937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0f4adb9-416e-4b2c-9fbf-0e02e09edb9e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:14.598715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0f4adb9-416e-4b2c-9fbf-0e02e09edb9e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:14.599899 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0f4adb9-416e-4b2c-9fbf-0e02e09edb9e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1262 microversion: 2.26 time: 0.117630 Dec 18 21:05:14.600548 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2406/4805] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:14 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:14.735236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:14.736057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:14.752732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:14.753200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:14.755432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:14.756165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:14.946291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:14.965183 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a388e75b-5cc6-4fd2-8b09-7914aad7b986 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1272 microversion: 2.1 time: 0.231269 Dec 18 21:05:14.968701 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2400/4806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:14 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:15.089616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ededab3e-9c0a-4e0d-bba3-5715f49cf922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:15.090737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ededab3e-9c0a-4e0d-bba3-5715f49cf922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:15.118199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ededab3e-9c0a-4e0d-bba3-5715f49cf922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:15.125181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ededab3e-9c0a-4e0d-bba3-5715f49cf922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:15.127126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ededab3e-9c0a-4e0d-bba3-5715f49cf922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:15.127742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ededab3e-9c0a-4e0d-bba3-5715f49cf922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:15.244255 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ededab3e-9c0a-4e0d-bba3-5715f49cf922 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.157722 Dec 18 21:05:15.245832 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2407/4807] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:15 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:15.619039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:15.619891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:15.626788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:15.627495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:15.628444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:15.629523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:15.738753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:15.756444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:15.759017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:15.765861 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3118abc9-8fb7-4f1c-a888-83ffa6017338 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1314 microversion: 2.26 time: 0.149644 Dec 18 21:05:15.765861 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2401/4808] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:15 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:15.985459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:15.986521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:15.994080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:15.994858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:15.995947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:15.996599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:16.261552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1e7439c-ead9-4a35-b0f7-a5912405bb79 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:16.263010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1e7439c-ead9-4a35-b0f7-a5912405bb79 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:16.270841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e7439c-ead9-4a35-b0f7-a5912405bb79 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:16.271643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e7439c-ead9-4a35-b0f7-a5912405bb79 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:16.272711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e7439c-ead9-4a35-b0f7-a5912405bb79 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:16.273353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1e7439c-ead9-4a35-b0f7-a5912405bb79 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:16.289206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:16.299482 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-124a4ca1-dde3-46d7-a420-c6e54130f3f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.318090 Dec 18 21:05:16.312552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2408/4809] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:15 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:16.339516 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1e7439c-ead9-4a35-b0f7-a5912405bb79 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.081668 Dec 18 21:05:16.342189 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2402/4810] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:16 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:16.784242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:16.785389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:16.793158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:16.793729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:16.794668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:16.795201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:16.885094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:16.896721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:16.898351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:16.899476 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56eca41a-d039-4eed-8572-aff29ecfc595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1320 microversion: 2.26 time: 0.119386 Dec 18 21:05:16.913224 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2409/4811] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:16 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1320 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:17.320232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:17.322049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:17.336802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:17.337525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:17.338570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:17.339147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:17.354753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f24ff1c8-bd00-4792-9958-03ccecf1c946 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:17.356329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f24ff1c8-bd00-4792-9958-03ccecf1c946 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:17.366762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24ff1c8-bd00-4792-9958-03ccecf1c946 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:17.369367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24ff1c8-bd00-4792-9958-03ccecf1c946 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:17.370402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24ff1c8-bd00-4792-9958-03ccecf1c946 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:17.370855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24ff1c8-bd00-4792-9958-03ccecf1c946 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:17.438737 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f24ff1c8-bd00-4792-9958-03ccecf1c946 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.088006 Dec 18 21:05:17.442472 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2410/4812] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:17 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:17.920738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:17.921532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:17.930719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:17.931453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:17.932429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:17.933022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:18.201386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:18.208165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:18.216079 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2704c38b-63f8-40a5-a851-972e3c201838 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.902498 Dec 18 21:05:18.216677 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2403/4813] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:17 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:18.219212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:18.225538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:18.230599 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9795e872-40d3-4fca-b3dc-83a81deb0b00 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1320 microversion: 2.26 time: 0.314498 Dec 18 21:05:18.233309 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2411/4814] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:17 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:05:18.452184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf8f705b-6468-4e5f-ae04-2e5df3865917 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:18.454278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf8f705b-6468-4e5f-ae04-2e5df3865917 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:18.465295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f705b-6468-4e5f-ae04-2e5df3865917 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:18.466244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f705b-6468-4e5f-ae04-2e5df3865917 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:18.467082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f705b-6468-4e5f-ae04-2e5df3865917 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:18.467672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf8f705b-6468-4e5f-ae04-2e5df3865917 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:18.518029 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf8f705b-6468-4e5f-ae04-2e5df3865917 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.069884 Dec 18 21:05:18.519439 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2404/4815] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:18 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:19.189225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1c9a1955-03ec-48b5-9b78-b86ca3216e83 req-fa429454-ff33-4c4e-9416-44ab1f25d592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab9b708f-24ca-4dad-9e48-ce4b71edf595", "tag": "39f33934-8809-44c6-97cd-68c74a5bf74c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:19.194296 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:05:19.194296 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:05:19.218806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1c9a1955-03ec-48b5-9b78-b86ca3216e83 req-fa429454-ff33-4c4e-9416-44ab1f25d592 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:19.219453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1c9a1955-03ec-48b5-9b78-b86ca3216e83 req-fa429454-ff33-4c4e-9416-44ab1f25d592 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:19.235402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:19.236167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:19.262805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:19.263368 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1c9a1955-03ec-48b5-9b78-b86ca3216e83 req-fa429454-ff33-4c4e-9416-44ab1f25d592 service nova] Creating event network-changed:39f33934-8809-44c6-97cd-68c74a5bf74c for instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 on nch1-master-1 Dec 18 21:05:19.266900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:19.271070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:19.271982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1c9a1955-03ec-48b5-9b78-b86ca3216e83 req-fa429454-ff33-4c4e-9416-44ab1f25d592 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088589 Dec 18 21:05:19.272549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:19.273938 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2412/4816] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:05:19.287858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:19.289139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:19.299484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:19.300998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:19.302073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:19.304680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:20.013211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:20.024598 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2d4e308-b971-491e-9146-024258388ee9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.795006 Dec 18 21:05:20.042861 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2405/4817] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:19 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:20.049879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9af34250-1d87-48af-9e54-8bee8c54746c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:20.053479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9af34250-1d87-48af-9e54-8bee8c54746c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:20.066457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:20.076763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:20.087036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:20.087347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9af34250-1d87-48af-9e54-8bee8c54746c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:20.087939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9af34250-1d87-48af-9e54-8bee8c54746c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:20.088911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9af34250-1d87-48af-9e54-8bee8c54746c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:20.090243 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-276d03e1-d12e-41bf-abac-5c77add76e4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.814477 Dec 18 21:05:20.090851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9af34250-1d87-48af-9e54-8bee8c54746c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:20.093078 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2413/4818] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:19 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:20.160420 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9af34250-1d87-48af-9e54-8bee8c54746c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.115415 Dec 18 21:05:20.170650 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2406/4819] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:20 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:21.049411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:21.053272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:21.074042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:21.074841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:21.078305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:21.079069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:21.119497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:21.121451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:21.144109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:21.144978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:21.146110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:21.146997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:21.558213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:21.570731 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7443a830-85e1-42c8-a27e-345c5f814416 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.528619 Dec 18 21:05:21.572498 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2414/4820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:21 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:21.582580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89bbc4ed-8370-4c5a-99b6-a76198208967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:21.583732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89bbc4ed-8370-4c5a-99b6-a76198208967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:21.602381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bbc4ed-8370-4c5a-99b6-a76198208967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:21.603115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bbc4ed-8370-4c5a-99b6-a76198208967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:21.604082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bbc4ed-8370-4c5a-99b6-a76198208967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:21.606613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89bbc4ed-8370-4c5a-99b6-a76198208967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:21.681714 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89bbc4ed-8370-4c5a-99b6-a76198208967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.107784 Dec 18 21:05:21.682636 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2415/4821] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:21 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:21.689587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b339dc19-3517-4706-8ab9-d7b51b3956dc req-c87b082f-bbd1-4f50-9f17-9f1af53a1279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650905b4-027a-40af-ae95-18573c57937e", "tag": "0dfa8a69-260f-46f9-a552-d8a5455e8dbe"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:21.693418 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:05:21.693418 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:05:21.697517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:21.706522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:21.711423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:21.717991 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d4e6a45-55a7-4e2b-91f6-3135360889b3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.602887 Dec 18 21:05:21.719207 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2407/4822] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:21 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:21.749715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b339dc19-3517-4706-8ab9-d7b51b3956dc req-c87b082f-bbd1-4f50-9f17-9f1af53a1279 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:21.751412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b339dc19-3517-4706-8ab9-d7b51b3956dc req-c87b082f-bbd1-4f50-9f17-9f1af53a1279 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:21.771019 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b339dc19-3517-4706-8ab9-d7b51b3956dc req-c87b082f-bbd1-4f50-9f17-9f1af53a1279 service nova] Creating event network-changed:0dfa8a69-260f-46f9-a552-d8a5455e8dbe for instance 650905b4-027a-40af-ae95-18573c57937e on nch2-master-1 Dec 18 21:05:21.777122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b339dc19-3517-4706-8ab9-d7b51b3956dc req-c87b082f-bbd1-4f50-9f17-9f1af53a1279 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092986 Dec 18 21:05:21.778011 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2416/4823] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:05:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:05:22.607022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:22.609422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:22.625041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:22.626143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:22.627178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:22.627808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:22.694600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f46a8d0-972f-4c3f-8bc8-16b13d2223ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:22.696536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f46a8d0-972f-4c3f-8bc8-16b13d2223ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:22.708246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f46a8d0-972f-4c3f-8bc8-16b13d2223ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:22.713071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f46a8d0-972f-4c3f-8bc8-16b13d2223ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:22.714138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f46a8d0-972f-4c3f-8bc8-16b13d2223ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:22.714818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f46a8d0-972f-4c3f-8bc8-16b13d2223ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:22.773311 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f46a8d0-972f-4c3f-8bc8-16b13d2223ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.083387 Dec 18 21:05:22.778859 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2417/4824] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:22 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:22.786934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:22.788871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:22.799902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:22.801927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:22.803781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:22.805030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:23.005709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:23.014199 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1cb2357c-929c-45bb-8509-fb2f2f22e6de tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.413795 Dec 18 21:05:23.024493 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2408/4825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:22 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:23.228877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:23.250852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:23.253424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:23.256305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c53a3c4-0608-476c-977a-757cfe0111f3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.474965 Dec 18 21:05:23.258973 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2418/4826] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:22 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:23.792082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d97a3fa-be2b-4b49-9428-b288165def89 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:23.795329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d97a3fa-be2b-4b49-9428-b288165def89 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:23.805184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d97a3fa-be2b-4b49-9428-b288165def89 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:23.805926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d97a3fa-be2b-4b49-9428-b288165def89 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:23.806953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d97a3fa-be2b-4b49-9428-b288165def89 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:23.808608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d97a3fa-be2b-4b49-9428-b288165def89 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:23.887651 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d97a3fa-be2b-4b49-9428-b288165def89 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.103843 Dec 18 21:05:23.888949 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2409/4827] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:23 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:24.032157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:24.032853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:24.044509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:24.045292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:24.046383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:24.047036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:24.276863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:24.277824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:24.286064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:24.286951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:24.287975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:24.288628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:24.466965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:24.485252 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f73e57a7-f9b2-44da-a132-3f5f71655489 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.456624 Dec 18 21:05:24.488230 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2419/4828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:24 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:24.742913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:24.755208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:24.757022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:24.758644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68bd2cc0-2d44-4ead-abf1-d75b4dd12ec1 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.486062 Dec 18 21:05:24.772619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2410/4829] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:24 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:05:24.899845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82c6914d-477c-4c86-8302-ca5fccf37774 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:24.900781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82c6914d-477c-4c86-8302-ca5fccf37774 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:24.914975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82c6914d-477c-4c86-8302-ca5fccf37774 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:24.915661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82c6914d-477c-4c86-8302-ca5fccf37774 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:24.916665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82c6914d-477c-4c86-8302-ca5fccf37774 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:24.917569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82c6914d-477c-4c86-8302-ca5fccf37774 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:25.011299 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82c6914d-477c-4c86-8302-ca5fccf37774 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.115277 Dec 18 21:05:25.013552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2420/4830] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:24 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:25.503100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:25.503761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:25.525264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:25.527025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:25.528013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:25.528755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:25.787121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:25.788582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:25.805872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:25.807790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:25.809106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:25.811944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:25.812801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:25.826217 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a1eb6cd8-5c25-444c-8591-63926dbfcd90 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.326365 Dec 18 21:05:25.827205 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2411/4831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:25 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:26.007604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:26.016049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:26.018503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:26.020775 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4383b217-e29e-4455-82f2-63e37ec642e2 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.247453 Dec 18 21:05:26.031699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86d6dc8b-10e9-48e8-ab9a-21fab9a98d67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:26.031699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86d6dc8b-10e9-48e8-ab9a-21fab9a98d67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:26.031848 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2421/4832] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:25 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:26.035513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d6dc8b-10e9-48e8-ab9a-21fab9a98d67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:26.035979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d6dc8b-10e9-48e8-ab9a-21fab9a98d67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:26.041769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d6dc8b-10e9-48e8-ab9a-21fab9a98d67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:26.042234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d6dc8b-10e9-48e8-ab9a-21fab9a98d67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:26.109548 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86d6dc8b-10e9-48e8-ab9a-21fab9a98d67 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.087836 Dec 18 21:05:26.110242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2412/4833] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:26 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:26.845170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:26.845753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:26.860735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:26.861201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:26.862026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:26.862661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:27.042166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:27.042987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:27.057354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:27.057972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:27.063535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:27.064214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:27.485541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:27.511009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:27.524032 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f280871d-127e-43a8-8176-95ddab2454f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.680878 Dec 18 21:05:27.528444 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2422/4834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:26 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:27.532065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:27.536616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:27.537794 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e131ad6-c37a-4aae-a0f3-ea2b309ae6c0 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.500447 Dec 18 21:05:27.538385 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2413/4835] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:27 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:27.544703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72b4169e-ffde-4674-9468-0c01be4dcf68 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:27.555049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72b4169e-ffde-4674-9468-0c01be4dcf68 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:27.567428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72b4169e-ffde-4674-9468-0c01be4dcf68 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:27.567887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72b4169e-ffde-4674-9468-0c01be4dcf68 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:27.570632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72b4169e-ffde-4674-9468-0c01be4dcf68 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:27.571348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72b4169e-ffde-4674-9468-0c01be4dcf68 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:27.628444 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72b4169e-ffde-4674-9468-0c01be4dcf68 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.087977 Dec 18 21:05:27.630867 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2423/4836] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:27 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:28.549409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:28.551561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:28.556960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:28.558457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:28.569613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:28.571761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:28.572750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:28.573575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:28.574238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:28.583011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:28.583876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:28.584519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:29.399314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:29.407910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:29.408397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:29.410639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:29.412298 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-942a1a53-4515-4552-9405-1945a06a988c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.859226 Dec 18 21:05:29.428196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2424/4837] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:28 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:29.434693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-33bd0e93-bd6d-42e9-9019-1a2f434a0c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:29.436022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-33bd0e93-bd6d-42e9-9019-1a2f434a0c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:29.436789 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c319457-c05a-49c0-b3dd-d0380d472fe4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.895023 Dec 18 21:05:29.437474 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2414/4838] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:28 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:29.444358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33bd0e93-bd6d-42e9-9019-1a2f434a0c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:29.446356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33bd0e93-bd6d-42e9-9019-1a2f434a0c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:29.447636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33bd0e93-bd6d-42e9-9019-1a2f434a0c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:29.448087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33bd0e93-bd6d-42e9-9019-1a2f434a0c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:29.462967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-52b4e079-92c3-4072-b476-b45c4078436c req-43ff8b53-9733-4e7c-a4fa-22dd9705e741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9b708f-24ca-4dad-9e48-ce4b71edf595", "name": "network-vif-plugged", "status": "completed", "tag": "39f33934-8809-44c6-97cd-68c74a5bf74c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:29.464697 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:05:29.464697 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:05:29.476771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-52b4e079-92c3-4072-b476-b45c4078436c req-43ff8b53-9733-4e7c-a4fa-22dd9705e741 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:29.477220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-52b4e079-92c3-4072-b476-b45c4078436c req-43ff8b53-9733-4e7c-a4fa-22dd9705e741 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:29.504163 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-52b4e079-92c3-4072-b476-b45c4078436c req-43ff8b53-9733-4e7c-a4fa-22dd9705e741 service nova] Creating event network-vif-plugged:39f33934-8809-44c6-97cd-68c74a5bf74c for instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 on nch1-master-1 Dec 18 21:05:29.514719 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-33bd0e93-bd6d-42e9-9019-1a2f434a0c9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.084751 Dec 18 21:05:29.518711 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-52b4e079-92c3-4072-b476-b45c4078436c req-43ff8b53-9733-4e7c-a4fa-22dd9705e741 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071465 Dec 18 21:05:29.520133 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2415/4839] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:05:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:05:29.522720 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2425/4840] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:29 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:30.445123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:30.447726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:30.459749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:30.460464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:30.461722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:30.464841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:30.474728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:30.475776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:30.476392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:30.477131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:30.479801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:30.481568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:31.153165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:31.162127 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48e1c1a1-7656-4c9f-84d2-c67f090db45f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1314 microversion: 2.1 time: 0.706851 Dec 18 21:05:31.172512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:31.177522 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2426/4841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:30 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:31.183635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:31.188504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f454e12-e57a-40bc-958c-dc0d2d7ebd16 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:31.190731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:31.193209 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9a43236a-462c-4d25-9574-8a14a34e24a4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 0.762626 Dec 18 21:05:31.195986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f454e12-e57a-40bc-958c-dc0d2d7ebd16 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:31.200162 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2416/4842] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:30 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:31.207686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-e57a-40bc-958c-dc0d2d7ebd16 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:31.208378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-e57a-40bc-958c-dc0d2d7ebd16 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:31.212310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-e57a-40bc-958c-dc0d2d7ebd16 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:31.214771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-e57a-40bc-958c-dc0d2d7ebd16 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:31.309192 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f454e12-e57a-40bc-958c-dc0d2d7ebd16 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.117484 Dec 18 21:05:31.310870 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2427/4843] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:31 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:31.576741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f0301f2f-a202-483b-b8af-861b09f7232f req-4fa2a7e4-e602-48c2-b0df-abedf8b7a174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650905b4-027a-40af-ae95-18573c57937e", "name": "network-vif-plugged", "status": "completed", "tag": "0dfa8a69-260f-46f9-a552-d8a5455e8dbe"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:31.579036 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:05:31.579036 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:05:31.594503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f0301f2f-a202-483b-b8af-861b09f7232f req-4fa2a7e4-e602-48c2-b0df-abedf8b7a174 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:31.596709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f0301f2f-a202-483b-b8af-861b09f7232f req-4fa2a7e4-e602-48c2-b0df-abedf8b7a174 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:31.619611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f0301f2f-a202-483b-b8af-861b09f7232f req-4fa2a7e4-e602-48c2-b0df-abedf8b7a174 service nova] Creating event network-vif-plugged:0dfa8a69-260f-46f9-a552-d8a5455e8dbe for instance 650905b4-027a-40af-ae95-18573c57937e on nch2-master-1 Dec 18 21:05:31.625430 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f0301f2f-a202-483b-b8af-861b09f7232f req-4fa2a7e4-e602-48c2-b0df-abedf8b7a174 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052278 Dec 18 21:05:31.626702 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2417/4844] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:05:32.195947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:32.196644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:32.210408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:32.215040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:32.218655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:32.218775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:32.222868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:32.223598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:32.236670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:32.238530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:32.239540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:32.242021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:33.069118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:33.076897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72863d2f-12de-47fa-af7a-1c6d305c9d21 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1500 microversion: 2.1 time: 0.885999 Dec 18 21:05:33.077498 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2428/4845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:32 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1500 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:33.085997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-079790b9-86d5-4290-b95d-b1807472de5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:33.104878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-079790b9-86d5-4290-b95d-b1807472de5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:33.116492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079790b9-86d5-4290-b95d-b1807472de5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:33.118012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079790b9-86d5-4290-b95d-b1807472de5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:33.119039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079790b9-86d5-4290-b95d-b1807472de5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:33.119622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-079790b9-86d5-4290-b95d-b1807472de5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:33.195179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:33.204327 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-079790b9-86d5-4290-b95d-b1807472de5e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.125532 Dec 18 21:05:33.205175 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2429/4846] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:33 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:33.210987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:33.213962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:33.217859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:33.226594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:33.232848 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0e30f3e-9855-451b-967d-103024207b60 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1362 microversion: 2.26 time: 1.018789 Dec 18 21:05:33.234004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:33.235569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:33.236812 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2418/4847] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:32 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1362 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:33.250215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:33.251288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:33.314905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lazy-loading 'flavor' on Instance uuid ab9b708f-24ca-4dad-9e48-ce4b71edf595 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:33.801310 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dedaeddf-8b2d-458e-bfa2-f01a68af62f5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595/action" status: 202 len: 0 microversion: 2.1 time: 0.594574 Dec 18 21:05:33.802508 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2430/4848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:05:33 2021] POST /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:33.810084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:33.811011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:33.819514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:33.820670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:33.821856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:33.822472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:34.218546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e4cd028c-44e5-482e-a237-9793fe389e1a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:34.220445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e4cd028c-44e5-482e-a237-9793fe389e1a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:34.232072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4cd028c-44e5-482e-a237-9793fe389e1a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:34.232894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4cd028c-44e5-482e-a237-9793fe389e1a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:34.234060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4cd028c-44e5-482e-a237-9793fe389e1a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:34.234715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4cd028c-44e5-482e-a237-9793fe389e1a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:34.304891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e4cd028c-44e5-482e-a237-9793fe389e1a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.090381 Dec 18 21:05:34.311689 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2431/4849] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:34 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:34.323094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:34.324231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:34.333918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:34.334722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:34.335855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:34.336913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:34.355448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:34.370510 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-73495168-76a7-4c66-bec8-dd5986896c5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.564019 Dec 18 21:05:34.379498 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2419/4850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:33 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:35.317846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7cb7cee-eafc-4108-b1c0-c271bc8bfe17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:35.319205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7cb7cee-eafc-4108-b1c0-c271bc8bfe17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:35.333051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7cb7cee-eafc-4108-b1c0-c271bc8bfe17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.333680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7cb7cee-eafc-4108-b1c0-c271bc8bfe17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.334645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7cb7cee-eafc-4108-b1c0-c271bc8bfe17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.341861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7cb7cee-eafc-4108-b1c0-c271bc8bfe17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.394784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:35.405032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:35.406586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:35.419788 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c02dc91-1324-416c-b550-cffd8818480c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1546 microversion: 2.26 time: 1.106555 Dec 18 21:05:35.420380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2432/4851] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:34 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1546 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:35.425609 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7cb7cee-eafc-4108-b1c0-c271bc8bfe17 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.111248 Dec 18 21:05:35.426158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:35.426570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:35.433630 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2420/4852] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:35 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:35.438918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.439366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.440177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.440715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.449597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714f5cb790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:35.466173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.467549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.469487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:35.479703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.480383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.482182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.484489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.552286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.553003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.570601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.571403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.609140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:35.632118 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba4f2d01-ff54-4035-98c4-dadb522ab550 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-128113870" status: 201 len: 0 microversion: 2.26 time: 0.193681 Dec 18 21:05:35.637180 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2421/4853] 10.222.0.13 () {62 vars in 1376 bytes} [Sat Dec 18 21:05:35 2021] PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-128113870 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Dec 18 21:05:35.644176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1b46064-656b-4f39-978a-2b2a6e41c630 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714f63b550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:35.656335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1b46064-656b-4f39-978a-2b2a6e41c630 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.657038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1b46064-656b-4f39-978a-2b2a6e41c630 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.671366 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1b46064-656b-4f39-978a-2b2a6e41c630 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-128113870" status: 204 len: 0 microversion: 2.26 time: 0.031829 Dec 18 21:05:35.687315 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2422/4854] 10.222.0.13 () {60 vars in 1357 bytes} [Sat Dec 18 21:05:35 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-128113870 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:05:35.703284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714f63b280>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:35.714468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.715108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.715752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:35.726608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.727598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.729018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.729787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.761631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.762388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.793794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:35.824933 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-092a7692-e1cb-4d48-822b-b95f2da89088 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 204 len: 0 microversion: 2.26 time: 0.132264 Dec 18 21:05:35.826894 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2423/4855] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Dec 18 21:05:35 2021] DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:05:35.839135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-561553cd-0af3-484f-a2a4-dd9f6608cf9c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714fb30ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:35.851032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:35.857391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-561553cd-0af3-484f-a2a4-dd9f6608cf9c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.857852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-561553cd-0af3-484f-a2a4-dd9f6608cf9c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.861930 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c9f7c11-42b8-4bee-877a-3a2c5a347084 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.440330 Dec 18 21:05:35.864266 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2433/4856] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:35 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:35.878552 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-561553cd-0af3-484f-a2a4-dd9f6608cf9c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 200 len: 12 microversion: 2.26 time: 0.043159 Dec 18 21:05:35.879424 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2424/4857] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 21:05:35 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:35.889585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714e406430>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:35.898730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.899829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.900480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:35.906893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.907604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.908589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.910152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.943257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.943736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:35.965768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:35.966685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.003204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:36.022182 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-182b3b02-a1fe-4224-89ca-3d545df147fd tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-144095242" status: 201 len: 0 microversion: 2.26 time: 0.136918 Dec 18 21:05:36.023547 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2434/4858] 10.222.0.13 () {62 vars in 1376 bytes} [Sat Dec 18 21:05:35 2021] PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-144095242 => generated 0 bytes in 139 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Dec 18 21:05:36.033398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-447e2d01-5151-46f8-ab26-502729327f67 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f716140dc10>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.044985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-447e2d01-5151-46f8-ab26-502729327f67 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.045791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-447e2d01-5151-46f8-ab26-502729327f67 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.058985 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-447e2d01-5151-46f8-ab26-502729327f67 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 200 len: 35 microversion: 2.26 time: 0.030408 Dec 18 21:05:36.061222 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2425/4859] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 21:05:36 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 35 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:36.075515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f716132e5e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.096172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.097998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.098962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.110914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.111755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.112970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.113670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.164590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.165136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.203452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:36.229587 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50b848a8-cd4e-4c3e-84b1-e2fa0ee252c3 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-144095242" status: 204 len: 0 microversion: 2.26 time: 0.162948 Dec 18 21:05:36.230659 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2435/4860] 10.222.0.13 () {60 vars in 1360 bytes} [Sat Dec 18 21:05:36 2021] DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-144095242 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 18 21:05:36.240021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7229d90-1913-42a8-a8c7-e8dbb50a6a9a tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714ee86ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.250057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7229d90-1913-42a8-a8c7-e8dbb50a6a9a tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.250566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7229d90-1913-42a8-a8c7-e8dbb50a6a9a tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.274986 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7229d90-1913-42a8-a8c7-e8dbb50a6a9a tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 200 len: 12 microversion: 2.26 time: 0.039801 Dec 18 21:05:36.276095 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2426/4861] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 21:05:36 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:36.287560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714e406ca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.302992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.303669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.304829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.318495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.323160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.324287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.324986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.371158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.371771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.399820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:36.427791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56ea7958-5b54-429a-af81-a50e8ae635b4 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 204 len: 0 microversion: 2.26 time: 0.146048 Dec 18 21:05:36.429065 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2436/4862] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Dec 18 21:05:36 2021] DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:05:36.440289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f716132e8b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.446165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a51feff-099b-46d4-87e1-84bfda314af7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:36.448257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a51feff-099b-46d4-87e1-84bfda314af7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.454723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.455489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.456857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.463828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.464574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.465580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.466333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.474810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a51feff-099b-46d4-87e1-84bfda314af7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.475301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a51feff-099b-46d4-87e1-84bfda314af7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.476869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a51feff-099b-46d4-87e1-84bfda314af7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.479939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a51feff-099b-46d4-87e1-84bfda314af7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.496794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.497478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.513163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.513962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.566354 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a51feff-099b-46d4-87e1-84bfda314af7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.128387 Dec 18 21:05:36.569260 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2427/4863] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:36 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:36.583430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:36.611952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-10654a26-dae7-4d1f-b10d-c99c48bc4145 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-1308160658" status: 201 len: 0 microversion: 2.26 time: 0.175355 Dec 18 21:05:36.615377 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2437/4864] 10.222.0.13 () {62 vars in 1379 bytes} [Sat Dec 18 21:05:36 2021] PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-1308160658 => generated 0 bytes in 179 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Dec 18 21:05:36.625079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f716140de50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.637114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.637927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.638677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.646571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.647262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.648180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.648634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.677390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.678139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.688609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.689371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.721146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:36.744537 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a45c339-2b79-41a7-8835-8030a8af4207 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-1778200856" status: 201 len: 0 microversion: 2.26 time: 0.123612 Dec 18 21:05:36.745964 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2428/4865] 10.222.0.13 () {62 vars in 1379 bytes} [Sat Dec 18 21:05:36 2021] PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-1778200856 => generated 0 bytes in 126 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Dec 18 21:05:36.755209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714e4065e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.763863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.764500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.765138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.771898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.772585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.773541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.773984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.798612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.799074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.820174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:36.837389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a5534c6-9ff2-4e96-83bf-d2f8dbf81992 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 204 len: 0 microversion: 2.26 time: 0.086150 Dec 18 21:05:36.838024 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2438/4866] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Dec 18 21:05:36 2021] DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:05:36.847351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56c0926d-0262-4945-bee5-4340a3de470d tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714fb30ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.856438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56c0926d-0262-4945-bee5-4340a3de470d tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.857355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56c0926d-0262-4945-bee5-4340a3de470d tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.868283 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56c0926d-0262-4945-bee5-4340a3de470d tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 200 len: 12 microversion: 2.26 time: 0.025966 Dec 18 21:05:36.869551 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2429/4867] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 21:05:36 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:36.883868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.884297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f71614f24c0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.885493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.893543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.894193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.894829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.896098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.897894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.899975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.901084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.901313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.901905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.902863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.903448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.929864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.930540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.945250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:36.962954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2073d762-4126-46ea-be1f-a78123ca94c6 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 204 len: 0 microversion: 2.26 time: 0.086628 Dec 18 21:05:36.963603 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2439/4868] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Dec 18 21:05:36 2021] DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:05:36.973131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f7161310040>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:36.985705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.986335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.986664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:36.993225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.993919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:36.994507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:36.995011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.020818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.021637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.040306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.040765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.070020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:37.089385 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c2040819-51fc-4bd3-87bb-5033f2d1b66e tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-1314002614" status: 201 len: 0 microversion: 2.26 time: 0.120344 Dec 18 21:05:37.093818 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2440/4869] 10.222.0.13 () {62 vars in 1379 bytes} [Sat Dec 18 21:05:36 2021] PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-1314002614 => generated 0 bytes in 122 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Dec 18 21:05:37.099628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714e402b80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:37.113627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.114085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.115014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:37.127302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.127755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.128552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.128983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.192206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.193047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.219747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.220608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.260529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:37.287808 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e212444d-47ad-4a1c-881b-0b403bb70552 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-176257657" status: 201 len: 0 microversion: 2.26 time: 0.192127 Dec 18 21:05:37.294606 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2441/4870] 10.222.0.13 () {62 vars in 1376 bytes} [Sat Dec 18 21:05:37 2021] PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags/tempest-tag-176257657 => generated 0 bytes in 196 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Dec 18 21:05:37.305772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Action: 'update_all', calling method: .version_select at 0x7f714e51b040>, body: {"tags": ["tempest-tag-167942185", "tempest-tag-755309174"]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:37.317819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.318309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.318804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:37.325586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.326052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.326890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.327342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:37.327473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.337820 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-371c812a-b04d-48d4-b331-4e00ded1f378 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.460833 Dec 18 21:05:37.338467 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2430/4871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:36 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:37.355006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.357522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.387699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:37.411030 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-37190cf8-318f-4cd5-a697-193dd6a4b595 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 200 len: 60 microversion: 2.26 time: 0.114993 Dec 18 21:05:37.412055 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2442/4872] 10.222.0.13 () {62 vars in 1311 bytes} [Sat Dec 18 21:05:37 2021] PUT /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 60 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:37.423894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9632ee58-23a4-4e32-8f75-5416f6c2843f tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f714fb19a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:37.437412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9632ee58-23a4-4e32-8f75-5416f6c2843f tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.438027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9632ee58-23a4-4e32-8f75-5416f6c2843f tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.448362 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9632ee58-23a4-4e32-8f75-5416f6c2843f tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 200 len: 60 microversion: 2.26 time: 0.030769 Dec 18 21:05:37.450292 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2431/4873] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Dec 18 21:05:37 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 60 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:37.459454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '.version_select at 0x7f71613b23a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:37.468461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.468914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.469387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:37.476395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.476848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.477624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.478055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.501050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.501922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.527986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'flavor' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:37.544508 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b06dfdd2-43aa-43ae-baac-b2f5d746997b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags" status: 204 len: 0 microversion: 2.26 time: 0.089682 Dec 18 21:05:37.545288 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2443/4874] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Dec 18 21:05:37 2021] DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:05:37.556436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:37.557551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:37.566644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.567702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.568702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.569312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.580939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1b76815-4e23-45ba-adf9-c8e51d592f86 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:37.582930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1b76815-4e23-45ba-adf9-c8e51d592f86 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:37.607521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b76815-4e23-45ba-adf9-c8e51d592f86 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.608486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b76815-4e23-45ba-adf9-c8e51d592f86 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.610459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b76815-4e23-45ba-adf9-c8e51d592f86 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.611156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1b76815-4e23-45ba-adf9-c8e51d592f86 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.632800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:05:37.775165 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1b76815-4e23-45ba-adf9-c8e51d592f86 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.198309 Dec 18 21:05:37.775722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e141a901-02a9-4db1-9883-f6058ee0b491 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 204 len: 0 microversion: 2.26 time: 0.223282 Dec 18 21:05:37.776535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2444/4875] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:37 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:37.781894 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2432/4876] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:05:37 2021] DELETE /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 18 21:05:37.793177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:37.794568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:37.804491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.805198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:37.807429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:37.808122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:38.120046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:38.136180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:38.140830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:38.143798 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d7b9f0d5-98bc-4cb6-902c-dba649a244f8 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1552 microversion: 2.26 time: 0.355479 Dec 18 21:05:38.145160 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2445/4877] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:37 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1552 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:38.355776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:38.356481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:38.363514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:38.363972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:38.364909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:38.365354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:38.526517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:38.535051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e4ef5b8-f59c-4ab8-b6bf-e7cf53654fe2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.182655 Dec 18 21:05:38.535858 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2433/4878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:38 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:38.788145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcc99af9-e812-4547-9657-83ac6efc434a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:38.789132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bcc99af9-e812-4547-9657-83ac6efc434a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:38.802568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc99af9-e812-4547-9657-83ac6efc434a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:38.803240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc99af9-e812-4547-9657-83ac6efc434a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:38.804195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc99af9-e812-4547-9657-83ac6efc434a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:38.804819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcc99af9-e812-4547-9657-83ac6efc434a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:38.855999 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcc99af9-e812-4547-9657-83ac6efc434a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.071411 Dec 18 21:05:38.856687 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2446/4879] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:38 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:39.163762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:39.164948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:39.177728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:39.178576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:39.179664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:39.180365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:39.556251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:39.557158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:39.564671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:39.565326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:39.566349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:39.567187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:39.821596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:39.838004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:39.843012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:39.848018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8dc5477d-649b-45b5-8cb0-b383afd1ba4b tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1552 microversion: 2.26 time: 0.687712 Dec 18 21:05:39.849216 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2434/4880] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:39 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1552 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:40.280059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb51ad11-8283-4b36-b428-ac3a3c3b6e4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:40.281475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb51ad11-8283-4b36-b428-ac3a3c3b6e4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:40.291309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb51ad11-8283-4b36-b428-ac3a3c3b6e4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:40.291777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb51ad11-8283-4b36-b428-ac3a3c3b6e4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:40.292602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb51ad11-8283-4b36-b428-ac3a3c3b6e4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:40.293045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb51ad11-8283-4b36-b428-ac3a3c3b6e4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:40.374005 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb51ad11-8283-4b36-b428-ac3a3c3b6e4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.509354 Dec 18 21:05:40.375388 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2435/4881] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:39 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:40.513291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:40.546870 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38c7025f-3da3-4f22-a00f-77fcab39d820 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.990174 Dec 18 21:05:40.547780 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2447/4882] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:39 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:40.707096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-09313e59-1efd-422f-9438-36449d403bf7 req-106cc8cf-c71b-4ebe-b7ac-de2141320412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650905b4-027a-40af-ae95-18573c57937e", "name": "network-vif-deleted", "tag": "0dfa8a69-260f-46f9-a552-d8a5455e8dbe"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:40.709797 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:05:40.709797 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:05:40.742081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-09313e59-1efd-422f-9438-36449d403bf7 req-106cc8cf-c71b-4ebe-b7ac-de2141320412 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:40.742469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-09313e59-1efd-422f-9438-36449d403bf7 req-106cc8cf-c71b-4ebe-b7ac-de2141320412 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:40.766755 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-09313e59-1efd-422f-9438-36449d403bf7 req-106cc8cf-c71b-4ebe-b7ac-de2141320412 service nova] Creating event network-vif-deleted:0dfa8a69-260f-46f9-a552-d8a5455e8dbe for instance 650905b4-027a-40af-ae95-18573c57937e on nch2-master-1 Dec 18 21:05:40.774816 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-09313e59-1efd-422f-9438-36449d403bf7 req-106cc8cf-c71b-4ebe-b7ac-de2141320412 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074363 Dec 18 21:05:40.775917 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2436/4883] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:05:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:05:40.867434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:40.868270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:40.876570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:40.878523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:40.879524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:40.880130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:40.933131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:40.933774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:40.934492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lazy-loading 'fault' on Instance uuid 650905b4-027a-40af-ae95-18573c57937e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:05:41.045262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:41.054285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:41.056666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1715a99625764d63a18f2191e297ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fbf6906e5d404c916ff274e95066ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:41.058017 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4052c955-038a-4743-b458-bd4c5ded584c tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 200 len: 1352 microversion: 2.26 time: 0.195468 Dec 18 21:05:41.058756 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2448/4884] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:40 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 1352 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:05:41.389301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4121bc68-3f84-44f8-8e28-a73e6762c435 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:41.390485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4121bc68-3f84-44f8-8e28-a73e6762c435 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:41.408884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4121bc68-3f84-44f8-8e28-a73e6762c435 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:41.410619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4121bc68-3f84-44f8-8e28-a73e6762c435 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:41.411734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4121bc68-3f84-44f8-8e28-a73e6762c435 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:41.412766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4121bc68-3f84-44f8-8e28-a73e6762c435 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:41.481611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4121bc68-3f84-44f8-8e28-a73e6762c435 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.096402 Dec 18 21:05:41.483254 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2437/4885] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:41 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:41.563854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:41.564413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:41.577807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:41.578279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:41.588563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:41.589267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:42.079925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:42.080548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] [instance: 650905b4-027a-40af-ae95-18573c57937e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:42.091451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:42.092190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:42.093877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:42.094515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:42.148523 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] HTTP exception thrown: Instance 650905b4-027a-40af-ae95-18573c57937e could not be found. Dec 18 21:05:42.149163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] Returning 404 to user: Instance 650905b4-027a-40af-ae95-18573c57937e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:05:42.150029 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7dec492-5f89-4503-8377-066caf75db40 tempest-ServerTagsTestJSON-707308840 tempest-ServerTagsTestJSON-707308840-project] 10.222.0.13 "GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e" status: 404 len: 111 microversion: 2.26 time: 0.076749 Dec 18 21:05:42.151122 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2438/4886] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:05:42 2021] GET /compute/v2.1/servers/650905b4-027a-40af-ae95-18573c57937e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:05:42.494319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a1ca5b2-c2b7-429e-9cc8-93dae7219367 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:42.499482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a1ca5b2-c2b7-429e-9cc8-93dae7219367 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:42.507167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a1ca5b2-c2b7-429e-9cc8-93dae7219367 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:42.507796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a1ca5b2-c2b7-429e-9cc8-93dae7219367 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:42.509062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a1ca5b2-c2b7-429e-9cc8-93dae7219367 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:42.509661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a1ca5b2-c2b7-429e-9cc8-93dae7219367 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:42.564333 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a1ca5b2-c2b7-429e-9cc8-93dae7219367 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.072089 Dec 18 21:05:42.566644 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2439/4887] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:42 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:42.610558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:42.621661 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3540554-cbd5-44ef-818a-38b43ce8b7c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 1.061486 Dec 18 21:05:42.623054 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2449/4888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:41 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:43.577915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-10e983eb-5428-470c-9b53-92d5d83180e5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:43.579191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-10e983eb-5428-470c-9b53-92d5d83180e5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:43.591046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10e983eb-5428-470c-9b53-92d5d83180e5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:43.591720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10e983eb-5428-470c-9b53-92d5d83180e5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:43.592687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10e983eb-5428-470c-9b53-92d5d83180e5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:43.593284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-10e983eb-5428-470c-9b53-92d5d83180e5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:43.640098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:43.641345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:43.654567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:43.655566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-10e983eb-5428-470c-9b53-92d5d83180e5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.081635 Dec 18 21:05:43.656198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:43.657664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:43.658966 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2440/4889] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:43 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:43.660447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:44.225165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:44.233469 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-398367f5-bd75-42e2-aa56-82be1a188222 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.597558 Dec 18 21:05:44.251255 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2450/4890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:43 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:44.676110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d081a6e-03c0-413b-8ce3-7b9a98ce4b94 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:44.678618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d081a6e-03c0-413b-8ce3-7b9a98ce4b94 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:44.713044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d081a6e-03c0-413b-8ce3-7b9a98ce4b94 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:44.713834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d081a6e-03c0-413b-8ce3-7b9a98ce4b94 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:44.714896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d081a6e-03c0-413b-8ce3-7b9a98ce4b94 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:44.717933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d081a6e-03c0-413b-8ce3-7b9a98ce4b94 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:44.796758 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d081a6e-03c0-413b-8ce3-7b9a98ce4b94 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.129777 Dec 18 21:05:44.797920 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2441/4891] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:44 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:45.250106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:45.252234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:45.260171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:45.260956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:45.262662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:45.263316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:45.501142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:45.512647 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0a8f82f5-811e-4290-ab54-ad7372e7d778 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.265844 Dec 18 21:05:45.514361 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2451/4892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:45 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:45.813081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b99791c9-728c-4501-8453-fc4706fe74fc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:45.814635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b99791c9-728c-4501-8453-fc4706fe74fc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:45.822764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b99791c9-728c-4501-8453-fc4706fe74fc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:45.823437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b99791c9-728c-4501-8453-fc4706fe74fc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:45.824410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b99791c9-728c-4501-8453-fc4706fe74fc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:45.824993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b99791c9-728c-4501-8453-fc4706fe74fc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:45.888099 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b99791c9-728c-4501-8453-fc4706fe74fc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.081237 Dec 18 21:05:45.893956 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2442/4893] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:45 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:46.535944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:46.538126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:46.597586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:46.598430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:46.599523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:46.601648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:46.914768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a20eddfb-2e5e-47c4-b61e-28be2554c264 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:46.920120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a20eddfb-2e5e-47c4-b61e-28be2554c264 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:46.944183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a20eddfb-2e5e-47c4-b61e-28be2554c264 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:46.945503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a20eddfb-2e5e-47c4-b61e-28be2554c264 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:46.946744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a20eddfb-2e5e-47c4-b61e-28be2554c264 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:46.965838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a20eddfb-2e5e-47c4-b61e-28be2554c264 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:47.023122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:47.031706 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-918d3ebf-12e1-490f-9760-f76b2812ca2f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.503837 Dec 18 21:05:47.032299 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2452/4894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:46 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:47.095233 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a20eddfb-2e5e-47c4-b61e-28be2554c264 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.196911 Dec 18 21:05:47.097890 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2443/4895] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:46 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:48.048893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:48.049523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:48.066046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:48.066788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:48.067994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:48.068595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:48.112759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a15e1280-fb39-4587-8e7f-c87a60a66a20 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:48.121059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a15e1280-fb39-4587-8e7f-c87a60a66a20 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:48.136163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15e1280-fb39-4587-8e7f-c87a60a66a20 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:48.136628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15e1280-fb39-4587-8e7f-c87a60a66a20 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:48.138286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15e1280-fb39-4587-8e7f-c87a60a66a20 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:48.141176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a15e1280-fb39-4587-8e7f-c87a60a66a20 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:48.240612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a15e1280-fb39-4587-8e7f-c87a60a66a20 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.135862 Dec 18 21:05:48.241291 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2444/4896] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:48 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:48.607486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:48.620543 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e9278df6-f60e-48de-a66e-6f06af47d8a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.572069 Dec 18 21:05:48.639956 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2453/4897] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:48 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:48.682093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2144280788", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:48.804462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] validate_networks() for [('1868cd24-2ddf-47fc-8474-997160de3083', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:05:49.254930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-358f5e02-ac5e-4cf1-b5e3-12c2fd47a068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:49.256705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-358f5e02-ac5e-4cf1-b5e3-12c2fd47a068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:49.267625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-358f5e02-ac5e-4cf1-b5e3-12c2fd47a068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:49.268555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-358f5e02-ac5e-4cf1-b5e3-12c2fd47a068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:49.269566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-358f5e02-ac5e-4cf1-b5e3-12c2fd47a068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:49.270236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-358f5e02-ac5e-4cf1-b5e3-12c2fd47a068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:49.333905 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-358f5e02-ac5e-4cf1-b5e3-12c2fd47a068 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.084018 Dec 18 21:05:49.336188 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2454/4898] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:49 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:49.657248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:49.659506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:49.669475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:49.670187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:49.671247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:49.672151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:50.203786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:05:50.204940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:05:50.211666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:05:50.213540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:05:50.214129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:05:50.231608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:50.233845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:50.237455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:50.238379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:50.287454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Getting quotas for project ea26536b064a4650b9c08f4b5ce6fadf. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:05:50.300540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Getting quotas for user d6278aefb6d5497aad3d74b47b2e95d9 and project ea26536b064a4650b9c08f4b5ce6fadf. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:05:50.338655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:05:50.345548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:05:50.456300 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f71ccebc-9fdd-450a-b963-dbdce8fd4202 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007775 Dec 18 21:05:50.465008 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2445/4899] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:05:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:05:50.480974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dc47752f-bf08-4d03-8cc5-2aabec2b6e52 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:50.484678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dc47752f-bf08-4d03-8cc5-2aabec2b6e52 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:50.505246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc47752f-bf08-4d03-8cc5-2aabec2b6e52 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:50.508942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc47752f-bf08-4d03-8cc5-2aabec2b6e52 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:50.509960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc47752f-bf08-4d03-8cc5-2aabec2b6e52 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:50.513631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc47752f-bf08-4d03-8cc5-2aabec2b6e52 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:50.599814 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dc47752f-bf08-4d03-8cc5-2aabec2b6e52 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.132094 Dec 18 21:05:50.603979 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2446/4900] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:50 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:50.625337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9782d78-b0d5-4df6-80d2-e0f9eaa8ab4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:50.626454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c9782d78-b0d5-4df6-80d2-e0f9eaa8ab4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:50.813497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:50.822337 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-79e46494-da24-4ea7-afc4-a95c3fe2067e tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 1.175341 Dec 18 21:05:50.823503 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2455/4901] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:49 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:51.023919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c9782d78-b0d5-4df6-80d2-e0f9eaa8ab4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:51.037536 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9782d78-b0d5-4df6-80d2-e0f9eaa8ab4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1217 microversion: 2.1 time: 0.425827 Dec 18 21:05:51.041328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2447/4902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:50 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1217 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:51.612052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e5cb1d10-1649-448f-94a3-3cd0f1d51481 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:51.612999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e5cb1d10-1649-448f-94a3-3cd0f1d51481 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:51.636738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5cb1d10-1649-448f-94a3-3cd0f1d51481 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:51.637635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5cb1d10-1649-448f-94a3-3cd0f1d51481 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:51.638547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5cb1d10-1649-448f-94a3-3cd0f1d51481 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:51.638993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5cb1d10-1649-448f-94a3-3cd0f1d51481 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:51.746799 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e5cb1d10-1649-448f-94a3-3cd0f1d51481 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.138531 Dec 18 21:05:51.747688 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2456/4903] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:51 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:51.847118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:51.848356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:51.862818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:51.863518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:51.864513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:51.865093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:52.059226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:52.060573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:52.085684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:52.086542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:52.098958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:52.099685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:52.602885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:52.612322 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6f9fd66-29b8-4637-a5f7-d754bff90e24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1277 microversion: 2.1 time: 0.557999 Dec 18 21:05:52.617824 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2457/4904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:52 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1277 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:52.763459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8207042c-27a6-45fc-b1ab-c169ae71ef76 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:52.764557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8207042c-27a6-45fc-b1ab-c169ae71ef76 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:52.781421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8207042c-27a6-45fc-b1ab-c169ae71ef76 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:52.781820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8207042c-27a6-45fc-b1ab-c169ae71ef76 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:52.782690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8207042c-27a6-45fc-b1ab-c169ae71ef76 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:52.787591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8207042c-27a6-45fc-b1ab-c169ae71ef76 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:52.892536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:52.908638 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8207042c-27a6-45fc-b1ab-c169ae71ef76 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.150518 Dec 18 21:05:52.909366 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e606ea7-04dd-47a2-8968-284961499f4f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 1.071401 Dec 18 21:05:52.910974 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2448/4905] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:51 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:52.912247 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2458/4906] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:52 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:53.632361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:53.633287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:53.648264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:53.648995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:53.649976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:53.650605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:53.866357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:53.877153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af83a3e4-c41e-41b5-a9af-f6341768f72d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1275 microversion: 2.1 time: 0.249053 Dec 18 21:05:53.878140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2449/4907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:53 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:53.923798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9df4aba4-f62b-4c39-bc5d-fcb5e71e7ba7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:53.925308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9df4aba4-f62b-4c39-bc5d-fcb5e71e7ba7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:53.930685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:53.932846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:53.939952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:53.940677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:53.940836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df4aba4-f62b-4c39-bc5d-fcb5e71e7ba7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:53.941325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df4aba4-f62b-4c39-bc5d-fcb5e71e7ba7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:53.942410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df4aba4-f62b-4c39-bc5d-fcb5e71e7ba7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:53.942859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df4aba4-f62b-4c39-bc5d-fcb5e71e7ba7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:53.943287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:53.943876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:54.035007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9df4aba4-f62b-4c39-bc5d-fcb5e71e7ba7 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.114622 Dec 18 21:05:54.036639 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2459/4908] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:53 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:54.431195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:54.444793 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e31c7751-7c74-4173-bc8e-a9da938b6bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.521962 Dec 18 21:05:54.447208 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2450/4909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:53 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:54.898270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:54.899299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:54.912621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:54.913199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:54.913904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:54.914380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:55.046669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7c859cb-91bc-4e6a-823c-37ab8d4f3fde tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:55.047661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7c859cb-91bc-4e6a-823c-37ab8d4f3fde tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:55.060177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7c859cb-91bc-4e6a-823c-37ab8d4f3fde tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:55.060640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7c859cb-91bc-4e6a-823c-37ab8d4f3fde tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:55.061463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7c859cb-91bc-4e6a-823c-37ab8d4f3fde tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:55.062055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7c859cb-91bc-4e6a-823c-37ab8d4f3fde tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:55.139910 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7c859cb-91bc-4e6a-823c-37ab8d4f3fde tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.096948 Dec 18 21:05:55.144131 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2451/4910] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:55 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:55.465267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:55.466624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:55.479000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:55.483804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:55.485205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:55.485871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:55.585509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:55.597658 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1914f4dc-0e62-424e-8c2e-ec8840938cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.700327 Dec 18 21:05:55.598830 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2460/4911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:56.152490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-afcce448-b681-4f9a-99cd-67eca6878976 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:56.153491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-afcce448-b681-4f9a-99cd-67eca6878976 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:56.173920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afcce448-b681-4f9a-99cd-67eca6878976 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:56.175058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afcce448-b681-4f9a-99cd-67eca6878976 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:56.179342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afcce448-b681-4f9a-99cd-67eca6878976 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:56.180008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afcce448-b681-4f9a-99cd-67eca6878976 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:56.263432 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-afcce448-b681-4f9a-99cd-67eca6878976 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.115773 Dec 18 21:05:56.264933 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2461/4912] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:56 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:56.319791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:56.335557 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b9efaf7-8823-4ea3-9e24-bf7f98560a34 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.877287 Dec 18 21:05:56.336160 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2452/4913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:55 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:56.615867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:56.617941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:56.638438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:56.639136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:56.640179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:56.640907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:57.215686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:57.227988 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30012884-856e-47c3-822d-c294ed01cfe0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.616619 Dec 18 21:05:57.238109 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2462/4914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:56 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:57.277195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9515949-42cc-41c9-ade0-5c30f7222d5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:57.279275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9515949-42cc-41c9-ade0-5c30f7222d5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:57.288846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9515949-42cc-41c9-ade0-5c30f7222d5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:57.291742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9515949-42cc-41c9-ade0-5c30f7222d5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:57.292845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9515949-42cc-41c9-ade0-5c30f7222d5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:57.293491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9515949-42cc-41c9-ade0-5c30f7222d5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:57.354308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:57.355230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:57.369082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:57.369710 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9515949-42cc-41c9-ade0-5c30f7222d5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.094343 Dec 18 21:05:57.372422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:57.376901 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2453/4915] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:57 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:57.378818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:57.379505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:57.824916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e9ce3dcd-00bf-490d-8fdd-883b4b084051 req-8a6e9974-67ca-4be1-9874-68bc01df6025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1be5bad-33b6-459e-93d1-c890f71c2fb7", "tag": "01029a1f-6c70-48b6-9ed9-4300a6739bea"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:57.852290 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:05:57.852290 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:05:57.868018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e9ce3dcd-00bf-490d-8fdd-883b4b084051 req-8a6e9974-67ca-4be1-9874-68bc01df6025 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:57.868515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e9ce3dcd-00bf-490d-8fdd-883b4b084051 req-8a6e9974-67ca-4be1-9874-68bc01df6025 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:57.886045 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e9ce3dcd-00bf-490d-8fdd-883b4b084051 req-8a6e9974-67ca-4be1-9874-68bc01df6025 service nova] Creating event network-changed:01029a1f-6c70-48b6-9ed9-4300a6739bea for instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 on nch1-master-1 Dec 18 21:05:57.894548 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e9ce3dcd-00bf-490d-8fdd-883b4b084051 req-8a6e9974-67ca-4be1-9874-68bc01df6025 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074148 Dec 18 21:05:57.895422 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2454/4916] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:05:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:05:58.248485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:58.249557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:58.261190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:58.261885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:58.263446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:58.264347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:58.275652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:58.289538 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f978cf56-ac91-4eac-ae6c-dd8b51bb259c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.939576 Dec 18 21:05:58.293178 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2463/4917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:57 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:05:58.384592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b608fe13-5ccb-412f-926e-017c3e3ae39b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:58.385874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b608fe13-5ccb-412f-926e-017c3e3ae39b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:58.398942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b608fe13-5ccb-412f-926e-017c3e3ae39b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:58.401036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b608fe13-5ccb-412f-926e-017c3e3ae39b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:58.402940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b608fe13-5ccb-412f-926e-017c3e3ae39b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:58.404113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b608fe13-5ccb-412f-926e-017c3e3ae39b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:58.493933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b608fe13-5ccb-412f-926e-017c3e3ae39b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.113696 Dec 18 21:05:58.500498 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2464/4918] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:58 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:05:58.732108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:58.749091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2698ec8f-e732-4d06-bfb1-611714a90ef2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.507455 Dec 18 21:05:58.761863 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2455/4919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:58 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:05:59.309041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:59.309800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:59.328158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:59.328732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:59.331762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:59.333229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:59.521765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e961d9c-ea4f-45dc-a539-6a4c3334b7d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:05:59.522923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e961d9c-ea4f-45dc-a539-6a4c3334b7d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:59.559204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e961d9c-ea4f-45dc-a539-6a4c3334b7d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:59.562662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e961d9c-ea4f-45dc-a539-6a4c3334b7d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:59.563754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e961d9c-ea4f-45dc-a539-6a4c3334b7d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:59.568098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e961d9c-ea4f-45dc-a539-6a4c3334b7d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:59.679688 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e961d9c-ea4f-45dc-a539-6a4c3334b7d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.173914 Dec 18 21:05:59.686345 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2456/4920] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:05:59 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:05:59.773859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:05:59.776902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:05:59.785353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:59.786212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:59.789559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:05:59.790190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:05:59.941103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:05:59.966534 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40929581-06e7-4945-b72e-086ca419dea8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.662703 Dec 18 21:05:59.968842 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2465/4921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:59 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:00.344224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:00.354370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6229e8d6-92a1-41a0-9c67-593ed0298d56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.590315 Dec 18 21:06:00.363955 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2457/4922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:05:59 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:00.693814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d63f2d6-7fb9-47b9-9aa4-25a5e0038833 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:00.694939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d63f2d6-7fb9-47b9-9aa4-25a5e0038833 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:00.714717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d63f2d6-7fb9-47b9-9aa4-25a5e0038833 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:00.715393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d63f2d6-7fb9-47b9-9aa4-25a5e0038833 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:00.716352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d63f2d6-7fb9-47b9-9aa4-25a5e0038833 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:00.716934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d63f2d6-7fb9-47b9-9aa4-25a5e0038833 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:00.806105 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d63f2d6-7fb9-47b9-9aa4-25a5e0038833 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.116678 Dec 18 21:06:00.806879 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2466/4923] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:00 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:00.984601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:00.985382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:01.008737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:01.009393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:01.010644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:01.011257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:01.319777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:01.358479 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-034704a2-5f38-447f-8b0f-44ca038dd08b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.377321 Dec 18 21:06:01.363088 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2458/4924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:00 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:01.374661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:01.375586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:01.390168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:01.390701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:01.391550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:01.394109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:01.724986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:01.739068 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6bd856a9-2097-4b96-b65e-5419f7b032a9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.371168 Dec 18 21:06:01.740209 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2467/4925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:01 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:01.819995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43ff0cc0-c0e7-484b-a890-c844509642d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:01.820928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-43ff0cc0-c0e7-484b-a890-c844509642d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:01.828836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43ff0cc0-c0e7-484b-a890-c844509642d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:01.829301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43ff0cc0-c0e7-484b-a890-c844509642d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:01.830933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43ff0cc0-c0e7-484b-a890-c844509642d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:01.831683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43ff0cc0-c0e7-484b-a890-c844509642d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:01.879845 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43ff0cc0-c0e7-484b-a890-c844509642d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.065315 Dec 18 21:06:01.881217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2459/4926] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:01 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:02.379746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:02.380610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:02.389134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:02.389830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:02.390833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:02.391270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:02.760307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:02.761659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:02.781188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:02.781649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:02.782491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:02.782937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:03.343129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:03.356672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03c5aac4-875b-4483-afd2-e35a10e6b98a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1506 microversion: 2.1 time: 0.981461 Dec 18 21:06:03.366324 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2468/4927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:02 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1506 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:03.371126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40922676-6e0f-4c13-ae8f-896f55d46773 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:03.372081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40922676-6e0f-4c13-ae8f-896f55d46773 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:03.383466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40922676-6e0f-4c13-ae8f-896f55d46773 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:03.384136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40922676-6e0f-4c13-ae8f-896f55d46773 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:03.389428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40922676-6e0f-4c13-ae8f-896f55d46773 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:03.390067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40922676-6e0f-4c13-ae8f-896f55d46773 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:03.469280 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40922676-6e0f-4c13-ae8f-896f55d46773 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.101600 Dec 18 21:06:03.469975 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2469/4928] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:03 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:03.598875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:03.611650 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c876dd52-3227-4779-8a26-1533b71643e7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.858600 Dec 18 21:06:03.623621 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2460/4929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:02 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:04.376457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:04.377853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:04.387919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:04.388634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:04.390231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:04.390855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:04.481971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-de4ff63a-0440-4f5e-a673-3010788ac538 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:04.483929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-de4ff63a-0440-4f5e-a673-3010788ac538 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:04.504498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de4ff63a-0440-4f5e-a673-3010788ac538 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:04.505285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de4ff63a-0440-4f5e-a673-3010788ac538 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:04.506885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de4ff63a-0440-4f5e-a673-3010788ac538 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:04.507676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de4ff63a-0440-4f5e-a673-3010788ac538 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:04.579916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-de4ff63a-0440-4f5e-a673-3010788ac538 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.102258 Dec 18 21:06:04.581662 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2461/4930] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:04 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:04.630117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:04.631376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:04.642235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:04.649345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:04.652635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:04.654590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:04.836009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:04.844425 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3967063b-d1cf-4544-bc1e-f68c62a5e815 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1527 microversion: 2.1 time: 0.474522 Dec 18 21:06:04.855190 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2470/4931] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:04 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1527 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:04.980552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:04.995267 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8e46b23b-696c-4714-ad67-7fcf3ffd4f46 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.369545 Dec 18 21:06:04.996135 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2462/4932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:04 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:05.596913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7c7bd74d-adec-4886-bc19-7dcc89319b5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:05.598980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7c7bd74d-adec-4886-bc19-7dcc89319b5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:05.606818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7bd74d-adec-4886-bc19-7dcc89319b5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:05.609298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7bd74d-adec-4886-bc19-7dcc89319b5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:05.613283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7bd74d-adec-4886-bc19-7dcc89319b5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:05.614043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7c7bd74d-adec-4886-bc19-7dcc89319b5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:05.695243 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7c7bd74d-adec-4886-bc19-7dcc89319b5d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.104284 Dec 18 21:06:05.699915 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2471/4933] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:05 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:05.865273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:05.865952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:05.888405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:05.891913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:05.896622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:05.897086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:06.013788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:06.014732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:06.036164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:06.037286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:06.038991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:06.039589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:06.731109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:06.754049 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a679e223-7631-4016-882e-3931241809e4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 0.742210 Dec 18 21:06:06.755101 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2472/4934] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:06 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:06.785518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ce910ef-87b8-4c97-82e1-41de0f17c41a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:06.787091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ce910ef-87b8-4c97-82e1-41de0f17c41a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:06.809718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ce910ef-87b8-4c97-82e1-41de0f17c41a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:06.811701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ce910ef-87b8-4c97-82e1-41de0f17c41a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:06.816684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ce910ef-87b8-4c97-82e1-41de0f17c41a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:06.820242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ce910ef-87b8-4c97-82e1-41de0f17c41a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:06.890590 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ce910ef-87b8-4c97-82e1-41de0f17c41a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.131636 Dec 18 21:06:06.891483 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2473/4935] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:06 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:06.901423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:06.909865 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cd1d27fd-1212-4a43-98ef-28f05e5e3b24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1527 microversion: 2.1 time: 1.050227 Dec 18 21:06:06.919243 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2463/4936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:05 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1527 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:07.784584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:07.786183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:07.802843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:07.807019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:07.811013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:07.811691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:07.909018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d1cba0f-8a07-4b4f-a706-f73d4ba699d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:07.909018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2d1cba0f-8a07-4b4f-a706-f73d4ba699d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:07.934373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d1cba0f-8a07-4b4f-a706-f73d4ba699d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:07.935219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d1cba0f-8a07-4b4f-a706-f73d4ba699d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:07.939379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d1cba0f-8a07-4b4f-a706-f73d4ba699d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:07.941569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d1cba0f-8a07-4b4f-a706-f73d4ba699d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:08.038492 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d1cba0f-8a07-4b4f-a706-f73d4ba699d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.139093 Dec 18 21:06:08.042999 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2464/4937] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:07 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:08.044164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:08.055076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:08.068557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:08.069027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:08.069861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:08.070334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:10.279236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:10.302385 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6fa5dd8-ed83-4253-a37e-8ffbe4293465 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 2.535541 Dec 18 21:06:10.306633 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2474/4938] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:07 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 2537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:10.306825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:10.311899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-52cb86e8-ac5a-4041-b1e5-e6603f705d82 req-4c407f3e-efd6-4798-be1f-9657ae1a00f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1be5bad-33b6-459e-93d1-c890f71c2fb7", "name": "network-vif-plugged", "status": "completed", "tag": "01029a1f-6c70-48b6-9ed9-4300a6739bea"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:10.313456 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:10.313456 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:06:10.325714 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-be4ddff7-50d0-4d67-b89d-f2e17f76466d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 2.285264 Dec 18 21:06:10.326334 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2465/4939] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:08 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:10.348983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-52cb86e8-ac5a-4041-b1e5-e6603f705d82 req-4c407f3e-efd6-4798-be1f-9657ae1a00f8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:10.349436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-52cb86e8-ac5a-4041-b1e5-e6603f705d82 req-4c407f3e-efd6-4798-be1f-9657ae1a00f8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:10.365340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23d6d020-8538-4976-935d-9caaf688d02e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:10.366202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-23d6d020-8538-4976-935d-9caaf688d02e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:10.396928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d6d020-8538-4976-935d-9caaf688d02e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:10.397386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d6d020-8538-4976-935d-9caaf688d02e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:10.398211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d6d020-8538-4976-935d-9caaf688d02e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:10.401640 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-52cb86e8-ac5a-4041-b1e5-e6603f705d82 req-4c407f3e-efd6-4798-be1f-9657ae1a00f8 service nova] Creating event network-vif-plugged:01029a1f-6c70-48b6-9ed9-4300a6739bea for instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 on nch1-master-1 Dec 18 21:06:10.407043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23d6d020-8538-4976-935d-9caaf688d02e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:10.420556 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-52cb86e8-ac5a-4041-b1e5-e6603f705d82 req-4c407f3e-efd6-4798-be1f-9657ae1a00f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116142 Dec 18 21:06:10.435342 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2475/4940] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:06:10.521855 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23d6d020-8538-4976-935d-9caaf688d02e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.177825 Dec 18 21:06:10.530949 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2466/4941] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:10 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:11.323409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:11.324121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:11.337921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:11.338692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:11.347130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:11.347815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:11.347954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:11.348647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:11.365607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:11.366101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:11.367080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:11.367509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:12.595939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:12.610347 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7834b18-3b89-407b-a389-d96420168bfb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 1.261023 Dec 18 21:06:12.614379 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2467/4942] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:11 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:12.632640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-463a976e-7b68-4685-b671-90ed7fee81ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:12.637413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-463a976e-7b68-4685-b671-90ed7fee81ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:12.664794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-463a976e-7b68-4685-b671-90ed7fee81ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:12.667938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-463a976e-7b68-4685-b671-90ed7fee81ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:12.669370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-463a976e-7b68-4685-b671-90ed7fee81ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:12.672513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-463a976e-7b68-4685-b671-90ed7fee81ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:12.818011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-463a976e-7b68-4685-b671-90ed7fee81ce tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.201216 Dec 18 21:06:12.829639 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2468/4943] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:12 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:12.839497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-0b6878bd-5caf-49b6-82ac-d56a1a4d9474 req-d26dc6ca-5be9-488a-8de4-30a4f62e255f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9b708f-24ca-4dad-9e48-ce4b71edf595", "name": "network-vif-plugged", "status": "completed", "tag": "39f33934-8809-44c6-97cd-68c74a5bf74c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:12.855839 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:12.855839 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:06:12.884486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0b6878bd-5caf-49b6-82ac-d56a1a4d9474 req-d26dc6ca-5be9-488a-8de4-30a4f62e255f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:12.896348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0b6878bd-5caf-49b6-82ac-d56a1a4d9474 req-d26dc6ca-5be9-488a-8de4-30a4f62e255f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:12.913195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:12.922010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb206231-7ed9-4b3e-9a9e-2836e6f298fe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1317 microversion: 2.1 time: 1.602810 Dec 18 21:06:12.927421 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2476/4944] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:11 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1317 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:12.954298 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-0b6878bd-5caf-49b6-82ac-d56a1a4d9474 req-d26dc6ca-5be9-488a-8de4-30a4f62e255f service nova] Creating event network-vif-plugged:39f33934-8809-44c6-97cd-68c74a5bf74c for instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 on nch1-master-1 Dec 18 21:06:12.965619 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-0b6878bd-5caf-49b6-82ac-d56a1a4d9474 req-d26dc6ca-5be9-488a-8de4-30a4f62e255f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133616 Dec 18 21:06:12.966233 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2469/4945] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:06:13.634872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:13.637150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:13.660227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:13.660957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:13.661935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:13.665862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:13.841583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44ba7e69-7938-4b8a-8d28-adfb3ade2b61 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:13.843845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-44ba7e69-7938-4b8a-8d28-adfb3ade2b61 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:13.853628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44ba7e69-7938-4b8a-8d28-adfb3ade2b61 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:13.856002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44ba7e69-7938-4b8a-8d28-adfb3ade2b61 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:13.857923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44ba7e69-7938-4b8a-8d28-adfb3ade2b61 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:13.858949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44ba7e69-7938-4b8a-8d28-adfb3ade2b61 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:13.968148 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44ba7e69-7938-4b8a-8d28-adfb3ade2b61 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.130936 Dec 18 21:06:13.981131 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2470/4946] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:13 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:13.998543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:13.999703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:14.019782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:14.021514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:14.025117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:14.025639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:14.563866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:14.573073 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d5d16063-59ad-41e9-ad17-7a4f34c4657c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 0.946169 Dec 18 21:06:14.576583 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2477/4947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:13 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:14.780069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:14.789201 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58b0889e-5d05-412f-93ea-a2272d6d0200 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.806690 Dec 18 21:06:14.794326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2471/4948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:13 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:14.988114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8fcacb9d-686c-40c8-957a-775bcf76f68e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:14.989303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8fcacb9d-686c-40c8-957a-775bcf76f68e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:15.010644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fcacb9d-686c-40c8-957a-775bcf76f68e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:15.011496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fcacb9d-686c-40c8-957a-775bcf76f68e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:15.012690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fcacb9d-686c-40c8-957a-775bcf76f68e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:15.015153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fcacb9d-686c-40c8-957a-775bcf76f68e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:15.089880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1109785400", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:15.120788 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8fcacb9d-686c-40c8-957a-775bcf76f68e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.136306 Dec 18 21:06:15.122382 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2478/4949] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:14 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:15.222551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] validate_networks() for [('1868cd24-2ddf-47fc-8474-997160de3083', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:06:15.593841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:15.600149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:15.621998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:15.623778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:15.624895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:15.630910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:16.790421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:16.809076 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e449c46-6094-491e-ae73-21a5dc5ed54c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 1.209293 Dec 18 21:06:16.810428 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2479/4950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:15 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:16.816795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-612d51b3-7327-4603-9337-9695e0d2b3c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:16.818222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-612d51b3-7327-4603-9337-9695e0d2b3c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:16.836243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-612d51b3-7327-4603-9337-9695e0d2b3c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:16.837060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-612d51b3-7327-4603-9337-9695e0d2b3c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:16.839071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-612d51b3-7327-4603-9337-9695e0d2b3c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:16.839775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-612d51b3-7327-4603-9337-9695e0d2b3c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:16.947492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-612d51b3-7327-4603-9337-9695e0d2b3c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.104585 Dec 18 21:06:16.947492 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2480/4951] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:16 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:17.832054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:17.832762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:17.843045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:17.844487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:17.846851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:17.847504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:17.870884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:06:17.872076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:06:17.872076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:06:17.872569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:06:17.873035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:06:17.921336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:17.921839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:17.933202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:17.936532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:17.973942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Getting quotas for project ea26536b064a4650b9c08f4b5ce6fadf. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:06:17.979834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Getting quotas for user d6278aefb6d5497aad3d74b47b2e95d9 and project ea26536b064a4650b9c08f4b5ce6fadf. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:06:17.996159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:06:17.999089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:06:18.087080 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39d4110f-de2d-469c-ad23-e50e5fd1b72a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.000842 Dec 18 21:06:18.093145 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2472/4952] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 3007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:06:18.099416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e935c07c-4c82-4446-8b51-b9d19f3c3302 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:18.101836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e935c07c-4c82-4446-8b51-b9d19f3c3302 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:18.112638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e935c07c-4c82-4446-8b51-b9d19f3c3302 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:18.113395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e935c07c-4c82-4446-8b51-b9d19f3c3302 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:18.114417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e935c07c-4c82-4446-8b51-b9d19f3c3302 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:18.115018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e935c07c-4c82-4446-8b51-b9d19f3c3302 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:18.185349 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e935c07c-4c82-4446-8b51-b9d19f3c3302 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.089304 Dec 18 21:06:18.194242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2473/4953] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:18 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:18.200513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57572dfc-b9e4-4941-861f-e51c9b178bce tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:18.201456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57572dfc-b9e4-4941-861f-e51c9b178bce tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:18.378389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-57572dfc-b9e4-4941-861f-e51c9b178bce tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:18.397576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57572dfc-b9e4-4941-861f-e51c9b178bce tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1217 microversion: 2.1 time: 0.201558 Dec 18 21:06:18.398594 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2474/4954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:18 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:18.847980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:18.859747 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8b1ba89e-5400-492d-a050-a7583cd98213 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 1.031713 Dec 18 21:06:18.871721 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2481/4955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:17 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:19.199055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a6cf36eb-61ca-4a8c-b950-76cfd9eb5175 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:19.200110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6cf36eb-61ca-4a8c-b950-76cfd9eb5175 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:19.216019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6cf36eb-61ca-4a8c-b950-76cfd9eb5175 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:19.220634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6cf36eb-61ca-4a8c-b950-76cfd9eb5175 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:19.223249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6cf36eb-61ca-4a8c-b950-76cfd9eb5175 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:19.223824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6cf36eb-61ca-4a8c-b950-76cfd9eb5175 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:19.328017 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a6cf36eb-61ca-4a8c-b950-76cfd9eb5175 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.133181 Dec 18 21:06:19.340871 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2475/4956] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:19 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:19.429335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:19.434593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:19.461143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:19.462653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:19.463482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:19.463923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:19.818306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:19.829938 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1b35c38-ebe3-4c47-8c1f-2d777bdf086b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1269 microversion: 2.1 time: 0.417103 Dec 18 21:06:19.832916 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2482/4957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:19 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1269 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:19.879210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:19.880226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:19.899693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:19.912941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:19.914148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:19.917502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:20.348825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16f5e075-e7a3-4604-b140-3257a745e770 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:20.350023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-16f5e075-e7a3-4604-b140-3257a745e770 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:20.365839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f5e075-e7a3-4604-b140-3257a745e770 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:20.366670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f5e075-e7a3-4604-b140-3257a745e770 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:20.367673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f5e075-e7a3-4604-b140-3257a745e770 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:20.368266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f5e075-e7a3-4604-b140-3257a745e770 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:20.447842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-16f5e075-e7a3-4604-b140-3257a745e770 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.103105 Dec 18 21:06:20.449239 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2483/4958] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:20 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:20.654957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:20.667301 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ba8bd83-3dae-4d29-a9af-61ea7af8fc6f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 0.793724 Dec 18 21:06:20.673042 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2476/4959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:19 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:20.853656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:20.854703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:20.895861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:20.898707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:20.900305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:20.900766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:21.194733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:21.202718 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb394000-5e09-4bbf-a75b-6bed39f1e57c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1275 microversion: 2.1 time: 0.357390 Dec 18 21:06:21.209930 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2484/4960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:20 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1275 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:21.461224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7374a47-eb0f-4293-8430-9c07448eb7db tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:21.462082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7374a47-eb0f-4293-8430-9c07448eb7db tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:21.478455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7374a47-eb0f-4293-8430-9c07448eb7db tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:21.478957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7374a47-eb0f-4293-8430-9c07448eb7db tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:21.481159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7374a47-eb0f-4293-8430-9c07448eb7db tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:21.481615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7374a47-eb0f-4293-8430-9c07448eb7db tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:21.597977 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7374a47-eb0f-4293-8430-9c07448eb7db tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.140087 Dec 18 21:06:21.605491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2477/4961] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:21 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:21.692903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:21.694167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:21.726001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:21.726502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:21.730343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:21.730872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:22.220941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:22.222515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:22.235029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:22.238784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:22.240147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:22.240799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:22.837110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:22.863376 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e68c8e62-a8a3-4f42-b510-3e6e6ac18ae7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 1.173010 Dec 18 21:06:22.866978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2485/4962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:21 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:22.884297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64b582da-c3b4-462b-865b-8dd24ca3fa14 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:22.885986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64b582da-c3b4-462b-865b-8dd24ca3fa14 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:22.898579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64b582da-c3b4-462b-865b-8dd24ca3fa14 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:22.900441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64b582da-c3b4-462b-865b-8dd24ca3fa14 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:22.901690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64b582da-c3b4-462b-865b-8dd24ca3fa14 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:22.902650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64b582da-c3b4-462b-865b-8dd24ca3fa14 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:22.958749 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64b582da-c3b4-462b-865b-8dd24ca3fa14 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.090033 Dec 18 21:06:22.959975 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2486/4963] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:22 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:23.099977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:23.108759 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4b2b333-2d48-47ee-9e7e-371316647081 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 0.892718 Dec 18 21:06:23.110275 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2478/4964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:22 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:23.899856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:23.901316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:23.918981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:23.919785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:23.921371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:23.924778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:23.971996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b3496be-4e8f-4e7a-b282-b16bcce7b41e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:23.973730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b3496be-4e8f-4e7a-b282-b16bcce7b41e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:23.997166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3496be-4e8f-4e7a-b282-b16bcce7b41e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:23.998077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3496be-4e8f-4e7a-b282-b16bcce7b41e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:24.001926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3496be-4e8f-4e7a-b282-b16bcce7b41e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:24.003588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b3496be-4e8f-4e7a-b282-b16bcce7b41e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:24.072516 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b3496be-4e8f-4e7a-b282-b16bcce7b41e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.104936 Dec 18 21:06:24.073989 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2479/4965] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:23 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:24.127376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:24.128421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:24.140561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:24.144749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:24.147552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:24.148272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:24.911570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:24.944464 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3114fb66-0968-425f-9a3c-79aec3372f35 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 1.056700 Dec 18 21:06:24.947509 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2487/4966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:23 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:24.964744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-683c0147-653e-4b63-a345-56d62114dc20 req-fefbd9b4-29b5-4f37-b290-343e92f357b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec0ec05-7209-486c-8059-40980e829fbb", "tag": "46e75647-b225-467b-8eec-04fcb683c9a3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:24.971127 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:24.971127 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:06:24.986946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-683c0147-653e-4b63-a345-56d62114dc20 req-fefbd9b4-29b5-4f37-b290-343e92f357b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:24.988598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-683c0147-653e-4b63-a345-56d62114dc20 req-fefbd9b4-29b5-4f37-b290-343e92f357b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:24.995301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:25.003337 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18cd37bb-2968-460a-a618-5b5d0677674c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 0.880854 Dec 18 21:06:25.003920 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2480/4967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:24 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:25.012237 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-683c0147-653e-4b63-a345-56d62114dc20 req-fefbd9b4-29b5-4f37-b290-343e92f357b7 service nova] Creating event network-changed:46e75647-b225-467b-8eec-04fcb683c9a3 for instance 7ec0ec05-7209-486c-8059-40980e829fbb on nch2-master-1 Dec 18 21:06:25.028530 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-683c0147-653e-4b63-a345-56d62114dc20 req-fefbd9b4-29b5-4f37-b290-343e92f357b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079483 Dec 18 21:06:25.030668 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2488/4968] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:06:25.084621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0775bb7-9fb7-4594-aa6d-04cdba4b2266 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:25.085586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0775bb7-9fb7-4594-aa6d-04cdba4b2266 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:25.096777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0775bb7-9fb7-4594-aa6d-04cdba4b2266 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:25.098118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0775bb7-9fb7-4594-aa6d-04cdba4b2266 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:25.100630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0775bb7-9fb7-4594-aa6d-04cdba4b2266 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:25.101182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0775bb7-9fb7-4594-aa6d-04cdba4b2266 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:25.179440 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0775bb7-9fb7-4594-aa6d-04cdba4b2266 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.098618 Dec 18 21:06:25.184322 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2481/4969] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:25 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:25.963069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:25.963677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:25.986847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:25.987292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:25.988105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:25.988542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:26.020524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:26.021940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:26.037712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:26.041352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:26.042520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:26.043120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:26.722404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:26.730158 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-920a271d-4f38-46c7-a42c-6eabfb243859 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 0.772793 Dec 18 21:06:26.730790 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2489/4970] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:25 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:26.751080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f0f561d-a8ef-4d62-bfc9-f2190faa0591 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:26.752823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8f0f561d-a8ef-4d62-bfc9-f2190faa0591 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:26.775692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f0f561d-a8ef-4d62-bfc9-f2190faa0591 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:26.776435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f0f561d-a8ef-4d62-bfc9-f2190faa0591 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:26.777244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f0f561d-a8ef-4d62-bfc9-f2190faa0591 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:26.777844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f0f561d-a8ef-4d62-bfc9-f2190faa0591 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:26.903363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f0f561d-a8ef-4d62-bfc9-f2190faa0591 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.159481 Dec 18 21:06:26.914666 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2490/4971] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:26 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:26.937035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:26.946029 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a6c8b2f2-73da-491f-b4ae-95fec1117fc8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 0.929387 Dec 18 21:06:26.946718 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2482/4972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:26 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:27.749013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:27.749765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:27.786707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:27.787170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:27.795848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:27.796308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:27.921723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd0ce5b1-53dc-472b-ac0b-b48decf5946d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:27.925031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd0ce5b1-53dc-472b-ac0b-b48decf5946d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:27.943914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd0ce5b1-53dc-472b-ac0b-b48decf5946d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:27.944399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd0ce5b1-53dc-472b-ac0b-b48decf5946d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:27.947259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd0ce5b1-53dc-472b-ac0b-b48decf5946d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:27.947723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd0ce5b1-53dc-472b-ac0b-b48decf5946d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:28.037147 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd0ce5b1-53dc-472b-ac0b-b48decf5946d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.109236 Dec 18 21:06:28.037947 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2483/4973] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:27 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:28.048865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:28.053384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:28.080640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:28.093776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:28.096420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:28.097050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:28.649677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:28.663508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:28.674109 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df75b317-4fa7-42a6-b639-a11381bc8baf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 0.929400 Dec 18 21:06:28.679355 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba156f8a-f076-453e-8f72-d432b3a040cb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 0.638790 Dec 18 21:06:28.682207 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2484/4974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:28 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:28.693709 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2491/4975] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:27 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:29.050413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-afb49ce9-74aa-413f-836b-d6463566a97a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:29.052042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-afb49ce9-74aa-413f-836b-d6463566a97a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:29.072538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb49ce9-74aa-413f-836b-d6463566a97a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:29.074761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb49ce9-74aa-413f-836b-d6463566a97a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:29.078531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb49ce9-74aa-413f-836b-d6463566a97a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:29.079090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afb49ce9-74aa-413f-836b-d6463566a97a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:29.197607 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-afb49ce9-74aa-413f-836b-d6463566a97a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.150998 Dec 18 21:06:29.198905 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2485/4976] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:29 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:29.704051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:29.705029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:29.706041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:29.721258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:29.756719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:29.768461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:29.769864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:29.770011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:29.770820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:29.771443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:29.774852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:29.779766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:30.809290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:30.826925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35ed874f-e43c-484b-8224-870ec3d85c01 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 1.124215 Dec 18 21:06:30.830362 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2486/4977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:29 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:30.836751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:30.846514 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c7e7cdc-3467-448d-a3a5-9dcea47fa04f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 1.153040 Dec 18 21:06:30.855013 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2492/4978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:29 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:30.856949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0acb974c-2b7b-4a01-a155-e0eed07f8697 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:30.864948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0acb974c-2b7b-4a01-a155-e0eed07f8697 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:30.883714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0acb974c-2b7b-4a01-a155-e0eed07f8697 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:30.887704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0acb974c-2b7b-4a01-a155-e0eed07f8697 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:30.889018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0acb974c-2b7b-4a01-a155-e0eed07f8697 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:30.890333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0acb974c-2b7b-4a01-a155-e0eed07f8697 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:30.948385 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0acb974c-2b7b-4a01-a155-e0eed07f8697 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.116258 Dec 18 21:06:30.951885 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2487/4979] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:30 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:31.854087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:31.855688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:31.871776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:31.871928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:31.872653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:31.881321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:31.882577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:31.884713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:31.896782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:31.897313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:31.898178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:31.901940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:32.506230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:32.537842 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d76645b-f398-4da2-9d7c-772a354df790 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 0.668107 Dec 18 21:06:32.540537 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2488/4980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:31 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:32.546654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:32.556719 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e332c9e-e141-4298-ad04-bea13d2fc8d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 0.714085 Dec 18 21:06:32.562178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12fcc6de-529f-4008-82ff-df0865b2547b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:32.563375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-12fcc6de-529f-4008-82ff-df0865b2547b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:32.570653 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2493/4981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:31 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:32.571092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12fcc6de-529f-4008-82ff-df0865b2547b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:32.572037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12fcc6de-529f-4008-82ff-df0865b2547b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:32.573139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12fcc6de-529f-4008-82ff-df0865b2547b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:32.573823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-12fcc6de-529f-4008-82ff-df0865b2547b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:32.663075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12fcc6de-529f-4008-82ff-df0865b2547b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.119837 Dec 18 21:06:32.669122 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2489/4982] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:32 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:33.555207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:33.555829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:33.564587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:33.565045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:33.565853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:33.566327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:33.578103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:33.580895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:33.609068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:33.611013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:33.622498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:33.623265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:33.976008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:33.983691 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39420b9c-0075-4816-83b3-4ca45f242104 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 0.432188 Dec 18 21:06:33.989303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2494/4983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:33 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:33.997048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa46931d-84bc-47a5-89dd-bd49624f6681 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:33.998378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa46931d-84bc-47a5-89dd-bd49624f6681 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:34.010367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa46931d-84bc-47a5-89dd-bd49624f6681 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:34.011084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa46931d-84bc-47a5-89dd-bd49624f6681 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:34.012097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa46931d-84bc-47a5-89dd-bd49624f6681 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:34.012695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa46931d-84bc-47a5-89dd-bd49624f6681 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:34.057764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:34.082432 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47ec4db9-14e6-4367-8b85-d8ce656b0f05 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1522 microversion: 2.1 time: 0.509933 Dec 18 21:06:34.084025 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2490/4984] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:33 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:34.098567 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa46931d-84bc-47a5-89dd-bd49624f6681 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.107487 Dec 18 21:06:34.105727 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2495/4985] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:33 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:34.960174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-304696a9-f19f-417d-b9b7-b995a5341aab req-734c1fd9-e16e-4e3a-b727-81ee41020b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec0ec05-7209-486c-8059-40980e829fbb", "name": "network-vif-plugged", "status": "completed", "tag": "46e75647-b225-467b-8eec-04fcb683c9a3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:34.962179 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:34.962179 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:06:34.983037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-304696a9-f19f-417d-b9b7-b995a5341aab req-734c1fd9-e16e-4e3a-b727-81ee41020b77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:34.984170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-304696a9-f19f-417d-b9b7-b995a5341aab req-734c1fd9-e16e-4e3a-b727-81ee41020b77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:35.011141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:35.012561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:35.022535 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-304696a9-f19f-417d-b9b7-b995a5341aab req-734c1fd9-e16e-4e3a-b727-81ee41020b77 service nova] Creating event network-vif-plugged:46e75647-b225-467b-8eec-04fcb683c9a3 for instance 7ec0ec05-7209-486c-8059-40980e829fbb on nch2-master-1 Dec 18 21:06:35.022751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:35.023036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:35.023845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:35.030377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:35.033773 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-304696a9-f19f-417d-b9b7-b995a5341aab req-734c1fd9-e16e-4e3a-b727-81ee41020b77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078520 Dec 18 21:06:35.035044 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2491/4986] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:06:35.101253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:35.101964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:35.113872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:35.114364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:35.115188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:35.115637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:35.664996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:35.673872 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9fa57648-bf94-4c2f-9ecf-06e8bbe10201 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1504 microversion: 2.1 time: 0.575931 Dec 18 21:06:35.674636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:35.684752 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2492/4987] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:35 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1504 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:35.691141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-915acbd6-b74d-4cfc-9aa8-3a44e388259f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:35.691410 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66caccde-83d6-4d81-91ce-c0c9aaec2895 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1317 microversion: 2.1 time: 0.683883 Dec 18 21:06:35.692255 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2496/4988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:35 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:35.693216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-915acbd6-b74d-4cfc-9aa8-3a44e388259f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:35.710310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-915acbd6-b74d-4cfc-9aa8-3a44e388259f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:35.711363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-915acbd6-b74d-4cfc-9aa8-3a44e388259f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:35.712560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-915acbd6-b74d-4cfc-9aa8-3a44e388259f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:35.713788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-915acbd6-b74d-4cfc-9aa8-3a44e388259f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:35.809866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-915acbd6-b74d-4cfc-9aa8-3a44e388259f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.123586 Dec 18 21:06:35.815630 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2493/4989] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:35 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:36.692572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:36.693861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:36.708495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:36.717331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:36.718966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:36.719396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:36.723158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:36.724902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:36.734063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:36.737877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:36.741941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:36.745153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:37.248450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:37.263460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:37.274342 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99360c30-8285-4156-9d8d-6fd29931c6eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1506 microversion: 2.1 time: 0.566826 Dec 18 21:06:37.278951 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2494/4990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:36 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:37.283909 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b91b0bdf-1404-4eb2-a9a3-e5c6893fe3c7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1504 microversion: 2.1 time: 0.595855 Dec 18 21:06:37.286172 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2497/4991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:36 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:37.314683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2900ef21-b838-481a-8c53-faffcdce97e1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:37.319269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2900ef21-b838-481a-8c53-faffcdce97e1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:37.321581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:37.324558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:37.344402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:37.346026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2900ef21-b838-481a-8c53-faffcdce97e1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:37.346790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:37.348484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:37.348769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2900ef21-b838-481a-8c53-faffcdce97e1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:37.350542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2900ef21-b838-481a-8c53-faffcdce97e1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:37.351478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2900ef21-b838-481a-8c53-faffcdce97e1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:37.351748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:37.408676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:06:37.425396 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2900ef21-b838-481a-8c53-faffcdce97e1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.137783 Dec 18 21:06:37.426761 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2495/4992] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:37 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:37.604360 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-604aa3a5-9366-4273-adf1-9d30b0a32eb1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 204 len: 0 microversion: 2.1 time: 0.307324 Dec 18 21:06:37.610436 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2498/4993] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:06:37 2021] DELETE /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:06:37.618662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:37.619677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:37.630858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:37.631323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:37.632167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:37.632659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:38.005880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:38.013605 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0151e9a9-384c-488e-8295-1910a7ca43b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1512 microversion: 2.1 time: 0.401557 Dec 18 21:06:38.014309 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2496/4994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:37 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:38.302088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:38.303200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:38.325411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:38.325877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:38.330326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:38.331055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:38.439151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5292f755-17d8-460b-92fc-37e336c0543d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:38.440176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5292f755-17d8-460b-92fc-37e336c0543d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:38.460440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5292f755-17d8-460b-92fc-37e336c0543d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:38.461264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5292f755-17d8-460b-92fc-37e336c0543d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:38.462284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5292f755-17d8-460b-92fc-37e336c0543d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:38.462882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5292f755-17d8-460b-92fc-37e336c0543d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:38.545108 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5292f755-17d8-460b-92fc-37e336c0543d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.109873 Dec 18 21:06:38.546490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2497/4995] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:38 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:38.592542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:38.603077 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5e3bcc12-bdd4-4d76-ab2a-4cdb15758b9b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1504 microversion: 2.1 time: 0.305411 Dec 18 21:06:38.603683 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2499/4996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:38 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:38.762606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ba983ddd-d5bd-4a8e-bece-05263dcfe382 req-136b2b77-f0e5-46f9-a9a5-d61e326d639c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9b708f-24ca-4dad-9e48-ce4b71edf595", "name": "network-vif-unplugged", "status": "completed", "tag": "39f33934-8809-44c6-97cd-68c74a5bf74c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:38.764359 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:38.764359 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:06:38.788385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ba983ddd-d5bd-4a8e-bece-05263dcfe382 req-136b2b77-f0e5-46f9-a9a5-d61e326d639c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:38.794011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ba983ddd-d5bd-4a8e-bece-05263dcfe382 req-136b2b77-f0e5-46f9-a9a5-d61e326d639c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:38.814387 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ba983ddd-d5bd-4a8e-bece-05263dcfe382 req-136b2b77-f0e5-46f9-a9a5-d61e326d639c service nova] Creating event network-vif-unplugged:39f33934-8809-44c6-97cd-68c74a5bf74c for instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 on nch1-master-1 Dec 18 21:06:38.820636 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ba983ddd-d5bd-4a8e-bece-05263dcfe382 req-136b2b77-f0e5-46f9-a9a5-d61e326d639c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062203 Dec 18 21:06:38.821819 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2498/4997] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:06:39.031156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:39.032298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:39.044229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:39.044693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:39.045675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:39.046325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:39.564639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc2d1637-41c0-4059-9f39-78081277b98f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:39.566470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc2d1637-41c0-4059-9f39-78081277b98f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:39.579436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc2d1637-41c0-4059-9f39-78081277b98f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:39.580486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc2d1637-41c0-4059-9f39-78081277b98f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:39.581501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc2d1637-41c0-4059-9f39-78081277b98f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:39.582120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc2d1637-41c0-4059-9f39-78081277b98f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:39.674507 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc2d1637-41c0-4059-9f39-78081277b98f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.118062 Dec 18 21:06:39.683288 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2499/4998] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:39 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:39.693411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:39.694651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:39.708224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:39.708939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:39.709954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:39.710726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:40.176146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:40.196434 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b859f3ae-2bc9-4e50-b8b9-988ae09e8006 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1512 microversion: 2.1 time: 1.162465 Dec 18 21:06:40.197324 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2500/4999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:39 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1512 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:40.694527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c1b7653f-1987-4b6c-996c-d51d5e013e58 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:40.695464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c1b7653f-1987-4b6c-996c-d51d5e013e58 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:40.715391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1b7653f-1987-4b6c-996c-d51d5e013e58 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:40.716275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1b7653f-1987-4b6c-996c-d51d5e013e58 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:40.717789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1b7653f-1987-4b6c-996c-d51d5e013e58 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:40.718821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1b7653f-1987-4b6c-996c-d51d5e013e58 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:40.784272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:40.794140 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a78287dd-4dec-4d0c-b7a1-5a62348a21b9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 200 len: 1447 microversion: 2.1 time: 1.109439 Dec 18 21:06:40.798598 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2500/5000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:39 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 1447 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:40.824246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:40.825052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:40.831858 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c1b7653f-1987-4b6c-996c-d51d5e013e58 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.139135 Dec 18 21:06:40.839789 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2501/5001] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:40 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:40.847656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:40.848789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:40.852191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:40.853345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:40.929983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:06:40.961297 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Working on deleting snapshot 9dc190c0-65c0-43ba-b909-245cdd35a394 from shelved instance... Dec 18 21:06:41.214071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:41.214818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:41.227021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:41.227482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:41.228286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:41.246190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:41.458108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:41.466157 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82385922-9af6-40a7-9b72-109403e36ae4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 200 len: 1302 microversion: 2.1 time: 0.256240 Dec 18 21:06:41.472564 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2502/5002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:41 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 1302 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:41.477506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-31b8c9a8-027e-4fdd-b52b-debea809c115 req-a50ecbdd-df13-4ea9-9efa-b9bb031294f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec0ec05-7209-486c-8059-40980e829fbb", "name": "network-vif-deleted", "tag": "46e75647-b225-467b-8eec-04fcb683c9a3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:41.483622 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:41.483622 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:06:41.503320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-31b8c9a8-027e-4fdd-b52b-debea809c115 req-a50ecbdd-df13-4ea9-9efa-b9bb031294f0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:41.504603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-31b8c9a8-027e-4fdd-b52b-debea809c115 req-a50ecbdd-df13-4ea9-9efa-b9bb031294f0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:41.535436 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-31b8c9a8-027e-4fdd-b52b-debea809c115 req-a50ecbdd-df13-4ea9-9efa-b9bb031294f0 service nova] Creating event network-vif-deleted:46e75647-b225-467b-8eec-04fcb683c9a3 for instance 7ec0ec05-7209-486c-8059-40980e829fbb on nch2-master-1 Dec 18 21:06:41.547210 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-31b8c9a8-027e-4fdd-b52b-debea809c115 req-a50ecbdd-df13-4ea9-9efa-b9bb031294f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072409 Dec 18 21:06:41.548243 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2503/5003] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:06:41.852356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71bdcde6-6a06-4b52-8aba-d6b6ea9f6789 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:41.859389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71bdcde6-6a06-4b52-8aba-d6b6ea9f6789 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:41.885154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71bdcde6-6a06-4b52-8aba-d6b6ea9f6789 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:41.886793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71bdcde6-6a06-4b52-8aba-d6b6ea9f6789 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:41.889406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71bdcde6-6a06-4b52-8aba-d6b6ea9f6789 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:41.898703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71bdcde6-6a06-4b52-8aba-d6b6ea9f6789 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:42.070822 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71bdcde6-6a06-4b52-8aba-d6b6ea9f6789 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.226632 Dec 18 21:06:42.087434 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2504/5004] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:41 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:42.489459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:42.490902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:42.503422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:42.504146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:42.509751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:42.510901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:42.519397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Doing local delete in cell cebfe89f-5b97-4ab9-9d9f-7dac71d0b692(cell1) {{(pid=140731) _delete /opt/stack/nova/nova/compute/api.py:2439}} Dec 18 21:06:42.520592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:42.521173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:42.521958 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 18 21:06:42.526734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] deallocate_for_instance() {{(pid=140731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Dec 18 21:06:42.551441 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. Dec 18 21:06:42.552518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:42.554288 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e69bfb31-13c1-402d-bc6f-cdcb0d147ee0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 404 len: 111 microversion: 2.1 time: 0.071284 Dec 18 21:06:42.560436 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2505/5005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:42 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:06:42.570400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:42.571373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:42.578553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:42.579925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:42.580958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:42.581660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:43.741462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:43.751851 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c070d81b-0c16-4c69-b7a2-242810f3366f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 1.186608 Dec 18 21:06:43.752438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2506/5006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:42 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:43.757149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba2869ed-a477-440c-a35b-b765878311dd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:43.758227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba2869ed-a477-440c-a35b-b765878311dd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:43.769956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba2869ed-a477-440c-a35b-b765878311dd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:43.770447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba2869ed-a477-440c-a35b-b765878311dd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:43.771408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba2869ed-a477-440c-a35b-b765878311dd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:43.771728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba2869ed-a477-440c-a35b-b765878311dd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:43.883723 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba2869ed-a477-440c-a35b-b765878311dd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.129692 Dec 18 21:06:43.891512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2507/5007] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:43 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:43.979544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d0870ae-c91d-4e83-af6e-002818b1f54e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:43.981398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d0870ae-c91d-4e83-af6e-002818b1f54e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:43.982567 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d0870ae-c91d-4e83-af6e-002818b1f54e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.007187 Dec 18 21:06:43.983694 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2508/5008] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:43 2021] POST /compute/v2.1/servers => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:06:43.998813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:44.007756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:44.034693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:44.035183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:44.036006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:44.036451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:44.602987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:44.616079 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c8eba24-7e8a-4c54-88be-f782c2a69a2e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.623838 Dec 18 21:06:44.618917 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2509/5009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:43 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:44.647071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:44.649223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:44.678174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:44.682976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:44.684256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:44.685084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:44.982595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Updating instance_info_cache with network_info: [] {{(pid=140731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 18 21:06:45.170479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:45.184382 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8db25529-2535-4b50-89c6-2ebbbc565ca5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.551157 Dec 18 21:06:45.193233 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2510/5010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:44 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:45.210760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-038856e8-489c-46a4-9784-50c93196fa28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:45.212046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-038856e8-489c-46a4-9784-50c93196fa28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:45.232483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-038856e8-489c-46a4-9784-50c93196fa28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:45.232871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-038856e8-489c-46a4-9784-50c93196fa28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:45.236442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-038856e8-489c-46a4-9784-50c93196fa28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:45.236930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-038856e8-489c-46a4-9784-50c93196fa28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:45.360812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-038856e8-489c-46a4-9784-50c93196fa28 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.165864 Dec 18 21:06:45.362120 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2511/5011] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:45 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:45.382336 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0c6dc62-9604-4543-a515-ef10c65cfab4 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 204 len: 0 microversion: 2.1 time: 4.567624 Dec 18 21:06:45.383830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c3249e1e-189c-4969-bdc1-1fee9eba825e req-2c376e85-54b4-4262-bc05-80ba4a35622c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab9b708f-24ca-4dad-9e48-ce4b71edf595", "name": "network-vif-deleted", "tag": "39f33934-8809-44c6-97cd-68c74a5bf74c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:45.385626 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:45.385626 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:06:45.389254 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2501/5012] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:06:40 2021] DELETE /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 0 bytes in 4574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:06:45.401234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:45.401734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:45.407849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c3249e1e-189c-4969-bdc1-1fee9eba825e req-2c376e85-54b4-4262-bc05-80ba4a35622c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:45.408957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c3249e1e-189c-4969-bdc1-1fee9eba825e req-2c376e85-54b4-4262-bc05-80ba4a35622c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:45.426621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:45.427455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:45.428639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:45.429266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:45.442717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.server_external_events [req-c3249e1e-189c-4969-bdc1-1fee9eba825e req-2c376e85-54b4-4262-bc05-80ba4a35622c service nova] Unable to find a host for instance ab9b708f-24ca-4dad-9e48-ce4b71edf595. Dropping event network-vif-deleted {{(pid=140732) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 18 21:06:45.443980 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c3249e1e-189c-4969-bdc1-1fee9eba825e req-2c376e85-54b4-4262-bc05-80ba4a35622c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.075056 Dec 18 21:06:45.446843 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2512/5013] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:45 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 81 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 18 21:06:45.478872 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 could not be found. Dec 18 21:06:45.479735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:45.480590 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-407a0a43-cd72-4c3c-8f08-5b225db0e98f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 404 len: 111 microversion: 2.1 time: 0.089233 Dec 18 21:06:45.484799 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2502/5014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:45 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:06:45.754373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-17752178", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "02107735-1e4a-434f-a377-a881410f569a"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:45.889432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] validate_networks() for [('02107735-1e4a-434f-a377-a881410f569a', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:06:46.373624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92790dea-15a6-41eb-b087-8dbdf22f23c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:46.374784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92790dea-15a6-41eb-b087-8dbdf22f23c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:46.385763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92790dea-15a6-41eb-b087-8dbdf22f23c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:46.388179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92790dea-15a6-41eb-b087-8dbdf22f23c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:46.389245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92790dea-15a6-41eb-b087-8dbdf22f23c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:46.389773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92790dea-15a6-41eb-b087-8dbdf22f23c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:46.456427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92790dea-15a6-41eb-b087-8dbdf22f23c1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.086814 Dec 18 21:06:46.457754 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2503/5015] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:46 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:47.084047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:06:47.084535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:06:47.084927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:06:47.085334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:06:47.085740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:06:47.107196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:47.107583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:47.108413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:47.108852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:47.193389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:06:47.211985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for user 0a98795bdb7447c5b2a4930173b3c56d and project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:06:47.262066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:06:47.265042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:06:47.350374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75cece9d-59dd-4a44-9f59-806cbce86cba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1268350195", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dd78e899-c855-4e65-bba8-34d29b113975", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:47.416277 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a54e360-92e9-4a3c-83dc-f1b48a1bbc5a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.666436 Dec 18 21:06:47.417580 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2513/5016] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:06:47.427370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e91a4622-fe8b-499b-89c4-ab4913fd26a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:47.427992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e91a4622-fe8b-499b-89c4-ab4913fd26a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:47.549465 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-75cece9d-59dd-4a44-9f59-806cbce86cba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Block Device dd78e899-c855-4e65-bba8-34d29b113975 is not bootable. Dec 18 21:06:47.550835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75cece9d-59dd-4a44-9f59-806cbce86cba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Block Device dd78e899-c855-4e65-bba8-34d29b113975 is not bootable. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:47.551951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75cece9d-59dd-4a44-9f59-806cbce86cba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.207500 Dec 18 21:06:47.552974 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2504/5017] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:47 2021] POST /compute/v2.1/servers => generated 110 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:06:47.558059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3a20f5d6-bc62-429d-a9d3-d67b497394ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:47.565197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3a20f5d6-bc62-429d-a9d3-d67b497394ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:47.621577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d6-bc62-429d-a9d3-d67b497394ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:47.622366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d6-bc62-429d-a9d3-d67b497394ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:47.627052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d6-bc62-429d-a9d3-d67b497394ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:47.635578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d6-bc62-429d-a9d3-d67b497394ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:47.780084 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3a20f5d6-bc62-429d-a9d3-d67b497394ff tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.224925 Dec 18 21:06:47.788083 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2505/5018] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:47 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:47.794057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:47.802572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:47.812685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:47.813690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:47.814535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:47.814982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:48.096203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e91a4622-fe8b-499b-89c4-ab4913fd26a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:48.115979 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e91a4622-fe8b-499b-89c4-ab4913fd26a6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1213 microversion: 2.1 time: 0.682942 Dec 18 21:06:48.117225 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2514/5019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:47 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1213 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:48.269659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:48.282473 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58d3834f-d35d-49af-88bb-47776bd4081c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.492405 Dec 18 21:06:48.288086 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2506/5020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:47 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:48.307956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:48.308624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:48.317440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:48.317902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:48.327074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:48.327543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:48.814719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:48.820859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6f40702-371e-4664-bb44-a689a78e1540 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:48.823640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6f40702-371e-4664-bb44-a689a78e1540 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:48.832566 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f77f3a83-8538-4414-badd-590517fd1ac6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.528447 Dec 18 21:06:48.833737 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2515/5021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:48 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:48.848202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f40702-371e-4664-bb44-a689a78e1540 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:48.849001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f40702-371e-4664-bb44-a689a78e1540 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:48.850357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f40702-371e-4664-bb44-a689a78e1540 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:48.851032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6f40702-371e-4664-bb44-a689a78e1540 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:48.950531 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6f40702-371e-4664-bb44-a689a78e1540 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.156014 Dec 18 21:06:48.952632 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2507/5022] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:48 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:49.135266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:49.138812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:49.171008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:49.177115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:49.180392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:49.183040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:49.411790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:49.430738 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4562f68b-ddd5-4c86-af9d-7f81558dec33 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1273 microversion: 2.1 time: 0.297038 Dec 18 21:06:49.434389 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2516/5023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:49 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:49.966106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-15fbe8a4-7f44-4159-b7d4-cc1ed956357b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:49.968078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-15fbe8a4-7f44-4159-b7d4-cc1ed956357b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:49.996591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15fbe8a4-7f44-4159-b7d4-cc1ed956357b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:49.998144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15fbe8a4-7f44-4159-b7d4-cc1ed956357b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:50.001898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15fbe8a4-7f44-4159-b7d4-cc1ed956357b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:50.007507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15fbe8a4-7f44-4159-b7d4-cc1ed956357b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:50.100718 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-15fbe8a4-7f44-4159-b7d4-cc1ed956357b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.140288 Dec 18 21:06:50.103459 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2508/5024] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:49 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:50.451591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:50.452132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:50.465316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:50.467241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:50.468328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:50.474717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:50.612286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1dd28a1a-0428-4e44-aa44-c0b2f62ff3fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-840951928", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "destination_type": "local"}, {"source_type": "volume", "uuid": "7cf9ffd2-1a5c-45ac-b99c-8aa62037cc81", "destination_type": "invalid"}], "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:50.614640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1dd28a1a-0428-4e44-aa44-c0b2f62ff3fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:50.615486 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1dd28a1a-0428-4e44-aa44-c0b2f62ff3fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010622 Dec 18 21:06:50.622466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:50.623707 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2509/5025] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:50 2021] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:06:50.631921 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8dfcb011-8182-461f-88a2-3f7c0bdfd30d tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1271 microversion: 2.1 time: 0.184058 Dec 18 21:06:50.635302 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2517/5026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:50 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:50.643571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:50.645706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:50.684692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:50.686804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:50.687990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:50.689623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:51.113084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c279633-3c4a-45f3-8daa-59606ef3c90e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:51.114364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c279633-3c4a-45f3-8daa-59606ef3c90e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:51.129988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c279633-3c4a-45f3-8daa-59606ef3c90e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:51.130500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c279633-3c4a-45f3-8daa-59606ef3c90e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:51.131488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c279633-3c4a-45f3-8daa-59606ef3c90e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:51.131930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c279633-3c4a-45f3-8daa-59606ef3c90e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:51.197457 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c279633-3c4a-45f3-8daa-59606ef3c90e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.087927 Dec 18 21:06:51.198506 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2518/5027] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:51 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:06:51.221780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:51.238664 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0ce24e7-2e28-4f84-bdba-3a4a52e8ab3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.605307 Dec 18 21:06:51.241374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2510/5028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:50 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:51.267970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:51.268675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:51.293555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:51.295494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:51.307839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:51.309737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:51.653294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:51.654877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:51.666181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:51.674661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:51.678823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:51.679329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:51.913231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:51.920805 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-993868f8-f8c6-4c29-8921-f25969ec3840 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1271 microversion: 2.1 time: 0.272962 Dec 18 21:06:51.930971 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2511/5029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:51 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:51.974408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:51.987843 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1de77d2-a77c-4150-bb83-34d494d2763d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.726289 Dec 18 21:06:51.989366 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2519/5030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:51 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:52.056990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad9b51dd-c6be-436f-87a2-e278652d0886 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1305448983", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:52.058585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad9b51dd-c6be-436f-87a2-e278652d0886 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:52.060233 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad9b51dd-c6be-436f-87a2-e278652d0886 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.007054 Dec 18 21:06:52.064520 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2512/5031] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:52 2021] POST /compute/v2.1/servers => generated 624 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:06:52.072833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:52.073915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:52.086771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:52.087711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:52.088722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:52.089391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:52.211011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da78116d-6993-4c94-bc8e-07b0bddfb92a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:52.212289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da78116d-6993-4c94-bc8e-07b0bddfb92a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:52.226845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da78116d-6993-4c94-bc8e-07b0bddfb92a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:52.228004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da78116d-6993-4c94-bc8e-07b0bddfb92a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:52.229234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da78116d-6993-4c94-bc8e-07b0bddfb92a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:52.231302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da78116d-6993-4c94-bc8e-07b0bddfb92a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:52.311894 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da78116d-6993-4c94-bc8e-07b0bddfb92a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.105433 Dec 18 21:06:52.313392 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2513/5032] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:52 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:52.937521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:52.939031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:52.946357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:52.947074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:52.948041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:52.948752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:53.216500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:53.224952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ae45595-797a-4d38-8d45-58b61c659dc2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 1.155703 Dec 18 21:06:53.225534 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2520/5033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:52 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:53.251475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:53.256797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:53.270199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:53.271068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:53.278135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:53.279127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:53.506190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:53.524836 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b253a39e-9223-455b-972f-4fd0c8e323b0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 0.591169 Dec 18 21:06:53.542246 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2514/5034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:52 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:53.572413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3483f266-8583-475a-9bce-bbe4f1b10233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:53.574861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3483f266-8583-475a-9bce-bbe4f1b10233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:53.585210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3483f266-8583-475a-9bce-bbe4f1b10233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:53.585769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3483f266-8583-475a-9bce-bbe4f1b10233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:53.587388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3483f266-8583-475a-9bce-bbe4f1b10233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:53.588014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3483f266-8583-475a-9bce-bbe4f1b10233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:53.664607 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3483f266-8583-475a-9bce-bbe4f1b10233 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.116276 Dec 18 21:06:53.665685 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2515/5035] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:53 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:53.883512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:53.924038 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1bf17647-fef3-4416-8c0b-c56e2e9b7e87 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.677224 Dec 18 21:06:53.925284 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2521/5036] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:53 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:54.038762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d81ab526-2d33-41c6-8aaf-5d7c643039d3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:54.039976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d81ab526-2d33-41c6-8aaf-5d7c643039d3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:54.040793 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d81ab526-2d33-41c6-8aaf-5d7c643039d3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.007341 Dec 18 21:06:54.041350 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2516/5037] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:54 2021] POST /compute/v2.1/servers => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:06:54.050057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:54.050704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:54.066777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:54.067610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:54.068758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:54.069362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:54.508219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:54.530843 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d4a4161-2375-47a5-b40f-1841e7518c42 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.483619 Dec 18 21:06:54.532358 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2522/5038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:54.549161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:54.550138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:54.561351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:54.561974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:54.562441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:54.563919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:54.565003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:54.566203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:54.590810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:54.592634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:54.593639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:54.594298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:55.040782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:55.052203 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9723f402-fdc3-4adb-8d12-8ad4b1df783a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 0.509191 Dec 18 21:06:55.052827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2517/5039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:54 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:55.057765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7efec115-ccf9-4f4c-8c28-378f0f92e12c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:55.058721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7efec115-ccf9-4f4c-8c28-378f0f92e12c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:55.076875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7efec115-ccf9-4f4c-8c28-378f0f92e12c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:55.077592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7efec115-ccf9-4f4c-8c28-378f0f92e12c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:55.078484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7efec115-ccf9-4f4c-8c28-378f0f92e12c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:55.078947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7efec115-ccf9-4f4c-8c28-378f0f92e12c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:55.084362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:55.110999 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e31ddd7f-543d-4fa9-97de-1b4d12db1b29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.560587 Dec 18 21:06:55.112115 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2523/5040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:55.161512 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7efec115-ccf9-4f4c-8c28-378f0f92e12c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.106055 Dec 18 21:06:55.162187 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2518/5041] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:55 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:55.205518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d267fe70-e211-4975-8dda-eb6a7b98d2c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1843570382", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": -1, "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:55.223458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d267fe70-e211-4975-8dda-eb6a7b98d2c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Flavor -1 could not be found. Dec 18 21:06:55.226952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d267fe70-e211-4975-8dda-eb6a7b98d2c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:55.229031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d267fe70-e211-4975-8dda-eb6a7b98d2c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.029757 Dec 18 21:06:55.230236 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2524/5042] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:55 2021] POST /compute/v2.1/servers => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:55.240791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:55.241805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:55.251101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:55.251781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:55.253099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:55.253956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:55.711514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:55.726130 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e42c35a-9560-4b5d-9f1e-ad3204f181b1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.490604 Dec 18 21:06:55.731115 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2519/5043] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:55 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:55.752871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:55.757560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:55.776125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:55.777141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:55.779601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:55.780541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:55.967487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1b9d8e79-af7a-4c84-af5d-5364c7a476ed req-5165f68b-90ed-4e83-94e6-09de80abb9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d3cca3-277f-4511-b8fa-d509183d0af0", "tag": "1e397e8f-628a-4ac3-ba85-1606b5d04abb"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:55.970535 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:06:55.970535 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:06:55.983753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1b9d8e79-af7a-4c84-af5d-5364c7a476ed req-5165f68b-90ed-4e83-94e6-09de80abb9d1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:55.984381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1b9d8e79-af7a-4c84-af5d-5364c7a476ed req-5165f68b-90ed-4e83-94e6-09de80abb9d1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:56.014221 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1b9d8e79-af7a-4c84-af5d-5364c7a476ed req-5165f68b-90ed-4e83-94e6-09de80abb9d1 service nova] Creating event network-changed:1e397e8f-628a-4ac3-ba85-1606b5d04abb for instance 48d3cca3-277f-4511-b8fa-d509183d0af0 on nch1-master-1 Dec 18 21:06:56.024758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1b9d8e79-af7a-4c84-af5d-5364c7a476ed req-5165f68b-90ed-4e83-94e6-09de80abb9d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485558 Dec 18 21:06:56.026144 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2525/5044] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:06:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:06:56.070583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:56.071414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:56.081101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:56.081843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:56.083670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:56.085171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:56.909020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:56.921369 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ef93561-7239-4274-bd04-be907f4f8509 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 0.855256 Dec 18 21:06:56.931704 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2526/5045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:56 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:56.939534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97e23a08-8827-46c3-8041-9d077af738f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:56.947584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97e23a08-8827-46c3-8041-9d077af738f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:56.960242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97e23a08-8827-46c3-8041-9d077af738f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:56.962020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97e23a08-8827-46c3-8041-9d077af738f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:56.963481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97e23a08-8827-46c3-8041-9d077af738f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:56.964863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97e23a08-8827-46c3-8041-9d077af738f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:57.046031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97e23a08-8827-46c3-8041-9d077af738f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.111915 Dec 18 21:06:57.047975 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2527/5046] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:56 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:57.320709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:57.329530 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ff7faba-5a95-4feb-bd9e-ea95b2959cf9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 1.587766 Dec 18 21:06:57.334086 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2520/5047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:55 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:57.438530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3ffa0b2-3813-4e27-af94-ce32cbecc441 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1983752556", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:57.440260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3ffa0b2-3813-4e27-af94-ce32cbecc441 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:57.441905 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3ffa0b2-3813-4e27-af94-ce32cbecc441 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.007714 Dec 18 21:06:57.442876 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2528/5048] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:57 2021] POST /compute/v2.1/servers => generated 145 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:06:57.451634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:57.452532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:57.464575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:57.465233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:57.466242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:57.466919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:57.888264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:57.903634 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-de9b5441-ff3c-4c27-8bd9-3fc02e3bffa5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.456042 Dec 18 21:06:57.904753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2521/5049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:57 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:06:57.921229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:57.922554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:57.939496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:57.940059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:57.955946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:57.956310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:57.957118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:57.957556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:57.959299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:57.960859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:57.962247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:57.963954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:58.782829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:58.790849 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-763276be-1d45-451f-aca9-75efb67863de tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.873948 Dec 18 21:06:58.797051 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2529/5050] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:57 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:58.803063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ddabb46-1436-46c9-bc82-4fe18d3027de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:58.804051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ddabb46-1436-46c9-bc82-4fe18d3027de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:58.846859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddabb46-1436-46c9-bc82-4fe18d3027de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:58.859072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddabb46-1436-46c9-bc82-4fe18d3027de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:58.862194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddabb46-1436-46c9-bc82-4fe18d3027de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:58.864597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ddabb46-1436-46c9-bc82-4fe18d3027de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:58.977118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:58.993751 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ddabb46-1436-46c9-bc82-4fe18d3027de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.195357 Dec 18 21:06:58.994963 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2530/5051] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:06:58 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:06:59.000897 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d015db4-0b1d-4166-82b8-b3cefb15aaa2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 1.064175 Dec 18 21:06:59.003193 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2522/5052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:57 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:59.014875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e82c6ec-6c08-4a44-90ba-a2519e88da07 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-316366637", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:06:59.024168 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0e82c6ec-6c08-4a44-90ba-a2519e88da07 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Dec 18 21:06:59.028383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e82c6ec-6c08-4a44-90ba-a2519e88da07 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:06:59.029612 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e82c6ec-6c08-4a44-90ba-a2519e88da07 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033295 Dec 18 21:06:59.032710 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2531/5053] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:06:58 2021] POST /compute/v2.1/servers => generated 123 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:06:59.041399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:59.042590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:59.058923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:59.060776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:59.063807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:59.069440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:59.523197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:06:59.532866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5acde0d7-a4fe-446f-a396-855950eeaec0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.496141 Dec 18 21:06:59.535559 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2523/5054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:59 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:06:59.555115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:06:59.555115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:06:59.574977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:59.575424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:06:59.576229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:06:59.576662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:00.005364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab8bafcb-3534-4e6b-888f-add77072b853 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:00.006310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab8bafcb-3534-4e6b-888f-add77072b853 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:00.016208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab8bafcb-3534-4e6b-888f-add77072b853 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:00.016581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab8bafcb-3534-4e6b-888f-add77072b853 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:00.017383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab8bafcb-3534-4e6b-888f-add77072b853 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:00.017820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab8bafcb-3534-4e6b-888f-add77072b853 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:00.127062 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab8bafcb-3534-4e6b-888f-add77072b853 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.125370 Dec 18 21:07:00.128339 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2524/5055] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:00 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:00.134555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:00.135495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:00.144590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:00.145268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:00.146242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:00.146865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:00.280142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:00.300833 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4625a6d-9c12-4e11-9d50-dc49652da1bf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.747434 Dec 18 21:07:00.316176 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2532/5056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:06:59 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:00.387138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e220e9ed-d6e5-4caf-aec5-424ae9b3bcd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2017890457", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "key_name": "tempest-key-1926717419", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:00.413259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:00.433020 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-73503719-260a-48ef-9e6a-a1e69a61a19c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 0.303166 Dec 18 21:07:00.435153 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2525/5057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:00 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:00.471314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-e220e9ed-d6e5-4caf-aec5-424ae9b3bcd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] validate_networks() for [('1868cd24-2ddf-47fc-8474-997160de3083', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:07:01.043100 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e220e9ed-d6e5-4caf-aec5-424ae9b3bcd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Invalid key_name provided. Dec 18 21:07:01.043921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e220e9ed-d6e5-4caf-aec5-424ae9b3bcd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid key_name provided. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:01.044914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e220e9ed-d6e5-4caf-aec5-424ae9b3bcd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.663450 Dec 18 21:07:01.046051 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2533/5058] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:07:00 2021] POST /compute/v2.1/servers => generated 70 bytes in 665 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:01.055235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:01.055843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:01.072172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.072643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.073466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.073924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.139550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c42125bf-e4ad-460d-8488-f5188057bfec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:01.140782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c42125bf-e4ad-460d-8488-f5188057bfec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:01.151914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42125bf-e4ad-460d-8488-f5188057bfec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.154294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42125bf-e4ad-460d-8488-f5188057bfec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.155255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42125bf-e4ad-460d-8488-f5188057bfec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.157831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42125bf-e4ad-460d-8488-f5188057bfec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.233943 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c42125bf-e4ad-460d-8488-f5188057bfec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.098630 Dec 18 21:07:01.236404 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2534/5059] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:01 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:01.454718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:01.455862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:01.464073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.464587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.465632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.466807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.474044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:01.486640 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-afcb3c1e-21a5-423c-a408-9a5241511a50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.435272 Dec 18 21:07:01.490753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2526/5060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:01 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:01.510946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:01.511849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:01.521662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.522116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.522971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:01.523439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:01.898556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:01.913480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81929e5b-6633-4224-8cea-3e150e1d372e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.410435 Dec 18 21:07:01.914365 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2527/5061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:01 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:01.948040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:01.966339 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c0b0f96-6499-4dbd-9a9b-257c64a9d9c5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 0.517251 Dec 18 21:07:01.970169 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2535/5062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:01 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:02.130009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-572b3a78-3060-4445-9968-ab81b1926f3b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1583158710", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:02.249641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03ef6ffe-0eac-4ca4-856d-225433071523 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:02.251398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03ef6ffe-0eac-4ca4-856d-225433071523 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:02.258916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ef6ffe-0eac-4ca4-856d-225433071523 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:02.259532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ef6ffe-0eac-4ca4-856d-225433071523 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:02.260936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ef6ffe-0eac-4ca4-856d-225433071523 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:02.261534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ef6ffe-0eac-4ca4-856d-225433071523 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:02.314860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03ef6ffe-0eac-4ca4-856d-225433071523 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.067396 Dec 18 21:07:02.319960 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2536/5063] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:02 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:02.329641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.security_group_api [None req-572b3a78-3060-4445-9968-ab81b1926f3b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Neutron security group does_not_exist not found {{(pid=140731) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Dec 18 21:07:02.330520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-572b3a78-3060-4445-9968-ab81b1926f3b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Dec 18 21:07:02.331756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-572b3a78-3060-4445-9968-ab81b1926f3b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:02.335603 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-572b3a78-3060-4445-9968-ab81b1926f3b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.213754 Dec 18 21:07:02.336353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2528/5064] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:07:02 2021] POST /compute/v2.1/servers => generated 106 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:07:02.349348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:02.350296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:02.358199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:02.358898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:02.361037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:02.362078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:02.749804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:02.758670 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da413ce2-56a6-48bb-ad69-7b464c5171c1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.416653 Dec 18 21:07:02.766802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2537/5065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:02 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:02.784489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:02.785168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:02.797904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:02.798405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:02.799441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:02.799898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:02.988487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:02.990117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:03.033373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:03.033957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:03.037273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:03.037780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:03.306240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:03.319217 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-19adc855-a82e-4367-8580-7a64cd1631df tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.539727 Dec 18 21:07:03.319977 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2529/5066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:02 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:03.330532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-99fc633f-bf00-4e6c-84a6-ce54770a3b4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:03.332227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-99fc633f-bf00-4e6c-84a6-ce54770a3b4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:03.344642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99fc633f-bf00-4e6c-84a6-ce54770a3b4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:03.353792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99fc633f-bf00-4e6c-84a6-ce54770a3b4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:03.354957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99fc633f-bf00-4e6c-84a6-ce54770a3b4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:03.355626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-99fc633f-bf00-4e6c-84a6-ce54770a3b4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:03.427461 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-99fc633f-bf00-4e6c-84a6-ce54770a3b4d tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.100723 Dec 18 21:07:03.428940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2530/5067] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:03 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:03.434169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db6eca2d-d0d3-4bc1-9228-e51faf9f0bba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:03.447097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db6eca2d-d0d3-4bc1-9228-e51faf9f0bba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: ec1c34f0-5079-4138-ad1d-c060c9b2531c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:03.454692 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-db6eca2d-d0d3-4bc1-9228-e51faf9f0bba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance ec1c34f0-5079-4138-ad1d-c060c9b2531c could not be found. Dec 18 21:07:03.455554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db6eca2d-d0d3-4bc1-9228-e51faf9f0bba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance ec1c34f0-5079-4138-ad1d-c060c9b2531c could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:03.456555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db6eca2d-d0d3-4bc1-9228-e51faf9f0bba tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec1c34f0-5079-4138-ad1d-c060c9b2531c" status: 404 len: 111 microversion: 2.1 time: 0.026321 Dec 18 21:07:03.457260 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2531/5068] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:07:03 2021] DELETE /compute/v2.1/servers/ec1c34f0-5079-4138-ad1d-c060c9b2531c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:03.478483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-fefc1126-083c-454e-8500-2cc7a62a2b14 req-80ac4849-42ab-42ba-abf6-d29a8dc1fa60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d3cca3-277f-4511-b8fa-d509183d0af0", "name": "network-vif-plugged", "status": "completed", "tag": "1e397e8f-628a-4ac3-ba85-1606b5d04abb"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:03.479935 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:07:03.479935 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:07:03.525550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fefc1126-083c-454e-8500-2cc7a62a2b14 req-80ac4849-42ab-42ba-abf6-d29a8dc1fa60 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:03.526419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fefc1126-083c-454e-8500-2cc7a62a2b14 req-80ac4849-42ab-42ba-abf6-d29a8dc1fa60 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:03.537687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:03.554010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39672bd7-4e1a-497f-8705-03c168b191fa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 0.572414 Dec 18 21:07:03.562655 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-fefc1126-083c-454e-8500-2cc7a62a2b14 req-80ac4849-42ab-42ba-abf6-d29a8dc1fa60 service nova] Creating event network-vif-plugged:1e397e8f-628a-4ac3-ba85-1606b5d04abb for instance 48d3cca3-277f-4511-b8fa-d509183d0af0 on nch1-master-1 Dec 18 21:07:03.574814 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2538/5069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:02 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:03.578534 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-fefc1126-083c-454e-8500-2cc7a62a2b14 req-80ac4849-42ab-42ba-abf6-d29a8dc1fa60 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119619 Dec 18 21:07:03.579801 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2532/5070] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:07:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:07:03.585142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:03.589452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:03.604987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:03.605877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:03.607153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:03.607803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:03.999203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:04.008116 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0fdf52ad-22cb-471d-a5f7-2890a3d126d9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.430524 Dec 18 21:07:04.015136 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2539/5071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:03 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:04.033746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:04.035169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:04.047892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.048354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:04.049176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.049619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:04.440806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e15e70e0-682a-4765-9549-1ff8bfa6e26a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:04.442463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e15e70e0-682a-4765-9549-1ff8bfa6e26a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:04.451103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e15e70e0-682a-4765-9549-1ff8bfa6e26a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.452467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e15e70e0-682a-4765-9549-1ff8bfa6e26a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:04.453524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e15e70e0-682a-4765-9549-1ff8bfa6e26a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.454123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e15e70e0-682a-4765-9549-1ff8bfa6e26a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:04.517285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e15e70e0-682a-4765-9549-1ff8bfa6e26a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.080830 Dec 18 21:07:04.524672 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2540/5072] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:04 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:04.584889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:04.586202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:04.595145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.596271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:04.597415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.598326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:04.802325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:04.818628 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d5ec2b3a-1dcd-4fbc-b28e-2807bd545384 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.789444 Dec 18 21:07:04.819313 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2533/5073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:04 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:04.836011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a484f3a8-d55f-4658-afc1-606511d44a43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:04.836636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a484f3a8-d55f-4658-afc1-606511d44a43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 18 21:07:04.837377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-a484f3a8-d55f-4658-afc1-606511d44a43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Dec 18 21:07:04.838146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a484f3a8-d55f-4658-afc1-606511d44a43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:04.839333 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a484f3a8-d55f-4658-afc1-606511d44a43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008472 Dec 18 21:07:04.840089 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2534/5074] 10.222.0.13 () {58 vars in 1187 bytes} [Sat Dec 18 21:07:04 2021] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 18 21:07:04.850468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:04.851189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:04.861490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.862074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:04.866163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:04.866163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:05.263504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:05.267187 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9069819c-b26a-4d17-89e7-f24d4c74a5d2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1313 microversion: 2.1 time: 0.689028 Dec 18 21:07:05.267785 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2541/5075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:04 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:05.422848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:05.435753 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-94f830f2-955d-4b82-86bc-08377cf471ec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.590820 Dec 18 21:07:05.436334 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2535/5076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:04 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:05.455565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:05.456181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:05.487441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:05.487907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:05.488724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:05.496232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:05.540409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f14b0bbe-c77c-4863-973b-bdcc03a807b5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:05.541640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f14b0bbe-c77c-4863-973b-bdcc03a807b5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:05.551200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f14b0bbe-c77c-4863-973b-bdcc03a807b5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:05.559626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f14b0bbe-c77c-4863-973b-bdcc03a807b5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:05.560687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f14b0bbe-c77c-4863-973b-bdcc03a807b5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:05.563302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f14b0bbe-c77c-4863-973b-bdcc03a807b5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:05.652989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f14b0bbe-c77c-4863-973b-bdcc03a807b5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.119578 Dec 18 21:07:05.654732 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2536/5077] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:05 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:06.036994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:06.051176 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7990d4c1-31c3-47d2-984b-85c5df6ecb9d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.597079 Dec 18 21:07:06.053408 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2542/5078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:05 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:06.071007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e75a7e4-70fe-491f-b04e-5438ed878112 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:06.083459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7e75a7e4-70fe-491f-b04e-5438ed878112 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Failed to fetch instance by id -1 {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 18 21:07:06.084172 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-7e75a7e4-70fe-491f-b04e-5438ed878112 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance -1 could not be found. Dec 18 21:07:06.085783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e75a7e4-70fe-491f-b04e-5438ed878112 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:06.088879 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7e75a7e4-70fe-491f-b04e-5438ed878112 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.021074 Dec 18 21:07:06.089665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2537/5079] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 21:07:06 2021] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:07:06.098516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:06.099396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:06.108738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.109234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.112119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.113188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.284597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:06.286003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:06.295321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.296030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.297379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.298063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.553444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:06.563507 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-119bef1e-3413-469d-92c7-3db261ec5ac3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.468320 Dec 18 21:07:06.567748 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2543/5080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:06 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:06.586474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:06.587413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:06.598086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.600172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.601338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.603231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.671418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:06.685612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6cd37ff-7d0b-48aa-b6de-1a525ff93950 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1499 microversion: 2.1 time: 0.402718 Dec 18 21:07:06.689857 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2538/5081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:06 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1499 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:06.702133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5958ede5-8159-4e92-a054-575e8a3a9ead tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:06.703224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5958ede5-8159-4e92-a054-575e8a3a9ead tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:06.735318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5958ede5-8159-4e92-a054-575e8a3a9ead tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.735784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5958ede5-8159-4e92-a054-575e8a3a9ead tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.743797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5958ede5-8159-4e92-a054-575e8a3a9ead tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.744288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5958ede5-8159-4e92-a054-575e8a3a9ead tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.879975 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5958ede5-8159-4e92-a054-575e8a3a9ead tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.188440 Dec 18 21:07:06.883116 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2539/5082] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:06 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:06.892367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1de4523a-18e4-4c81-9dde-ee3d6c9f0f38 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:06.911473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1de4523a-18e4-4c81-9dde-ee3d6c9f0f38 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:06.914412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1de4523a-18e4-4c81-9dde-ee3d6c9f0f38 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:06.983405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1de4523a-18e4-4c81-9dde-ee3d6c9f0f38 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Going to try to stop instance {{(pid=140731) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 21:07:06.985391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:07.010072 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f548e38c-7129-44eb-9ba0-90352e823b48 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.427496 Dec 18 21:07:07.019819 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2544/5083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:06 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:07.033425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9758fbc7-87ea-42db-86bc-27c0366b29ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:07.058566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9758fbc7-87ea-42db-86bc-27c0366b29ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 4508db52-4937-4868-a38b-6baf65345ac9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:07.088569 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1de4523a-18e4-4c81-9dde-ee3d6c9f0f38 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0/action" status: 202 len: 0 microversion: 2.1 time: 0.206108 Dec 18 21:07:07.089636 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2540/5084] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:06 2021] POST /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:07.099573 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9758fbc7-87ea-42db-86bc-27c0366b29ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 4508db52-4937-4868-a38b-6baf65345ac9 could not be found. Dec 18 21:07:07.100271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9758fbc7-87ea-42db-86bc-27c0366b29ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 4508db52-4937-4868-a38b-6baf65345ac9 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:07.103293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9758fbc7-87ea-42db-86bc-27c0366b29ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/4508db52-4937-4868-a38b-6baf65345ac9/action" status: 404 len: 111 microversion: 2.1 time: 0.080171 Dec 18 21:07:07.103966 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2545/5085] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:07 2021] POST /compute/v2.1/servers/4508db52-4937-4868-a38b-6baf65345ac9/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:07.104435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:07.105340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:07.119092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:07.123311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:07.133856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:07.139900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:07.141478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:07.145157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:07.148320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:07.153437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:07.155469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:07.158431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.001878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:08.005240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:08.018478 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b7c682a-27b1-42eb-8d75-f62afb2c6905 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.923407 Dec 18 21:07:08.019214 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2541/5086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:07 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:08.021126 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84fbf58a-9c40-4d7d-b8d5-60f0ea705961 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.912090 Dec 18 21:07:08.021947 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2546/5087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:07 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:08.026930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93ca4c6f-60ec-4abc-b6b1-2730ebb17c2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:08.027858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93ca4c6f-60ec-4abc-b6b1-2730ebb17c2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.043085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ca4c6f-60ec-4abc-b6b1-2730ebb17c2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.046338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ca4c6f-60ec-4abc-b6b1-2730ebb17c2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.047395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ca4c6f-60ec-4abc-b6b1-2730ebb17c2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.051029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ca4c6f-60ec-4abc-b6b1-2730ebb17c2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.054524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:08.055186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.085331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.085828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.086757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.087207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.130499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93ca4c6f-60ec-4abc-b6b1-2730ebb17c2e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.109178 Dec 18 21:07:08.133919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2542/5088] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:08 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:08.257825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:08.265710 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-855dbe4c-7610-4e47-852a-7c0015796fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.220590 Dec 18 21:07:08.266320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2547/5089] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:08 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:08.282567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29749b63-ccc0-4d04-9480-219ac9a4d1b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:08.283628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29749b63-ccc0-4d04-9480-219ac9a4d1b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b440a7eb-ecdb-4117-9319-091786d41d7d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.290465 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-29749b63-ccc0-4d04-9480-219ac9a4d1b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance b440a7eb-ecdb-4117-9319-091786d41d7d could not be found. Dec 18 21:07:08.291064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29749b63-ccc0-4d04-9480-219ac9a4d1b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance b440a7eb-ecdb-4117-9319-091786d41d7d could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:08.291913 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-29749b63-ccc0-4d04-9480-219ac9a4d1b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b440a7eb-ecdb-4117-9319-091786d41d7d/action" status: 404 len: 111 microversion: 2.1 time: 0.013615 Dec 18 21:07:08.292488 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2543/5090] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:08 2021] POST /compute/v2.1/servers/b440a7eb-ecdb-4117-9319-091786d41d7d/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:08.301254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:08.301870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.308166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.308631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.309444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.309885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.454305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:08.461987 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-525c1a0a-b828-4e95-95fb-4e5285cdc653 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.165023 Dec 18 21:07:08.462621 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2548/5091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:08 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:08.478502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:08.479106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.487293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.487770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.488559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.489059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.643639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:08.651329 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7c4563d8-d667-4a19-bc45-9147b34bf326 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.176419 Dec 18 21:07:08.651991 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2544/5092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:08 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:08.667618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-737d96c9-15ad-453a-86f8-8a83e0ad8ff0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:08.668222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-737d96c9-15ad-453a-86f8-8a83e0ad8ff0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: a04ded2e-67a0-4b30-87c7-95b46103b26c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.674514 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-737d96c9-15ad-453a-86f8-8a83e0ad8ff0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance a04ded2e-67a0-4b30-87c7-95b46103b26c could not be found. Dec 18 21:07:08.675089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-737d96c9-15ad-453a-86f8-8a83e0ad8ff0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance a04ded2e-67a0-4b30-87c7-95b46103b26c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:08.675919 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-737d96c9-15ad-453a-86f8-8a83e0ad8ff0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/a04ded2e-67a0-4b30-87c7-95b46103b26c" status: 404 len: 111 microversion: 2.1 time: 0.011974 Dec 18 21:07:08.676442 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2549/5093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:08 2021] GET /compute/v2.1/servers/a04ded2e-67a0-4b30-87c7-95b46103b26c => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:08.684604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:08.685252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.691713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.692441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.693237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.693682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.833991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:08.841782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6b92f1c-ef15-4573-992d-cf220e19d54d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.160717 Dec 18 21:07:08.842405 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2545/5094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:08 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:08.859766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:08.860601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:08.867709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.868337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:08.869513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:08.869959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.008849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:09.018359 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-269bc3c0-5ea1-4112-ac13-177c0bd3cc4d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.162882 Dec 18 21:07:09.018922 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2550/5095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:08 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:09.037313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:09.038219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:09.044668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.045259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.046321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.046888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.153772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1692c404-fd63-46e1-a48b-383865bc86c0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:09.155378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1692c404-fd63-46e1-a48b-383865bc86c0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:09.174833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1692c404-fd63-46e1-a48b-383865bc86c0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.179259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1692c404-fd63-46e1-a48b-383865bc86c0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.182327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1692c404-fd63-46e1-a48b-383865bc86c0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.184873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1692c404-fd63-46e1-a48b-383865bc86c0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.245435 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1692c404-fd63-46e1-a48b-383865bc86c0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.097651 Dec 18 21:07:09.246987 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2551/5096] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:09 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:09.258655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac86c2e5-8396-455d-9b2c-46fdc3b9d2e1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-271437738", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:09.266200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:09.267220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac86c2e5-8396-455d-9b2c-46fdc3b9d2e1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:09.269588 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac86c2e5-8396-455d-9b2c-46fdc3b9d2e1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020055 Dec 18 21:07:09.271659 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2552/5097] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:07:09 2021] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:07:09.279027 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0dcb2023-9bc7-4f54-9181-982367606794 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.246402 Dec 18 21:07:09.282873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:09.283852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:09.294606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.295403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.296448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.297184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.308723 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2546/5098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:09 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:09.555400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:09.564064 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a81f3f05-5147-479a-b799-78dba0251527 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.287189 Dec 18 21:07:09.570319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2553/5099] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:09 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:09.587426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:09.588036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:09.597205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.597917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.600121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:09.600725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:09.855441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:09.868526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-73835b26-643a-4840-87fb-a105eccb73b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.284805 Dec 18 21:07:09.869877 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2547/5100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:09 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:10.115257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc02dc77-c9cd-46c8-acbc-1162a80f5579 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-629674157", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:10.117366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc02dc77-c9cd-46c8-acbc-1162a80f5579 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:10.118965 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc02dc77-c9cd-46c8-acbc-1162a80f5579 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010912 Dec 18 21:07:10.119672 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2554/5101] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:07:10 2021] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:07:10.132798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:10.133673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:10.145350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.146214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.147268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.150220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.277480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3311f4c8-9fa9-4d2a-88f1-6b5e8174b80a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:10.277480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3311f4c8-9fa9-4d2a-88f1-6b5e8174b80a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:10.296857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3311f4c8-9fa9-4d2a-88f1-6b5e8174b80a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.299066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3311f4c8-9fa9-4d2a-88f1-6b5e8174b80a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.300678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3311f4c8-9fa9-4d2a-88f1-6b5e8174b80a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.309824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3311f4c8-9fa9-4d2a-88f1-6b5e8174b80a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.410399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3311f4c8-9fa9-4d2a-88f1-6b5e8174b80a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.154941 Dec 18 21:07:10.411233 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2555/5102] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:10 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:10.419027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:10.423030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:10.434523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.435413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.436720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.438178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.646465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:10.656344 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97279f0b-27e0-4cf2-9876-bd0a4b546373 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.526819 Dec 18 21:07:10.656979 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2548/5103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:10 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:10.674214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:10.675261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:10.682485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.683210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.684428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:10.685190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:10.878350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:10.889184 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ee20a2c-9481-4cc2-b35c-a7e9baf0f001 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.476101 Dec 18 21:07:10.890113 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2556/5104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:10 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:11.007140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:11.025733 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03a9b2ed-b776-4c02-8830-23278e3c4946 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.355634 Dec 18 21:07:11.026336 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2549/5105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:10 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:11.049847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d6bfd8a-5cf2-43ab-b06a-bc745097ded9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:11.050480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9d6bfd8a-5cf2-43ab-b06a-bc745097ded9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 5faaa406-74a0-4ce8-bb93-a6611f8d4397] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:11.069669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9d6bfd8a-5cf2-43ab-b06a-bc745097ded9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 5faaa406-74a0-4ce8-bb93-a6611f8d4397 could not be found. Dec 18 21:07:11.070299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d6bfd8a-5cf2-43ab-b06a-bc745097ded9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 5faaa406-74a0-4ce8-bb93-a6611f8d4397 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:11.071150 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d6bfd8a-5cf2-43ab-b06a-bc745097ded9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/5faaa406-74a0-4ce8-bb93-a6611f8d4397/action" status: 404 len: 111 microversion: 2.1 time: 0.029838 Dec 18 21:07:11.072678 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2557/5106] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:11 2021] POST /compute/v2.1/servers/5faaa406-74a0-4ce8-bb93-a6611f8d4397/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:11.080594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:11.081424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:11.090740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.091201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.092021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.092469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.421555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29ef4784-7652-4053-a3eb-924c57444d9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:11.423514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-29ef4784-7652-4053-a3eb-924c57444d9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:11.434674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:11.444075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d933e06-086e-42bf-a975-c6fe6d6b76fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.367075 Dec 18 21:07:11.444663 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2550/5107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:11 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:11.447414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ef4784-7652-4053-a3eb-924c57444d9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.447863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ef4784-7652-4053-a3eb-924c57444d9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.448655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ef4784-7652-4053-a3eb-924c57444d9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.449084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29ef4784-7652-4053-a3eb-924c57444d9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.465601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:11.466213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:11.478120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.478612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.481516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.483025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.534614 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29ef4784-7652-4053-a3eb-924c57444d9e tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.109414 Dec 18 21:07:11.534614 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2558/5108] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:11 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:11.743217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:11.759500 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72f2ccba-dfd7-4785-bc26-eb2a3006d334 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.297514 Dec 18 21:07:11.761150 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2551/5109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:11 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:11.779094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-08efe65d-baf8-450d-94bf-88191e35c53a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:11.780002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-08efe65d-baf8-450d-94bf-88191e35c53a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:11.790604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08efe65d-baf8-450d-94bf-88191e35c53a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.794146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08efe65d-baf8-450d-94bf-88191e35c53a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.795369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08efe65d-baf8-450d-94bf-88191e35c53a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.797044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08efe65d-baf8-450d-94bf-88191e35c53a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.908557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:11.909177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:11.918367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.924273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.926213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.926715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.943866 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-08efe65d-baf8-450d-94bf-88191e35c53a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.168979 Dec 18 21:07:11.949251 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2559/5110] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:11 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:11.963599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:11.964319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:11.989075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.989579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:11.990459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:11.990891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:12.287304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:12.295622 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b4597d5-cef9-442f-a183-ece019852bb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1510 microversion: 2.1 time: 0.335990 Dec 18 21:07:12.310271 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2560/5111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:11 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:12.347266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:12.359830 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-972cc7b9-9eaf-4c44-9a6b-cdc4160e0b55 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.455697 Dec 18 21:07:12.360596 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2552/5112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:11 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:12.544839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-832ed62a-706c-45d3-b98d-64a4f77b4125 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:12.546521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-832ed62a-706c-45d3-b98d-64a4f77b4125 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:12.555596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832ed62a-706c-45d3-b98d-64a4f77b4125 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:12.556293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832ed62a-706c-45d3-b98d-64a4f77b4125 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:12.557281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832ed62a-706c-45d3-b98d-64a4f77b4125 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:12.557902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832ed62a-706c-45d3-b98d-64a4f77b4125 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:12.661248 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-832ed62a-706c-45d3-b98d-64a4f77b4125 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.124723 Dec 18 21:07:12.665403 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2561/5113] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:12 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:13.319258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:13.320771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:13.333523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.336020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.337394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.338264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.377141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:13.377833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:13.394493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.395108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.395959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.396564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.562816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:13.572380 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-365240b4-cc77-48a8-8980-3a98298dfe33 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1490 microversion: 2.1 time: 0.259089 Dec 18 21:07:13.576873 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2553/5114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:13 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1490 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:13.595925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:13.597381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:13.605670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.606227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.607138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.607545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.633180 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Cannot 'pause' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state paused Dec 18 21:07:13.633786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 409 to user: Cannot 'pause' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state paused {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:13.634656 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee09b098-f60f-4bbd-a3ab-88f0a57e2949 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 409 len: 143 microversion: 2.1 time: 0.044359 Dec 18 21:07:13.635304 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2554/5115] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:13 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 143 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 18 21:07:13.645164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3a02a527-7193-4a35-ae82-49894c4cde0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:13.645974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3a02a527-7193-4a35-ae82-49894c4cde0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:13.653644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a02a527-7193-4a35-ae82-49894c4cde0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.654827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a02a527-7193-4a35-ae82-49894c4cde0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.656416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a02a527-7193-4a35-ae82-49894c4cde0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.657009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a02a527-7193-4a35-ae82-49894c4cde0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.671092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:13.678993 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-430ab1b8-1f75-4d02-9ab5-a5f527f94396 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.305819 Dec 18 21:07:13.680681 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2562/5116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:13 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:13.685640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-887aefb7-10d1-4382-9267-d374a99f87d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:13.686669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-887aefb7-10d1-4382-9267-d374a99f87d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:13.693779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-887aefb7-10d1-4382-9267-d374a99f87d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.694353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-887aefb7-10d1-4382-9267-d374a99f87d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.695237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-887aefb7-10d1-4382-9267-d374a99f87d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.695751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-887aefb7-10d1-4382-9267-d374a99f87d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.767897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-887aefb7-10d1-4382-9267-d374a99f87d2 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.082727 Dec 18 21:07:13.769599 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2563/5117] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:13 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:13.789700 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3a02a527-7193-4a35-ae82-49894c4cde0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.149744 Dec 18 21:07:13.791024 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2555/5118] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:13 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:13.799311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:13.803209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:13.809927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.811883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:13.813947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:13.814462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:14.063689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:14.073613 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef12824f-e80a-4f7f-845a-6d99ac1c12fc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1497 microversion: 2.1 time: 0.278486 Dec 18 21:07:14.074657 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2564/5119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:13 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:14.700570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:14.702279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:14.713764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:14.714369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:14.720087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:14.720610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:14.783121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1653340-c09d-4b01-8691-3c0c66dac1b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:14.784574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1653340-c09d-4b01-8691-3c0c66dac1b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:14.814853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1653340-c09d-4b01-8691-3c0c66dac1b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:14.815503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1653340-c09d-4b01-8691-3c0c66dac1b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:14.822783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1653340-c09d-4b01-8691-3c0c66dac1b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:14.823820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1653340-c09d-4b01-8691-3c0c66dac1b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:14.899867 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1653340-c09d-4b01-8691-3c0c66dac1b0 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.123134 Dec 18 21:07:14.901358 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2565/5120] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:14 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:15.102695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:15.103809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:15.111609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:15.122663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6d49db0a-902a-4c9f-987c-141a8676ffdb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.427415 Dec 18 21:07:15.127922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.130334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.131185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.133202 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2556/5121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:14 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:15.134588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.453220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:15.464238 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bced7b07-66c1-4f17-b763-53c56e55a52c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.372776 Dec 18 21:07:15.466357 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2566/5122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:15 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:15.485833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:15.486728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:15.493425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.494123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.495107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.495896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.755418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:15.767193 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-786b6a85-e625-4d9d-9a4a-93b83286b1b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.284908 Dec 18 21:07:15.767788 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2557/5123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:15 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:15.785597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:15.786588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:15.797678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.798050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.798886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.799762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.815438 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. Dec 18 21:07:15.816077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:15.816922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b23bdcd6-f4a4-4ba5-b9ac-7a2a50faf708 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb/action" status: 404 len: 111 microversion: 2.1 time: 0.036624 Dec 18 21:07:15.817959 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2567/5124] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:15 2021] POST /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:15.826725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:15.828360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:15.835151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.835949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.837288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.837947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.913273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a4d9708-ac5e-474b-a1d2-cc0b19a0f006 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:15.914417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a4d9708-ac5e-474b-a1d2-cc0b19a0f006 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:15.928151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a4d9708-ac5e-474b-a1d2-cc0b19a0f006 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.928865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a4d9708-ac5e-474b-a1d2-cc0b19a0f006 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.930832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a4d9708-ac5e-474b-a1d2-cc0b19a0f006 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:15.931680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a4d9708-ac5e-474b-a1d2-cc0b19a0f006 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:15.982871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a4d9708-ac5e-474b-a1d2-cc0b19a0f006 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.073673 Dec 18 21:07:15.984619 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2568/5125] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:15 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:16.141536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:16.142467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:16.150119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:16.151003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:16.152382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:16.152861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:16.318709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:16.328635 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-082690fd-3407-4880-9764-8a9790df477b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.505927 Dec 18 21:07:16.338787 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2558/5126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:15 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:16.352422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:16.353348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:16.365468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:16.365960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:16.371033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:16.371682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:16.506979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:16.517241 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c6c156ba-f12e-49b8-beb0-926746b2c063 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.380681 Dec 18 21:07:16.518382 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2569/5127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:16 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:16.751981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:16.769077 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6810eff1-1581-490f-9ef5-86eaeb74297d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.420528 Dec 18 21:07:16.770114 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2559/5128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:16 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:16.791681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17c874cc-b064-4698-a216-9c511d8bb62b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:16.793652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-17c874cc-b064-4698-a216-9c511d8bb62b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: d8771af8-e918-45b8-be9b-f8261fbfd054] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:16.806072 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-17c874cc-b064-4698-a216-9c511d8bb62b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance d8771af8-e918-45b8-be9b-f8261fbfd054 could not be found. Dec 18 21:07:16.808940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17c874cc-b064-4698-a216-9c511d8bb62b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance d8771af8-e918-45b8-be9b-f8261fbfd054 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:16.810941 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-17c874cc-b064-4698-a216-9c511d8bb62b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/d8771af8-e918-45b8-be9b-f8261fbfd054/action" status: 404 len: 111 microversion: 2.1 time: 0.023886 Dec 18 21:07:16.812449 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2570/5129] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:16 2021] POST /compute/v2.1/servers/d8771af8-e918-45b8-be9b-f8261fbfd054/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:16.821623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:16.822797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:16.835989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:16.837185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:16.839917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:16.841082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:16.997718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f13b1ca1-ce7b-4e26-88b8-4a6178d6dea1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:16.998726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f13b1ca1-ce7b-4e26-88b8-4a6178d6dea1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:17.013741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f13b1ca1-ce7b-4e26-88b8-4a6178d6dea1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.014205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f13b1ca1-ce7b-4e26-88b8-4a6178d6dea1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.015602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f13b1ca1-ce7b-4e26-88b8-4a6178d6dea1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.016243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f13b1ca1-ce7b-4e26-88b8-4a6178d6dea1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.092488 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f13b1ca1-ce7b-4e26-88b8-4a6178d6dea1 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.099649 Dec 18 21:07:17.097864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2571/5130] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:16 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:17.185016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:17.198786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25e5ec24-e0f8-43ab-9600-17cf1bc8066c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.381377 Dec 18 21:07:17.200287 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2560/5131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:16 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:17.218128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:17.218865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:17.229384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.249974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.258284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.258975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.536399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:17.541424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:17.543289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:17.554333 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-43172061-8030-4b81-a384-e76fed17d0fd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.340193 Dec 18 21:07:17.563372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.563833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.566823 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2572/5132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:17 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:17.568126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.568685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.586335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:17.587856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:17.599288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.599918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.600806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.601246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.618939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. Dec 18 21:07:17.620092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:17.621088 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99665019-9736-4d57-848b-95ca1b8e6f39 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb/action" status: 404 len: 111 microversion: 2.1 time: 0.041181 Dec 18 21:07:17.622091 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2573/5133] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:17 2021] POST /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:07:17.632643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:17.633527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:17.640703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.641470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.642989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:17.643766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:17.996181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:18.020845 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d9a99e00-14fc-4620-a73d-7fd382e29a16 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.488391 Dec 18 21:07:18.023128 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2561/5134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:17 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:18.025262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:18.033665 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52675301-2337-4f3e-a233-1b062b0f6b1e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.405609 Dec 18 21:07:18.034665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2574/5135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:17 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:18.054559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:18.054980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:18.062466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.062964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:18.064099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.064692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:18.107039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f95bfa2-7e9b-42c0-8532-7ec20c2716f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:18.108838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8f95bfa2-7e9b-42c0-8532-7ec20c2716f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:18.118440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f95bfa2-7e9b-42c0-8532-7ec20c2716f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.119255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f95bfa2-7e9b-42c0-8532-7ec20c2716f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:18.120516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f95bfa2-7e9b-42c0-8532-7ec20c2716f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.121172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f95bfa2-7e9b-42c0-8532-7ec20c2716f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:18.190477 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f95bfa2-7e9b-42c0-8532-7ec20c2716f3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.088938 Dec 18 21:07:18.197356 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2575/5136] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:18 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:18.289897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:18.301474 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-24c98698-8d47-4c44-aba9-4c714c181b0a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.252183 Dec 18 21:07:18.312438 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2562/5137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:18 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:18.320055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-266b5b73-5906-4d5c-9b50-fadf1b346385 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:18.321896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-266b5b73-5906-4d5c-9b50-fadf1b346385 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 4f6f859f-8b64-4aee-91a9-1e924b436b94] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:18.329322 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-266b5b73-5906-4d5c-9b50-fadf1b346385 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 4f6f859f-8b64-4aee-91a9-1e924b436b94 could not be found. Dec 18 21:07:18.330435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-266b5b73-5906-4d5c-9b50-fadf1b346385 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 4f6f859f-8b64-4aee-91a9-1e924b436b94 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:18.331335 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-266b5b73-5906-4d5c-9b50-fadf1b346385 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/4f6f859f-8b64-4aee-91a9-1e924b436b94/action" status: 404 len: 111 microversion: 2.1 time: 0.016133 Dec 18 21:07:18.332287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2576/5138] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:18 2021] POST /compute/v2.1/servers/4f6f859f-8b64-4aee-91a9-1e924b436b94/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:18.343669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:18.344556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:18.351208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.351816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:18.352704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.353280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:18.857923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:18.868481 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8ab4335b-5592-408d-aff2-a8e9cfa2759c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.530320 Dec 18 21:07:18.869348 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2563/5139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:18 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:18.885806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:18.886452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:18.906282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.907749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:18.908694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:18.909154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.041701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:19.043277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:19.058413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.058413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.059406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.060110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.194614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:19.207565 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48c09044-5568-4ead-8d97-8a067f212ce4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.325178 Dec 18 21:07:19.224635 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2577/5140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:18 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:19.244929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-267af189-2b6c-4eab-98ef-74cc8ac03860 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:19.245849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-267af189-2b6c-4eab-98ef-74cc8ac03860 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:19.258085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-267af189-2b6c-4eab-98ef-74cc8ac03860 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.260646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-267af189-2b6c-4eab-98ef-74cc8ac03860 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.261484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-267af189-2b6c-4eab-98ef-74cc8ac03860 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.261929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-267af189-2b6c-4eab-98ef-74cc8ac03860 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.331659 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-267af189-2b6c-4eab-98ef-74cc8ac03860 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.107808 Dec 18 21:07:19.332376 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2578/5141] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:19 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:19.338739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1264b560-7822-49f2-9c72-25178138ca0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:19.339363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1264b560-7822-49f2-9c72-25178138ca0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 61acd0e0-c8af-4276-bf45-d2a039ec9e29] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:19.347669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1264b560-7822-49f2-9c72-25178138ca0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 61acd0e0-c8af-4276-bf45-d2a039ec9e29 could not be found. Dec 18 21:07:19.348266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1264b560-7822-49f2-9c72-25178138ca0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 61acd0e0-c8af-4276-bf45-d2a039ec9e29 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:19.349098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1264b560-7822-49f2-9c72-25178138ca0e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/61acd0e0-c8af-4276-bf45-d2a039ec9e29/action" status: 404 len: 111 microversion: 2.1 time: 0.015659 Dec 18 21:07:19.349673 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2579/5142] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:19 2021] POST /compute/v2.1/servers/61acd0e0-c8af-4276-bf45-d2a039ec9e29/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:19.358928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:19.359768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:19.368201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.369398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.370724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.371416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.637487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:19.646681 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b0f3668c-8121-4f56-8462-235675d2ceb9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.610791 Dec 18 21:07:19.660784 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2564/5143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:19 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:19.745655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:19.754681 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-520be574-f30b-4f4f-94ae-820906124ca2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.400085 Dec 18 21:07:19.756137 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2580/5144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:19 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:19.774277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:19.775290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:19.782540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.783340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:19.784403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:19.784989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.058174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:20.115359 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-368905c0-3656-49c7-9f18-ca569d898c20 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.322722 Dec 18 21:07:20.116982 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2565/5145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:19 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:20.132300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:20.132832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:20.139600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.139924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.140729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.141108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.176044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Cannot 'restore' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active Dec 18 21:07:20.176639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 409 to user: Cannot 'restore' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:20.177635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5cb82f70-23be-4408-89b9-5e06aa5abb52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 409 len: 145 microversion: 2.1 time: 0.049154 Dec 18 21:07:20.178197 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2581/5146] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:20 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 145 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:07:20.188857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:20.189638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:20.198953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.201659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.203792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.207097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.367026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c3201c3-99f0-465f-8cd0-a70877cebbbe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:20.367965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c3201c3-99f0-465f-8cd0-a70877cebbbe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:20.384711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c3201c3-99f0-465f-8cd0-a70877cebbbe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.385289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c3201c3-99f0-465f-8cd0-a70877cebbbe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.385989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c3201c3-99f0-465f-8cd0-a70877cebbbe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.386707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c3201c3-99f0-465f-8cd0-a70877cebbbe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.436502 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c3201c3-99f0-465f-8cd0-a70877cebbbe tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.091060 Dec 18 21:07:20.437382 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2582/5147] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:20 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:20.593670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:20.602301 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7ae84b8-57d5-40c2-8ad6-314aaff17d43 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.417512 Dec 18 21:07:20.603500 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2566/5148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:20 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:20.625643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:20.626485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:20.635607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.636165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.638168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.638648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.664592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:20.665461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:20.672443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.673311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:20.674444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:20.675047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:21.147609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:21.164098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72876fae-d02c-4231-b6a8-befde91f161b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.543221 Dec 18 21:07:21.166998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:21.168269 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2583/5149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:20 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:21.186203 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0522a396-d0e7-443c-b8bd-1baf38a42243 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.525571 Dec 18 21:07:21.186733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57ea6f9e-07b0-458d-8b03-43cb4b5c31d8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:21.187524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57ea6f9e-07b0-458d-8b03-43cb4b5c31d8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 6fef7fd9-2094-4f50-bb62-b17bd895d67b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:21.199432 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-57ea6f9e-07b0-458d-8b03-43cb4b5c31d8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 6fef7fd9-2094-4f50-bb62-b17bd895d67b could not be found. Dec 18 21:07:21.200041 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2567/5150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:20 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:21.206330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57ea6f9e-07b0-458d-8b03-43cb4b5c31d8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 6fef7fd9-2094-4f50-bb62-b17bd895d67b could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:21.207601 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57ea6f9e-07b0-458d-8b03-43cb4b5c31d8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/6fef7fd9-2094-4f50-bb62-b17bd895d67b/action" status: 404 len: 111 microversion: 2.1 time: 0.025017 Dec 18 21:07:21.210448 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2584/5151] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:21 2021] POST /compute/v2.1/servers/6fef7fd9-2094-4f50-bb62-b17bd895d67b/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:21.220132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:21.220810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:21.231143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:21.232560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:21.235530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:21.235530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:21.453456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f9ba7e7-66e9-4dd3-9c00-3a1f5d228581 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:21.455542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f9ba7e7-66e9-4dd3-9c00-3a1f5d228581 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:21.472614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f9ba7e7-66e9-4dd3-9c00-3a1f5d228581 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:21.473102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f9ba7e7-66e9-4dd3-9c00-3a1f5d228581 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:21.473951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f9ba7e7-66e9-4dd3-9c00-3a1f5d228581 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:21.474429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f9ba7e7-66e9-4dd3-9c00-3a1f5d228581 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:21.555291 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f9ba7e7-66e9-4dd3-9c00-3a1f5d228581 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.109410 Dec 18 21:07:21.556569 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2585/5152] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:21 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:21.672096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:21.684919 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2accb94-1781-45e9-b11c-54c350a5a038 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.469088 Dec 18 21:07:21.698350 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2568/5153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:21 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:21.708126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:21.709081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:21.716430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:21.716834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:21.718552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:21.719144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.204898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:22.206374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:22.220059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.220801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.221847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.224972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.453657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:22.465873 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-77acb1fe-2503-4910-9e4d-3e35246a441d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.764335 Dec 18 21:07:22.473519 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2586/5154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:21 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:22.503721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:22.504273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:22.518004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.523563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.524458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.524985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.581653 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Cannot 'resume' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active Dec 18 21:07:22.582614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 409 to user: Cannot 'resume' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:22.583747 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-912dc96f-702c-46c5-9e0a-3bad82906575 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 409 len: 144 microversion: 2.1 time: 0.083862 Dec 18 21:07:22.588238 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2587/5155] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:22 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 144 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:07:22.595714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd7cd3ea-b286-4cfe-8856-7b84d973b0b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:22.607509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dd7cd3ea-b286-4cfe-8856-7b84d973b0b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:22.614581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd7cd3ea-b286-4cfe-8856-7b84d973b0b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.615246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd7cd3ea-b286-4cfe-8856-7b84d973b0b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.616247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd7cd3ea-b286-4cfe-8856-7b84d973b0b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.619752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd7cd3ea-b286-4cfe-8856-7b84d973b0b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.692330 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd7cd3ea-b286-4cfe-8856-7b84d973b0b3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.102321 Dec 18 21:07:22.696333 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2588/5156] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:22 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:22.712962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:22.714309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:22.724873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.725639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.727126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:22.728012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:22.789287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:22.797111 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9b39ec8-45d9-4bb8-8871-125758ca41cb tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.596011 Dec 18 21:07:22.803238 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2569/5157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:22 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:23.228173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:23.242747 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-375e54fd-0bf2-4f02-b0fa-504b5967dd5b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.543593 Dec 18 21:07:23.243355 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2589/5158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:22 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:23.264429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:23.267338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:23.277210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.277567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:23.278671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.279485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:23.621852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:23.629619 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0d42fe7d-5d55-4183-8b3d-2cdeb94dc797 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.369590 Dec 18 21:07:23.630201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2570/5159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:23 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:23.714218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-198d805d-01f2-4f37-b26e-385b2a8ff558 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:23.715884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-198d805d-01f2-4f37-b26e-385b2a8ff558 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:23.732466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198d805d-01f2-4f37-b26e-385b2a8ff558 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.739917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198d805d-01f2-4f37-b26e-385b2a8ff558 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:23.744801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198d805d-01f2-4f37-b26e-385b2a8ff558 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.748711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-198d805d-01f2-4f37-b26e-385b2a8ff558 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:23.821469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:23.822237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:23.831974 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-198d805d-01f2-4f37-b26e-385b2a8ff558 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.127249 Dec 18 21:07:23.833210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.835981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:23.837346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2590/5160] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:23 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:23.839703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.840424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:23.872177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b352e78-fa8a-48a6-bdb8-b8bf3d23c149 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1868cd24-2ddf-47fc-8474-997160de3083"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:23.874628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b352e78-fa8a-48a6-bdb8-b8bf3d23c149 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:23.875614 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b352e78-fa8a-48a6-bdb8-b8bf3d23c149 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008446 Dec 18 21:07:23.880821 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2591/5161] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:07:23 2021] POST /compute/v2.1/servers => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:07:23.887106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:23.888168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:23.899188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.899968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:23.901431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:23.902020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:24.465705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:24.473389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ad540c3-16ed-40bd-b9ef-98110e192de4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.591276 Dec 18 21:07:24.475719 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2592/5162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:23 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:24.491602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:24.497929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:24.498585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:24.508975 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c581ad9-d5c7-4ad6-b2de-8c82c86a51ff tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.693159 Dec 18 21:07:24.520584 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2571/5163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:23 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:24.846238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-366d36ea-4224-4993-b8b9-0e6a6a532520 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:24.847216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-366d36ea-4224-4993-b8b9-0e6a6a532520 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:24.862513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-366d36ea-4224-4993-b8b9-0e6a6a532520 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:24.862976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-366d36ea-4224-4993-b8b9-0e6a6a532520 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:24.872125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-366d36ea-4224-4993-b8b9-0e6a6a532520 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:24.872731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-366d36ea-4224-4993-b8b9-0e6a6a532520 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:25.014745 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-366d36ea-4224-4993-b8b9-0e6a6a532520 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.168681 Dec 18 21:07:25.022159 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2572/5164] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:24 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:25.031916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:25.034310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:25.035676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:25.036616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:25.540578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:25.544675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:25.563244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:25.571307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:25.572497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:25.572940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:25.716594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:25.729002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-231eeaea-dd3f-410d-92b7-bcc0d9ae882f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 1.236749 Dec 18 21:07:25.732337 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2593/5165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:24 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:25.756717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62444cad-f3dc-46b9-ad4d-f2f2f730e319 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:25.760399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62444cad-f3dc-46b9-ad4d-f2f2f730e319 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 6de0f84c-5933-4e47-ad5b-06488d939588] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:25.771544 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-62444cad-f3dc-46b9-ad4d-f2f2f730e319 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 6de0f84c-5933-4e47-ad5b-06488d939588 could not be found. Dec 18 21:07:25.776707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62444cad-f3dc-46b9-ad4d-f2f2f730e319 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 6de0f84c-5933-4e47-ad5b-06488d939588 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:25.778473 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62444cad-f3dc-46b9-ad4d-f2f2f730e319 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/6de0f84c-5933-4e47-ad5b-06488d939588/action" status: 404 len: 111 microversion: 2.1 time: 0.027491 Dec 18 21:07:25.779595 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2594/5166] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:25 2021] POST /compute/v2.1/servers/6de0f84c-5933-4e47-ad5b-06488d939588/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:07:25.799451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:25.801904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:25.833864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:25.834390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:25.838235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:25.839760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:26.096212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:26.105088 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-088156a8-5a05-495e-8f9a-0c6850dfad64 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.572416 Dec 18 21:07:26.106350 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2573/5167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:25 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:26.114198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52a954af-8c5f-40ad-99d0-08f8dcc619cf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:26.115784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52a954af-8c5f-40ad-99d0-08f8dcc619cf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:26.126860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a954af-8c5f-40ad-99d0-08f8dcc619cf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:26.127970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a954af-8c5f-40ad-99d0-08f8dcc619cf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:26.129094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a954af-8c5f-40ad-99d0-08f8dcc619cf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:26.130538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52a954af-8c5f-40ad-99d0-08f8dcc619cf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:26.210646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:26.222283 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1cee28d-bf4d-4f92-a3c5-51d33665158c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.436957 Dec 18 21:07:26.223579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2595/5168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:25 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:26.251079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:26.251847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52a954af-8c5f-40ad-99d0-08f8dcc619cf tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.143081 Dec 18 21:07:26.252162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:26.262286 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2574/5169] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:26 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:26.268525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:26.269733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:26.272280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:26.274097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:26.784600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:26.801534 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-137784e8-ed8b-49cf-ab2b-b707a298fdb8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.555451 Dec 18 21:07:26.814941 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2596/5170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:26 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:26.818585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:26.819448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:26.837247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:26.837732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:26.846674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:26.849424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:26.940976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lazy-loading 'flavor' on Instance uuid b1be5bad-33b6-459e-93d1-c890f71c2fb7 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:07:27.125995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:27.126945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:27.137368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:27.138956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:27.141146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:27.141796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:27.542907 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0447cf5c-85b4-42b8-b708-a0ebd0bbf2cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.728356 Dec 18 21:07:27.569705 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2575/5171] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:26 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:27.593476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47a71bf2-6b2b-47e9-9328-bdba993e80ab tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:27.595267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47a71bf2-6b2b-47e9-9328-bdba993e80ab tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:27.614096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47a71bf2-6b2b-47e9-9328-bdba993e80ab tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:27.614795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47a71bf2-6b2b-47e9-9328-bdba993e80ab tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:27.615823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47a71bf2-6b2b-47e9-9328-bdba993e80ab tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:27.616527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47a71bf2-6b2b-47e9-9328-bdba993e80ab tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:27.649663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:27.658562 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75ad6af9-33e5-405d-923c-2f1a0a1a4a56 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.539735 Dec 18 21:07:27.662878 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2597/5172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:27 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:27.677096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:27.679119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:27.683191 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47a71bf2-6b2b-47e9-9328-bdba993e80ab tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.107916 Dec 18 21:07:27.687642 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2576/5173] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:27 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:27.693234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:27.694092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:27.695204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:27.698970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:27.990953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:28.000154 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f827d87-5c7c-40df-b220-645047b361b4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.335873 Dec 18 21:07:28.001055 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2598/5174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:27 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:28.682693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:28.684171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:28.694887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dca2054f-f909-49d0-8086-7833d74d381f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:28.695819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dca2054f-f909-49d0-8086-7833d74d381f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:28.697532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:28.698210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:28.700530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:28.701303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:28.707065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dca2054f-f909-49d0-8086-7833d74d381f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:28.707747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dca2054f-f909-49d0-8086-7833d74d381f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:28.714003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dca2054f-f909-49d0-8086-7833d74d381f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:28.714530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dca2054f-f909-49d0-8086-7833d74d381f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:28.814320 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dca2054f-f909-49d0-8086-7833d74d381f tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.123156 Dec 18 21:07:28.820839 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2599/5175] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:28 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:29.019228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:29.020135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:29.025852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:29.038452 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0d51fb2b-9697-4b68-89e5-c0024f77d719 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.361876 Dec 18 21:07:29.040001 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2577/5176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:28 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:29.047774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:29.051209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:29.053949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:29.054939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:29.502484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:29.513063 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6c92c97-cd0b-4570-b09e-198d5e51065b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.499224 Dec 18 21:07:29.516158 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2600/5177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:29 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:29.828694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c08acdd1-e753-40e1-a22b-b4efc11df44b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:29.829673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c08acdd1-e753-40e1-a22b-b4efc11df44b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:29.844518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08acdd1-e753-40e1-a22b-b4efc11df44b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:29.844980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08acdd1-e753-40e1-a22b-b4efc11df44b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:29.845774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08acdd1-e753-40e1-a22b-b4efc11df44b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:29.846215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08acdd1-e753-40e1-a22b-b4efc11df44b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:29.916494 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c08acdd1-e753-40e1-a22b-b4efc11df44b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.091503 Dec 18 21:07:29.918542 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2578/5178] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:29 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:30.054655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:30.055331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:30.065628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:30.066728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:30.070478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:30.071047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:30.425194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:30.435370 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f28f0cad-9536-46ca-bda9-d769ea3b4a4b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.384667 Dec 18 21:07:30.442625 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2601/5179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:30 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:30.535865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:30.537008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:30.562485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:30.566161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:30.567747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:30.568288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:30.948875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-073bee97-8af5-4b9e-8fbe-cba218f65ae8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:30.954195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-073bee97-8af5-4b9e-8fbe-cba218f65ae8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:30.989143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-073bee97-8af5-4b9e-8fbe-cba218f65ae8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:30.989644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-073bee97-8af5-4b9e-8fbe-cba218f65ae8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:30.997645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-073bee97-8af5-4b9e-8fbe-cba218f65ae8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:30.998162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-073bee97-8af5-4b9e-8fbe-cba218f65ae8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:31.101723 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-073bee97-8af5-4b9e-8fbe-cba218f65ae8 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.169818 Dec 18 21:07:31.103876 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2602/5180] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:30 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:31.456600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:31.457602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:31.466762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:31.468164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:31.471196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:31.472136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:31.671349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:31.684319 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b31967ae-b932-479e-964e-359efbf29f2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 1.154979 Dec 18 21:07:31.684934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2579/5181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:30 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:32.017807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:32.041691 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96d18621-d378-402e-b031-6a010444c781 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.588787 Dec 18 21:07:32.042294 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2603/5182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:31 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:32.114023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6c46a55-6073-4255-af8a-fe00eb6b86ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:32.115247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6c46a55-6073-4255-af8a-fe00eb6b86ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:32.128189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c46a55-6073-4255-af8a-fe00eb6b86ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:32.128731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c46a55-6073-4255-af8a-fe00eb6b86ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:32.132861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c46a55-6073-4255-af8a-fe00eb6b86ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:32.133387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6c46a55-6073-4255-af8a-fe00eb6b86ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:32.180154 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6c46a55-6073-4255-af8a-fe00eb6b86ba tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.069831 Dec 18 21:07:32.181278 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2580/5183] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:32 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:32.701577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:32.702220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:32.722387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:32.722854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:32.723958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:32.724417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:33.062031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:33.063903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:33.077344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:33.088928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:33.089507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:33.092245 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a9c1ba8-d1c6-4e8f-aaeb-c213e4938664 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.393279 Dec 18 21:07:33.093485 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2604/5184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:32 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:33.094196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:33.094832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:33.192397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-131360b4-f609-4bc0-9aef-f6042714f4c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:33.193715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-131360b4-f609-4bc0-9aef-f6042714f4c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:33.215806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-131360b4-f609-4bc0-9aef-f6042714f4c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:33.216269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-131360b4-f609-4bc0-9aef-f6042714f4c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:33.217076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-131360b4-f609-4bc0-9aef-f6042714f4c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:33.219909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-131360b4-f609-4bc0-9aef-f6042714f4c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:33.304877 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-131360b4-f609-4bc0-9aef-f6042714f4c5 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.116199 Dec 18 21:07:33.307965 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2605/5185] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:33 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:33.582206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:33.604801 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c4d37e64-78cb-4fda-9b76-35d720216a0f tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.547967 Dec 18 21:07:33.607355 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2581/5186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:33 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:34.121596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:34.122362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:34.141589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:34.147935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:34.148891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:34.149348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:34.319521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75511847-78ad-41c8-bd49-084fe5f594f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:34.320722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75511847-78ad-41c8-bd49-084fe5f594f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:34.331797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75511847-78ad-41c8-bd49-084fe5f594f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:34.332406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75511847-78ad-41c8-bd49-084fe5f594f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:34.333815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75511847-78ad-41c8-bd49-084fe5f594f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:34.334553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75511847-78ad-41c8-bd49-084fe5f594f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:34.432951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75511847-78ad-41c8-bd49-084fe5f594f6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.108916 Dec 18 21:07:34.434185 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2582/5187] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:34 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:34.576700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:34.589407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13004ae5-0cee-471f-a32c-961940e60ddd tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.481637 Dec 18 21:07:34.590826 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2606/5188] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:34 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:34.626545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:34.627531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:34.635895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:34.636496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:34.637434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:34.638089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:35.013512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:35.022763 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-803ebebd-c5d7-4fee-b152-c187da8e52c2 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.399860 Dec 18 21:07:35.032134 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2583/5189] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:34 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:35.445345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-390dda2a-3ae2-4716-b73a-d9b4f671baec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:35.446912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-390dda2a-3ae2-4716-b73a-d9b4f671baec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:35.470015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-390dda2a-3ae2-4716-b73a-d9b4f671baec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:35.470937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-390dda2a-3ae2-4716-b73a-d9b4f671baec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:35.473226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-390dda2a-3ae2-4716-b73a-d9b4f671baec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:35.474857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-390dda2a-3ae2-4716-b73a-d9b4f671baec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:35.585423 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-390dda2a-3ae2-4716-b73a-d9b4f671baec tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.143868 Dec 18 21:07:35.588924 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2607/5190] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:35 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:35.613677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:35.615172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:35.628703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:35.629866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:35.631123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:35.631743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:36.039986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:36.042470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:36.053998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:36.057491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:36.058610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:36.059255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:36.361013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:36.384076 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ef1c9aa-4a2d-42f7-8d27-0979a071d509 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.776571 Dec 18 21:07:36.393787 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2584/5191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:35 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:36.521685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:36.529433 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f15e6de9-c6e2-4dd5-aa2d-29f2f725e149 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1509 microversion: 2.1 time: 0.493691 Dec 18 21:07:36.531729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2608/5192] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:36 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:36.603917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b42fd28-19e5-41de-87cc-c04fac0c7368 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:36.605381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b42fd28-19e5-41de-87cc-c04fac0c7368 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:36.618689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b42fd28-19e5-41de-87cc-c04fac0c7368 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:36.624410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b42fd28-19e5-41de-87cc-c04fac0c7368 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:36.625966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b42fd28-19e5-41de-87cc-c04fac0c7368 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:36.626685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b42fd28-19e5-41de-87cc-c04fac0c7368 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:36.696127 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b42fd28-19e5-41de-87cc-c04fac0c7368 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.099928 Dec 18 21:07:36.696750 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2585/5193] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:36 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:37.411298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:37.413702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:37.426004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.426984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.428777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.429236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.551335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:37.552586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:37.567442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.568946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.571840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.573988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.787582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:37.798464 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b4d6681-f580-4427-a96e-dd4778ee5e86 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.398932 Dec 18 21:07:37.799050 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2609/5194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:37 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:37.818185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2891df9d-98d7-4edb-9a51-70e6681b3294 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:37.820811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2891df9d-98d7-4edb-9a51-70e6681b3294 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:37.835169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2891df9d-98d7-4edb-9a51-70e6681b3294 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.835628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2891df9d-98d7-4edb-9a51-70e6681b3294 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.836437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2891df9d-98d7-4edb-9a51-70e6681b3294 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.836880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2891df9d-98d7-4edb-9a51-70e6681b3294 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.846035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:37.856270 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81a9baf1-8128-45be-81a8-21ae54179cd0 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1486 microversion: 2.1 time: 0.311558 Dec 18 21:07:37.857385 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2586/5195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:37 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1486 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:37.876093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:37.876853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:37.884254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.885046 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2891df9d-98d7-4edb-9a51-70e6681b3294 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.070448 Dec 18 21:07:37.885446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.886436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:37.887132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:37.891543 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2610/5196] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:37 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:37.925298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:07:38.038806 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b77ab00e-24ca-4000-b829-18130ebea9c8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 204 len: 0 microversion: 2.1 time: 0.168688 Dec 18 21:07:38.040317 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2587/5197] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:07:37 2021] DELETE /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:07:38.049419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:38.050415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:38.058483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:38.059151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:38.060147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:38.060587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:38.341810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:38.365164 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9cc43288-79ba-493e-8b68-7ea48ad1a6ef tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1492 microversion: 2.1 time: 0.319842 Dec 18 21:07:38.365807 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2611/5198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:38 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1492 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:38.817459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:38.818659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:38.828252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:38.828712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:38.829528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:38.829975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:38.899717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-750f37ae-fa93-4ce8-b337-90c55c7694a3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:38.902318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-750f37ae-fa93-4ce8-b337-90c55c7694a3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:38.917572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-750f37ae-fa93-4ce8-b337-90c55c7694a3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:38.919554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-750f37ae-fa93-4ce8-b337-90c55c7694a3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:38.921864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-750f37ae-fa93-4ce8-b337-90c55c7694a3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:38.923137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-750f37ae-fa93-4ce8-b337-90c55c7694a3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:38.989220 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-750f37ae-fa93-4ce8-b337-90c55c7694a3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.094028 Dec 18 21:07:38.989962 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2612/5199] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:38 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:39.213379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:39.229002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aee9584b-b53f-4e76-a7c1-7bb6d53b1dca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.416398 Dec 18 21:07:39.229642 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2588/5200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:38 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:39.384014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:39.384957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:39.400149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:39.400880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:39.402863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:39.405953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:40.003205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-728416d0-46ca-49eb-a2c6-aebae254184a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:40.005735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-728416d0-46ca-49eb-a2c6-aebae254184a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:40.015698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-728416d0-46ca-49eb-a2c6-aebae254184a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:40.016425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-728416d0-46ca-49eb-a2c6-aebae254184a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:40.017457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-728416d0-46ca-49eb-a2c6-aebae254184a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:40.018118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-728416d0-46ca-49eb-a2c6-aebae254184a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:40.069923 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-728416d0-46ca-49eb-a2c6-aebae254184a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.072029 Dec 18 21:07:40.075649 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2589/5201] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:39 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:40.139501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:40.148788 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-51cb8cfa-bbb6-4ef8-9db7-eb135aee2976 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1492 microversion: 2.1 time: 0.769376 Dec 18 21:07:40.149478 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2613/5202] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:39 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1492 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:40.288761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:40.290069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:40.308439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:40.314574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:40.316419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:40.317466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:40.503220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d58bceff-0424-4a76-88dd-a31408014183 req-415758b9-dad7-4f71-802e-717e19449b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d3cca3-277f-4511-b8fa-d509183d0af0", "name": "network-vif-deleted", "tag": "1e397e8f-628a-4ac3-ba85-1606b5d04abb"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:40.505159 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:07:40.505159 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:07:40.524183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d58bceff-0424-4a76-88dd-a31408014183 req-415758b9-dad7-4f71-802e-717e19449b29 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:40.526001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d58bceff-0424-4a76-88dd-a31408014183 req-415758b9-dad7-4f71-802e-717e19449b29 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:40.562116 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d58bceff-0424-4a76-88dd-a31408014183 req-415758b9-dad7-4f71-802e-717e19449b29 service nova] Creating event network-vif-deleted:1e397e8f-628a-4ac3-ba85-1606b5d04abb for instance 48d3cca3-277f-4511-b8fa-d509183d0af0 on nch1-master-1 Dec 18 21:07:40.573305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d58bceff-0424-4a76-88dd-a31408014183 req-415758b9-dad7-4f71-802e-717e19449b29 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078494 Dec 18 21:07:40.576062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2614/5203] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:07:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:07:40.830227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:40.841336 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da98ff27-d72c-4ed1-97e0-fee6a458559f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.597873 Dec 18 21:07:40.841927 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2590/5204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:40 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:41.087415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f24a4489-496e-4566-a639-97c9ffa80e3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:41.089157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f24a4489-496e-4566-a639-97c9ffa80e3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:41.099359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24a4489-496e-4566-a639-97c9ffa80e3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:41.100154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24a4489-496e-4566-a639-97c9ffa80e3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:41.101219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24a4489-496e-4566-a639-97c9ffa80e3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:41.101901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f24a4489-496e-4566-a639-97c9ffa80e3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:41.154498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f24a4489-496e-4566-a639-97c9ffa80e3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.070842 Dec 18 21:07:41.159055 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2615/5205] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:41 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:41.172493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:41.173131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:41.192904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:41.195719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:41.196593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:41.198172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:41.295994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:41.298371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:41.299290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lazy-loading 'fault' on Instance uuid 48d3cca3-277f-4511-b8fa-d509183d0af0 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:07:41.392685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:41.405550 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1ae6ec4-a89f-4f19-8d1c-60cfea111344 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 200 len: 1303 microversion: 2.1 time: 0.243112 Dec 18 21:07:41.407011 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2591/5206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:41 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:41.860898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:41.862280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:41.872986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:41.873902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:41.874896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:41.875338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:42.147785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:42.159672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3b359e0-392a-4300-a0da-9704f27f88b9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.303947 Dec 18 21:07:42.169067 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2616/5207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:41 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:42.169250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e74171e1-057d-4d98-936f-1244d78f1967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:42.170929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e74171e1-057d-4d98-936f-1244d78f1967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:42.178910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e74171e1-057d-4d98-936f-1244d78f1967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:42.179674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e74171e1-057d-4d98-936f-1244d78f1967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:42.180578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e74171e1-057d-4d98-936f-1244d78f1967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:42.181300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e74171e1-057d-4d98-936f-1244d78f1967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:42.233621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e74171e1-057d-4d98-936f-1244d78f1967 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.067897 Dec 18 21:07:42.233621 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2592/5208] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:42 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:42.422804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:42.424854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:42.436035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:42.438190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:42.439288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:42.440847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:42.465983 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 48d3cca3-277f-4511-b8fa-d509183d0af0 could not be found. Dec 18 21:07:42.466861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 48d3cca3-277f-4511-b8fa-d509183d0af0 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:07:42.468442 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d85431f-ac26-4fff-9c2b-8ff412380b1b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 404 len: 111 microversion: 2.1 time: 0.050056 Dec 18 21:07:42.473512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2617/5209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:42 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:42.632267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1015549044", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "02107735-1e4a-434f-a377-a881410f569a"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:42.732860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] validate_networks() for [('02107735-1e4a-434f-a377-a881410f569a', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:07:43.176975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:43.178145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:43.185526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:43.187085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:43.187895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:43.188511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:43.761377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:43.773309 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e696889e-eb1d-43c5-b6bc-492acdd302af tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.599906 Dec 18 21:07:43.783626 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2618/5210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:43 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:43.783626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39f6145a-5963-42b8-94dc-ce89430a2b3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:43.783626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39f6145a-5963-42b8-94dc-ce89430a2b3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:43.791118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f6145a-5963-42b8-94dc-ce89430a2b3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:43.791982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f6145a-5963-42b8-94dc-ce89430a2b3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:43.793063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f6145a-5963-42b8-94dc-ce89430a2b3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:43.793707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f6145a-5963-42b8-94dc-ce89430a2b3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:43.849792 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39f6145a-5963-42b8-94dc-ce89430a2b3a tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.071603 Dec 18 21:07:43.850934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2619/5211] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:43 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:43.871356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:07:43.871873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:07:43.872237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:07:43.872640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:07:43.873048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:07:43.900477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:43.900930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:43.901753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:43.902244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:43.927102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:07:43.934220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Getting quotas for user 0a98795bdb7447c5b2a4930173b3c56d and project 58d1ab8b81784fb2ad1b6c9a7d9efc37. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:07:43.954548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:07:43.959477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:07:44.028391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-253efc29-d526-450e-a024-9a35ab2677d7 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401229 Dec 18 21:07:44.030019 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2593/5212] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:07:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:07:44.040409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c518629-3a7f-41dc-984d-4a2209de3ac8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:44.041075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c518629-3a7f-41dc-984d-4a2209de3ac8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:44.149035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6c518629-3a7f-41dc-984d-4a2209de3ac8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:44.157313 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c518629-3a7f-41dc-984d-4a2209de3ac8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1215 microversion: 2.1 time: 0.121371 Dec 18 21:07:44.158129 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2620/5213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:44 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:44.796820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:44.797446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:44.806935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:44.807393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:44.809393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:44.810442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:44.863813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d10150dd-6e5f-4ade-a6d8-a7adce0511b6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:44.864834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d10150dd-6e5f-4ade-a6d8-a7adce0511b6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:44.876053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10150dd-6e5f-4ade-a6d8-a7adce0511b6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:44.876624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10150dd-6e5f-4ade-a6d8-a7adce0511b6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:44.877466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10150dd-6e5f-4ade-a6d8-a7adce0511b6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:44.878926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10150dd-6e5f-4ade-a6d8-a7adce0511b6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:44.952771 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d10150dd-6e5f-4ade-a6d8-a7adce0511b6 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.091675 Dec 18 21:07:44.960967 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2621/5214] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:44 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:07:45.174722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:45.175433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:45.183143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:45.183613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:45.184419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:45.184866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:45.222843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:45.237417 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d45c24b-f814-4786-848c-fe55fbcabd2a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.446825 Dec 18 21:07:45.238022 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2594/5215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:44 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:45.306054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:45.315351 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ae64dfa-da01-4a2c-8ad7-cab63c38eacf tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1267 microversion: 2.1 time: 0.144812 Dec 18 21:07:45.317457 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2622/5216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:45 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:45.970016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a6f014b-e3b2-4f59-acaa-5594671d09c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:45.971418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a6f014b-e3b2-4f59-acaa-5594671d09c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:45.985845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6f014b-e3b2-4f59-acaa-5594671d09c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:45.986353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6f014b-e3b2-4f59-acaa-5594671d09c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:45.987125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6f014b-e3b2-4f59-acaa-5594671d09c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:45.990733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a6f014b-e3b2-4f59-acaa-5594671d09c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:46.082471 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a6f014b-e3b2-4f59-acaa-5594671d09c3 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.117562 Dec 18 21:07:46.087902 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2595/5217] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:45 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:46.257199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:46.259324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:46.272551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:46.273336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:46.274974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:46.275700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:46.333751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:46.334547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:46.343649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:46.348361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:46.349938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:46.353289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:46.484208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:46.494981 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18c7143a-350e-471c-87db-f0957a6e66f8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1273 microversion: 2.1 time: 0.165415 Dec 18 21:07:46.498162 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2596/5218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:46 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:46.525216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:46.539124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-90a7379b-6ba9-4bd1-b76c-a251d6f07a9f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.288006 Dec 18 21:07:46.539962 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2623/5219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:46 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:47.098541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04d84686-475a-47b7-a392-54d6c1febb62 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:47.099393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04d84686-475a-47b7-a392-54d6c1febb62 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:47.107414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04d84686-475a-47b7-a392-54d6c1febb62 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:47.108920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04d84686-475a-47b7-a392-54d6c1febb62 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:47.111057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04d84686-475a-47b7-a392-54d6c1febb62 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:47.112559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04d84686-475a-47b7-a392-54d6c1febb62 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:47.195315 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04d84686-475a-47b7-a392-54d6c1febb62 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.100672 Dec 18 21:07:47.206802 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2597/5220] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:47 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:47.514868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:47.515594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:47.530296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:47.531017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:47.533402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:47.534070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:47.561917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:47.564873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:47.587944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:47.589164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:47.590861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:47.592990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:48.006478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:48.009757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:48.019769 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-63376324-0add-491a-8a49-b859e14efc52 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.466672 Dec 18 21:07:48.020396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2598/5221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:47 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:48.031175 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e87c09d3-695a-48d1-b41a-6331c0948d57 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1315 microversion: 2.1 time: 0.520490 Dec 18 21:07:48.031735 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2624/5222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:47 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:48.215796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b3b61fce-d798-40af-8376-2c35f2da4c0c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:48.217705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b3b61fce-d798-40af-8376-2c35f2da4c0c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:48.259781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3b61fce-d798-40af-8376-2c35f2da4c0c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:48.260666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3b61fce-d798-40af-8376-2c35f2da4c0c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:48.263113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3b61fce-d798-40af-8376-2c35f2da4c0c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:48.266618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3b61fce-d798-40af-8376-2c35f2da4c0c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:48.353497 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b3b61fce-d798-40af-8376-2c35f2da4c0c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.143624 Dec 18 21:07:48.354171 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2599/5223] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:48 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:48.539803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1e3a6dda-aa02-44d9-80f3-cd2ae622c375 req-a0308227-fa53-4746-b207-0437ba4bcc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6203ab3a-8cc1-476b-9d39-f63d644e2bb7", "tag": "c9652365-5f28-4d73-849a-105795171619"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:48.541838 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:07:48.541838 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:07:48.559228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1e3a6dda-aa02-44d9-80f3-cd2ae622c375 req-a0308227-fa53-4746-b207-0437ba4bcc62 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:48.561868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1e3a6dda-aa02-44d9-80f3-cd2ae622c375 req-a0308227-fa53-4746-b207-0437ba4bcc62 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:48.586130 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1e3a6dda-aa02-44d9-80f3-cd2ae622c375 req-a0308227-fa53-4746-b207-0437ba4bcc62 service nova] Creating event network-changed:c9652365-5f28-4d73-849a-105795171619 for instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 on nch1-master-1 Dec 18 21:07:48.596279 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1e3a6dda-aa02-44d9-80f3-cd2ae622c375 req-a0308227-fa53-4746-b207-0437ba4bcc62 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060879 Dec 18 21:07:48.597873 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2625/5224] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:07:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:07:49.040012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:49.040834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:49.050987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:49.051251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:49.051450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:49.052080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:49.053110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:49.053618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:49.071401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:49.072124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:49.073131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:49.073904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:49.447704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:49.480800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2a81535-46b1-4476-afa2-9ad8d2aa70ca tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1315 microversion: 2.1 time: 0.432475 Dec 18 21:07:49.495296 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2626/5225] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:49 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:49.515284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15cbb6ee-b406-456d-84ce-5764e247ff6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:49.525348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15cbb6ee-b406-456d-84ce-5764e247ff6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:49.544737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:49.548824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15cbb6ee-b406-456d-84ce-5764e247ff6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:49.551075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15cbb6ee-b406-456d-84ce-5764e247ff6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:49.555287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15cbb6ee-b406-456d-84ce-5764e247ff6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:49.555793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15cbb6ee-b406-456d-84ce-5764e247ff6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:49.562440 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee631310-03c8-40c5-b4f8-aa6fd1aede5a tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.529058 Dec 18 21:07:49.565632 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2600/5226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:49 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:49.661191 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15cbb6ee-b406-456d-84ce-5764e247ff6c tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.156091 Dec 18 21:07:49.661191 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2627/5227] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:49 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:50.501257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:50.502468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:50.511747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:50.512194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:50.513184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:50.513626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:50.581583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:50.588873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:50.603008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:50.605084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:50.605916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:50.606394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:50.900636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:50.910582 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4bd1494e-91f7-4ec7-b351-5e06eafa1f47 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1315 microversion: 2.1 time: 0.413569 Dec 18 21:07:50.912306 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2601/5228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:50 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:50.916946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-731f2285-9c46-4fd4-ac85-849f2acf3837 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:50.923522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-731f2285-9c46-4fd4-ac85-849f2acf3837 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:50.935911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-731f2285-9c46-4fd4-ac85-849f2acf3837 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:50.936372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-731f2285-9c46-4fd4-ac85-849f2acf3837 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:50.937176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-731f2285-9c46-4fd4-ac85-849f2acf3837 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:50.943311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-731f2285-9c46-4fd4-ac85-849f2acf3837 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:51.004498 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-731f2285-9c46-4fd4-ac85-849f2acf3837 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.089209 Dec 18 21:07:51.005326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2602/5229] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:50 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:51.049783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:51.060174 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-787e9d37-c4e3-48bf-b7dc-24c8a97916b2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.482571 Dec 18 21:07:51.071431 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2628/5230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:50 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:51.929114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:51.930580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:51.941261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:51.941955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:51.943298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:51.944584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.020151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-183a9356-9baf-49cc-98c2-3de0aa650687 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:52.024272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-183a9356-9baf-49cc-98c2-3de0aa650687 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:52.033028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-183a9356-9baf-49cc-98c2-3de0aa650687 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.033667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-183a9356-9baf-49cc-98c2-3de0aa650687 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.034793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-183a9356-9baf-49cc-98c2-3de0aa650687 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.035388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-183a9356-9baf-49cc-98c2-3de0aa650687 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.097414 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-183a9356-9baf-49cc-98c2-3de0aa650687 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action" status: 200 len: 40739 microversion: 2.42 time: 0.081488 Dec 18 21:07:52.098993 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2629/5231] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:07:52 2021] POST /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/action => generated 40739 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:52.109849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:52.111558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:52.119597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.120169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.121357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.122113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.243749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:52.252928 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1588cfcc-df04-4851-9e79-9fc7058ffa3b tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1315 microversion: 2.1 time: 0.327980 Dec 18 21:07:52.264768 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2603/5232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:51 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:52.278506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:52.279951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:52.288658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.289281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.290266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.290856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.582925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:52.595362 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29500bf8-f6cc-4d09-b2f2-dd26616fddbe tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.493202 Dec 18 21:07:52.596271 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2630/5233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:52 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:52.725522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:52.735198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:52.737353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:52.739351 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7d0ddfb-6c5f-49f9-a22f-242c4e105c73 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2950 microversion: 2.42 time: 0.465569 Dec 18 21:07:52.755773 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2604/5234] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:07:52 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2950 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:07:52.771864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-865f3e85-e0bb-4c4b-8f40-f914cde2bb03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:52.772365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-865f3e85-e0bb-4c4b-8f40-f914cde2bb03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:52.778932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f3e85-e0bb-4c4b-8f40-f914cde2bb03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.779447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f3e85-e0bb-4c4b-8f40-f914cde2bb03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:52.780286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f3e85-e0bb-4c4b-8f40-f914cde2bb03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:52.780701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-865f3e85-e0bb-4c4b-8f40-f914cde2bb03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:53.001205 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-865f3e85-e0bb-4c4b-8f40-f914cde2bb03 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.233029 Dec 18 21:07:53.002441 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2631/5235] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Dec 18 21:07:52 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82/os-interface => generated 1830 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:07:53.285235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:53.285858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:53.299235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:53.301477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:53.304592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:53.307756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:53.516765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f3081c3d-6a2e-4d7a-bd37-ac3ffb99ee44 req-51695e84-c7d5-4806-a6db-c85c36bc408e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203ab3a-8cc1-476b-9d39-f63d644e2bb7", "name": "network-vif-plugged", "status": "completed", "tag": "c9652365-5f28-4d73-849a-105795171619"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:53.520489 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:07:53.520489 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:07:53.530841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f3081c3d-6a2e-4d7a-bd37-ac3ffb99ee44 req-51695e84-c7d5-4806-a6db-c85c36bc408e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:53.531536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f3081c3d-6a2e-4d7a-bd37-ac3ffb99ee44 req-51695e84-c7d5-4806-a6db-c85c36bc408e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:53.555475 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f3081c3d-6a2e-4d7a-bd37-ac3ffb99ee44 req-51695e84-c7d5-4806-a6db-c85c36bc408e service nova] Creating event network-vif-plugged:c9652365-5f28-4d73-849a-105795171619 for instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 on nch1-master-1 Dec 18 21:07:53.569831 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f3081c3d-6a2e-4d7a-bd37-ac3ffb99ee44 req-51695e84-c7d5-4806-a6db-c85c36bc408e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.584470 Dec 18 21:07:53.570798 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2605/5236] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:07:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:07:53.616508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:53.618070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:53.629844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:53.631100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:53.632434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:53.633078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:53.645161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:53.670501 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e506242-4723-4fa3-ad7d-3fdf239b46ba tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1315 microversion: 2.1 time: 0.390860 Dec 18 21:07:53.673752 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2632/5237] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:53 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:07:53.898566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:53.907374 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0473501e-9af5-43cd-9304-ab258a08db4f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1532 microversion: 2.1 time: 0.297676 Dec 18 21:07:53.907980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2606/5238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:53 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1532 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:54.694225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:54.694932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:54.723785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:54.724252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:54.725102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:54.725558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:54.925898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:54.927571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:54.939412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:54.944054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:54.946644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:54.947797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:54.991874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:55.000331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8d021ae-e3f8-44fe-b0e1-da2cbf761755 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1315 microversion: 2.1 time: 0.314944 Dec 18 21:07:55.016430 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2633/5239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:54 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:55.225239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:55.237309 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ef2bbcdd-9eb7-47ce-80f5-53b1fe8972b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1532 microversion: 2.1 time: 0.316332 Dec 18 21:07:55.246805 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2607/5240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1532 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:56.016637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:56.017791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:56.035432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.037290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.038303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.038909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.255466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:56.256638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:56.271786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.272488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.273597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.274023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:56.274208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.291141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a794aa3b-d037-48b5-b556-4398c3e48a24 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1502 microversion: 2.1 time: 0.270953 Dec 18 21:07:56.292550 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2634/5241] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:56 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:56.311695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:56.313089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:56.325760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.327007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.328141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.328802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.397842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lazy-loading 'flavor' on Instance uuid 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:07:56.539543 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09ef8bec-2ebf-4b79-8b3d-1a7bd55af522 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "POST /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7/action" status: 202 len: 0 microversion: 2.1 time: 0.232084 Dec 18 21:07:56.540224 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2635/5242] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:07:56 2021] POST /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:07:56.551768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:56.557276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:56.560055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:56.581043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.583267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.583800 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ee82c04-b991-46bb-9d15-61fe24256be1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.330527 Dec 18 21:07:56.584313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:56.594574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:56.601075 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2608/5243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:56 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:56.789074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:56.799829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57988db8-43d3-4795-b151-6020a169efad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1510 microversion: 2.1 time: 0.253411 Dec 18 21:07:56.800829 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2636/5244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:56 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:57.106594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4da397d4-18a4-4f2d-a0e7-5a4e1c623413 req-3d3207ef-4240-45d4-9459-4cc6d715bf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1be5bad-33b6-459e-93d1-c890f71c2fb7", "name": "network-vif-plugged", "status": "completed", "tag": "01029a1f-6c70-48b6-9ed9-4300a6739bea"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:07:57.108739 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:07:57.108739 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:07:57.128215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4da397d4-18a4-4f2d-a0e7-5a4e1c623413 req-3d3207ef-4240-45d4-9459-4cc6d715bf96 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:57.128667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4da397d4-18a4-4f2d-a0e7-5a4e1c623413 req-3d3207ef-4240-45d4-9459-4cc6d715bf96 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:57.158614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4da397d4-18a4-4f2d-a0e7-5a4e1c623413 req-3d3207ef-4240-45d4-9459-4cc6d715bf96 service nova] Creating event network-vif-plugged:01029a1f-6c70-48b6-9ed9-4300a6739bea for instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 on nch1-master-1 Dec 18 21:07:57.172402 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4da397d4-18a4-4f2d-a0e7-5a4e1c623413 req-3d3207ef-4240-45d4-9459-4cc6d715bf96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068622 Dec 18 21:07:57.175428 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2609/5245] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:07:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:07:57.604930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:57.606743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:57.616880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:57.617702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:57.619574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:57.620250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:57.819618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:57.820674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:57.835983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:57.844397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:57.845658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:57.846160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:57.877047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:57.891914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82cd0d7a-782f-4f8e-8127-acfe3d4fe32e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.288645 Dec 18 21:07:57.892697 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2637/5246] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:57 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:58.101091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:58.109661 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9cc130c1-942b-4035-8c64-2df7cd1a4dc6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1493 microversion: 2.1 time: 0.295683 Dec 18 21:07:58.126089 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2610/5247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:57 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1493 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:58.136655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:58.137363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:58.147809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:58.148502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:58.149410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:58.150185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:58.197043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:07:58.371724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1dd31a05-904b-4585-9dc5-19266de7569a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 204 len: 0 microversion: 2.1 time: 0.239567 Dec 18 21:07:58.375590 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2638/5248] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:07:58 2021] DELETE /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:07:58.381405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:58.382015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:58.394151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:58.398931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:58.399792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:58.403222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:58.867210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:58.879428 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0c9f649-0ac3-4ea7-8a33-44dd93265f79 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1499 microversion: 2.1 time: 0.497971 Dec 18 21:07:58.880456 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2611/5249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:58 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1499 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:58.915711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:58.918908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:58.940748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:58.941686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:58.943258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:58.959298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:59.485689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:07:59.501586 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e114bd9-1f97-4814-8dee-0e298feff42d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.594161 Dec 18 21:07:59.503847 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2639/5250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:58 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:07:59.897343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:07:59.898730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:07:59.906953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:59.907353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:07:59.910061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:07:59.910709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:00.109564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:00.130045 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75839b5b-d92d-4199-8225-c9357263dbf1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1499 microversion: 2.1 time: 0.232792 Dec 18 21:08:00.131153 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2612/5251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:07:59 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1499 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:00.526559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:00.527708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:00.546710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:00.550805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:00.555605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:00.557891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:01.039903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:01.051414 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-24f247f5-5e78-4d16-893f-467dbfd983a7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.534188 Dec 18 21:08:01.052820 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2640/5252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:00 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:01.150898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:01.153773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:01.186612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:01.187346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:01.194375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:01.197088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:01.368510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5bcf5cec-43e0-4162-a4ef-04b78709104f req-16fc1274-3cab-4b99-ab50-e1d1821bc3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203ab3a-8cc1-476b-9d39-f63d644e2bb7", "name": "network-vif-deleted", "tag": "c9652365-5f28-4d73-849a-105795171619"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:01.371899 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:01.371899 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:08:01.386608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5bcf5cec-43e0-4162-a4ef-04b78709104f req-16fc1274-3cab-4b99-ab50-e1d1821bc3c8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:01.388543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5bcf5cec-43e0-4162-a4ef-04b78709104f req-16fc1274-3cab-4b99-ab50-e1d1821bc3c8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:01.437578 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5bcf5cec-43e0-4162-a4ef-04b78709104f req-16fc1274-3cab-4b99-ab50-e1d1821bc3c8 service nova] Creating event network-vif-deleted:c9652365-5f28-4d73-849a-105795171619 for instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 on nch1-master-1 Dec 18 21:08:01.469895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5bcf5cec-43e0-4162-a4ef-04b78709104f req-16fc1274-3cab-4b99-ab50-e1d1821bc3c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105031 Dec 18 21:08:01.471503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a98795bdb7447c5b2a4930173b3c56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:01.475955 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2641/5253] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:08:01.494688 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-140070c9-e273-408f-9ce5-8df71c1e10ab tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 200 len: 1457 microversion: 2.1 time: 0.347660 Dec 18 21:08:01.505424 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2613/5254] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:01 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 1457 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:02.071337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.072151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.095912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.099921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.101044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.102479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.467095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:02.475007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2eb674f8-b974-424e-9af8-a4462c0078a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.409213 Dec 18 21:08:02.476740 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2642/5255] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:02 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:02.512005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.513204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.539813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.543224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.545382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.549808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.572005 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 could not be found. Dec 18 21:08:02.573148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:02.577196 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d151e25b-1983-477d-b83a-10fe4a8a5170 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 404 len: 111 microversion: 2.1 time: 0.068792 Dec 18 21:08:02.589746 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2614/5256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:02 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:02.592290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.592930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.608135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.608600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.611323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.615897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.633725 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 could not be found. Dec 18 21:08:02.634319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:02.635376 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-507f9cd7-28d1-4645-9b29-b2a71ca07bf5 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 404 len: 111 microversion: 2.1 time: 0.047626 Dec 18 21:08:02.636729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2643/5257] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:02 2021] DELETE /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:02.646665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.647579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 6203ab3a-8cc1-476b-9d39-f63d644e2bb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.657816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.658899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.660518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.661119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.682188 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 could not be found. Dec 18 21:08:02.683069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 6203ab3a-8cc1-476b-9d39-f63d644e2bb7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:02.684266 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75d9d427-4ecd-4bb1-978c-dc335ed9c7f9 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7" status: 404 len: 111 microversion: 2.1 time: 0.043184 Dec 18 21:08:02.688361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2615/5258] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:02 2021] GET /compute/v2.1/servers/6203ab3a-8cc1-476b-9d39-f63d644e2bb7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:02.693715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.696329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.703746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.704440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.705436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.706037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.735987 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 48d3cca3-277f-4511-b8fa-d509183d0af0 could not be found. Dec 18 21:08:02.736587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 48d3cca3-277f-4511-b8fa-d509183d0af0 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:02.737427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03d0939a-7f63-415b-8e62-589f84f71cd6 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 404 len: 111 microversion: 2.1 time: 0.048269 Dec 18 21:08:02.741678 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2644/5259] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:02 2021] DELETE /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:02.751503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.752426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 48d3cca3-277f-4511-b8fa-d509183d0af0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.760021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.760659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.761700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.762783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.778112 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 48d3cca3-277f-4511-b8fa-d509183d0af0 could not be found. Dec 18 21:08:02.779550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 48d3cca3-277f-4511-b8fa-d509183d0af0 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:02.780943 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-88f1673a-7563-400e-a476-9c41470087c1 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0" status: 404 len: 111 microversion: 2.1 time: 0.036976 Dec 18 21:08:02.781966 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2616/5260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:02 2021] GET /compute/v2.1/servers/48d3cca3-277f-4511-b8fa-d509183d0af0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:02.796035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.799625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.808269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.809155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.810317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.810996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.882088 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 could not be found. Dec 18 21:08:02.882718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:02.887635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e530f2e8-0b09-416c-a8ba-1f36a4cde532 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 404 len: 111 microversion: 2.1 time: 0.101108 Dec 18 21:08:02.902355 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2645/5261] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:02 2021] DELETE /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:02.907399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:02.908021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ab9b708f-24ca-4dad-9e48-ce4b71edf595] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:02.936425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.939495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:02.940394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:02.940838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:03.015592 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 could not be found. Dec 18 21:08:03.020774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance ab9b708f-24ca-4dad-9e48-ce4b71edf595 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:03.025945 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-77ebf385-edb1-4074-9094-29881dd2b6ec tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595" status: 404 len: 111 microversion: 2.1 time: 0.120711 Dec 18 21:08:03.032585 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2617/5262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:02 2021] GET /compute/v2.1/servers/ab9b708f-24ca-4dad-9e48-ce4b71edf595 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:03.036143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:03.036883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:03.062747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:03.063225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:03.068341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:03.071488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:03.113874 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 could not be found. Dec 18 21:08:03.114767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:03.116665 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a81b2f54-5a94-4886-93c3-1eaeeb5ca050 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 404 len: 111 microversion: 2.1 time: 0.084863 Dec 18 21:08:03.123141 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2646/5263] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:03 2021] DELETE /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:03.130884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:03.132068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 7488031b-21d1-4bf2-a8fe-baa195bfbaa5] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:03.142047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:03.142807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:03.143629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:03.145052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:03.189241 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 could not be found. Dec 18 21:08:03.190047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 7488031b-21d1-4bf2-a8fe-baa195bfbaa5 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:03.191086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a807421-60d2-478d-889a-27e484e8cdaa tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5" status: 404 len: 111 microversion: 2.1 time: 0.064205 Dec 18 21:08:03.192892 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2618/5264] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:03 2021] GET /compute/v2.1/servers/7488031b-21d1-4bf2-a8fe-baa195bfbaa5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:08:03.204076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41b1f5a7-3cea-4b3b-8a14-b63ed919a8b8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:03.204964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41b1f5a7-3cea-4b3b-8a14-b63ed919a8b8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:03.213476 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-41b1f5a7-3cea-4b3b-8a14-b63ed919a8b8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 8ca18aeb-fcff-41f1-828d-ad9aeea7139e could not be found. Dec 18 21:08:03.214575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41b1f5a7-3cea-4b3b-8a14-b63ed919a8b8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 8ca18aeb-fcff-41f1-828d-ad9aeea7139e could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:03.216193 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41b1f5a7-3cea-4b3b-8a14-b63ed919a8b8 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e" status: 404 len: 111 microversion: 2.1 time: 0.018499 Dec 18 21:08:03.217647 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2647/5265] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:03 2021] DELETE /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:03.254228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-02b409d4-c94e-4dd9-8f08-d0d3f1c318df tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:03.255794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-02b409d4-c94e-4dd9-8f08-d0d3f1c318df tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 8ca18aeb-fcff-41f1-828d-ad9aeea7139e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:03.272185 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-02b409d4-c94e-4dd9-8f08-d0d3f1c318df tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 8ca18aeb-fcff-41f1-828d-ad9aeea7139e could not be found. Dec 18 21:08:03.272996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-02b409d4-c94e-4dd9-8f08-d0d3f1c318df tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 8ca18aeb-fcff-41f1-828d-ad9aeea7139e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:03.274044 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-02b409d4-c94e-4dd9-8f08-d0d3f1c318df tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e" status: 404 len: 111 microversion: 2.1 time: 0.052152 Dec 18 21:08:03.275662 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2619/5266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:03 2021] GET /compute/v2.1/servers/8ca18aeb-fcff-41f1-828d-ad9aeea7139e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:03.493213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:03.494751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:03.508997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:03.529199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:03.536240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:03.536533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:03.867069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:03.877404 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1e70403-b35c-4591-83e5-0e081381eaeb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.388781 Dec 18 21:08:03.878701 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2648/5267] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:03 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:04.583059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:04.584253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:04.597743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.618864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.623465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.625082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.654637 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. Dec 18 21:08:04.655479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:04.656474 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-899f9d84-cad2-4ad0-8f46-7613753f2088 tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 404 len: 111 microversion: 2.1 time: 0.079051 Dec 18 21:08:04.657639 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2620/5268] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:04 2021] DELETE /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:04.671967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:04.676486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: 0f80750d-04f9-46f2-b3b7-d72d0e49b146] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:04.698616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.699883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.736532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.737324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.769167 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. Dec 18 21:08:04.770844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance 0f80750d-04f9-46f2-b3b7-d72d0e49b146 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:04.772098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c67c5d16-c237-4103-adbe-f4404c44e4ad tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146" status: 404 len: 111 microversion: 2.1 time: 0.109831 Dec 18 21:08:04.773501 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2649/5269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:04 2021] GET /compute/v2.1/servers/0f80750d-04f9-46f2-b3b7-d72d0e49b146 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:04.782834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:04.784081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:04.792325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.793217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.795061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.796179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.815701 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf could not be found. Dec 18 21:08:04.817298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:04.818951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a75952b-9a92-4df5-80db-da0a31aec50a tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 404 len: 111 microversion: 2.1 time: 0.040928 Dec 18 21:08:04.820083 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2621/5270] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:04 2021] DELETE /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:08:04.828935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:04.829788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] [instance: ba1fea17-a56f-4df5-b5a7-0a1243877fbf] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:04.843819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.844581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.845709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.846393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.879280 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] HTTP exception thrown: Instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf could not be found. Dec 18 21:08:04.880454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] Returning 404 to user: Instance ba1fea17-a56f-4df5-b5a7-0a1243877fbf could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:04.881546 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7b52882-6690-4d3f-a13b-517866e5e11c tempest-DeleteServersTestJSON-508589951 tempest-DeleteServersTestJSON-508589951-project] 10.222.0.13 "GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf" status: 404 len: 111 microversion: 2.1 time: 0.057700 Dec 18 21:08:04.886065 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2650/5271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:04 2021] GET /compute/v2.1/servers/ba1fea17-a56f-4df5-b5a7-0a1243877fbf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:04.895075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:04.895691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:04.907636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.908484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:04.909741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:04.910520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:05.306171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:05.320205 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76cf73fa-37f5-4051-8e9c-cd2310c54cd9 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.429027 Dec 18 21:08:05.321993 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2622/5272] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:04 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:06.336993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:06.337992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:06.346976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:06.348595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:06.349490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:06.349937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:06.536784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:06.546792 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-869f4698-2897-4a14-a6a6-f90f4f6f3759 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.213662 Dec 18 21:08:06.557503 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2651/5273] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:06 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:07.583323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:07.584071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:07.645485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:07.646458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:07.664730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:07.665631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:07.997082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:08.007852 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d375e86b-b386-4e84-9b52-9625bd74690c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.446801 Dec 18 21:08:08.009211 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2623/5274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:07 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:09.029125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:09.030610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:09.041679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:09.042650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:09.046260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:09.051527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:09.344109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:09.354457 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f0eea36d-bb67-46f5-912e-7770ad8c2619 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.330828 Dec 18 21:08:09.356031 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2652/5275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:09 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:10.384316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:10.385910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:10.409657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:10.410285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:10.413351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:10.413857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:10.869156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:10.877447 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-96734820-6119-47e9-a88d-c48944e102e3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.504771 Dec 18 21:08:10.880613 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2624/5276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:10 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:11.901155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:11.901918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:11.917739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:11.918634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:11.920977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:11.921844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:12.235917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:12.246285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dae83ff6-6412-49b7-afc7-0f1a5c76bb29 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.351135 Dec 18 21:08:12.256933 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2653/5277] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:11 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:12.490848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1844702082", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "3baa75de-f149-471c-88ef-ff11a8232ff3"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:12.581772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] validate_networks() for [('3baa75de-f149-471c-88ef-ff11a8232ff3', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:08:13.096370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:08:13.096789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:08:13.097576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:08:13.098145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:08:13.098785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:08:13.113933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:13.114499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:13.115242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:13.115698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:13.139511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Getting quotas for project 78970748663c43d7956bc64b493acfae. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:08:13.145707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Getting quotas for user 35e8d9677fae4bebb8ec386e90349f76 and project 78970748663c43d7956bc64b493acfae. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:08:13.164611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:08:13.167520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:08:13.253555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a8f7c14f-5af9-4acc-9f32-a25fecb3985b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.148696 Dec 18 21:08:13.254521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2625/5278] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:08:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:08:13.266636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a77a37be-8851-40ca-a796-6d444636f996 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:13.267348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a77a37be-8851-40ca-a796-6d444636f996 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:13.282017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:13.283637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:13.312054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:13.312538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:13.323794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:13.323794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:13.364927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a77a37be-8851-40ca-a796-6d444636f996 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:13.374769 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a77a37be-8851-40ca-a796-6d444636f996 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1225 microversion: 2.1 time: 0.112775 Dec 18 21:08:13.378027 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2654/5279] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:13 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:13.624254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:13.644600 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c346b505-7931-446f-acb2-5241538286c7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.382193 Dec 18 21:08:13.656048 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2626/5280] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:13 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:14.393734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:14.394371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:14.404244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:14.404696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:14.405699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:14.406144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:14.521472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:14.538833 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5da811b6-66a2-44e7-aa40-544eda3ebc06 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1277 microversion: 2.1 time: 0.149630 Dec 18 21:08:14.551134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2655/5281] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:14 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:14.665537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:14.667066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:14.682566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:14.683236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:14.684095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:14.684546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:14.987090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:14.997009 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db02b59c-cbc1-419a-8734-3583276a7344 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1527 microversion: 2.1 time: 0.337141 Dec 18 21:08:14.997626 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2627/5282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:14 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:15.561331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:15.561846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:15.572588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:15.573552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:15.576186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:15.576933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:15.649930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:15.659789 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bef3c4f0-d383-4c04-b91c-65dc12633702 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1283 microversion: 2.1 time: 0.104219 Dec 18 21:08:15.662369 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2656/5283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:15 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:16.017188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:16.018578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:16.026438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:16.027243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:16.029251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:16.029922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:16.343121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:16.358712 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6c8a73a3-3453-4923-8f0d-96bed0d21fb0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1509 microversion: 2.1 time: 0.345973 Dec 18 21:08:16.361209 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2628/5284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:16 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:16.684022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:16.685388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:16.697754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:16.698578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:16.699566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:16.700250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:16.979892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e4df2098-ac60-4cdb-93cd-12d342f1d9b3 req-d13c4fa0-6bb9-4fc1-b776-63a33493ba01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28062e3e-9e82-4f4e-97ca-1af56a3f94ca", "tag": "6419101c-f417-440a-9dc1-1ff20d886edd"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:16.982192 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:16.982192 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:16.992162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e4df2098-ac60-4cdb-93cd-12d342f1d9b3 req-d13c4fa0-6bb9-4fc1-b776-63a33493ba01 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:16.992976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e4df2098-ac60-4cdb-93cd-12d342f1d9b3 req-d13c4fa0-6bb9-4fc1-b776-63a33493ba01 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:17.031596 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e4df2098-ac60-4cdb-93cd-12d342f1d9b3 req-d13c4fa0-6bb9-4fc1-b776-63a33493ba01 service nova] Creating event network-changed:6419101c-f417-440a-9dc1-1ff20d886edd for instance 28062e3e-9e82-4f4e-97ca-1af56a3f94ca on nch1-master-1 Dec 18 21:08:17.039335 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e4df2098-ac60-4cdb-93cd-12d342f1d9b3 req-d13c4fa0-6bb9-4fc1-b776-63a33493ba01 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064072 Dec 18 21:08:17.041061 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2629/5285] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:17.067932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:17.079746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84efaa15-7dcd-4bed-b650-d14b54d0478a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1325 microversion: 2.1 time: 0.404247 Dec 18 21:08:17.081950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2657/5286] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:16 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1325 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:17.378037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:17.379035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:17.393868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:17.395117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:17.396678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:17.397414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:17.753055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1836716087", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "8033b418-7626-44d2-9e3d-745ce17575dd"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:17.858736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] validate_networks() for [('8033b418-7626-44d2-9e3d-745ce17575dd', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:08:18.102441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:18.110948 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-243cb729-1bf6-49e2-a63f-0d212f8f7b3d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1509 microversion: 2.1 time: 0.737762 Dec 18 21:08:18.112218 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2630/5287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:17 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1509 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:18.116916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:18.117802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:18.124090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:18.124880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:18.125902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:18.126589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:18.362605 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:08:18.363176 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:08:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Dec 18 21:08:18.415526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:18.426876 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6162f01f-3bb3-4bb7-91cc-05fef62c11f3 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1325 microversion: 2.1 time: 0.310051 Dec 18 21:08:18.427973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2631/5288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:18 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1325 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:18.687302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:08:18.688113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:08:18.688747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:08:18.689537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:08:18.690367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:08:18.711236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:18.711236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:18.711236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:18.711480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:18.734344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Getting quotas for project c48b8b9635104eafab5295b3b8709c14. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:08:18.741112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Getting quotas for user e8150e994a4f42e3b014e5e51265213a and project c48b8b9635104eafab5295b3b8709c14. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:08:18.756342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:08:18.759043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:08:18.824696 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97eb1ba2-819b-421f-9e46-90556c0af031 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247337 Dec 18 21:08:18.825710 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2658/5289] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:08:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:08:18.835450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57e8f08d-ec6b-4b2b-8570-8112451f74cd tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:18.836544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57e8f08d-ec6b-4b2b-8570-8112451f74cd tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:18.913257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-57e8f08d-ec6b-4b2b-8570-8112451f74cd tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:18.923386 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57e8f08d-ec6b-4b2b-8570-8112451f74cd tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1214 microversion: 2.1 time: 0.091686 Dec 18 21:08:18.924700 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2632/5290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:18 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:19.136238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c01ebdc9-09f9-469e-bc18-cdf72292050c req-22098e58-b489-48dc-8037-b81355d11901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1be5bad-33b6-459e-93d1-c890f71c2fb7", "name": "network-vif-unplugged", "status": "completed", "tag": "01029a1f-6c70-48b6-9ed9-4300a6739bea"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:19.137343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:19.139932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:19.140106 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:19.140106 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:19.150164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.151526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.154566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.155604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.158469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c01ebdc9-09f9-469e-bc18-cdf72292050c req-22098e58-b489-48dc-8037-b81355d11901 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.158955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c01ebdc9-09f9-469e-bc18-cdf72292050c req-22098e58-b489-48dc-8037-b81355d11901 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.194432 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c01ebdc9-09f9-469e-bc18-cdf72292050c req-22098e58-b489-48dc-8037-b81355d11901 service nova] Creating event network-vif-unplugged:01029a1f-6c70-48b6-9ed9-4300a6739bea for instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 on nch1-master-1 Dec 18 21:08:19.218083 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c01ebdc9-09f9-469e-bc18-cdf72292050c req-22098e58-b489-48dc-8037-b81355d11901 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090869 Dec 18 21:08:19.224021 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2633/5291] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:19.379743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:19.388888 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3753c1f1-e89e-46d6-bee1-fa35a2f9c140 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1512 microversion: 2.1 time: 0.263324 Dec 18 21:08:19.391147 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2659/5292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:19 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:19.408497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:19.409256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:19.417230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.417695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.418538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.419610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.444879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:19.445493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:19.464590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.465105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.470546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.471648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.694924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:19.708619 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8ab2eff0-def3-4833-9c6c-730d40dad5cf tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1452 microversion: 2.1 time: 0.303483 Dec 18 21:08:19.709489 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2634/5293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:19 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1452 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:19.770690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:19.776695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:19.777519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:19.782736 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0fbc5c03-d83c-4e76-ab8f-1c62ad43ebce tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1325 microversion: 2.1 time: 0.341754 Dec 18 21:08:19.783380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2660/5294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:19 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:19.788627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.789755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.791014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.791753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.837537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lazy-loading 'flavor' on Instance uuid b1be5bad-33b6-459e-93d1-c890f71c2fb7 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:08:19.860146 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Cannot 'shelve' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state shelved_offloaded Dec 18 21:08:19.860747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 409 to user: Cannot 'shelve' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state shelved_offloaded {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:19.861824 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1fdd4711-5aef-4c8f-93cd-2ae267df52eb tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 409 len: 155 microversion: 2.1 time: 0.090193 Dec 18 21:08:19.862894 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2635/5295] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:19 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 155 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:08:19.872665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3def8e6c-be79-4598-ac54-a010b5f90f3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:19.873323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3def8e6c-be79-4598-ac54-a010b5f90f3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:19.879400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3def8e6c-be79-4598-ac54-a010b5f90f3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.879862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3def8e6c-be79-4598-ac54-a010b5f90f3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.880680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3def8e6c-be79-4598-ac54-a010b5f90f3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.881113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3def8e6c-be79-4598-ac54-a010b5f90f3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.942429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:19.943203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:19.951766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.952534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:19.953423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:19.953939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:20.017528 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3def8e6c-be79-4598-ac54-a010b5f90f3c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.150290 Dec 18 21:08:20.018771 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2661/5296] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:19 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:08:20.025754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:20.026671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:20.027553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:20.035304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:20.035468 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b6f09fd-2aac-4df5-9f15-34dfc52036c0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1266 microversion: 2.1 time: 0.097761 Dec 18 21:08:20.036085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:20.036281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2636/5297] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:19 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:20.037433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:20.037883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:20.329297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:20.337325 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c338682a-ef17-4c26-88cb-1f27b7bb249b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1460 microversion: 2.1 time: 0.314595 Dec 18 21:08:20.338227 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2662/5298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:20 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1460 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:20.803150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:20.803786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:20.819328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:20.820227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:20.822746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:20.823575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:21.063661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:21.066540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:21.079613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:21.081113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:21.082553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:21.084212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:21.325709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:21.334502 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a84e7f2a-a59e-498f-8c7a-cb13a4893091 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1325 microversion: 2.1 time: 0.537169 Dec 18 21:08:21.347082 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2637/5299] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:20 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1325 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:21.354963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:21.355855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:21.380262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:21.380698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:21.381529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:21.381961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:21.549410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:21.590149 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85a9216a-c88b-4cca-b959-b219fda33548 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.528086 Dec 18 21:08:21.611905 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2663/5300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:21 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:21.625899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-75e25e09-9917-4586-982e-3bc61cc8d569 req-15c9026a-7d92-4447-a192-23fbddda8fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28062e3e-9e82-4f4e-97ca-1af56a3f94ca", "name": "network-vif-plugged", "status": "completed", "tag": "6419101c-f417-440a-9dc1-1ff20d886edd"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:21.627593 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:21.627593 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:08:21.644346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-75e25e09-9917-4586-982e-3bc61cc8d569 req-15c9026a-7d92-4447-a192-23fbddda8fbe service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:21.644799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-75e25e09-9917-4586-982e-3bc61cc8d569 req-15c9026a-7d92-4447-a192-23fbddda8fbe service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:21.670322 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-75e25e09-9917-4586-982e-3bc61cc8d569 req-15c9026a-7d92-4447-a192-23fbddda8fbe service nova] Creating event network-vif-plugged:6419101c-f417-440a-9dc1-1ff20d886edd for instance 28062e3e-9e82-4f4e-97ca-1af56a3f94ca on nch1-master-1 Dec 18 21:08:21.676252 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-75e25e09-9917-4586-982e-3bc61cc8d569 req-15c9026a-7d92-4447-a192-23fbddda8fbe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061941 Dec 18 21:08:21.677369 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2664/5301] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:21.741821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:21.750632 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a446545d-4015-478c-bafa-b85d32adfb92 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1462 microversion: 2.1 time: 0.399164 Dec 18 21:08:21.751625 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2638/5302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:21 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1462 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:22.364958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:22.366555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:22.375533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:22.376354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:22.377516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:22.378132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:22.612124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:22.618784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:22.628702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:22.629782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:22.639397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:22.640143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:22.767259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:22.776276 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b35671ec-8924-488c-ab6b-ade64de27d6e tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1325 microversion: 2.1 time: 0.416183 Dec 18 21:08:22.777437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2665/5303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:22 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1325 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:22.783518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:22.784308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:22.791138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:22.791833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:22.792802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:22.793425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:23.183013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:23.194663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a91d548-c3dc-4b6b-849f-9a030885a2a0 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.585447 Dec 18 21:08:23.196068 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2639/5304] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:22 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:23.416171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:23.428481 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bee5c3dc-8acb-468d-aaa8-b47216b8d0f1 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.649114 Dec 18 21:08:23.429078 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2666/5305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:22 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:23.477472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b216ba05-776b-4e28-b611-e52a3bef17cf req-f8883f84-fb36-42f7-ba26-9a59845ffb86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8668088b-ae76-48a8-bd85-f81eb04d72cc", "tag": "3097be62-2436-4586-8304-3ef9c014939e"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:23.479310 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:23.479310 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:23.494678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b216ba05-776b-4e28-b611-e52a3bef17cf req-f8883f84-fb36-42f7-ba26-9a59845ffb86 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:23.495876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b216ba05-776b-4e28-b611-e52a3bef17cf req-f8883f84-fb36-42f7-ba26-9a59845ffb86 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:23.523847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b216ba05-776b-4e28-b611-e52a3bef17cf req-f8883f84-fb36-42f7-ba26-9a59845ffb86 service nova] Creating event network-changed:3097be62-2436-4586-8304-3ef9c014939e for instance 8668088b-ae76-48a8-bd85-f81eb04d72cc on nch2-master-1 Dec 18 21:08:23.533078 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b216ba05-776b-4e28-b611-e52a3bef17cf req-f8883f84-fb36-42f7-ba26-9a59845ffb86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325740 Dec 18 21:08:23.534865 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2640/5306] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:23.792789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:23.793795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:23.800203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:23.801045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:23.802071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:23.802758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.220405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:24.222599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:24.231131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.232691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.233725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.234917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.692607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:24.707477 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a081ab6-be51-4f95-9ff4-c0a9459e8c09 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1522 microversion: 2.1 time: 0.916444 Dec 18 21:08:24.721556 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2667/5307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:23 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1522 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:24.728959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:24.732765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:24.744233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.751062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.752269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.752878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.811064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:24.824856 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0308e3f0-917f-4da2-a3e1-d1e593f03a16 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.616422 Dec 18 21:08:24.826146 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2641/5308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:24 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:24.842272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:24.850374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:24.864705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.865353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.866531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.867161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.893806 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] HTTP exception thrown: Instance is not a member of specified network Dec 18 21:08:24.894687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:24.896022 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-50176244-64cb-441e-816c-a9763f7b603f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.064312 Dec 18 21:08:24.896963 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2642/5309] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:08:24 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca/ips/invalid => generated 91 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:08:24.908146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1879ddf8-b533-4b1a-b697-7f9f6364e36d tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:24.908897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1879ddf8-b533-4b1a-b697-7f9f6364e36d tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Failed to fetch instance by id 999 {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 18 21:08:24.909623 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1879ddf8-b533-4b1a-b697-7f9f6364e36d tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] HTTP exception thrown: Instance 999 could not be found. Dec 18 21:08:24.910425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1879ddf8-b533-4b1a-b697-7f9f6364e36d tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:24.911433 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1879ddf8-b533-4b1a-b697-7f9f6364e36d tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007323 Dec 18 21:08:24.912367 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2643/5310] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 21:08:24 2021] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:08:24.921214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:24.926639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:24.969374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.988666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:24.992629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:24.993995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:25.092557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:08:25.235157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:25.243414 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4304dc7d-8544-4f96-9fc5-6905ce1465ff tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.520456 Dec 18 21:08:25.250631 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2668/5311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:24 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:25.263507 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a014f37-1dd5-4d58-81ce-429569204891 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 204 len: 0 microversion: 2.1 time: 0.344933 Dec 18 21:08:25.268267 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2644/5312] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:24 2021] DELETE /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:08:25.272782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:25.273407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:25.286814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:25.289347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:25.291763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:25.295767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:25.845816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:25.846623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:25.855760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:25.863692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:25.867583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:25.869747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:25.939609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:25.958131 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e28c1d31-d43d-41b3-be6a-2fa623e39d3f tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 0.688657 Dec 18 21:08:25.960978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2669/5313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:25 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:26.268419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:26.270508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:26.292733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:26.298144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:26.301059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:26.305592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:26.650394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:26.665467 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8c752766-d26c-46ef-9285-21c2eec75b86 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.822979 Dec 18 21:08:26.669363 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2645/5314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:25 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:26.762729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:26.774549 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2d3661b-8f35-488f-9ce4-aa5f1ab9689e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.509942 Dec 18 21:08:26.776276 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2670/5315] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:26 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:26.979209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:26.980578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:27.003490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:27.004009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:27.005119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:27.005818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:27.331507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:27.343740 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ccbee0c-8ecf-4ed6-855d-f2733cdacc9b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 0.369456 Dec 18 21:08:27.344331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2646/5316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:26 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:27.694235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:27.695090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:27.715104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:27.717817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:27.721468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:27.728097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:27.795250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:27.795919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:27.808280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:27.808733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:27.809572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:27.820500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:28.289239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:28.305146 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3e21967f-bc52-4301-b1da-18a841d09a4d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.622751 Dec 18 21:08:28.311763 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2671/5317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:27 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:28.366806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:28.373027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:28.380991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:28.381691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:28.382726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:28.383367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:28.403868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:28.417323 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-91d5a54e-4b14-47d0-9628-8c0f41b94305 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.626095 Dec 18 21:08:28.429091 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2647/5318] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:27 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:28.670427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:28.692695 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbbe047b-37a6-4d24-ad76-d209e9b110cc tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 0.332525 Dec 18 21:08:28.709352 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2672/5319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:28 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:29.334395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:29.337909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:29.359292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:29.360178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:29.361788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:29.362618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:29.436326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:29.436934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:29.448375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:29.448842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:29.454072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:29.454609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:29.861294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:29.873613 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a0d48d7e-e786-4034-b61c-45424f2d6702 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.551775 Dec 18 21:08:29.906011 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2648/5320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:29 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:29.911980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-924061328", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:30.015132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] validate_networks() for None {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:08:30.324345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:30.346225 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bd579f8d-eb7c-4743-ad54-ee417d9b5428 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.913269 Dec 18 21:08:30.348041 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2673/5321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:29 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:30.370558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:30.371707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:30.378550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:30.379889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:30.380947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:30.381604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:30.434835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:08:30.435900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:08:30.436657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:08:30.437331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:08:30.437958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:08:30.450725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:30.452290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:30.453451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:30.454108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:30.500448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Getting quotas for project 6df650339f864e028604b27467d14de8. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:08:30.516719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Getting quotas for user 4669c1de603a448a91c3b979a632468b and project 6df650339f864e028604b27467d14de8. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:08:30.548349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:08:30.551795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:08:30.665028 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf8f317b-8aad-4ba4-93a2-1576f8180f7e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756146 Dec 18 21:08:30.671598 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2649/5322] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:08:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:08:30.677052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6fa529c-dee1-4413-b150-4650af35d5ee tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:30.677684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6fa529c-dee1-4413-b150-4650af35d5ee tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:31.494630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d6fa529c-dee1-4413-b150-4650af35d5ee tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:31.505827 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6fa529c-dee1-4413-b150-4650af35d5ee tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1214 microversion: 2.1 time: 0.832871 Dec 18 21:08:31.514267 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2650/5323] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:30 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1214 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:31.525332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:31.526643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:31.542678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:31.544182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:31.546981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:31.548565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:31.740828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:31.749405 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ce5b4668-f36b-4f99-b375-96215b481f5b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 1.399887 Dec 18 21:08:31.754579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2674/5324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:30 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:31.759548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:31.763516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:31.775085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:31.775734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:31.777494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:31.779113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:32.162695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:32.180400 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5df7d4b0-6986-47d7-b168-28b153ec85a2 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.664384 Dec 18 21:08:32.181377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2651/5325] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:31 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:32.367381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:32.378424 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3eeb8608-b4fa-406d-a2e9-671ba1eea4ac tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.622408 Dec 18 21:08:32.380058 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2675/5326] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:31 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:32.527498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:32.529028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:32.540095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:32.540650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:32.541800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:32.542373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:32.662467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:32.674315 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d069cfdf-fc61-4415-9974-b8d154bc7506 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1218 microversion: 2.1 time: 0.150651 Dec 18 21:08:32.676051 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2652/5327] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:32 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:32.769529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:32.770234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:32.792489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:32.792985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:32.794750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:32.795441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:33.199102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:33.200332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:33.208496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:33.218979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:33.220455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:33.221720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:33.692434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:33.716924 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab1f915c-ad15-4ffa-9640-b85a5fb08867 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 0.951764 Dec 18 21:08:33.718116 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2676/5328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:32 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:33.723160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:33.723777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:33.732812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:33.733626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:33.735031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:33.735638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:33.893377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:33.905086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b5ca256-4723-401f-b925-377f3a3b982d tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.710385 Dec 18 21:08:33.909318 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2653/5329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:33 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:33.919792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-55bd9155-dd0f-4fa0-894b-63cd7358ffe6 req-be7ef1a1-e526-4259-89ce-6d61c33bee23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8668088b-ae76-48a8-bd85-f81eb04d72cc", "name": "network-vif-plugged", "status": "completed", "tag": "3097be62-2436-4586-8304-3ef9c014939e"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:33.923356 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:33.923356 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:33.952322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-55bd9155-dd0f-4fa0-894b-63cd7358ffe6 req-be7ef1a1-e526-4259-89ce-6d61c33bee23 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:33.953039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-55bd9155-dd0f-4fa0-894b-63cd7358ffe6 req-be7ef1a1-e526-4259-89ce-6d61c33bee23 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:33.970020 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-55bd9155-dd0f-4fa0-894b-63cd7358ffe6 req-be7ef1a1-e526-4259-89ce-6d61c33bee23 service nova] Creating event network-vif-plugged:3097be62-2436-4586-8304-3ef9c014939e for instance 8668088b-ae76-48a8-bd85-f81eb04d72cc on nch2-master-1 Dec 18 21:08:33.978470 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-55bd9155-dd0f-4fa0-894b-63cd7358ffe6 req-be7ef1a1-e526-4259-89ce-6d61c33bee23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067614 Dec 18 21:08:33.980003 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2654/5330] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:33.994055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:33.995021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:34.019789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:34.020489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:34.021493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:34.022277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:34.235369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:34.252073 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ec2dca2-0b1f-4bf8-bcd6-d17c5ee6563e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1218 microversion: 2.1 time: 0.269162 Dec 18 21:08:34.254377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2655/5331] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:33 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1218 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:34.383281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:34.393254 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a98b030-aeda-49fc-96d3-9dab3d183551 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.674042 Dec 18 21:08:34.393850 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2677/5332] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:33 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:34.733397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:34.734331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:34.741437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:34.742152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:34.743194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:34.743805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:34.925161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:34.926317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:34.935409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:34.936301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:34.937279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:34.937879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:35.400974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:35.412088 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d74d348-6aff-4146-9b5b-674d9700193b tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 0.682866 Dec 18 21:08:35.423659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2656/5333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:34 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:35.430363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:35.431594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:35.444111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:35.444569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:35.445381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:35.445891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:35.448171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:35.462892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50657ced-1e2b-48d0-930d-efae1569b372 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1314 microversion: 2.1 time: 0.537871 Dec 18 21:08:35.474300 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2678/5334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:34 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:35.484782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:35.485970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:35.494329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:35.495498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:35.497197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:35.497961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:35.545461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:35.553048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b0d8cf0-dc2e-4f22-a655-a3617de0cd5d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1218 microversion: 2.1 time: 0.130255 Dec 18 21:08:35.553728 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2657/5335] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:35 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:35.884262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:35.892407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f559504-86ae-4d51-b980-f8095d7b4e50 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.416651 Dec 18 21:08:35.893081 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2679/5336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:35 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:36.431391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:36.432163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:36.443533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:36.444982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:36.445899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:36.448191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:36.481607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:36.482958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:36.490431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:36.491259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:36.492450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:36.493108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:36.932988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:36.944429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:36.955986 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1916093c-1e04-4437-8865-432e2aae9108 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 0.528415 Dec 18 21:08:36.956950 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2658/5337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:36 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:36.972000 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03c0166f-6bf0-4509-ab4b-0a4c6ada2c56 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1499 microversion: 2.1 time: 0.494435 Dec 18 21:08:36.976029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:36.976874 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2680/5338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:36 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1499 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:36.977284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:36.999479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:37.008686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:37.010581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:37.011055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:37.013427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:37.014103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:37.039328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:37.048787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:37.053045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:37.053797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:37.220670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:37.238361 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f91033dc-8e92-4436-a075-017bb2be692d tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1266 microversion: 2.1 time: 0.277285 Dec 18 21:08:37.240353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2659/5339] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:36 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:37.604486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:37.614753 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a59b5cec-4947-450d-9a6f-f1dacd172b24 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.635751 Dec 18 21:08:37.615548 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2681/5340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:36 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:37.972955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:37.973730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:37.982205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:37.991031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:37.991921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:37.992367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:38.257112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:38.257996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:38.268464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:38.268933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:38.272032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:38.272689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:38.415801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:38.429390 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-38d1e01f-f46a-4678-9eb6-607337e0259e tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1272 microversion: 2.1 time: 0.173048 Dec 18 21:08:38.430934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2682/5341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:38 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:38.490811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:38.503285 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b969487d-bed7-4879-b8cc-acf64e75485a tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1528 microversion: 2.1 time: 0.534846 Dec 18 21:08:38.513259 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2660/5342] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:37 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1528 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:38.632656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:38.633381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:38.644793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:38.645011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:38.645658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:38.646097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:39.341758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9cd39663-f099-44ad-a676-ac578660c705 req-f31ddd3d-3e75-48bf-8216-fe0ff06071ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28062e3e-9e82-4f4e-97ca-1af56a3f94ca", "name": "network-vif-deleted", "tag": "6419101c-f417-440a-9dc1-1ff20d886edd"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:39.343744 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:39.343744 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:39.361186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9cd39663-f099-44ad-a676-ac578660c705 req-f31ddd3d-3e75-48bf-8216-fe0ff06071ee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:39.361643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9cd39663-f099-44ad-a676-ac578660c705 req-f31ddd3d-3e75-48bf-8216-fe0ff06071ee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:39.406636 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9cd39663-f099-44ad-a676-ac578660c705 req-f31ddd3d-3e75-48bf-8216-fe0ff06071ee service nova] Creating event network-vif-deleted:6419101c-f417-440a-9dc1-1ff20d886edd for instance 28062e3e-9e82-4f4e-97ca-1af56a3f94ca on nch1-master-1 Dec 18 21:08:39.417371 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9cd39663-f099-44ad-a676-ac578660c705 req-f31ddd3d-3e75-48bf-8216-fe0ff06071ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080462 Dec 18 21:08:39.417996 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2661/5343] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:08:39.460136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:39.471631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:39.494584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:39.495055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:39.495889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:39.496406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:39.590722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:39.608867 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e18f704e-e2af-4d41-84b4-14116969c0ca tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.978682 Dec 18 21:08:39.626425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2683/5344] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:38 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:39.644448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:39.648479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:39.675678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:39.678031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:39.684503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:39.685205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:39.739197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:39.743227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:39.744142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lazy-loading 'fault' on Instance uuid 28062e3e-9e82-4f4e-97ca-1af56a3f94ca {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:08:39.826032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e8d9677fae4bebb8ec386e90349f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78970748663c43d7956bc64b493acfae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:39.841447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:39.842151 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbcb67fb-e4f7-41a6-94dc-af6f26553e98 tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 200 len: 1315 microversion: 2.1 time: 0.209190 Dec 18 21:08:39.845826 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2684/5345] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:39 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:39.869518 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e7aa1ed-5fd4-4b30-9c7e-4dacad321975 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1314 microversion: 2.1 time: 0.420899 Dec 18 21:08:39.870735 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2662/5346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:39 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:40.529236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ea52c947-c95d-4b6c-a6a3-aee3f1b63a24 req-e64edf4a-c48c-4584-847e-ca7440be71ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d942a42-4f82-4308-bd4c-2501b4e54663", "tag": "e3692064-60f7-457f-a6ec-747e276ca1b7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:40.534963 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:40.534963 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:08:40.558398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ea52c947-c95d-4b6c-a6a3-aee3f1b63a24 req-e64edf4a-c48c-4584-847e-ca7440be71ee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:40.559668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ea52c947-c95d-4b6c-a6a3-aee3f1b63a24 req-e64edf4a-c48c-4584-847e-ca7440be71ee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:40.583427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ea52c947-c95d-4b6c-a6a3-aee3f1b63a24 req-e64edf4a-c48c-4584-847e-ca7440be71ee service nova] Creating event network-changed:e3692064-60f7-457f-a6ec-747e276ca1b7 for instance 7d942a42-4f82-4308-bd4c-2501b4e54663 on nch1-master-1 Dec 18 21:08:40.591764 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ea52c947-c95d-4b6c-a6a3-aee3f1b63a24 req-e64edf4a-c48c-4584-847e-ca7440be71ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070607 Dec 18 21:08:40.593046 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2685/5347] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:40.630709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:40.631406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:40.642152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:40.644078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:40.645915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:40.647291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:40.835230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:40.843135 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7295ae4-cec7-4e19-a083-c270b71fe090 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.218277 Dec 18 21:08:40.843997 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2663/5348] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:40 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:40.862556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:40.863385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] [instance: 28062e3e-9e82-4f4e-97ca-1af56a3f94ca] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:40.869547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:40.870000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:40.870871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:40.871842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:40.888012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:40.888999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:40.895925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:40.896715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:40.896871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] HTTP exception thrown: Instance 28062e3e-9e82-4f4e-97ca-1af56a3f94ca could not be found. Dec 18 21:08:40.897692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] Returning 404 to user: Instance 28062e3e-9e82-4f4e-97ca-1af56a3f94ca could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:40.897896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:40.898773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:40.899765 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cc20c559-b5b5-4eef-a923-c47e18fbebda tempest-ServerAddressesNegativeTestJSON-1023505407 tempest-ServerAddressesNegativeTestJSON-1023505407-project] 10.222.0.13 "GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca" status: 404 len: 111 microversion: 2.1 time: 0.041240 Dec 18 21:08:40.903544 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2686/5349] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:40 2021] GET /compute/v2.1/servers/28062e3e-9e82-4f4e-97ca-1af56a3f94ca => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:41.188299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:41.206141 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d18a4f27-c223-45ec-a1ad-4281002048a5 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1314 microversion: 2.1 time: 0.322464 Dec 18 21:08:41.207878 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2664/5350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:40 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:41.233564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:41.234511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:41.241052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:41.241953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:41.243097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:41.243921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:41.274143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:08:41.365408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-019d7352-6013-49aa-b351-011542f9f911 req-47b212ad-517f-420b-aabc-ec904d2a3ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1be5bad-33b6-459e-93d1-c890f71c2fb7", "name": "network-vif-plugged", "status": "completed", "tag": "01029a1f-6c70-48b6-9ed9-4300a6739bea"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:41.369208 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:41.369208 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:41.395095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-019d7352-6013-49aa-b351-011542f9f911 req-47b212ad-517f-420b-aabc-ec904d2a3ac9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:41.395509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-019d7352-6013-49aa-b351-011542f9f911 req-47b212ad-517f-420b-aabc-ec904d2a3ac9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:41.417779 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-019d7352-6013-49aa-b351-011542f9f911 req-47b212ad-517f-420b-aabc-ec904d2a3ac9 service nova] Creating event network-vif-plugged:01029a1f-6c70-48b6-9ed9-4300a6739bea for instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 on nch1-master-1 Dec 18 21:08:41.428502 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-019d7352-6013-49aa-b351-011542f9f911 req-47b212ad-517f-420b-aabc-ec904d2a3ac9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066711 Dec 18 21:08:41.429488 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2665/5351] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:41.484467 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa2503be-9767-4791-a1fd-25fb3a7f34fe tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 204 len: 0 microversion: 2.1 time: 0.250710 Dec 18 21:08:41.488833 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2687/5352] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:41 2021] DELETE /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:08:41.497722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:41.498716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:41.505708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:41.507022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:41.511453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:41.513208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:41.862474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:41.863480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:41.872247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:41.873091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:41.874187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:41.874941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:42.040162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:42.055200 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25d44a37-5e2c-4f6d-ac5f-00bff596d6ec tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1505 microversion: 2.1 time: 0.562123 Dec 18 21:08:42.059620 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2666/5353] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:41 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:42.139478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:42.147506 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4604d246-e963-4696-9380-414fa6d07219 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.289853 Dec 18 21:08:42.148396 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2688/5354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:41 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:42.227271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:42.231852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:42.239675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:42.240639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:42.242284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:42.243075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:42.419110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:42.428438 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eec50acf-94fb-4b53-8edc-6b44549d135a tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1314 microversion: 2.1 time: 0.208081 Dec 18 21:08:42.436346 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2667/5355] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:42 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:43.076759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:43.078948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:43.104069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:43.107181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:43.108486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:43.109193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:43.168979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:43.170228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:43.194381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:43.195304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:43.196388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:43.197087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:43.475300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8150e994a4f42e3b014e5e51265213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48b8b9635104eafab5295b3b8709c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:43.494067 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fdb9e96c-048e-4fae-be78-a9897882d58e tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 200 len: 1505 microversion: 2.1 time: 0.424874 Dec 18 21:08:43.495228 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2689/5356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:43 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:43.501158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:43.502088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:43.511006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:43.512240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:43.513924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:43.514722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:43.612898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:43.666455 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aa7288c4-d05e-46ed-a05d-2d2fe790d1a5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1518 microversion: 2.1 time: 0.505291 Dec 18 21:08:43.678358 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2668/5357] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:43 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1518 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:43.806651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-de02ba17-2d10-4d19-8b24-18df3199b7aa req-2b211e4f-154a-422d-9d1b-842d96452b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8668088b-ae76-48a8-bd85-f81eb04d72cc", "name": "network-vif-deleted", "tag": "3097be62-2436-4586-8304-3ef9c014939e"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:43.819055 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:43.819055 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:43.837707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-de02ba17-2d10-4d19-8b24-18df3199b7aa req-2b211e4f-154a-422d-9d1b-842d96452b67 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:43.839627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-de02ba17-2d10-4d19-8b24-18df3199b7aa req-2b211e4f-154a-422d-9d1b-842d96452b67 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:43.863773 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-de02ba17-2d10-4d19-8b24-18df3199b7aa req-2b211e4f-154a-422d-9d1b-842d96452b67 service nova] Creating event network-vif-deleted:3097be62-2436-4586-8304-3ef9c014939e for instance 8668088b-ae76-48a8-bd85-f81eb04d72cc on nch2-master-1 Dec 18 21:08:43.890304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:43.904649 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82cef8d9-3aea-427c-b150-f260d2aebf95 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1314 microversion: 2.1 time: 0.405186 Dec 18 21:08:43.904817 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-de02ba17-2d10-4d19-8b24-18df3199b7aa req-2b211e4f-154a-422d-9d1b-842d96452b67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100815 Dec 18 21:08:43.907666 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2669/5358] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:08:43.916297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2690/5359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:43 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:43.921862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-218098947", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "719d1db8-90bc-4a29-9e67-d552b1d87f10"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:44.088435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] validate_networks() for [('719d1db8-90bc-4a29-9e67-d552b1d87f10', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:08:44.513340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:44.514718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] [instance: 8668088b-ae76-48a8-bd85-f81eb04d72cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:44.525158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:44.525946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:44.527200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:44.528625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:44.545770 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] HTTP exception thrown: Instance 8668088b-ae76-48a8-bd85-f81eb04d72cc could not be found. Dec 18 21:08:44.546721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] Returning 404 to user: Instance 8668088b-ae76-48a8-bd85-f81eb04d72cc could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:44.547964 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45709308-7ee7-472f-8993-daf3f90c7d42 tempest-VolumesActionsTest-489501281 tempest-VolumesActionsTest-489501281-project] 10.222.0.13 "GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc" status: 404 len: 111 microversion: 2.1 time: 0.040058 Dec 18 21:08:44.549034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2691/5360] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:44 2021] GET /compute/v2.1/servers/8668088b-ae76-48a8-bd85-f81eb04d72cc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:44.664546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:08:44.665115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:08:44.665609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:08:44.666018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:08:44.666732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:08:44.677910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:44.678870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:44.679699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:44.680148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:44.690112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:44.691063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:44.700505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:08:44.702910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:44.705567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:44.706755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:44.707200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:08:44.709222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:44.745692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:08:44.751153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ef155ebf-aa5a-4723-a2b7-d2f74c10ca2c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:08:44.860932 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34ea38e4-931f-4a45-b87e-83f95b740465 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950006 Dec 18 21:08:44.861897 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2670/5361] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:08:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:08:44.875037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6384e5df-cc5a-40b0-af01-0c2484a069cb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:44.876413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6384e5df-cc5a-40b0-af01-0c2484a069cb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:45.063423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6384e5df-cc5a-40b0-af01-0c2484a069cb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:45.080048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6384e5df-cc5a-40b0-af01-0c2484a069cb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1056 microversion: 2.1 time: 0.209907 Dec 18 21:08:45.082415 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2671/5362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:44 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1056 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:45.101060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:45.106842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:45.108948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:45.116641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.117910 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71430c0b-81cf-49a5-b79f-172df5f6246b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.432086 Dec 18 21:08:45.118725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.119582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.120000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.122955 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2692/5363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:44 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:45.147329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:45.150154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:45.156947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.158163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.159198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.166092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.431091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:45.433997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:45.439678 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b0704300-ad50-471b-80f3-6e5ab89ec0c6 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1314 microversion: 2.1 time: 0.355159 Dec 18 21:08:45.440435 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2672/5364] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:45 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:45.454124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-964ebd29-d1be-4df1-b040-073e48adba06 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.318322 Dec 18 21:08:45.464192 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2693/5365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:45 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:45.496145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:45.496768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:45.504517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.505424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.506504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.507133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.623006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1880178688", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "afdfbfa6-06d3-4512-85d9-5baa178f2b1d"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:45.671373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:45.679057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22a3c8bc-7dec-488e-8d29-087750c93ca0 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.187162 Dec 18 21:08:45.679625 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2694/5366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:45 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:45.690410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] validate_networks() for [('afdfbfa6-06d3-4512-85d9-5baa178f2b1d', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:08:45.696877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f748ed1-6833-4b7a-be40-70af716828d4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:45.702903 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-7f748ed1-6833-4b7a-be40-70af716828d4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 7e3ea517-78c2-4831-976e-a00d73de35c5 has no mapping to a cell. Dec 18 21:08:45.703491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f748ed1-6833-4b7a-be40-70af716828d4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 7e3ea517-78c2-4831-976e-a00d73de35c5 has no mapping to a cell. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:45.704345 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f748ed1-6833-4b7a-be40-70af716828d4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/7e3ea517-78c2-4831-976e-a00d73de35c5/action" status: 404 len: 117 microversion: 2.1 time: 0.011386 Dec 18 21:08:45.704909 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2695/5367] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:45 2021] POST /compute/v2.1/servers/7e3ea517-78c2-4831-976e-a00d73de35c5/action => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:08:45.712763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:45.714182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:45.722159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.722645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.723448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.723895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.930201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:45.940508 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ed88e6c-51f1-4226-b756-63649a49bc28 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.231416 Dec 18 21:08:45.941102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2696/5368] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:45 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:45.957528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:45.958168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:45.964140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.964597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:45.965484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:45.965935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.228367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:08:46.229051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:08:46.229840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:08:46.231205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:08:46.231698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:46.233289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:08:46.240818 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d8559994-047a-4299-8bbb-d0f6d652c72f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.286911 Dec 18 21:08:46.241748 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2697/5369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:45 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:46.247423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.247941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.248973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.249608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.260726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:46.261356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:46.273131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.273592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.274744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Getting quotas for project 88b33c528aa7484e8069e68727cd6e27. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:08:46.275172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.275628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.285038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Getting quotas for user 4de10fac4f814ac9a78d8f18ff231b7c and project 88b33c528aa7484e8069e68727cd6e27. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:08:46.301597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:08:46.304929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:08:46.379547 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e80e8d37-2ce9-456e-bf6a-e6c64e116e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937257 Dec 18 21:08:46.380024 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2673/5370] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:08:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:08:46.390795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a11869d5-2b24-4225-a3ae-ce440df1f1f8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:46.391860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a11869d5-2b24-4225-a3ae-ce440df1f1f8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: e34de9c6-1608-4266-80a9-911bc1956f08] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:46.397884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:46.421914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2f82ddb3-f30e-485e-a846-836b21d4f543 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1126 microversion: 2.1 time: 0.178697 Dec 18 21:08:46.423032 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2698/5371] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:46 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1126 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:46.428276 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-a11869d5-2b24-4225-a3ae-ce440df1f1f8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance e34de9c6-1608-4266-80a9-911bc1956f08 could not be found. Dec 18 21:08:46.428962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a11869d5-2b24-4225-a3ae-ce440df1f1f8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance e34de9c6-1608-4266-80a9-911bc1956f08 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:46.429434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82bbc95f-3248-488f-833b-68427ac76be0 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:46.429804 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a11869d5-2b24-4225-a3ae-ce440df1f1f8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/e34de9c6-1608-4266-80a9-911bc1956f08/action" status: 404 len: 111 microversion: 2.1 time: 0.049184 Dec 18 21:08:46.430386 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2674/5372] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:46 2021] POST /compute/v2.1/servers/e34de9c6-1608-4266-80a9-911bc1956f08/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:46.433502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82bbc95f-3248-488f-833b-68427ac76be0 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:46.448007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:46.448935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:46.471670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.472346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.475252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.478325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.515837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82bbc95f-3248-488f-833b-68427ac76be0 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:46.527259 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82bbc95f-3248-488f-833b-68427ac76be0 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1224 microversion: 2.1 time: 0.102442 Dec 18 21:08:46.529754 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2699/5373] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:46 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:46.542310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:46.551039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:46.574551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.575162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.575963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.576403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.886293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:46.903316 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4644f3c1-5653-42c3-b972-c2b2ab0d095c tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.459486 Dec 18 21:08:46.904884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2675/5374] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:46 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:46.926938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:46.928514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:46.938650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:46.939658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.940947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.941968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:46.945249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:46.961363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6293be41-5b94-42a0-8ecd-fe87bda8be19 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1314 microversion: 2.1 time: 0.426833 Dec 18 21:08:46.966622 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2700/5375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:46 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:47.230061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:47.235608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f57aa92a-d743-4f7a-9576-1ff61d35b311 req-87c13b86-d174-407f-9065-ed2a1a7d5384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d942a42-4f82-4308-bd4c-2501b4e54663", "name": "network-vif-plugged", "status": "completed", "tag": "e3692064-60f7-457f-a6ec-747e276ca1b7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:47.237313 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:47.237313 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:08:47.240616 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a37fc27b-e620-46b4-af61-49d96d595f56 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.317815 Dec 18 21:08:47.243462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2676/5376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:46 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:47.249099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f57aa92a-d743-4f7a-9576-1ff61d35b311 req-87c13b86-d174-407f-9065-ed2a1a7d5384 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.250396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f57aa92a-d743-4f7a-9576-1ff61d35b311 req-87c13b86-d174-407f-9065-ed2a1a7d5384 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.259072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:47.259851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:47.271984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.272678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.273475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.274052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.282372 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f57aa92a-d743-4f7a-9576-1ff61d35b311 req-87c13b86-d174-407f-9065-ed2a1a7d5384 service nova] Creating event network-vif-plugged:e3692064-60f7-457f-a6ec-747e276ca1b7 for instance 7d942a42-4f82-4308-bd4c-2501b4e54663 on nch1-master-1 Dec 18 21:08:47.290543 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f57aa92a-d743-4f7a-9576-1ff61d35b311 req-87c13b86-d174-407f-9065-ed2a1a7d5384 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058357 Dec 18 21:08:47.291446 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2701/5377] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:08:47.321522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lazy-loading 'flavor' on Instance uuid b1be5bad-33b6-459e-93d1-c890f71c2fb7 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:08:47.442922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:47.443857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:47.457443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.458140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.460858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.462040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.489027 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1bdd8de4-0537-4c12-9c8b-4866da770ff6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.230168 Dec 18 21:08:47.490235 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2677/5378] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:47 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:08:47.500341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:47.501058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:47.519609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.520077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.520897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.524951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.909736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:47.918311 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa2e4a21-4f2f-4cc4-a56c-267541e5d71b tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1513 microversion: 2.1 time: 0.422815 Dec 18 21:08:47.919440 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2678/5379] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:47 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:47.932887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:47.938905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:47.943649 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4ce742a-89d7-4106-bed6-a183d471371d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1168 microversion: 2.1 time: 0.505849 Dec 18 21:08:47.944834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:47.945597 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2702/5380] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:47 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1168 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:47.975992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.984886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:47.985993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:47.986535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:47.987341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:47.989805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:48.005455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:48.006325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:48.016051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:48.016870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:48.221294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:48.237530 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-603272d4-d318-4d19-bb9e-fc805e3c514d tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1276 microversion: 2.1 time: 0.316781 Dec 18 21:08:48.238934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2679/5381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:47 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:48.779613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:48.809471 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-581bb5fa-36e6-4f2d-b235-1df7677a61e3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1314 microversion: 2.1 time: 0.823900 Dec 18 21:08:48.811670 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2703/5382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:47 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:48.935668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:48.937252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:48.945654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:48.946313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:48.947338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:48.947914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:48.968262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:48.971767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:48.979645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:48.980345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:48.981400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:48.982014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.401962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:49.408382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:49.411092 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c28689a5-9650-45f1-a1bc-98c23f1ca6f4 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1496 microversion: 2.1 time: 0.479080 Dec 18 21:08:49.411899 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2680/5383] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:48 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1496 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:49.417205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:49.418476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:49.427631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.428188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.429255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.429857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.441118 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75ac75cf-efc2-44de-9507-cbda4ad45b61 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1168 microversion: 2.1 time: 0.482001 Dec 18 21:08:49.442307 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2704/5384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:48 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1168 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:49.450051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:49.450633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:49.460224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.460689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.461710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.462220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.493281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lazy-loading 'flavor' on Instance uuid b1be5bad-33b6-459e-93d1-c890f71c2fb7 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:08:49.509739 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Cannot 'suspend' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state suspended Dec 18 21:08:49.510378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 409 to user: Cannot 'suspend' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state suspended {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:49.511233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5abdd039-ccfd-43be-abc7-4a1e480fbe31 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 409 len: 148 microversion: 2.1 time: 0.067080 Dec 18 21:08:49.511893 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2705/5385] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:49 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 148 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:08:49.519924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca2706c5-aa63-48c7-8e28-7d2292e9b185 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:49.520573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca2706c5-aa63-48c7-8e28-7d2292e9b185 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:49.528126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca2706c5-aa63-48c7-8e28-7d2292e9b185 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.528602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca2706c5-aa63-48c7-8e28-7d2292e9b185 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.529594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca2706c5-aa63-48c7-8e28-7d2292e9b185 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.530233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca2706c5-aa63-48c7-8e28-7d2292e9b185 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.537954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:49.554922 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9cc8ecbd-b0de-4be8-8653-63617c791e90 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1282 microversion: 2.1 time: 0.141312 Dec 18 21:08:49.559634 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2681/5386] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:49 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:49.608139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca2706c5-aa63-48c7-8e28-7d2292e9b185 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 202 len: 0 microversion: 2.1 time: 0.091555 Dec 18 21:08:49.609347 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2706/5387] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:49 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:08:49.618072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:49.619253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:49.627107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.627884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.628879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.629831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.655051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ae55b2c0-7138-4f97-9664-8e908da3ac7c req-d4c29ace-221b-4b45-ad5a-a3ffa184fd88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7daee463-3272-487e-8135-f684d393deed", "tag": "597bdadb-cb27-4590-9bf4-888c4f82aae3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:49.659141 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:49.659141 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:08:49.677937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ae55b2c0-7138-4f97-9664-8e908da3ac7c req-d4c29ace-221b-4b45-ad5a-a3ffa184fd88 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.678707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ae55b2c0-7138-4f97-9664-8e908da3ac7c req-d4c29ace-221b-4b45-ad5a-a3ffa184fd88 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.708222 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ae55b2c0-7138-4f97-9664-8e908da3ac7c req-d4c29ace-221b-4b45-ad5a-a3ffa184fd88 service nova] Creating event network-changed:597bdadb-cb27-4590-9bf4-888c4f82aae3 for instance 7daee463-3272-487e-8135-f684d393deed on nch2-master-1 Dec 18 21:08:49.725596 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ae55b2c0-7138-4f97-9664-8e908da3ac7c req-d4c29ace-221b-4b45-ad5a-a3ffa184fd88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074580 Dec 18 21:08:49.726822 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2707/5388] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:49.829509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:49.830535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:49.837251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.838123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:49.839231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:49.840427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.068038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:50.076629 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-537ad241-e733-44ab-96b6-0c14e3b0218f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1502 microversion: 2.1 time: 0.462860 Dec 18 21:08:50.078046 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2682/5389] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:49 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1502 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:50.280916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:50.295484 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c0b34165-2bb9-4316-8561-978fe5224cb3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1464 microversion: 2.1 time: 0.469653 Dec 18 21:08:50.298436 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2708/5390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:49 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1464 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:50.458275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:50.460547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:50.461296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:50.461892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:50.481145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.482489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.483116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.484050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.484594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.485124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.487832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.488529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.532669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:08:50.644012 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-acde50ba-ccc0-4a4d-ad0a-6ca805e71b47 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 204 len: 0 microversion: 2.1 time: 0.194140 Dec 18 21:08:50.644635 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2683/5391] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:50 2021] DELETE /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:08:50.655495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:50.656207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:50.665849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.666576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.668349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.669719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.891566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:50.899144 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-789f07dc-7b28-4610-903d-f73487aa6a59 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1168 microversion: 2.1 time: 0.444604 Dec 18 21:08:50.900314 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2709/5392] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:50 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1168 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:50.905511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:50.906308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:50.913777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.914676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:50.915666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:50.916110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.051689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:51.063150 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22d2e8f5-276f-4025-b2c0-0ed824332929 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.412086 Dec 18 21:08:51.066016 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2684/5393] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:50 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:51.094775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:51.100049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:51.106219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:51.106989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.107849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:51.108354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.354961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:51.362797 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e23a0ad4-d118-4c44-b6c6-083bdbf479d3 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1470 microversion: 2.1 time: 0.461275 Dec 18 21:08:51.363378 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2710/5394] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:50 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:51.483487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:51.490753 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9215b53-9c68-4140-81b0-0a2db08519e6 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.399717 Dec 18 21:08:51.491328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2685/5395] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:51 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:51.508584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:51.509542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:51.516773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:51.517302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.518168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:51.518817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.796342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-44083f11-dffe-4323-a638-b8208670fd2e req-1a804472-d827-466d-ab73-b2c01640d677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db18654e-90f1-4c94-bf14-03fcc3a678b7", "tag": "a81daf49-71eb-4800-830e-d8fc7dbbfaae"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:51.798671 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:51.798671 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:51.807863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-44083f11-dffe-4323-a638-b8208670fd2e req-1a804472-d827-466d-ab73-b2c01640d677 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:51.809780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-44083f11-dffe-4323-a638-b8208670fd2e req-1a804472-d827-466d-ab73-b2c01640d677 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.825195 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-44083f11-dffe-4323-a638-b8208670fd2e req-1a804472-d827-466d-ab73-b2c01640d677 service nova] Creating event network-changed:a81daf49-71eb-4800-830e-d8fc7dbbfaae for instance db18654e-90f1-4c94-bf14-03fcc3a678b7 on nch1-master-1 Dec 18 21:08:51.831134 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-44083f11-dffe-4323-a638-b8208670fd2e req-1a804472-d827-466d-ab73-b2c01640d677 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038477 Dec 18 21:08:51.831840 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2686/5396] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:08:51.919046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:51.919897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:51.926923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:51.927601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.928706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:51.929233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:51.941420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:51.970502 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf04e995-3d2a-431b-816c-1c570a773eb5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.464937 Dec 18 21:08:51.971240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2711/5397] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:51 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:51.988889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d92c03fb-ff5f-4d02-8ec6-8e91beebe929 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:51.990203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d92c03fb-ff5f-4d02-8ec6-8e91beebe929 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 2cff585e-fd88-4dfc-b179-9bd2511dd519] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:52.003283 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d92c03fb-ff5f-4d02-8ec6-8e91beebe929 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 2cff585e-fd88-4dfc-b179-9bd2511dd519 could not be found. Dec 18 21:08:52.004591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d92c03fb-ff5f-4d02-8ec6-8e91beebe929 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 2cff585e-fd88-4dfc-b179-9bd2511dd519 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:52.005608 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d92c03fb-ff5f-4d02-8ec6-8e91beebe929 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/2cff585e-fd88-4dfc-b179-9bd2511dd519/action" status: 404 len: 111 microversion: 2.1 time: 0.021391 Dec 18 21:08:52.006742 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2712/5398] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:51 2021] POST /compute/v2.1/servers/2cff585e-fd88-4dfc-b179-9bd2511dd519/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:52.014346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:52.015224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:52.023056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.023589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.024930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.025564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.565215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:52.577703 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaa36f43-032c-48b0-99ca-34e8283bb6e1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1202 microversion: 2.1 time: 0.663407 Dec 18 21:08:52.577703 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2687/5399] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:51 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1202 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:52.582760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:52.583589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:52.593402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.594200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.596496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.596496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.649672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:52.667190 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-36bf03c1-3a48-44c7-81a5-7dd573aedc79 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.656471 Dec 18 21:08:52.668452 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2713/5400] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:52 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:52.674290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:52.678478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:52.688307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.689527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.692700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.693258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.838500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669c1de603a448a91c3b979a632468b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df650339f864e028604b27467d14de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:52.846688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fb60d91-2389-4f60-9aa6-c34d8bc27606 tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 200 len: 1428 microversion: 2.1 time: 0.176844 Dec 18 21:08:52.856700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2714/5401] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:52 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 1428 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:52.856700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:52.856700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:52.859457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.859921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.860733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.861182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.881349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:52.893178 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe58786b-53a4-4d98-887e-8b218cf0cbf1 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.313954 Dec 18 21:08:52.897110 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2688/5402] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:52 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:52.910867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-0eef42d3-6dfe-43f0-9fa0-9c377c088699 req-808d4071-89d2-41cb-bd80-f519984fb6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d942a42-4f82-4308-bd4c-2501b4e54663", "name": "network-vif-deleted", "tag": "e3692064-60f7-457f-a6ec-747e276ca1b7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:52.912748 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:52.912748 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:52.920582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0eef42d3-6dfe-43f0-9fa0-9c377c088699 req-808d4071-89d2-41cb-bd80-f519984fb6c0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:52.921837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0eef42d3-6dfe-43f0-9fa0-9c377c088699 req-808d4071-89d2-41cb-bd80-f519984fb6c0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:52.933477 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-0eef42d3-6dfe-43f0-9fa0-9c377c088699 req-808d4071-89d2-41cb-bd80-f519984fb6c0 service nova] Creating event network-vif-deleted:e3692064-60f7-457f-a6ec-747e276ca1b7 for instance 7d942a42-4f82-4308-bd4c-2501b4e54663 on nch1-master-1 Dec 18 21:08:52.938796 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-0eef42d3-6dfe-43f0-9fa0-9c377c088699 req-808d4071-89d2-41cb-bd80-f519984fb6c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040198 Dec 18 21:08:52.939988 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2689/5403] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:08:53.106820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:53.111680 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a0feedd-b88a-4b94-b9f2-60f97c24c549 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.262967 Dec 18 21:08:53.112303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2715/5404] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:52 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:53.129970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:53.130679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.142889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.143637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.144864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.145538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.185489 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Cannot 'unpause' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active Dec 18 21:08:53.186088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 409 to user: Cannot 'unpause' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:53.187141 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b7ec2c8-dda8-4a60-b691-1a1f9a0734a2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 409 len: 145 microversion: 2.1 time: 0.061565 Dec 18 21:08:53.187717 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2690/5405] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:53 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 21:08:53.196313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:53.196936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.204919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.205621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.208900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.209880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.486427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:53.494596 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e58ab5e3-ed8f-481c-87f3-db18e4bdea51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.302232 Dec 18 21:08:53.495270 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2716/5406] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:53 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:53.511139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:53.512348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.519211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.519662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.520444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.520885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.593168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:53.593777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.601098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.601628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.602450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.602889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.735546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:53.743347 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-335cec7e-bb5d-407d-95b9-663255188839 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.235832 Dec 18 21:08:53.743994 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2691/5407] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:53 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:53.759550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bcf07c3b-2018-4d10-84b3-29323a15f9b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:53.760121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bcf07c3b-2018-4d10-84b3-29323a15f9b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: d51ee52d-1d55-44f6-80da-3f06ba28959a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.766299 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-bcf07c3b-2018-4d10-84b3-29323a15f9b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance d51ee52d-1d55-44f6-80da-3f06ba28959a could not be found. Dec 18 21:08:53.766921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bcf07c3b-2018-4d10-84b3-29323a15f9b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance d51ee52d-1d55-44f6-80da-3f06ba28959a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:53.767775 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bcf07c3b-2018-4d10-84b3-29323a15f9b5 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/d51ee52d-1d55-44f6-80da-3f06ba28959a/action" status: 404 len: 111 microversion: 2.1 time: 0.011966 Dec 18 21:08:53.768331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2692/5408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:53 2021] POST /compute/v2.1/servers/d51ee52d-1d55-44f6-80da-3f06ba28959a/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:53.776337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:53.776951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.783376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.783837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.784690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.785141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.797199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:53.804692 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48be59fd-b02d-4664-842c-64ffb9fb380e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1202 microversion: 2.1 time: 0.215302 Dec 18 21:08:53.805350 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2717/5409] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:53 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1202 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:53.864463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:53.865065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] [instance: 7d942a42-4f82-4308-bd4c-2501b4e54663] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.871519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.872045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.872901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.873404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.887275 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] HTTP exception thrown: Instance 7d942a42-4f82-4308-bd4c-2501b4e54663 could not be found. Dec 18 21:08:53.887865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] Returning 404 to user: Instance 7d942a42-4f82-4308-bd4c-2501b4e54663 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:53.888698 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4d6778b-9cba-4b58-894a-9a506033b9ec tempest-VolumesNegativeTest-1566869411 tempest-VolumesNegativeTest-1566869411-project] 10.222.0.13 "GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663" status: 404 len: 111 microversion: 2.1 time: 0.028156 Dec 18 21:08:53.889252 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2718/5410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:53 2021] GET /compute/v2.1/servers/7d942a42-4f82-4308-bd4c-2501b4e54663 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:08:53.912743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:53.913508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.920993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.921433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:53.921568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.922447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.923318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.928907 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7693964a-8f0c-4ba5-962b-2dea25babf76 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.156449 Dec 18 21:08:53.929540 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2693/5411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:53 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:53.951859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:53.952481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:53.958472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.958932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:53.959903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:53.960356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.124347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:54.132949 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d1a13b6-e276-44d5-8b1f-7bbdc2d07545 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.223925 Dec 18 21:08:54.134357 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2719/5412] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:53 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:54.145636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:54.153693 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa259ff4-0bfd-4f90-a93e-3909100a7b77 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.205624 Dec 18 21:08:54.154305 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2694/5413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:53 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:54.169709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:54.170317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:54.177589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.178219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.179084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.180612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.206217 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Cannot 'unshelve' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active Dec 18 21:08:54.206975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 409 to user: Cannot 'unshelve' instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 while it is in vm_state active {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:54.207848 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30537c3c-82b1-4510-b92f-104de0404eec tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action" status: 409 len: 146 microversion: 2.1 time: 0.042104 Dec 18 21:08:54.208475 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2720/5414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:08:54 2021] POST /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7/action => generated 146 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 18 21:08:54.222288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:54.223060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:54.230914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.231553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.232435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.232956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.381701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:54.393973 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2260f5b-cdf9-41bd-b01e-231a44c2290d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.173367 Dec 18 21:08:54.404301 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2695/5415] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:54.409590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:54.410586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:54.419529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.419992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.421137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.421745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.592985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:54.602092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f5fddbc-6350-4ab5-bfc1-094423481e7d tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.196743 Dec 18 21:08:54.602826 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2721/5416] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:54.618849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc67dd9b-e991-4a8c-82dd-3d80772630f2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1476524927_updated"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:54.619985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc67dd9b-e991-4a8c-82dd-3d80772630f2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 1c0174ed-c327-4ba9-88d1-a7d8920b9f68] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:54.627934 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-cc67dd9b-e991-4a8c-82dd-3d80772630f2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 1c0174ed-c327-4ba9-88d1-a7d8920b9f68 could not be found. Dec 18 21:08:54.628568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc67dd9b-e991-4a8c-82dd-3d80772630f2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 1c0174ed-c327-4ba9-88d1-a7d8920b9f68 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:54.629588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc67dd9b-e991-4a8c-82dd-3d80772630f2 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "PUT /compute/v2.1/servers/1c0174ed-c327-4ba9-88d1-a7d8920b9f68" status: 404 len: 111 microversion: 2.1 time: 0.014561 Dec 18 21:08:54.630511 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2696/5417] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:08:54 2021] PUT /compute/v2.1/servers/1c0174ed-c327-4ba9-88d1-a7d8920b9f68 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:08:54.639704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:54.640596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:54.647669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.648130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.649022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.649519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.815533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:54.822203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:54.823303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:54.834316 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58bb66f3-96d3-42c2-be08-b4339b9d8e3f tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.199066 Dec 18 21:08:54.834912 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2722/5418] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:54.836974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.837434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.838278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.838720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.850819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:54.851438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:54.858053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.858544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:54.859362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:54.859797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.084024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:55.088506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:55.093871 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fec28513-d9e0-40e1-9b2d-be05ee63d413 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1202 microversion: 2.1 time: 0.275192 Dec 18 21:08:55.097943 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28ae1548-8cb0-487b-afa9-f542321eccf8 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.250634 Dec 18 21:08:55.098897 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2723/5419] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:54 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:55.103709 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2697/5420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:54 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1202 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:55.119480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a6737a67-e554-4ce6-af45-3fb50da90161 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:55.120783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a6737a67-e554-4ce6-af45-3fb50da90161 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:55.121593 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a6737a67-e554-4ce6-af45-3fb50da90161 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "PUT /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 400 len: 619 microversion: 2.1 time: 0.006040 Dec 18 21:08:55.122406 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2724/5421] 10.222.0.13 () {60 vars in 1256 bytes} [Sat Dec 18 21:08:55 2021] PUT /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:08:55.130939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:55.131835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:55.138128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.138848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.139646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.140087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.150119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:55.151247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:55.161873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.162171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.163163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.163760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.356420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:55.367651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:55.367870 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95bdaa6c-f27d-41aa-af6a-60613b1e6c51 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.241196 Dec 18 21:08:55.368632 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2698/5422] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:55 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:55.375311 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98580e78-dec6-42cf-bac2-b4950d7ba80e tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.229033 Dec 18 21:08:55.375879 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2725/5423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:55 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:08:55.384981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:55.385726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:55.392008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.392529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.393568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.394086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.538324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:55.547761 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-691d563f-924a-4eec-b24c-b0ea1e46d503 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.166299 Dec 18 21:08:55.559840 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2699/5424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:55 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:55.565589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-77909345-3ba8-4d7b-991b-2a2edcb77359 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:55.567731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-77909345-3ba8-4d7b-991b-2a2edcb77359 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:55.568756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-77909345-3ba8-4d7b-991b-2a2edcb77359 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "PUT /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 400 len: 108 microversion: 2.1 time: 0.007246 Dec 18 21:08:55.569526 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2726/5425] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:08:55 2021] PUT /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:08:55.578742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:55.579526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:55.585873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.587311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.591258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:55.591854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:55.755368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:55.764646 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4536025-f80c-4de7-9f8f-13e1773d5a34 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1505 microversion: 2.1 time: 0.190660 Dec 18 21:08:55.765390 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2700/5426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:55 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:56.112068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:56.112708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:56.123857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:56.124550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:56.125273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:56.125771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:56.289947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:56.299047 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fa5ff63-c57b-41ee-9645-2c674a42edf9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1202 microversion: 2.1 time: 0.192353 Dec 18 21:08:56.299622 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2727/5427] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:56 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:56.393937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:56.394594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:56.400473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:56.401136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:56.401721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:56.402664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:56.543178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:56.552016 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b47fc975-4acb-44e9-95c2-4b2f8101234f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.161659 Dec 18 21:08:56.552711 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2701/5428] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:56 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:57.321237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:57.322574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:57.330566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:57.331235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:57.332257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:57.332909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:57.539734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:57.553623 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64965c30-286a-4399-be21-f3b66647c44a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1202 microversion: 2.1 time: 0.237625 Dec 18 21:08:57.556229 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2728/5429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:57 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1202 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:57.573781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:57.574430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:57.587022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:57.589191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:57.591985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:57.592878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:57.637140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-334f88bb-d1d4-4298-9342-474f80f2d201 req-b529bd8d-e75d-4caf-bcbb-4b515d99a3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7daee463-3272-487e-8135-f684d393deed", "name": "network-vif-plugged", "status": "completed", "tag": "597bdadb-cb27-4590-9bf4-888c4f82aae3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:57.640437 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:57.640437 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:08:57.649438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-334f88bb-d1d4-4298-9342-474f80f2d201 req-b529bd8d-e75d-4caf-bcbb-4b515d99a3ba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:57.650354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-334f88bb-d1d4-4298-9342-474f80f2d201 req-b529bd8d-e75d-4caf-bcbb-4b515d99a3ba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:57.664323 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-334f88bb-d1d4-4298-9342-474f80f2d201 req-b529bd8d-e75d-4caf-bcbb-4b515d99a3ba service nova] Creating event network-vif-plugged:597bdadb-cb27-4590-9bf4-888c4f82aae3 for instance 7daee463-3272-487e-8135-f684d393deed on nch2-master-1 Dec 18 21:08:57.670150 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-334f88bb-d1d4-4298-9342-474f80f2d201 req-b529bd8d-e75d-4caf-bcbb-4b515d99a3ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036867 Dec 18 21:08:57.671215 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2729/5430] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:08:57.826601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:57.836728 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c66b42c6-e302-448f-84df-23e086060429 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.267458 Dec 18 21:08:57.840943 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2702/5431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:57 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:58.117677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:58.118381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:58.130588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.131842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.132931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.133530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.154599 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. Dec 18 21:08:58.155454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:58.156300 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2bd72dcc-8e43-4a9a-aa50-8d7d2dd9133e tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 404 len: 111 microversion: 2.1 time: 0.042720 Dec 18 21:08:58.157028 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2730/5432] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:58 2021] DELETE /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:58.165601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:58.166213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: 7ec0ec05-7209-486c-8059-40980e829fbb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:58.175188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.175963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.176657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.177099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.193970 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. Dec 18 21:08:58.194987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance 7ec0ec05-7209-486c-8059-40980e829fbb could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:08:58.196609 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed75fefe-1748-41c8-8eb8-5ec01de47601 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb" status: 404 len: 111 microversion: 2.1 time: 0.035180 Dec 18 21:08:58.197358 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2703/5433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:58 2021] GET /compute/v2.1/servers/7ec0ec05-7209-486c-8059-40980e829fbb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:58.206144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:58.206681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:58.213229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.213774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.214870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.215469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.246717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:08:58.321610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc34768d-1016-4da3-bde0-8e225876fbf3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 204 len: 0 microversion: 2.1 time: 0.119004 Dec 18 21:08:58.322385 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2731/5434] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:08:58 2021] DELETE /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:08:58.332300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:58.332908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:58.338856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.339986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.340775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.341221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.487493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:58.495393 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce166f84-785c-4e85-ae47-20e0851bd2cc tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.167883 Dec 18 21:08:58.496477 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2704/5435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:58 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:58.576863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:58.577662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:58.584765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.585328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.586121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.586593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.742998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:58.752010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-970046f1-c45f-4228-af13-e0c8f60bc756 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1202 microversion: 2.1 time: 0.179085 Dec 18 21:08:58.752437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2732/5436] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:58 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:58.858084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:58.858759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:58.866215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.866823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:58.867625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:58.868076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:59.028905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:59.037588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b664f07-410e-47ca-a3ec-9fd39d9b2bc9 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.184985 Dec 18 21:08:59.038160 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2705/5437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:58 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:59.512273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:59.512767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:59.525647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:59.526192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:59.527852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:59.528758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:59.672830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:59.680904 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fae7489c-978e-4dde-a14d-2bd2b7b69cb3 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.172857 Dec 18 21:08:59.681496 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2733/5438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:59 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:08:59.696901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e5fb353e-e10e-4d36-98a9-771f1aedf4fe req-12601490-1724-49ec-97c9-a1145ebd5c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18654e-90f1-4c94-bf14-03fcc3a678b7", "name": "network-vif-plugged", "status": "completed", "tag": "a81daf49-71eb-4800-830e-d8fc7dbbfaae"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:08:59.699278 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:08:59.699278 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:08:59.706165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e5fb353e-e10e-4d36-98a9-771f1aedf4fe req-12601490-1724-49ec-97c9-a1145ebd5c77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:59.706666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e5fb353e-e10e-4d36-98a9-771f1aedf4fe req-12601490-1724-49ec-97c9-a1145ebd5c77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:59.723274 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e5fb353e-e10e-4d36-98a9-771f1aedf4fe req-12601490-1724-49ec-97c9-a1145ebd5c77 service nova] Creating event network-vif-plugged:a81daf49-71eb-4800-830e-d8fc7dbbfaae for instance db18654e-90f1-4c94-bf14-03fcc3a678b7 on nch1-master-1 Dec 18 21:08:59.729335 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e5fb353e-e10e-4d36-98a9-771f1aedf4fe req-12601490-1724-49ec-97c9-a1145ebd5c77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036009 Dec 18 21:08:59.730704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2706/5439] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:08:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:08:59.769403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:08:59.770147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:08:59.779234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:59.780172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:59.780988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:08:59.782665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:08:59.976932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:08:59.985054 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-055566ae-1c7c-49af-9ef1-ac3a47f788fe tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1389 microversion: 2.1 time: 0.219684 Dec 18 21:08:59.985645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2734/5440] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:59 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1389 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:00.002899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:00.003752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:00.009855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.010358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.011329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.011774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.055030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:00.055819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:00.062493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.063070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.064013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.064583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.192333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:00.200746 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b000ebe6-2a00-423b-8724-68068b80f374 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1389 microversion: 2.1 time: 0.202200 Dec 18 21:09:00.201363 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2707/5441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:08:59 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1389 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:00.216267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:00.216881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:00.222889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.223550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.224350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.224814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.239689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:00.247746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0057186c-b20b-4d67-8c90-83b265eaa91b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1324 microversion: 2.1 time: 0.196439 Dec 18 21:09:00.248604 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2735/5442] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:00 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:00.353983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:00.361984 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c167b16e-1a7c-4d39-b4bd-277e6d1ffbf2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1389 microversion: 2.1 time: 0.149310 Dec 18 21:09:00.362600 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2708/5443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:00 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:00.433192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:00.433701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:00.439707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.440253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.441049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.441496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.467058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:09:00.554211 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b44912b5-5d5d-4b31-afa8-a203538670b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 204 len: 0 microversion: 2.1 time: 0.123520 Dec 18 21:09:00.559264 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2736/5444] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:09:00 2021] DELETE /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:09:00.564519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:00.565120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:00.571267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.571730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.572527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.572961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.704014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:00.705240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:00.726228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.726742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.727864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:00.728375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:00.943392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:00.952606 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c668841b-8162-4f19-a4e9-97ea376ea1bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1395 microversion: 2.1 time: 0.391759 Dec 18 21:09:00.953298 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2709/5445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:00 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1395 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:01.052110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6278aefb6d5497aad3d74b47b2e95d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea26536b064a4650b9c08f4b5ce6fadf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:01.060854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb294867-cb2f-4c6e-9829-040b85e47dd7 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 200 len: 1511 microversion: 2.1 time: 0.363902 Dec 18 21:09:01.061745 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2737/5446] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:00 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:01.222246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a482b507-8660-469d-a508-af3c36865346 req-283626c4-ba8c-43d2-80de-e03e17c6dcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1be5bad-33b6-459e-93d1-c890f71c2fb7", "name": "network-vif-deleted", "tag": "01029a1f-6c70-48b6-9ed9-4300a6739bea"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:01.227881 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:01.227881 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:01.244393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a482b507-8660-469d-a508-af3c36865346 req-283626c4-ba8c-43d2-80de-e03e17c6dcfe service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:01.246039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a482b507-8660-469d-a508-af3c36865346 req-283626c4-ba8c-43d2-80de-e03e17c6dcfe service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:01.263008 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a482b507-8660-469d-a508-af3c36865346 req-283626c4-ba8c-43d2-80de-e03e17c6dcfe service nova] Creating event network-vif-deleted:01029a1f-6c70-48b6-9ed9-4300a6739bea for instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 on nch1-master-1 Dec 18 21:09:01.265574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:01.266677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:01.270621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a482b507-8660-469d-a508-af3c36865346 req-283626c4-ba8c-43d2-80de-e03e17c6dcfe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054350 Dec 18 21:09:01.271670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2710/5447] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:01.274111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:01.274237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:01.274983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:01.275428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:01.438895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:01.447164 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7223659b-6dfe-4b53-8a98-db6801512855 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1520 microversion: 2.1 time: 0.185796 Dec 18 21:09:01.447784 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2738/5448] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:01 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:01.558541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05b18010-88f4-469a-bc58-d8c7a64f5d22 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1301026938", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "afdfbfa6-06d3-4512-85d9-5baa178f2b1d"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:01.559962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05b18010-88f4-469a-bc58-d8c7a64f5d22 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:01.560760 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-05b18010-88f4-469a-bc58-d8c7a64f5d22 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.007296 Dec 18 21:09:01.561276 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2711/5449] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:01 2021] POST /compute/v2.1/servers => generated 175 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:09:01.571362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1fea651-34b2-4e44-ac9a-9fbe5a62a333 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:01.571910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1fea651-34b2-4e44-ac9a-9fbe5a62a333 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: 6aec4cd5-a72b-4a51-9b54-60618f2a055c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:01.577512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-a1fea651-34b2-4e44-ac9a-9fbe5a62a333 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] HTTP exception thrown: Instance 6aec4cd5-a72b-4a51-9b54-60618f2a055c could not be found. Dec 18 21:09:01.578220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1fea651-34b2-4e44-ac9a-9fbe5a62a333 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 404 to user: Instance 6aec4cd5-a72b-4a51-9b54-60618f2a055c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:01.579191 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1fea651-34b2-4e44-ac9a-9fbe5a62a333 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/6aec4cd5-a72b-4a51-9b54-60618f2a055c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.011790 Dec 18 21:09:01.579817 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2739/5450] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:09:01 2021] GET /compute/v2.1/servers/6aec4cd5-a72b-4a51-9b54-60618f2a055c/metadata => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:01.635737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-355a4b5a-3490-4302-8e00-62611c01f961 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-921238178", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "afdfbfa6-06d3-4512-85d9-5baa178f2b1d"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:01.637706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-355a4b5a-3490-4302-8e00-62611c01f961 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:01.638976 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-355a4b5a-3490-4302-8e00-62611c01f961 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.006555 Dec 18 21:09:01.640027 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2712/5451] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:01 2021] POST /compute/v2.1/servers => generated 687 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:09:01.686079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-999b428a-887f-40ea-9cb2-d0cdcce09971 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1056494018", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "afdfbfa6-06d3-4512-85d9-5baa178f2b1d"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:01.687678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-999b428a-887f-40ea-9cb2-d0cdcce09971 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:01.688461 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-999b428a-887f-40ea-9cb2-d0cdcce09971 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.006740 Dec 18 21:09:01.689144 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2740/5452] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:01 2021] POST /compute/v2.1/servers => generated 689 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:09:01.737045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-00817b32-c1f1-4950-921d-521396a63313 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-588091640", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "afdfbfa6-06d3-4512-85d9-5baa178f2b1d"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:01.738599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-00817b32-c1f1-4950-921d-521396a63313 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:01.739557 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-00817b32-c1f1-4950-921d-521396a63313 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.007367 Dec 18 21:09:01.740159 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2713/5453] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:01 2021] POST /compute/v2.1/servers => generated 1197 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Dec 18 21:09:01.837555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18f4448a-86aa-41cb-a5b2-fb60f98ca12b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1796973758", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "afdfbfa6-06d3-4512-85d9-5baa178f2b1d"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:01.839752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18f4448a-86aa-41cb-a5b2-fb60f98ca12b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:01.840966 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18f4448a-86aa-41cb-a5b2-fb60f98ca12b tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.008765 Dec 18 21:09:01.842440 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2741/5454] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Dec 18 21:09:01 2021] POST /compute/v2.1/servers => generated 2221 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Dec 18 21:09:01.857809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-714d9295-77a8-4c9c-989e-d8c58b846e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:01.858618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-714d9295-77a8-4c9c-989e-d8c58b846e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: 2f256615-8c16-4f0c-8c9d-c3d6c1861891] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:01.864462 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-714d9295-77a8-4c9c-989e-d8c58b846e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] HTTP exception thrown: Instance 2f256615-8c16-4f0c-8c9d-c3d6c1861891 could not be found. Dec 18 21:09:01.865054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-714d9295-77a8-4c9c-989e-d8c58b846e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 404 to user: Instance 2f256615-8c16-4f0c-8c9d-c3d6c1861891 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:01.865886 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-714d9295-77a8-4c9c-989e-d8c58b846e11 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/2f256615-8c16-4f0c-8c9d-c3d6c1861891/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.012705 Dec 18 21:09:01.866604 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2714/5455] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Dec 18 21:09:01 2021] GET /compute/v2.1/servers/2f256615-8c16-4f0c-8c9d-c3d6c1861891/metadata/test2 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:01.881788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:01.882538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:01.889397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:01.889855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:01.890917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:01.891361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:01.921431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:09:01.971421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:01.972188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:01.981018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:01.981580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:01.982607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:01.983124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:02.055046 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fcecf0b-cb9e-42e8-ad2b-bd19a28de38f tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 204 len: 0 microversion: 2.1 time: 0.178213 Dec 18 21:09:02.055996 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2742/5456] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:09:01 2021] DELETE /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:09:02.068406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:02.071864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:02.079515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:02.080213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:02.081288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:02.081945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:02.303495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:02.310949 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b32f601f-5262-43de-b18b-ddfcac4f70b0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1395 microversion: 2.1 time: 0.343908 Dec 18 21:09:02.311516 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2715/5457] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:01 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1395 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:02.325443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:02.326049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] [instance: b1be5bad-33b6-459e-93d1-c890f71c2fb7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:02.332348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:02.333041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:02.334013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:02.334668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:02.349432 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] HTTP exception thrown: Instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 could not be found. Dec 18 21:09:02.350042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] Returning 404 to user: Instance b1be5bad-33b6-459e-93d1-c890f71c2fb7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:02.350921 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9cdbd1c9-78ea-4d68-b631-cc549e186d63 tempest-ServersNegativeTestJSON-381782243 tempest-ServersNegativeTestJSON-381782243-project] 10.222.0.13 "GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7" status: 404 len: 111 microversion: 2.1 time: 0.029546 Dec 18 21:09:02.351478 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2716/5458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:02 2021] GET /compute/v2.1/servers/b1be5bad-33b6-459e-93d1-c890f71c2fb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:02.388478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:02.398851 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85a8c781-1cda-4736-aa5e-d1aca67d0b66 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1526 microversion: 2.1 time: 0.336471 Dec 18 21:09:02.399514 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2743/5459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:02 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1526 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:03.289551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d4b6bc3c-4a5b-46a0-8b5d-9df4e731acb0 req-4ac66d2c-046f-4033-9e7c-16ee06e5912d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7daee463-3272-487e-8135-f684d393deed", "name": "network-vif-deleted", "tag": "597bdadb-cb27-4590-9bf4-888c4f82aae3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:03.291607 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:03.291607 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:03.300878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d4b6bc3c-4a5b-46a0-8b5d-9df4e731acb0 req-4ac66d2c-046f-4033-9e7c-16ee06e5912d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:03.301549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d4b6bc3c-4a5b-46a0-8b5d-9df4e731acb0 req-4ac66d2c-046f-4033-9e7c-16ee06e5912d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:03.314241 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d4b6bc3c-4a5b-46a0-8b5d-9df4e731acb0 req-4ac66d2c-046f-4033-9e7c-16ee06e5912d service nova] Creating event network-vif-deleted:597bdadb-cb27-4590-9bf4-888c4f82aae3 for instance 7daee463-3272-487e-8135-f684d393deed on nch2-master-1 Dec 18 21:09:03.320935 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d4b6bc3c-4a5b-46a0-8b5d-9df4e731acb0 req-4ac66d2c-046f-4033-9e7c-16ee06e5912d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035621 Dec 18 21:09:03.324479 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2717/5460] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:03.328726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:03.329917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:03.341189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:03.341839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:03.342912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:03.343599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:03.387328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:03.387990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:03.388557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lazy-loading 'fault' on Instance uuid 7daee463-3272-487e-8135-f684d393deed {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:09:03.418336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:03.419515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:03.426973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:03.427463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:03.428484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:03.429194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:03.446512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:03.472057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b595c72-c3db-44ef-a53f-316310a0aa33 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 200 len: 1192 microversion: 2.1 time: 0.147244 Dec 18 21:09:03.484897 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2744/5461] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:03 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 1192 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:03.731241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:03.739861 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b180552a-34ee-4df9-91ad-84731e602131 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1526 microversion: 2.1 time: 0.326672 Dec 18 21:09:03.744660 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2718/5462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:03 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1526 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:04.490524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:04.491147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:04.501333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.501710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.502559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.503011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.518822 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 7daee463-3272-487e-8135-f684d393deed could not be found. Dec 18 21:09:04.519434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 7daee463-3272-487e-8135-f684d393deed could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:04.520327 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3caa742d-72fd-47c9-8792-365ecfccd823 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 404 len: 111 microversion: 2.1 time: 0.035183 Dec 18 21:09:04.521477 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2745/5463] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:04 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:04.561335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:04.561952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:04.570644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.571304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.572382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.573043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.590799 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 7daee463-3272-487e-8135-f684d393deed could not be found. Dec 18 21:09:04.591502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 7daee463-3272-487e-8135-f684d393deed could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:04.592416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5ba8aeb-3150-461f-9d81-ad21fdfead5d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 404 len: 111 microversion: 2.1 time: 0.035641 Dec 18 21:09:04.593078 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2719/5464] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:09:04 2021] DELETE /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:04.601276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:04.602306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 7daee463-3272-487e-8135-f684d393deed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:04.608778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.609464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.610417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.610865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.627824 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 7daee463-3272-487e-8135-f684d393deed could not be found. Dec 18 21:09:04.629027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 7daee463-3272-487e-8135-f684d393deed could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:04.629983 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0601653c-ed77-4dd8-a205-388abf98d2ac tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed" status: 404 len: 111 microversion: 2.1 time: 0.032399 Dec 18 21:09:04.631352 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2746/5465] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:04 2021] GET /compute/v2.1/servers/7daee463-3272-487e-8135-f684d393deed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:04.760021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:04.760825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:04.769641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.770273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.771434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.771861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.809694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:04.810516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:04.811181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lazy-loading 'fault' on Instance uuid db18654e-90f1-4c94-bf14-03fcc3a678b7 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:09:04.869311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10fac4f814ac9a78d8f18ff231b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b33c528aa7484e8069e68727cd6e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:04.879516 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 200 len: 1314 microversion: 2.1 time: 0.124758 Dec 18 21:09:04.880283 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2720/5466] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:04 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 1314 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:05.362068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0960b145-e22e-42df-bc10-39f6b3278fc8 req-abb4e642-480c-456e-9f34-cda663643d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18654e-90f1-4c94-bf14-03fcc3a678b7", "name": "network-vif-deleted", "tag": "a81daf49-71eb-4800-830e-d8fc7dbbfaae"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:05.363706 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:05.363706 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:05.371856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0960b145-e22e-42df-bc10-39f6b3278fc8 req-abb4e642-480c-456e-9f34-cda663643d24 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:05.372309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0960b145-e22e-42df-bc10-39f6b3278fc8 req-abb4e642-480c-456e-9f34-cda663643d24 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:05.384853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0960b145-e22e-42df-bc10-39f6b3278fc8 req-abb4e642-480c-456e-9f34-cda663643d24 service nova] Creating event network-vif-deleted:a81daf49-71eb-4800-830e-d8fc7dbbfaae for instance db18654e-90f1-4c94-bf14-03fcc3a678b7 on nch1-master-1 Dec 18 21:09:05.390500 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0960b145-e22e-42df-bc10-39f6b3278fc8 req-abb4e642-480c-456e-9f34-cda663643d24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032427 Dec 18 21:09:05.391693 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2747/5467] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:09:05.594513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:05.595161 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001401 Dec 18 21:09:05.595161 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2721/5468] 10.222.0.13 () {56 vars in 885 bytes} [Sat Dec 18 21:09:05 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 18 21:09:05.911546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:05.914304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] [instance: db18654e-90f1-4c94-bf14-03fcc3a678b7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:05.933560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:05.935417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:05.939685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:05.940625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:05.990382 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] HTTP exception thrown: Instance db18654e-90f1-4c94-bf14-03fcc3a678b7 could not be found. Dec 18 21:09:05.991337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Returning 404 to user: Instance db18654e-90f1-4c94-bf14-03fcc3a678b7 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:09:05.992793 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-386d7c45-df01-4787-80a2-61f8b28ba472 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7" status: 404 len: 111 microversion: 2.1 time: 0.096315 Dec 18 21:09:05.994124 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2748/5469] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:05 2021] GET /compute/v2.1/servers/db18654e-90f1-4c94-bf14-03fcc3a678b7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:07.813471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:07.814621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34897dbf-14c1-4ff7-a37f-beee9eb294c4 tempest-ServerMetadataNegativeTestJSON-1868969141 tempest-ServerMetadataNegativeTestJSON-1868969141-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001595 Dec 18 21:09:07.815053 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2722/5470] 10.222.0.13 () {56 vars in 885 bytes} [Sat Dec 18 21:09:07 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 18 21:09:11.089518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-205601750", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "02e23047-aecc-4a47-abf5-3b74dfa2dc23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "719d1db8-90bc-4a29-9e67-d552b1d87f10"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:11.168071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] validate_networks() for [('719d1db8-90bc-4a29-9e67-d552b1d87f10', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:09:12.017908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:09:12.019783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:09:12.020432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:09:12.021036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:09:12.021452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:09:12.031733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:12.032390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:12.033462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:12.034080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:12.056125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:12.062619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:12.133897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:09:12.137481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02e23047-aecc-4a47-abf5-3b74dfa2dc23',volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:09:12.406133 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8741b8d3-adaf-428b-a71a-1791db4a3a0e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319840 Dec 18 21:09:12.407078 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2749/5471] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:09:12.420236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07626276-6ac1-4373-a92a-c8af13ee7ed0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:12.421073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07626276-6ac1-4373-a92a-c8af13ee7ed0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:12.517984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-07626276-6ac1-4373-a92a-c8af13ee7ed0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:12.528826 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07626276-6ac1-4373-a92a-c8af13ee7ed0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1070 microversion: 2.1 time: 0.115436 Dec 18 21:09:12.531056 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2723/5472] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:12 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1070 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:13.553421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:13.554240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:13.586712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:13.587174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:13.587994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:13.588967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:13.706713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:13.731557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c801e495-4646-4242-96eb-ff089760f73d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1120 microversion: 2.1 time: 0.186199 Dec 18 21:09:13.732154 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2750/5473] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:13 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1120 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:14.748323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:14.750047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:14.785566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:14.788684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:14.790011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:14.794877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:15.006893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:15.047330 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-31aa558a-8a35-4927-a69b-d88f87dd5bba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1186 microversion: 2.1 time: 0.303208 Dec 18 21:09:15.052677 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2724/5474] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:14 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1186 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:16.068257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:16.068934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:16.086209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:16.089896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:16.090803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:16.091250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:16.248072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:16.257364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-87210221-3169-4089-bba7-1a0bc10b21e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1186 microversion: 2.1 time: 0.194653 Dec 18 21:09:16.259121 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2751/5475] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:16 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1186 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:17.275356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:17.275887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:17.284755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:17.286065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:17.287302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:17.288252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:18.018807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:18.042483 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e4224d2-aadc-4a8a-95f3-66500a438a21 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 0.764728 Dec 18 21:09:18.045622 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2725/5476] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:17 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:18.130710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-420dcba9-84b5-4498-a2f1-e687d18bad1a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'create', calling method: .version_select at 0x7f714eebd430>, body: {"keypair": {"name": "tempest-keypair-1099073238"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:18.162011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-420dcba9-84b5-4498-a2f1-e687d18bad1a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:18.168442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-420dcba9-84b5-4498-a2f1-e687d18bad1a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for user a3e6bef41b9948099215b02cdca829bf and project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:18.634804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-420dcba9-84b5-4498-a2f1-e687d18bad1a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:18.640747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-420dcba9-84b5-4498-a2f1-e687d18bad1a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for user a3e6bef41b9948099215b02cdca829bf and project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:18.656443 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-420dcba9-84b5-4498-a2f1-e687d18bad1a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.003586 Dec 18 21:09:18.657407 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2752/5477] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:09:17 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:19.065228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:19.070464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:19.101617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:19.105059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:19.106376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:19.107940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:19.372087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-08dfb3c6-fbf8-474b-bc6d-d272431cee03 req-e690a246-a03e-423b-bd3e-414ac3583452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfef2208-39a2-4867-b92e-b779754f95e6", "tag": "f16db603-fc8c-45ee-85f8-94d3470ee5f5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:19.375286 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:19.375286 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:19.406866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-08dfb3c6-fbf8-474b-bc6d-d272431cee03 req-e690a246-a03e-423b-bd3e-414ac3583452 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:19.408074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-08dfb3c6-fbf8-474b-bc6d-d272431cee03 req-e690a246-a03e-423b-bd3e-414ac3583452 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:19.455497 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-08dfb3c6-fbf8-474b-bc6d-d272431cee03 req-e690a246-a03e-423b-bd3e-414ac3583452 service nova] Creating event network-changed:f16db603-fc8c-45ee-85f8-94d3470ee5f5 for instance bfef2208-39a2-4867-b92e-b779754f95e6 on nch1-master-1 Dec 18 21:09:19.471775 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-08dfb3c6-fbf8-474b-bc6d-d272431cee03 req-e690a246-a03e-423b-bd3e-414ac3583452 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099339 Dec 18 21:09:19.472875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2753/5478] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:09:20.110623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:20.123710 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-79f13190-4f61-478d-9f2a-4dede1f08384 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 1.066074 Dec 18 21:09:20.124490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2726/5479] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:19 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:21.143676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:21.145091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:21.154054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:21.162242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:21.164414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:21.165636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:22.289883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:22.299472 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf6351bc-8f7d-4176-9178-0edb7b948eb6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 1.161564 Dec 18 21:09:22.315539 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2754/5480] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:21 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:23.322135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:23.323465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:23.335196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:23.337812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:23.342060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:23.342476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:23.824376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:23.840507 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-867df251-2964-4bf9-9e04-84add3f913c2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 0.522262 Dec 18 21:09:23.856103 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2727/5481] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:23 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:24.364623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d73cc5c-9e43-43e0-97bf-1ee85b508f1b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'create', calling method: .version_select at 0x7f714f6e48b0>, body: {"keypair": {"name": "tempest-keypair-414375820"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:24.396887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1d73cc5c-9e43-43e0-97bf-1ee85b508f1b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:24.408261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1d73cc5c-9e43-43e0-97bf-1ee85b508f1b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for user bdd05da990fb4f7290fb926a258de4eb and project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:24.863426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:24.864054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:24.870683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1d73cc5c-9e43-43e0-97bf-1ee85b508f1b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:24.875281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:24.875778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:24.877326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-1d73cc5c-9e43-43e0-97bf-1ee85b508f1b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for user bdd05da990fb4f7290fb926a258de4eb and project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:24.879501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:24.879971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:24.897402 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d73cc5c-9e43-43e0-97bf-1ee85b508f1b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.755423 Dec 18 21:09:24.898525 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2755/5482] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Dec 18 21:09:24 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 757 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:09:25.084698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2140420833", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fa9a6b3-e419-4c2c-9375-8a9a95a008ff"}], "security_groups": [{"name": "tempest-securitygroup--214975411"}], "key_name": "tempest-keypair-1099073238", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:25.347898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] validate_networks() for [('3fa9a6b3-e419-4c2c-9375-8a9a95a008ff', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:09:25.458898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:25.467517 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3bdb938d-cfb7-4885-a312-a03f36fb6945 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 0.608799 Dec 18 21:09:25.482661 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2728/5483] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:24 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:26.326805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:09:26.327420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:09:26.327758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:09:26.328173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:09:26.328640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:09:26.343846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:26.346279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:26.347141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:26.349222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:26.391588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:26.398740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for user a3e6bef41b9948099215b02cdca829bf and project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:26.417259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:09:26.420172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:09:26.493728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:26.496024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:26.518132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:26.518916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:26.522752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:26.523512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:26.583774 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cff60c84-21ad-4fd0-827a-108aad6d6fc7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.503002 Dec 18 21:09:26.599877 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2756/5484] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:25 2021] POST /compute/v2.1/servers => generated 401 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:09:26.605886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-842abce2-7f11-40b7-8b4d-ddb567c6ab08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:26.606876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-842abce2-7f11-40b7-8b4d-ddb567c6ab08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:26.768720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-842abce2-7f11-40b7-8b4d-ddb567c6ab08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:26.785893 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-842abce2-7f11-40b7-8b4d-ddb567c6ab08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1238 microversion: 2.1 time: 0.184394 Dec 18 21:09:26.808048 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2757/5485] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:26 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1238 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:27.043896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:27.064923 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a6958704-f7b3-408d-8052-3135370d0d82 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 0.583340 Dec 18 21:09:27.080386 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2729/5486] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:26 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:27.808946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:27.809666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:27.819487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:27.819949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:27.820763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:27.823645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:27.959274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:27.967080 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de48ca94-ce91-45cf-a1f7-c8d9cf6d6802 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1234 microversion: 2.1 time: 0.161988 Dec 18 21:09:27.978392 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2758/5487] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:27 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1234 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:28.083922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:28.085840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:28.102482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:28.105467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:28.106507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:28.107135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:28.446900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:28.460585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaad4dc0-9eac-43f8-b48d-c5ead5086a78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 0.380346 Dec 18 21:09:28.461202 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2730/5488] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:28 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:28.984224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:28.984849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:28.996708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:28.998570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:28.999927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:29.001184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:29.021998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-620578079", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a73f33f-bbbf-4537-b0c3-79abe445c89e"}], "security_groups": [{"name": "tempest-securitygroup--1462364744"}], "key_name": "tempest-keypair-414375820", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:29.164057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:29.178545 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8323a0a8-09ae-439e-b405-589b1b430f9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1290 microversion: 2.1 time: 0.198506 Dec 18 21:09:29.181750 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2759/5489] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:28 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1290 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:29.318817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] validate_networks() for [('7a73f33f-bbbf-4537-b0c3-79abe445c89e', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:09:29.480660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cf1d9290-8471-4cc7-b753-dc95f7fed41c req-1c08c92d-9840-4e1e-bf65-98d7768804a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfef2208-39a2-4867-b92e-b779754f95e6", "name": "network-vif-plugged", "status": "completed", "tag": "f16db603-fc8c-45ee-85f8-94d3470ee5f5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:29.482608 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:29.482608 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:29.499114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cf1d9290-8471-4cc7-b753-dc95f7fed41c req-1c08c92d-9840-4e1e-bf65-98d7768804a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:29.499869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cf1d9290-8471-4cc7-b753-dc95f7fed41c req-1c08c92d-9840-4e1e-bf65-98d7768804a0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:29.515783 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cf1d9290-8471-4cc7-b753-dc95f7fed41c req-1c08c92d-9840-4e1e-bf65-98d7768804a0 service nova] Creating event network-vif-plugged:f16db603-fc8c-45ee-85f8-94d3470ee5f5 for instance bfef2208-39a2-4867-b92e-b779754f95e6 on nch1-master-1 Dec 18 21:09:29.521701 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cf1d9290-8471-4cc7-b753-dc95f7fed41c req-1c08c92d-9840-4e1e-bf65-98d7768804a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045918 Dec 18 21:09:29.522622 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2760/5490] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:29.534473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:29.535464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:29.548954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:29.549738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:29.550747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:29.551352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:30.097496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:30.108384 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07a5a58b-4c16-427f-91cf-5c4c5ef9fe91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 0.581666 Dec 18 21:09:30.108813 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2761/5491] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:29 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:30.204267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:30.205948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:30.220310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:30.220853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:30.221711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:30.222156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:30.362009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:30.383050 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-efc98df1-b243-4790-84d3-24acb4f2574a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1296 microversion: 2.1 time: 0.186080 Dec 18 21:09:30.384463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2762/5492] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:30 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:30.938401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:09:30.939690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:09:30.940386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:09:30.941200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:09:30.943047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:09:30.982526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:30.982986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:30.990616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:30.992972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:31.019842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:31.025620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for user bdd05da990fb4f7290fb926a258de4eb and project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:31.043411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:09:31.048758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:09:31.134207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:31.137509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:31.145137 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82535217-0481-4916-ae95-17229e6f6282 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.128806 Dec 18 21:09:31.147103 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2731/5493] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:09:29 2021] POST /compute/v2.1/servers => generated 402 bytes in 2134 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 21:09:31.151316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:31.155941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:31.156851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:31.157318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:31.168429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd34ccda-776a-4b4b-ae33-b8a7eae1f54d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:31.170796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd34ccda-776a-4b4b-ae33-b8a7eae1f54d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:31.364142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd34ccda-776a-4b4b-ae33-b8a7eae1f54d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:31.379584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd34ccda-776a-4b4b-ae33-b8a7eae1f54d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:31.381230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd34ccda-776a-4b4b-ae33-b8a7eae1f54d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:31.385223 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd34ccda-776a-4b4b-ae33-b8a7eae1f54d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1280 microversion: 2.20 time: 0.229351 Dec 18 21:09:31.387864 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2732/5494] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:31 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:31.404296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:31.405152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:31.419679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:31.425946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:31.430450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:31.432530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:31.904495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:31.921895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-339b0125-4999-46cf-944d-18ff6fef3654 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1216 microversion: 2.1 time: 0.800709 Dec 18 21:09:31.933244 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2763/5495] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:31 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1216 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:32.000115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:32.007499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ccf2de27-8cb6-4b89-8b75-0298b87e307a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1363 microversion: 2.1 time: 0.610151 Dec 18 21:09:32.008086 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2733/5496] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:31 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1363 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:32.405769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:32.406393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:32.415030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:32.416882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:32.418470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:32.420465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:32.735388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:32.749362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:32.750954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:32.752086 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60eca4dd-ce6d-440f-8387-1809715d51c6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1332 microversion: 2.20 time: 0.350184 Dec 18 21:09:32.756715 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2764/5497] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:32 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1332 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:32.939058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:32.940060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:32.958665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:32.959734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:32.961397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:32.963532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:33.024756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:33.029064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:33.057671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:33.060607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:33.071018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:33.072966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:33.889835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:33.903204 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-448045e3-df8d-4b47-90ad-dcd2f3e5ca23 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1404 microversion: 2.1 time: 0.967551 Dec 18 21:09:33.906162 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2734/5498] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:32 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1404 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:33.915144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:33.916536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:33.928627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:33.939209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:33.940335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:33.940942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:34.002159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:34.011068 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a1c8209-aa6a-4b39-a80b-df9eae32b83d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1363 microversion: 2.1 time: 0.990044 Dec 18 21:09:34.011916 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2765/5499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:33 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1363 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:34.018047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:34.025806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:34.044606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:34.045871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:34.047632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:34.050132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:34.100762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:34.121809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:34.129381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:34.132922 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97cbde83-0b48-4cee-a2fa-f12bce27f549 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1338 microversion: 2.20 time: 0.225542 Dec 18 21:09:34.142640 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2735/5500] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:33 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:34.399706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6a1f7e3d-9aa4-477a-820b-39325af1c908 req-2147a41e-c4d9-4cfa-b077-3bfe9d65a8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befd31cf-08d3-4d80-a3e6-101af7256703", "tag": "83ebec85-c173-4b36-8f22-c0da8cd772d9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:34.403229 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:34.403229 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:34.440238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a1f7e3d-9aa4-477a-820b-39325af1c908 req-2147a41e-c4d9-4cfa-b077-3bfe9d65a8eb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:34.440949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a1f7e3d-9aa4-477a-820b-39325af1c908 req-2147a41e-c4d9-4cfa-b077-3bfe9d65a8eb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:34.481466 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6a1f7e3d-9aa4-477a-820b-39325af1c908 req-2147a41e-c4d9-4cfa-b077-3bfe9d65a8eb service nova] Creating event network-changed:83ebec85-c173-4b36-8f22-c0da8cd772d9 for instance befd31cf-08d3-4d80-a3e6-101af7256703 on nch2-master-1 Dec 18 21:09:34.496540 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6a1f7e3d-9aa4-477a-820b-39325af1c908 req-2147a41e-c4d9-4cfa-b077-3bfe9d65a8eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103771 Dec 18 21:09:34.498565 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2736/5501] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:09:34.945154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:34.955986 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abb93d34-1359-481c-9d28-931bbe888061 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1404 microversion: 2.1 time: 0.942267 Dec 18 21:09:34.970774 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2766/5502] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:34 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1404 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:34.980600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1776890629"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:34.981800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:34.998195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:34.998691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:35.001782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:35.002989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:35.028556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:35.029368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:35.044045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:35.047655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:35.050686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:35.051153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:35.235277 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Attempting to quiesce instance before volume snapshot. Dec 18 21:09:35.308232 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Dec 18 21:09:35.477079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Creating snapshot from volume 02e23047-aecc-4a47-abf5-3b74dfa2dc23. {{(pid=140731) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Dec 18 21:09:35.616261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:35.703070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28a62d57-f389-488f-9483-e0416d63c95c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1363 microversion: 2.1 time: 0.677732 Dec 18 21:09:35.703715 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2767/5503] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:35 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1363 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:35.744654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:35.749916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:35.771283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:35.774685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:35.783921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:35.784472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:35.970704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:35.993094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:35.999511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:36.006976 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b2d67362-3d08-4249-a2e3-b6a1bad6bdd6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1338 microversion: 2.20 time: 0.294933 Dec 18 21:09:36.012711 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2768/5504] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:35 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1338 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:36.730193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:36.734235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:36.758008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:36.758879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:36.760152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:36.763771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:37.573528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:37.587122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d276d706-2696-4a49-8276-4dc4d48a628b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1363 microversion: 2.1 time: 0.870136 Dec 18 21:09:37.589748 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2769/5505] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:36 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1363 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:37.595624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:37.596695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:37.604855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:37.605642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:37.607832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:37.608493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:37.747360 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a658db90-1e35-44cc-95e8-eb25874854fb tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6/action" status: 202 len: 0 microversion: 2.1 time: 2.773010 Dec 18 21:09:37.769533 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2737/5506] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:34 2021] POST /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6/action => generated 0 bytes in 2794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 21:09:38.067780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-120435316", "imageRef": "2f7d7469-1e2f-43fe-93ad-72bdc960911e", "flavorRef": "452", "networks": [{"uuid": "719d1db8-90bc-4a29-9e67-d552b1d87f10"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:38.171278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] validate_networks() for [('719d1db8-90bc-4a29-9e67-d552b1d87f10', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:09:38.933428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:38.952236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:38.954913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:38.956744 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2f4d212-f044-4662-9aba-35e3c09ee1a1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1406 microversion: 2.20 time: 1.365463 Dec 18 21:09:38.957679 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2770/5507] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:37 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1406 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:38.983638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:38.984551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:38.991582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:38.992610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:38.993651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:38.994470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:39.454144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:39.466753 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-707fe42e-7cc4-4014-810c-4c6d160d0186 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1363 microversion: 2.1 time: 0.507669 Dec 18 21:09:39.470069 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2771/5508] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:38 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1363 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:39.748528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e73a8953-6cd8-438e-ae13-b41be012e216 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1230383021", "availability_zone": "foo_zone"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:39.750079 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:39.750079 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:39.751675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.aggregate [None req-e73a8953-6cd8-438e-ae13-b41be012e216 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Generated uuid de43b754-5a32-4807-99b4-715a0e6c146d for aggregate {{(pid=140732) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 18 21:09:39.844931 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e73a8953-6cd8-438e-ae13-b41be012e216 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.373360 Dec 18 21:09:39.851107 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2772/5509] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Dec 18 21:09:39 2021] POST /compute/v2.1/os-aggregates => generated 209 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:39.854812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-bb21f0aa-f000-4eac-a8d0-f552576bcda0 req-877a7dea-88f9-4aab-ad3a-1da96633b462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:39.860276 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:39.860276 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:39.870633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-bb21f0aa-f000-4eac-a8d0-f552576bcda0 req-877a7dea-88f9-4aab-ad3a-1da96633b462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:39.871095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-bb21f0aa-f000-4eac-a8d0-f552576bcda0 req-877a7dea-88f9-4aab-ad3a-1da96633b462 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:39.897954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-bb21f0aa-f000-4eac-a8d0-f552576bcda0 req-877a7dea-88f9-4aab-ad3a-1da96633b462 service nova] Creating event network-changed:108c8a1c-0915-4513-8659-185ce5146ce7 for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 on nch1-master-1 Dec 18 21:09:39.904172 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-bb21f0aa-f000-4eac-a8d0-f552576bcda0 req-877a7dea-88f9-4aab-ad3a-1da96633b462 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056273 Dec 18 21:09:39.905391 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2773/5510] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:39.913896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98fcbb80-6e96-4fda-95e8-891f0e4eea7c tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:39.916792 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:39.916792 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:39.944690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98fcbb80-6e96-4fda-95e8-891f0e4eea7c tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.036975 Dec 18 21:09:39.946609 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2774/5511] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 21:09:39 2021] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:39.960280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99e57f3c-92f6-4c7d-bd88-c778db7829a3 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:39.961555 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:39.961555 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:39.963803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99e57f3c-92f6-4c7d-bd88-c778db7829a3 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:39.964258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99e57f3c-92f6-4c7d-bd88-c778db7829a3 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:39.965073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99e57f3c-92f6-4c7d-bd88-c778db7829a3 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:39.965941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99e57f3c-92f6-4c7d-bd88-c778db7829a3 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:40.000518 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99e57f3c-92f6-4c7d-bd88-c778db7829a3 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043914 Dec 18 21:09:40.007462 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2775/5512] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Dec 18 21:09:39 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:09:40.013751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:40.014802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:40.022714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:40.023467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:40.024571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:40.025775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:40.037403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:09:40.037921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:09:40.038487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:09:40.038979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:09:40.039964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:09:40.063649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:40.065406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:40.067287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:40.070859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:40.130039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:40.144024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:40.176550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:09:40.180665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5d1fb417-1893-4a31-ae5f-e0033d4ffdbf',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:09:40.332927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:40.341255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:40.344264 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-abe2cea8-95db-4600-a635-a707d0f69e64 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249117 Dec 18 21:09:40.345398 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2738/5513] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:09:40.351443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff790c0d-953f-4b28-b761-c245090db3ab tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:40.351624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:40.355090 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:40.355090 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:40.366944 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff790c0d-953f-4b28-b761-c245090db3ab tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.019042 Dec 18 21:09:40.371100 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2739/5514] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 21:09:40 2021] GET /compute/v2.1/os-aggregates => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:40.377524 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2faccaad-4d5f-48cd-a6d9-a67527ceebbe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1406 microversion: 2.20 time: 0.348254 Dec 18 21:09:40.388201 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2776/5515] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:40 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:40.392917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-46fc06d3-47d7-43ab-954f-8cf2e1b96c3d tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:40.394151 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:40.394151 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:40.395075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fdf31a0a-2eb0-42b8-9e69-c4574ca05f77 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:40.395986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fdf31a0a-2eb0-42b8-9e69-c4574ca05f77 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:40.440615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-46fc06d3-47d7-43ab-954f-8cf2e1b96c3d tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:40.444978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-46fc06d3-47d7-43ab-954f-8cf2e1b96c3d tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:40.540360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fdf31a0a-2eb0-42b8-9e69-c4574ca05f77 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:40.555839 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fdf31a0a-2eb0-42b8-9e69-c4574ca05f77 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1229 microversion: 2.1 time: 0.182763 Dec 18 21:09:40.559682 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2740/5516] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:40 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1229 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:40.567254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:40.568543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:40.608959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:40.610417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:40.613744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:40.616708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:41.126378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:41.145287 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-797e1f2d-251d-4f0e-b109-a53fb63ff0f3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1363 microversion: 2.1 time: 0.584284 Dec 18 21:09:41.145879 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2741/5517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:40 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1363 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:41.239689 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-46fc06d3-47d7-43ab-954f-8cf2e1b96c3d tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.850345 Dec 18 21:09:41.248870 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2777/5518] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 21:09:40 2021] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:41.258845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59fb79ed-8842-47de-b984-6af5299853d1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:41.262537 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:41.262537 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:41.281646 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59fb79ed-8842-47de-b984-6af5299853d1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.025669 Dec 18 21:09:41.285208 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2742/5519] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 21:09:41 2021] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:41.296640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae1c9076-be61-4ee9-a0e3-1fadbe05efc1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-431611704", "availability_zone": "foo_zone"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:41.298484 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:41.298484 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:41.388821 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae1c9076-be61-4ee9-a0e3-1fadbe05efc1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.097403 Dec 18 21:09:41.390103 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2778/5520] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Dec 18 21:09:41 2021] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:41.411710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54e65e42-8a23-414e-b042-1e72c915f6b1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:41.412835 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:41.412835 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:41.422841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:41.423832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:41.431615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:41.432289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:41.434541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:41.435213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:41.445883 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54e65e42-8a23-414e-b042-1e72c915f6b1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] [8dd317d4-e5a6-4383-9f1e-824b7b312d63] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:09:41.757356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:41.772833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:41.774424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:41.776665 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5262fc91-4317-4db6-ab64-305f8ba572bb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1406 microversion: 2.20 time: 0.361364 Dec 18 21:09:41.780146 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2779/5521] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:41 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1406 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:41.786446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:41.787232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:41.796712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:41.797380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:41.799332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:41.799818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:41.909976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:41.919915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8b163aec-9f67-46fb-b51a-8c6efe394179 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1285 microversion: 2.1 time: 0.137654 Dec 18 21:09:41.921058 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2780/5522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:41 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:41.926899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f3021e05-4f82-4d42-8320-4b4f3fb8c28a req-f1b1368b-e934-4304-b449-43b446f4378b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befd31cf-08d3-4d80-a3e6-101af7256703", "name": "network-vif-plugged", "status": "completed", "tag": "83ebec85-c173-4b36-8f22-c0da8cd772d9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:41.928560 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:41.928560 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:41.939099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f3021e05-4f82-4d42-8320-4b4f3fb8c28a req-f1b1368b-e934-4304-b449-43b446f4378b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:41.943033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f3021e05-4f82-4d42-8320-4b4f3fb8c28a req-f1b1368b-e934-4304-b449-43b446f4378b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:41.956407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f3021e05-4f82-4d42-8320-4b4f3fb8c28a req-f1b1368b-e934-4304-b449-43b446f4378b service nova] Creating event network-vif-plugged:83ebec85-c173-4b36-8f22-c0da8cd772d9 for instance befd31cf-08d3-4d80-a3e6-101af7256703 on nch2-master-1 Dec 18 21:09:41.964000 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f3021e05-4f82-4d42-8320-4b4f3fb8c28a req-f1b1368b-e934-4304-b449-43b446f4378b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041251 Dec 18 21:09:41.965217 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2781/5523] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:42.166660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:42.169419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:42.187247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:42.187714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:42.191253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:42.191594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:42.479347 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [None req-54e65e42-8a23-414e-b042-1e72c915f6b1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] [8dd317d4-e5a6-4383-9f1e-824b7b312d63] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56122. Dec 18 21:09:42.504521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:42.516081 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f556088-19fc-4588-a9c7-64b9eb7bbd25 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1367 microversion: 2.1 time: 0.356255 Dec 18 21:09:42.517413 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2782/5524] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:42 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:42.536448 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54e65e42-8a23-414e-b042-1e72c915f6b1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 1.138796 Dec 18 21:09:42.542355 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2743/5525] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 21:09:41 2021] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:42.553372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29b08d78-16a5-4da5-8daf-e45e946b42e6 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:42.554707 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:42.554707 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:42.565014 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29b08d78-16a5-4da5-8daf-e45e946b42e6 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.015525 Dec 18 21:09:42.568933 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2783/5526] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 21:09:42 2021] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:42.581703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b868eb0-d9e1-46b2-af62-d301142806f1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:42.583433 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:42.583433 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:42.597710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b868eb0-d9e1-46b2-af62-d301142806f1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:42.599106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b868eb0-d9e1-46b2-af62-d301142806f1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:42.800290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:42.801194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:42.813671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:42.814128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:42.814964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:42.815403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:43.095168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4b868eb0-d9e1-46b2-af62-d301142806f1 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.517683 Dec 18 21:09:43.095831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:43.097139 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2744/5527] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Dec 18 21:09:42 2021] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:43.102836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:43.104128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:43.112393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:43.113124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:43.114356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:43.115173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:43.115417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:43.117181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:43.119305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a07c2a0e-bb91-42f8-881b-b034b667fc86 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1406 microversion: 2.20 time: 0.325047 Dec 18 21:09:43.120770 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2784/5528] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:42 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:09:43.268064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:43.285470 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5422f90d-a669-4cd4-8463-d0f578076bd2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1299 microversion: 2.1 time: 0.181761 Dec 18 21:09:43.286201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2745/5529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:43 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:43.323826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a21e5ded-8fc7-42f0-aa64-f11abcd06d91 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:43.326506 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:43.326506 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:43.387136 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a21e5ded-8fc7-42f0-aa64-f11abcd06d91 tempest-TestAggregatesBasicOps-977317672 tempest-TestAggregatesBasicOps-977317672-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.085284 Dec 18 21:09:43.387963 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2746/5530] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 21:09:43 2021] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 18 21:09:43.534619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:43.535391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:43.551408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:43.552004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:43.552903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:43.553532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:43.629055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-be20c109-36ed-4db6-b59b-d6097c1625d3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: .version_select at 0x7f714f6c9940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1539721925"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:43.670078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-be20c109-36ed-4db6-b59b-d6097c1625d3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:43.683769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-be20c109-36ed-4db6-b59b-d6097c1625d3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:44.238813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:44.248187 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4dc8725c-a294-4385-9411-4d2919614462 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1547 microversion: 2.1 time: 0.718593 Dec 18 21:09:44.253055 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2747/5531] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:43 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1547 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:44.259153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:44.264772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:44.273934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:44.276755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:44.279031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:44.279659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:44.348894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-be20c109-36ed-4db6-b59b-d6097c1625d3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:44.355470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-be20c109-36ed-4db6-b59b-d6097c1625d3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:44.377952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-be20c109-36ed-4db6-b59b-d6097c1625d3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.255105 Dec 18 21:09:44.384485 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2785/5532] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:09:43 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:44.390452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6dd4282b-69a5-47e9-aa45-ddd5904d81d5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:44.390960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6dd4282b-69a5-47e9-aa45-ddd5904d81d5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:44.399620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd4282b-69a5-47e9-aa45-ddd5904d81d5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:44.400448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd4282b-69a5-47e9-aa45-ddd5904d81d5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:44.401297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd4282b-69a5-47e9-aa45-ddd5904d81d5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:44.401746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd4282b-69a5-47e9-aa45-ddd5904d81d5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:44.637892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6dd4282b-69a5-47e9-aa45-ddd5904d81d5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252220 Dec 18 21:09:44.642495 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2786/5533] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:09:44 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:44.656377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:44.656888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:44.666389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:44.667238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:44.668218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:44.668909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:44.749208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:44.763423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:44.765263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:44.769303 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e758a03-fb0f-4a8f-9808-0eb0c24773a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1406 microversion: 2.20 time: 0.512286 Dec 18 21:09:44.770521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2748/5534] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:44 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:45.030522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:45.043822 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9353f477-1f77-49c8-a441-5e0ccf0b7f31 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1341 microversion: 2.1 time: 0.399389 Dec 18 21:09:45.044953 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2787/5535] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:44 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1341 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:45.187111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-caadb827-149e-4e53-9162-8f8b819c62ed req-30b3ccae-c7dd-4428-aece-a75d17b02d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceaaab41-fbd2-47ed-b72a-90caaa32d9c7", "tag": "913b3bf1-d339-48ab-8f6f-9bdc6158dd92"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:45.189916 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:45.189916 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:45.237231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-caadb827-149e-4e53-9162-8f8b819c62ed req-30b3ccae-c7dd-4428-aece-a75d17b02d8b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:45.239089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-caadb827-149e-4e53-9162-8f8b819c62ed req-30b3ccae-c7dd-4428-aece-a75d17b02d8b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:45.276691 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-caadb827-149e-4e53-9162-8f8b819c62ed req-30b3ccae-c7dd-4428-aece-a75d17b02d8b service nova] Creating event network-changed:913b3bf1-d339-48ab-8f6f-9bdc6158dd92 for instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 on nch2-master-1 Dec 18 21:09:45.290053 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-caadb827-149e-4e53-9162-8f8b819c62ed req-30b3ccae-c7dd-4428-aece-a75d17b02d8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105070 Dec 18 21:09:45.292705 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2749/5536] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:45.544828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-af888027-d953-4a53-8b02-318ce8e498c5 req-bbf258b4-8bad-4d74-b042-67d9adc6fa3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "name": "network-vif-plugged", "status": "completed", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:45.547144 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:45.547144 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:09:45.561745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-af888027-d953-4a53-8b02-318ce8e498c5 req-bbf258b4-8bad-4d74-b042-67d9adc6fa3f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:45.562720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-af888027-d953-4a53-8b02-318ce8e498c5 req-bbf258b4-8bad-4d74-b042-67d9adc6fa3f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:45.581013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-af888027-d953-4a53-8b02-318ce8e498c5 req-bbf258b4-8bad-4d74-b042-67d9adc6fa3f service nova] Creating event network-vif-plugged:108c8a1c-0915-4513-8659-185ce5146ce7 for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 on nch1-master-1 Dec 18 21:09:45.587936 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-af888027-d953-4a53-8b02-318ce8e498c5 req-bbf258b4-8bad-4d74-b042-67d9adc6fa3f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049006 Dec 18 21:09:45.589659 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2788/5537] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:09:45.792605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:45.793449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:45.801959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:45.802566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:45.803454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:45.803977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:46.062940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:46.064487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:46.075063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:46.077915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:46.078965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:46.079570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:46.229759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:46.239608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:46.242432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:46.243954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5926061-f4b1-4bed-852f-70e514c69280 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1406 microversion: 2.20 time: 0.459514 Dec 18 21:09:46.255401 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2750/5538] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:45 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:46.448598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:46.461857 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a12191a2-2b99-426d-a81b-524577a462f0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1341 microversion: 2.1 time: 0.403643 Dec 18 21:09:46.465108 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2789/5539] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:46 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1341 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:46.843405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb40d430-2ed4-449a-ae30-f950b783114e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:46.844339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb40d430-2ed4-449a-ae30-f950b783114e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:46.861909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb40d430-2ed4-449a-ae30-f950b783114e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:46.862526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb40d430-2ed4-449a-ae30-f950b783114e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:46.863388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb40d430-2ed4-449a-ae30-f950b783114e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:46.863868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb40d430-2ed4-449a-ae30-f950b783114e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:46.921199 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb40d430-2ed4-449a-ae30-f950b783114e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.082575 Dec 18 21:09:46.921855 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2751/5540] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:46 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:09:47.262075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:47.263304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:47.277839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:47.278628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:47.279606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:47.281326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:47.367531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-55822369-494f-4a10-aa4e-00247efb2ddb req-742769b6-3a8b-425c-9bbd-24475c9b6a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befd31cf-08d3-4d80-a3e6-101af7256703", "tag": "83ebec85-c173-4b36-8f22-c0da8cd772d9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:47.369580 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:47.369580 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:47.386350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-55822369-494f-4a10-aa4e-00247efb2ddb req-742769b6-3a8b-425c-9bbd-24475c9b6a90 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:47.387231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-55822369-494f-4a10-aa4e-00247efb2ddb req-742769b6-3a8b-425c-9bbd-24475c9b6a90 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:47.414745 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-55822369-494f-4a10-aa4e-00247efb2ddb req-742769b6-3a8b-425c-9bbd-24475c9b6a90 service nova] Creating event network-changed:83ebec85-c173-4b36-8f22-c0da8cd772d9 for instance befd31cf-08d3-4d80-a3e6-101af7256703 on nch2-master-1 Dec 18 21:09:47.432910 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-55822369-494f-4a10-aa4e-00247efb2ddb req-742769b6-3a8b-425c-9bbd-24475c9b6a90 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069539 Dec 18 21:09:47.436899 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2752/5541] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:09:47.482332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:47.483374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:47.497110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:47.497576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:47.498417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:47.498876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:47.979660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:47.993161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:47.994672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:48.000862 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3adbd1c1-5558-4936-80c9-12896a8766d5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1406 microversion: 2.20 time: 0.742463 Dec 18 21:09:48.001529 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2790/5542] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:47 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1406 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:48.030590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89e4ae4c-dadf-43ba-9a1d-0c2ececd6c0f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:48.031796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89e4ae4c-dadf-43ba-9a1d-0c2ececd6c0f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:48.048265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89e4ae4c-dadf-43ba-9a1d-0c2ececd6c0f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:48.049115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89e4ae4c-dadf-43ba-9a1d-0c2ececd6c0f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:48.050292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89e4ae4c-dadf-43ba-9a1d-0c2ececd6c0f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:48.050955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89e4ae4c-dadf-43ba-9a1d-0c2ececd6c0f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:48.111046 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89e4ae4c-dadf-43ba-9a1d-0c2ececd6c0f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.091156 Dec 18 21:09:48.112742 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2791/5543] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:48 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:09:48.175402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:48.183014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bbb181c8-2857-4d83-816f-7db467bbd59e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1387 microversion: 2.1 time: 0.705294 Dec 18 21:09:48.187994 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2753/5544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:47 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1387 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:49.021339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:49.021999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:49.030034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.030445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.031255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.031696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.123576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7d4de288-90c8-418d-b1a3-e40be234c63c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:49.124557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7d4de288-90c8-418d-b1a3-e40be234c63c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:49.132286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4de288-90c8-418d-b1a3-e40be234c63c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.132985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4de288-90c8-418d-b1a3-e40be234c63c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.133937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4de288-90c8-418d-b1a3-e40be234c63c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.135176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7d4de288-90c8-418d-b1a3-e40be234c63c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.177285 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7d4de288-90c8-418d-b1a3-e40be234c63c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.056832 Dec 18 21:09:49.179003 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2754/5545] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:49 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:09:49.204002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:49.204960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:49.230495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.231394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.233061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.234794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.289576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:49.300826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:49.302398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:49.303603 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-296f164f-a661-4f8a-b746-b0ac07234a34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1597 microversion: 2.20 time: 0.287540 Dec 18 21:09:49.308310 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2792/5546] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:49 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1597 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:09:49.325724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c70396a-eb40-4127-b75d-4a9338227c3f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:49.325983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c70396a-eb40-4127-b75d-4a9338227c3f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:49.333572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c70396a-eb40-4127-b75d-4a9338227c3f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.334029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c70396a-eb40-4127-b75d-4a9338227c3f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.335096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c70396a-eb40-4127-b75d-4a9338227c3f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:49.341569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c70396a-eb40-4127-b75d-4a9338227c3f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:49.513804 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c70396a-eb40-4127-b75d-4a9338227c3f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.192928 Dec 18 21:09:49.514874 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2793/5547] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Dec 18 21:09:49 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:09:49.746953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:49.766848 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-65861d64-f444-4dad-8f6b-b609a7485e26 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1375 microversion: 2.1 time: 0.562922 Dec 18 21:09:49.768164 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2755/5548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:49 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1375 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:50.191678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-446093fa-2e9a-4c41-a37e-c7230d37d512 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:50.192858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-446093fa-2e9a-4c41-a37e-c7230d37d512 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:50.206803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446093fa-2e9a-4c41-a37e-c7230d37d512 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:50.207923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446093fa-2e9a-4c41-a37e-c7230d37d512 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:50.208984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446093fa-2e9a-4c41-a37e-c7230d37d512 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:50.210283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446093fa-2e9a-4c41-a37e-c7230d37d512 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:50.262755 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-446093fa-2e9a-4c41-a37e-c7230d37d512 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.075418 Dec 18 21:09:50.263952 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2794/5549] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:50 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:09:50.785244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:50.786457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:50.799770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:50.800439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:50.801435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:50.801897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:51.279219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e4559d1-f3ca-4102-a531-83f99f43e95b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:51.280237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e4559d1-f3ca-4102-a531-83f99f43e95b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:51.287704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e4559d1-f3ca-4102-a531-83f99f43e95b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:51.288508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e4559d1-f3ca-4102-a531-83f99f43e95b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:51.289539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e4559d1-f3ca-4102-a531-83f99f43e95b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:51.290204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e4559d1-f3ca-4102-a531-83f99f43e95b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:51.333329 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e4559d1-f3ca-4102-a531-83f99f43e95b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.058086 Dec 18 21:09:51.334594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2795/5550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:51 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:09:51.345421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:51.361876 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13fb38ea-9efe-4584-aaf5-49204035993e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1375 microversion: 2.1 time: 0.580159 Dec 18 21:09:51.363489 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2756/5551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:50 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1375 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:51.822986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12e0c428-e9c0-4427-b273-ef123b65ab9b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:51.824319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-12e0c428-e9c0-4427-b273-ef123b65ab9b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:51.840058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e0c428-e9c0-4427-b273-ef123b65ab9b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:51.840708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e0c428-e9c0-4427-b273-ef123b65ab9b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:51.841548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e0c428-e9c0-4427-b273-ef123b65ab9b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:51.841993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e0c428-e9c0-4427-b273-ef123b65ab9b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:51.850004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c1c4ee43-8beb-429e-973c-b5d4dd48818c req-3407b951-f521-4bbb-9e55-fc9a645b4531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:51.854075 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:51.854075 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:51.864742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c1c4ee43-8beb-429e-973c-b5d4dd48818c req-3407b951-f521-4bbb-9e55-fc9a645b4531 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:51.896736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c1c4ee43-8beb-429e-973c-b5d4dd48818c req-3407b951-f521-4bbb-9e55-fc9a645b4531 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:51.923588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c1c4ee43-8beb-429e-973c-b5d4dd48818c req-3407b951-f521-4bbb-9e55-fc9a645b4531 service nova] Creating event network-changed:108c8a1c-0915-4513-8659-185ce5146ce7 for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 on nch1-master-1 Dec 18 21:09:51.937118 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-12e0c428-e9c0-4427-b273-ef123b65ab9b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.119700 Dec 18 21:09:51.938154 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2796/5552] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:09:51 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:51.943507 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c1c4ee43-8beb-429e-973c-b5d4dd48818c req-3407b951-f521-4bbb-9e55-fc9a645b4531 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096910 Dec 18 21:09:51.970756 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2757/5553] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:09:52.346920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0b1b240-c235-4d8f-b724-0130c8be41c4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:52.348335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0b1b240-c235-4d8f-b724-0130c8be41c4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:52.365141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0b1b240-c235-4d8f-b724-0130c8be41c4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:52.365607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0b1b240-c235-4d8f-b724-0130c8be41c4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:52.374206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0b1b240-c235-4d8f-b724-0130c8be41c4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:52.374656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0b1b240-c235-4d8f-b724-0130c8be41c4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:52.387306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:52.389376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:52.423774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:52.426083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:52.428404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:52.432506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:52.436745 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0b1b240-c235-4d8f-b724-0130c8be41c4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.095167 Dec 18 21:09:52.438011 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2797/5554] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:52 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:09:52.880982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:52.894517 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f5d86c3-1d45-4a17-82a2-cdf21012c2bf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1375 microversion: 2.1 time: 0.518355 Dec 18 21:09:52.904876 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2758/5555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:52 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1375 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:52.951054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-138a3bd9-dd3c-41f2-869e-5356bfd0211e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:52.952338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-138a3bd9-dd3c-41f2-869e-5356bfd0211e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:52.959254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138a3bd9-dd3c-41f2-869e-5356bfd0211e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:52.959951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138a3bd9-dd3c-41f2-869e-5356bfd0211e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:52.961113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138a3bd9-dd3c-41f2-869e-5356bfd0211e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:52.961700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138a3bd9-dd3c-41f2-869e-5356bfd0211e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:53.011001 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-138a3bd9-dd3c-41f2-869e-5356bfd0211e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.065522 Dec 18 21:09:53.011667 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2798/5556] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:09:52 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:53.448393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a6b9efa6-68fa-4d05-97b4-2a2a3265b01b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:53.449609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6b9efa6-68fa-4d05-97b4-2a2a3265b01b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:53.464110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6b9efa6-68fa-4d05-97b4-2a2a3265b01b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:53.464854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6b9efa6-68fa-4d05-97b4-2a2a3265b01b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:53.465857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6b9efa6-68fa-4d05-97b4-2a2a3265b01b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:53.467667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6b9efa6-68fa-4d05-97b4-2a2a3265b01b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:53.564875 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a6b9efa6-68fa-4d05-97b4-2a2a3265b01b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.119815 Dec 18 21:09:53.567785 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2759/5557] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:53 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:09:53.911786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:53.912510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:53.927990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:53.928474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:53.929307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:53.929748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:54.023273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51b4ca39-85e1-4aca-9963-a04b44f9a80d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:54.025601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51b4ca39-85e1-4aca-9963-a04b44f9a80d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:54.034337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51b4ca39-85e1-4aca-9963-a04b44f9a80d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:54.064312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51b4ca39-85e1-4aca-9963-a04b44f9a80d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:54.066393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51b4ca39-85e1-4aca-9963-a04b44f9a80d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:54.068347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51b4ca39-85e1-4aca-9963-a04b44f9a80d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:54.138162 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51b4ca39-85e1-4aca-9963-a04b44f9a80d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.118466 Dec 18 21:09:54.138162 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2760/5558] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:09:54 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:54.180282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:54.199186 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-646a4af2-f7b3-4e6f-908d-c6a9376d8457 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1375 microversion: 2.1 time: 0.283291 Dec 18 21:09:54.210995 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2799/5559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:53 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1375 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:54.599381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b024f2bb-34c2-40af-9853-c1f38bc32cf0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:54.600857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b024f2bb-34c2-40af-9853-c1f38bc32cf0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:54.616622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b024f2bb-34c2-40af-9853-c1f38bc32cf0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:54.617528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b024f2bb-34c2-40af-9853-c1f38bc32cf0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:54.620396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b024f2bb-34c2-40af-9853-c1f38bc32cf0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:54.621205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b024f2bb-34c2-40af-9853-c1f38bc32cf0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:54.735288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b024f2bb-34c2-40af-9853-c1f38bc32cf0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 14 microversion: 2.1 time: 0.155538 Dec 18 21:09:54.736508 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2761/5560] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:54 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:09:55.151420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5522dd4-27ac-4249-b085-553ab456d52d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:55.153306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5522dd4-27ac-4249-b085-553ab456d52d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:55.163064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5522dd4-27ac-4249-b085-553ab456d52d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:55.166424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5522dd4-27ac-4249-b085-553ab456d52d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:55.169720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5522dd4-27ac-4249-b085-553ab456d52d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:55.170810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5522dd4-27ac-4249-b085-553ab456d52d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:55.217628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:55.218520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:55.232927 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5522dd4-27ac-4249-b085-553ab456d52d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.088399 Dec 18 21:09:55.233990 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2800/5561] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:09:55 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:55.244975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:55.248067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:55.252301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:55.254383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:55.759705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4cda4127-f75f-4b3f-af13-af584242e9a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:55.761252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4cda4127-f75f-4b3f-af13-af584242e9a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:55.780645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cda4127-f75f-4b3f-af13-af584242e9a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:55.781155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cda4127-f75f-4b3f-af13-af584242e9a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:55.782182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cda4127-f75f-4b3f-af13-af584242e9a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:55.782600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cda4127-f75f-4b3f-af13-af584242e9a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:55.905300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:55.922036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-401c0830-5a68-4950-88f2-723c6fb63b53 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1375 microversion: 2.1 time: 0.708934 Dec 18 21:09:55.935970 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2762/5562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:55 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1375 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:55.966842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4cda4127-f75f-4b3f-af13-af584242e9a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 7754 microversion: 2.1 time: 0.220095 Dec 18 21:09:55.971470 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2801/5563] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:55 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 7754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:55.991508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-35a5345e-83ee-4453-8d38-505417be23f7 req-fc14a70b-2593-4f19-b987-d163480e9b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceaaab41-fbd2-47ed-b72a-90caaa32d9c7", "name": "network-vif-plugged", "status": "completed", "tag": "913b3bf1-d339-48ab-8f6f-9bdc6158dd92"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:55.994377 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:09:55.994377 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:09:56.015472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-35a5345e-83ee-4453-8d38-505417be23f7 req-fc14a70b-2593-4f19-b987-d163480e9b03 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:56.015961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-35a5345e-83ee-4453-8d38-505417be23f7 req-fc14a70b-2593-4f19-b987-d163480e9b03 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:56.036371 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-35a5345e-83ee-4453-8d38-505417be23f7 req-fc14a70b-2593-4f19-b987-d163480e9b03 service nova] Creating event network-vif-plugged:913b3bf1-d339-48ab-8f6f-9bdc6158dd92 for instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 on nch2-master-1 Dec 18 21:09:56.052036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-35a5345e-83ee-4453-8d38-505417be23f7 req-fc14a70b-2593-4f19-b987-d163480e9b03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065451 Dec 18 21:09:56.052665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2763/5564] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:09:56.231970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-705109219", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "50351f84-6aa6-4168-a1c5-734a5dfac7c6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1539721925", "security_groups": [{"name": "tempest-secgroup-smoke-131772408"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:56.247439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b50efb4c-0fc4-4911-a1f6-ebab451b5e2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:56.248724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b50efb4c-0fc4-4911-a1f6-ebab451b5e2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:56.267875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50efb4c-0fc4-4911-a1f6-ebab451b5e2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:56.268767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50efb4c-0fc4-4911-a1f6-ebab451b5e2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:56.271303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50efb4c-0fc4-4911-a1f6-ebab451b5e2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:56.272274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b50efb4c-0fc4-4911-a1f6-ebab451b5e2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:56.363164 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b50efb4c-0fc4-4911-a1f6-ebab451b5e2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.119538 Dec 18 21:09:56.365022 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2764/5565] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:09:56 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:56.441686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] validate_networks() for [('50351f84-6aa6-4168-a1c5-734a5dfac7c6', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:09:56.941726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:56.943094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:56.950905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:56.951189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:56.952783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:56.953467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.486360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:09:57.486981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:09:57.487564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:09:57.488073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:09:57.489156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:09:57.516673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.517516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.521843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.522819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.574776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:09:57.586689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:09:57.589278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:57.605904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:09:57.607417 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3efb4bf5-927b-4b50-a9cb-325b13e33463 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1375 microversion: 2.1 time: 0.670197 Dec 18 21:09:57.609010 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2765/5566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:56 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1375 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:09:57.609439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:09:57.624711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0812cf0-6d4a-439d-a8d6-c6c67698c64e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:57.625882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0812cf0-6d4a-439d-a8d6-c6c67698c64e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:57.636256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0812cf0-6d4a-439d-a8d6-c6c67698c64e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.637150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0812cf0-6d4a-439d-a8d6-c6c67698c64e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.639456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0812cf0-6d4a-439d-a8d6-c6c67698c64e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.645721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0812cf0-6d4a-439d-a8d6-c6c67698c64e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.673057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dcf3fcd2-6e6e-4968-b115-6c6303699a61 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.445598 Dec 18 21:09:57.675102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2802/5567] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:09:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:09:57.681418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cc891f07-ed96-4e47-a9c4-90d04b063162 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:57.682813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cc891f07-ed96-4e47-a9c4-90d04b063162 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:57.706435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc891f07-ed96-4e47-a9c4-90d04b063162 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.706962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc891f07-ed96-4e47-a9c4-90d04b063162 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.708040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc891f07-ed96-4e47-a9c4-90d04b063162 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.708816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc891f07-ed96-4e47-a9c4-90d04b063162 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.725599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0812cf0-6d4a-439d-a8d6-c6c67698c64e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 15947 microversion: 2.1 time: 0.114794 Dec 18 21:09:57.730899 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2766/5568] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:57 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 15947 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:09:57.741575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:57.744594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:57.792401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.794526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.797095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cc891f07-ed96-4e47-a9c4-90d04b063162 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.119997 Dec 18 21:09:57.798697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:57.799512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:57.801014 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2803/5569] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:09:57 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:57.810707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c98f3d3-5b0a-4462-8cba-e4942fdaad1c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:57.811688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c98f3d3-5b0a-4462-8cba-e4942fdaad1c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:57.898781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:09:57.934934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1c98f3d3-5b0a-4462-8cba-e4942fdaad1c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:57.946217 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c98f3d3-5b0a-4462-8cba-e4942fdaad1c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1266 microversion: 2.1 time: 0.140464 Dec 18 21:09:57.956701 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2804/5570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:57 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:58.035989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ae61526-ed3f-40a8-9bb9-00c43a48abcb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 204 len: 0 microversion: 2.42 time: 0.301268 Dec 18 21:09:58.036564 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2767/5571] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:09:57 2021] DELETE /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:09:58.045621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:58.046240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:58.068754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.069510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.070505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.071053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.368717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:58.382413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:58.384452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:58.387177 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8b504673-0346-47b0-9710-d1acf3c202cc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2956 microversion: 2.42 time: 0.345296 Dec 18 21:09:58.387959 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2805/5572] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:58 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2956 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:09:58.630164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:58.631394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:58.652383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.653565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.659503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.659503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.738786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fd24f673-a698-41a1-973e-8e82efe56513 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:58.739754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fd24f673-a698-41a1-973e-8e82efe56513 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:58.748290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd24f673-a698-41a1-973e-8e82efe56513 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.748759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd24f673-a698-41a1-973e-8e82efe56513 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.749582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd24f673-a698-41a1-973e-8e82efe56513 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.750027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd24f673-a698-41a1-973e-8e82efe56513 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.824058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fd24f673-a698-41a1-973e-8e82efe56513 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 15947 microversion: 2.1 time: 0.088726 Dec 18 21:09:58.826426 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2806/5573] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:09:58 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 15947 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:09:58.833638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b0e33c2-596a-44f9-b0bf-2b9313c95d25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:09:58.835201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b0e33c2-596a-44f9-b0bf-2b9313c95d25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:58.848834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b0e33c2-596a-44f9-b0bf-2b9313c95d25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.849453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b0e33c2-596a-44f9-b0bf-2b9313c95d25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.850609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b0e33c2-596a-44f9-b0bf-2b9313c95d25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.851157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b0e33c2-596a-44f9-b0bf-2b9313c95d25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.907982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b0e33c2-596a-44f9-b0bf-2b9313c95d25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.079588 Dec 18 21:09:58.909820 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2807/5574] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:09:58 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:58.917864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:58.931827 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2f1268dd-8804-4aea-b53f-356db53f7074 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1563 microversion: 2.1 time: 0.308658 Dec 18 21:09:58.932939 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2768/5575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:58 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1563 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:58.950913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:58.951623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:58.960185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.961056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.962052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.962566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.967870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:58.968889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:58.984998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.985586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:58.986673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:58.988053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:59.144515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:59.175528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95569f57-f1e6-4201-9fd0-95a57fcb6108 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1318 microversion: 2.1 time: 0.213387 Dec 18 21:09:59.197932 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2769/5576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:58 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:59.408937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:59.409757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:59.419256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:59.419928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:59.421118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:59.422717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:59.439279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:09:59.459296 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f824285a-ef1a-4741-8bd0-558d948bc20f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1563 microversion: 2.1 time: 0.514056 Dec 18 21:09:59.480727 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2808/5577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:58 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1563 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:09:59.572766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:59.574040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:59.590030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:59.590960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:59.592581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:59.593424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:59.636973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:09:59.805864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af41f371-6ee2-4dcd-8c7c-2a87f773d4c3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 204 len: 0 microversion: 2.1 time: 0.239293 Dec 18 21:09:59.810601 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2809/5578] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:09:59 2021] DELETE /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:09:59.817800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:09:59.819056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:09:59.826898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:59.832766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:09:59.840930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:09:59.841683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:00.396705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:00.410636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:00.412114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:00.414310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:00.426643 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c33d8946-1a35-471c-aae5-6530e6df6f07 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1569 microversion: 2.1 time: 0.613376 Dec 18 21:10:00.428250 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d021d9b5-acdb-4a1b-aa35-f4c2f04e46fb tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2956 microversion: 2.42 time: 1.023829 Dec 18 21:10:00.430277 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2810/5579] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:09:59 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1569 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:00.445453 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2770/5580] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:09:59 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2956 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:10:00.451772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ecada97-9eb7-4626-81f9-f078992f666c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:00.453105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67d653e5-97da-4503-85c1-f56aa9631205 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:00.453421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ecada97-9eb7-4626-81f9-f078992f666c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:00.456872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-67d653e5-97da-4503-85c1-f56aa9631205 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:00.469103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ecada97-9eb7-4626-81f9-f078992f666c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:00.470064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ecada97-9eb7-4626-81f9-f078992f666c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:00.471294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ecada97-9eb7-4626-81f9-f078992f666c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:00.471956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ecada97-9eb7-4626-81f9-f078992f666c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:00.474864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d653e5-97da-4503-85c1-f56aa9631205 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:00.475669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d653e5-97da-4503-85c1-f56aa9631205 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:00.476617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d653e5-97da-4503-85c1-f56aa9631205 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:00.477127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67d653e5-97da-4503-85c1-f56aa9631205 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:00.528106 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ecada97-9eb7-4626-81f9-f078992f666c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 14 microversion: 2.20 time: 0.080168 Dec 18 21:10:00.529281 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2771/5581] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:00 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:00.537477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:00.538503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:00.549054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:00.550770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:00.557995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:00.558983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:00.588894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67d653e5-97da-4503-85c1-f56aa9631205 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 15947 microversion: 2.1 time: 0.149256 Dec 18 21:10:00.590695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2811/5582] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:00 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 15947 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:00.756899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:00.773803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-642eebc5-a95a-42d2-bbe5-36fa11acceab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1324 microversion: 2.1 time: 0.242726 Dec 18 21:10:00.775211 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2772/5583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:00 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:01.451149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:01.452476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:01.459897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:01.460714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:01.463359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:01.464526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:01.465654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:01.466439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:01.476232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:01.477037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:01.478749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:01.481441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.230952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:02.244705 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cb514a90-261c-4247-97dd-b95df2096c78 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 200 len: 1569 microversion: 2.1 time: 0.800599 Dec 18 21:10:02.245358 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2812/5584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:01 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 1569 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:02.260351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0e0eedc-1e9c-4c50-bc2f-551e6da4cc6c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:02.261286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0e0eedc-1e9c-4c50-bc2f-551e6da4cc6c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:02.281524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0e0eedc-1e9c-4c50-bc2f-551e6da4cc6c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:02.281909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0e0eedc-1e9c-4c50-bc2f-551e6da4cc6c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.287338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0e0eedc-1e9c-4c50-bc2f-551e6da4cc6c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:02.288050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0e0eedc-1e9c-4c50-bc2f-551e6da4cc6c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.383911 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0e0eedc-1e9c-4c50-bc2f-551e6da4cc6c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 16396 microversion: 2.20 time: 0.127359 Dec 18 21:10:02.385216 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2813/5585] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:02 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 16396 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:02.391606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-766248f6-1ab7-4d8f-9e0c-69b976e4bfbc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:02.393099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-766248f6-1ab7-4d8f-9e0c-69b976e4bfbc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:02.401569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766248f6-1ab7-4d8f-9e0c-69b976e4bfbc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:02.403245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766248f6-1ab7-4d8f-9e0c-69b976e4bfbc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.404391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766248f6-1ab7-4d8f-9e0c-69b976e4bfbc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:02.405243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-766248f6-1ab7-4d8f-9e0c-69b976e4bfbc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.453777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:02.464674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:02.466346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:02.467520 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-766248f6-1ab7-4d8f-9e0c-69b976e4bfbc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.080608 Dec 18 21:10:02.467936 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee8b7251-e046-40f1-b547-55a25d1e89cd tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2935 microversion: 2.42 time: 1.017902 Dec 18 21:10:02.469212 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2814/5586] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:02 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:02.475461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:02.476614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:02.478645 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2773/5587] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:01 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2935 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:10:02.485925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-62e8416b-95d6-4444-bc54-429985c65d38 req-712bd177-ab44-4e5d-a86a-c34b5a2bc5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceaaab41-fbd2-47ed-b72a-90caaa32d9c7", "name": "network-vif-deleted", "tag": "913b3bf1-d339-48ab-8f6f-9bdc6158dd92"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:02.486427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:02.486910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.487881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:02.488424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.488572 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:02.488572 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:02.497088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-62e8416b-95d6-4444-bc54-429985c65d38 req-712bd177-ab44-4e5d-a86a-c34b5a2bc5c2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:02.497556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-62e8416b-95d6-4444-bc54-429985c65d38 req-712bd177-ab44-4e5d-a86a-c34b5a2bc5c2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:02.510720 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-62e8416b-95d6-4444-bc54-429985c65d38 req-712bd177-ab44-4e5d-a86a-c34b5a2bc5c2 service nova] Creating event network-vif-deleted:913b3bf1-d339-48ab-8f6f-9bdc6158dd92 for instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 on nch2-master-1 Dec 18 21:10:02.518791 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-62e8416b-95d6-4444-bc54-429985c65d38 req-712bd177-ab44-4e5d-a86a-c34b5a2bc5c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037950 Dec 18 21:10:02.520229 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2774/5588] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:03.263649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:03.264791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:03.275821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.276401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.277479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.277985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.301729 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 could not be found. Dec 18 21:10:03.302888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:03.304175 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6ee97892-20f9-4817-8f99-5024fa4319e2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 404 len: 111 microversion: 2.1 time: 0.046243 Dec 18 21:10:03.308716 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2775/5589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:03 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:10:03.396645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66af8baf-258e-4c2e-b189-9b22ee6658b0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:03.397949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66af8baf-258e-4c2e-b189-9b22ee6658b0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:03.407007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66af8baf-258e-4c2e-b189-9b22ee6658b0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.407474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66af8baf-258e-4c2e-b189-9b22ee6658b0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.408498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66af8baf-258e-4c2e-b189-9b22ee6658b0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.409125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66af8baf-258e-4c2e-b189-9b22ee6658b0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.473219 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66af8baf-258e-4c2e-b189-9b22ee6658b0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 16396 microversion: 2.20 time: 0.080551 Dec 18 21:10:03.479321 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2776/5590] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:03 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 16396 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:03.487836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86d7de6d-6783-472c-bce9-5dc47f6b8094 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:03.489103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86d7de6d-6783-472c-bce9-5dc47f6b8094 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:03.497463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d7de6d-6783-472c-bce9-5dc47f6b8094 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.499565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d7de6d-6783-472c-bce9-5dc47f6b8094 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.500593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d7de6d-6783-472c-bce9-5dc47f6b8094 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.502802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86d7de6d-6783-472c-bce9-5dc47f6b8094 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.567407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:03.567951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86d7de6d-6783-472c-bce9-5dc47f6b8094 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.086324 Dec 18 21:10:03.568297 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2777/5591] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:03 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:03.579666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:03.580657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:03.594785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.597442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.598797 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac763d29-1e8e-4369-b604-e2c8de5954e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 1.127739 Dec 18 21:10:03.599869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.600246 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2815/5592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:02 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:03.600705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.604999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-58307dad-0b78-4017-b5db-d656a259a38d req-cb8a2702-bb9e-4a99-93fb-0fc27875b8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-unplugged", "status": "completed", "tag": "1dc7a401-6ed9-4aec-ba52-1af54a484d85"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:03.607628 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:03.607628 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:10:03.616447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-58307dad-0b78-4017-b5db-d656a259a38d req-cb8a2702-bb9e-4a99-93fb-0fc27875b8c2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:03.617707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-58307dad-0b78-4017-b5db-d656a259a38d req-cb8a2702-bb9e-4a99-93fb-0fc27875b8c2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:03.651274 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-58307dad-0b78-4017-b5db-d656a259a38d req-cb8a2702-bb9e-4a99-93fb-0fc27875b8c2 service nova] Creating event network-vif-unplugged:1dc7a401-6ed9-4aec-ba52-1af54a484d85 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:03.662274 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-58307dad-0b78-4017-b5db-d656a259a38d req-cb8a2702-bb9e-4a99-93fb-0fc27875b8c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056441 Dec 18 21:10:03.663507 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2816/5593] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:04.266528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:04.297609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:04.299511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:04.301050 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0579f03f-8a82-4054-8750-7b213f40d58b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2914 microversion: 2.42 time: 0.730006 Dec 18 21:10:04.315244 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2778/5594] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:03 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2914 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:10:04.487644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ebd6834d-1ca3-48c7-8514-c787a12dd30d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:04.489241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ebd6834d-1ca3-48c7-8514-c787a12dd30d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:04.501206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebd6834d-1ca3-48c7-8514-c787a12dd30d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:04.503693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebd6834d-1ca3-48c7-8514-c787a12dd30d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:04.504798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebd6834d-1ca3-48c7-8514-c787a12dd30d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:04.505414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebd6834d-1ca3-48c7-8514-c787a12dd30d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:04.566111 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ebd6834d-1ca3-48c7-8514-c787a12dd30d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 16396 microversion: 2.20 time: 0.082440 Dec 18 21:10:04.568335 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2817/5595] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:04 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 16396 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:04.588371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-800c76ff-eac5-4e19-9162-cbed7cbb38b7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:04.590340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-800c76ff-eac5-4e19-9162-cbed7cbb38b7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:04.608314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-800c76ff-eac5-4e19-9162-cbed7cbb38b7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:04.609257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-800c76ff-eac5-4e19-9162-cbed7cbb38b7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:04.610554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-800c76ff-eac5-4e19-9162-cbed7cbb38b7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:04.611248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-800c76ff-eac5-4e19-9162-cbed7cbb38b7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:04.617488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:04.620008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:04.639660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:04.640134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:04.640969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:04.641422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:04.669443 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-800c76ff-eac5-4e19-9162-cbed7cbb38b7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.091510 Dec 18 21:10:04.671591 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2779/5596] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:04 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:04.831091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-10440998-0e1c-4e44-bc7e-33cf3aee7b48 req-1eec6a7d-42b5-4b3a-aeae-bb2b14b39901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:04.834467 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:04.834467 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:04.847834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-10440998-0e1c-4e44-bc7e-33cf3aee7b48 req-1eec6a7d-42b5-4b3a-aeae-bb2b14b39901 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:04.848705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-10440998-0e1c-4e44-bc7e-33cf3aee7b48 req-1eec6a7d-42b5-4b3a-aeae-bb2b14b39901 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:04.879802 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-10440998-0e1c-4e44-bc7e-33cf3aee7b48 req-1eec6a7d-42b5-4b3a-aeae-bb2b14b39901 service nova] Creating event network-changed:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch1-master-1 Dec 18 21:10:04.888964 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-10440998-0e1c-4e44-bc7e-33cf3aee7b48 req-1eec6a7d-42b5-4b3a-aeae-bb2b14b39901 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063915 Dec 18 21:10:04.890278 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2780/5597] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:10:05.322785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:05.323502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:05.330688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:05.331434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:05.332499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:05.339594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:05.394217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:05.404850 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b8d7f01-d8be-4d61-bad9-09d8618cc19b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.791950 Dec 18 21:10:05.408174 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2818/5598] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:04 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:05.580608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4020bb7-8c52-4015-adb5-f532551b8c28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:05.582957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4020bb7-8c52-4015-adb5-f532551b8c28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:05.594458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4020bb7-8c52-4015-adb5-f532551b8c28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:05.595285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4020bb7-8c52-4015-adb5-f532551b8c28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:05.597739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4020bb7-8c52-4015-adb5-f532551b8c28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:05.598692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4020bb7-8c52-4015-adb5-f532551b8c28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:05.649598 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4020bb7-8c52-4015-adb5-f532551b8c28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 16396 microversion: 2.20 time: 0.072945 Dec 18 21:10:05.650338 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2819/5599] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:05 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 16396 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:05.684236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b96afc0-7b6f-4e07-8620-8014730749e2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:05.685393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9b96afc0-7b6f-4e07-8620-8014730749e2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:05.693482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b96afc0-7b6f-4e07-8620-8014730749e2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:05.693946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b96afc0-7b6f-4e07-8620-8014730749e2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:05.694901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b96afc0-7b6f-4e07-8620-8014730749e2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:05.696023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b96afc0-7b6f-4e07-8620-8014730749e2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:05.740905 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b96afc0-7b6f-4e07-8620-8014730749e2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.061669 Dec 18 21:10:05.745914 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2820/5600] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:05 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:05.748544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-unplugged", "status": "completed", "tag": "f1860d8e-c101-497b-93b4-18753b0bd5c6"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-unplugged", "status": "completed", "tag": "59526aeb-f155-46bf-ba7e-15d8467624a2"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-unplugged", "status": "completed", "tag": "1f477167-6d29-4a5d-a26d-96bb2271bada"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-unplugged", "status": "completed", "tag": "340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:05.750425 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:05.750425 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:10:05.758470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:05.759885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:05.772026 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] Creating event network-vif-unplugged:f1860d8e-c101-497b-93b4-18753b0bd5c6 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:05.772200 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] Creating event network-vif-unplugged:59526aeb-f155-46bf-ba7e-15d8467624a2 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:05.772663 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] Creating event network-vif-unplugged:1f477167-6d29-4a5d-a26d-96bb2271bada for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:05.773144 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] Creating event network-vif-unplugged:340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:05.778808 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-9f48e73a-638a-4e13-b592-5361c8117adb req-f7ae5d60-ba09-410a-b3ad-6de92e777e37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.034158 Dec 18 21:10:05.779417 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2821/5601] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:05 2021] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:05.908091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:05.919038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:05.920565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:05.921854 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6319b7b3-9d8f-4ac8-a239-59fd06e25128 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2868 microversion: 2.42 time: 0.603833 Dec 18 21:10:05.922800 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2781/5602] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:05 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2868 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:10:06.425089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:06.427051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:06.435046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.436177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.437115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.437568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.664593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0656309f-c5c9-4dad-8666-1259eddf82f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:06.667086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0656309f-c5c9-4dad-8666-1259eddf82f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:06.680377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0656309f-c5c9-4dad-8666-1259eddf82f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.680902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0656309f-c5c9-4dad-8666-1259eddf82f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.682383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0656309f-c5c9-4dad-8666-1259eddf82f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.683130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0656309f-c5c9-4dad-8666-1259eddf82f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.728789 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0656309f-c5c9-4dad-8666-1259eddf82f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 16396 microversion: 2.20 time: 0.070747 Dec 18 21:10:06.729596 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2782/5603] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:06 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 16396 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:06.753641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-164406b1-31ab-449f-bdf3-5a0f649af91e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:06.754617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-164406b1-31ab-449f-bdf3-5a0f649af91e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:06.762099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-164406b1-31ab-449f-bdf3-5a0f649af91e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.762593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-164406b1-31ab-449f-bdf3-5a0f649af91e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.763407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-164406b1-31ab-449f-bdf3-5a0f649af91e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.763994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-164406b1-31ab-449f-bdf3-5a0f649af91e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.806654 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-164406b1-31ab-449f-bdf3-5a0f649af91e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.057014 Dec 18 21:10:06.807618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2783/5604] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:06 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:06.826159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:06.834004 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3dcc0f53-ef9a-456a-af4a-7ad4aa564e06 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.414247 Dec 18 21:10:06.834733 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2822/5605] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:06 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:06.931010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-82ff6df5-ab7a-47c3-9269-fd7e11ffda46 req-12d6d5b9-84e0-411f-af45-5993272b5f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-deleted", "tag": "1dc7a401-6ed9-4aec-ba52-1af54a484d85"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:06.932852 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:06.932852 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:06.941863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-82ff6df5-ab7a-47c3-9269-fd7e11ffda46 req-12d6d5b9-84e0-411f-af45-5993272b5f48 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.942707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-82ff6df5-ab7a-47c3-9269-fd7e11ffda46 req-12d6d5b9-84e0-411f-af45-5993272b5f48 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.943784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:06.944401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:06.951536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.952091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.952770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:06.953207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:06.964070 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-82ff6df5-ab7a-47c3-9269-fd7e11ffda46 req-12d6d5b9-84e0-411f-af45-5993272b5f48 service nova] Creating event network-vif-deleted:1dc7a401-6ed9-4aec-ba52-1af54a484d85 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:06.973716 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-82ff6df5-ab7a-47c3-9269-fd7e11ffda46 req-12d6d5b9-84e0-411f-af45-5993272b5f48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046459 Dec 18 21:10:06.975258 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2784/5606] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:07.375464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:07.391492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:07.393260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:07.394816 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21be0540-3521-45de-b352-a0318dd6ca54 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2822 microversion: 2.42 time: 0.455184 Dec 18 21:10:07.396050 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2823/5607] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:06 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2822 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:10:07.746553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2535e5a9-e9cd-4c20-89fc-7cb86a1eaf2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:07.747976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2535e5a9-e9cd-4c20-89fc-7cb86a1eaf2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:07.755543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2535e5a9-e9cd-4c20-89fc-7cb86a1eaf2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:07.756195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2535e5a9-e9cd-4c20-89fc-7cb86a1eaf2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:07.757202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2535e5a9-e9cd-4c20-89fc-7cb86a1eaf2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:07.757645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2535e5a9-e9cd-4c20-89fc-7cb86a1eaf2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:07.814072 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2535e5a9-e9cd-4c20-89fc-7cb86a1eaf2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.073957 Dec 18 21:10:07.815528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2785/5608] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:07 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:07.819147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e684970-bd7b-447c-9ace-c790c701c937 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:07.820337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e684970-bd7b-447c-9ace-c790c701c937 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:07.829431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e684970-bd7b-447c-9ace-c790c701c937 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:07.830076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e684970-bd7b-447c-9ace-c790c701c937 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:07.834356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e684970-bd7b-447c-9ace-c790c701c937 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:07.834723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e684970-bd7b-447c-9ace-c790c701c937 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:07.864183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:07.864905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:07.881242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:07.881993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:07.883789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:07.885258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:07.932321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e684970-bd7b-447c-9ace-c790c701c937 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.117456 Dec 18 21:10:07.937200 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2824/5609] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:07 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:08.232608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:08.252175 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9099cd80-e481-4bdf-aa85-da07db7adf57 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.402018 Dec 18 21:10:08.261941 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2786/5610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:07 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:08.418138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:08.418864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:08.429781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:08.430510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:08.431497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:08.432154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:08.826898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d83ae5b-86dd-4274-b427-47f413918b40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:08.827841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2d83ae5b-86dd-4274-b427-47f413918b40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:08.840104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d83ae5b-86dd-4274-b427-47f413918b40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:08.840592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d83ae5b-86dd-4274-b427-47f413918b40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:08.841442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d83ae5b-86dd-4274-b427-47f413918b40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:08.841896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d83ae5b-86dd-4274-b427-47f413918b40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:08.930218 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d83ae5b-86dd-4274-b427-47f413918b40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.105369 Dec 18 21:10:08.935573 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2787/5611] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:08 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:08.961385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b64d870-530c-418c-a50e-2cf39769ade9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:08.964160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b64d870-530c-418c-a50e-2cf39769ade9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:08.982364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b64d870-530c-418c-a50e-2cf39769ade9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:08.983560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b64d870-530c-418c-a50e-2cf39769ade9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:08.984866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b64d870-530c-418c-a50e-2cf39769ade9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:08.985593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b64d870-530c-418c-a50e-2cf39769ade9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:09.024759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:09.049883 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b64d870-530c-418c-a50e-2cf39769ade9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.106680 Dec 18 21:10:09.050969 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2788/5612] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:08 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:09.056259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:09.057894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:09.066027 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-937f6195-470c-44f6-b8f7-b20aa3920bc4 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2662 microversion: 2.42 time: 0.652389 Dec 18 21:10:09.067401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-0efb711b-281f-4840-a6bf-497355d38174 req-28a9c84d-6967-4221-b77c-45dc1befba8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-deleted", "tag": "340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3"}, {"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-deleted", "tag": "1f477167-6d29-4a5d-a26d-96bb2271bada"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:09.071474 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:09.071474 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:09.079316 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2825/5613] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:08 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2662 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:10:09.088093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0efb711b-281f-4840-a6bf-497355d38174 req-28a9c84d-6967-4221-b77c-45dc1befba8a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:09.088563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0efb711b-281f-4840-a6bf-497355d38174 req-28a9c84d-6967-4221-b77c-45dc1befba8a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:09.106447 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-0efb711b-281f-4840-a6bf-497355d38174 req-28a9c84d-6967-4221-b77c-45dc1befba8a service nova] Creating event network-vif-deleted:340e6be6-1fef-4dd8-be5e-b48f2c8f9ee3 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:09.106997 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-0efb711b-281f-4840-a6bf-497355d38174 req-28a9c84d-6967-4221-b77c-45dc1befba8a service nova] Creating event network-vif-deleted:1f477167-6d29-4a5d-a26d-96bb2271bada for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:09.114441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-0efb711b-281f-4840-a6bf-497355d38174 req-28a9c84d-6967-4221-b77c-45dc1befba8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060279 Dec 18 21:10:09.116612 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2789/5614] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:09 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:09.269388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:09.270189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:09.287965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:09.289390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:09.291656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:09.295600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:09.626683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:09.637015 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0801fdfd-ed6d-480c-abf6-a508a0a5f6f8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.371778 Dec 18 21:10:09.650218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2826/5615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:09 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:09.949089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f411ed34-3982-4db8-b0c6-b5165e64961e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:09.951912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f411ed34-3982-4db8-b0c6-b5165e64961e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:09.965877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f411ed34-3982-4db8-b0c6-b5165e64961e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:09.979274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f411ed34-3982-4db8-b0c6-b5165e64961e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:09.980628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f411ed34-3982-4db8-b0c6-b5165e64961e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:10.002183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f411ed34-3982-4db8-b0c6-b5165e64961e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:10.062756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-815a2b83-5f0d-4b5c-93c8-53baf3ff397a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:10.063706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-815a2b83-5f0d-4b5c-93c8-53baf3ff397a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:10.075847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815a2b83-5f0d-4b5c-93c8-53baf3ff397a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:10.078784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815a2b83-5f0d-4b5c-93c8-53baf3ff397a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:10.080541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815a2b83-5f0d-4b5c-93c8-53baf3ff397a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:10.085646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-815a2b83-5f0d-4b5c-93c8-53baf3ff397a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:10.093260 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f411ed34-3982-4db8-b0c6-b5165e64961e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.148774 Dec 18 21:10:10.107414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2790/5616] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:09 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:10.113835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:10.114761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:10.129268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:10.130052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:10.132384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:10.135420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:10.152891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-815a2b83-5f0d-4b5c-93c8-53baf3ff397a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.093830 Dec 18 21:10:10.153975 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2827/5617] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:10 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:10.654934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:10.655643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:10.668307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:10.670757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:10.672230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:10.672951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:11.040809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:11.051059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:11.055111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:11.059383 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-efb41e48-fa0c-4121-bedb-01e5305b8139 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 2344 microversion: 2.42 time: 0.947526 Dec 18 21:10:11.060564 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2791/5618] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:10 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 2344 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:10:11.113928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d8984225-0b66-4753-9f0e-9e762c3cb32a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:11.115174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d8984225-0b66-4753-9f0e-9e762c3cb32a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:11.125401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:11.140829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70dc721d-6c50-4a91-aa0c-4c4ef81ef755 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.489751 Dec 18 21:10:11.143978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8984225-0b66-4753-9f0e-9e762c3cb32a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:11.145145 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2828/5619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:10 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:11.146174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8984225-0b66-4753-9f0e-9e762c3cb32a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:11.147124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8984225-0b66-4753-9f0e-9e762c3cb32a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:11.151808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8984225-0b66-4753-9f0e-9e762c3cb32a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:11.165518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-543fc061-61bd-4585-8d1d-4330d54ae7ee req-c7b12784-4f9d-443e-bcc9-59168b86fc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-deleted", "tag": "f1860d8e-c101-497b-93b4-18753b0bd5c6"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:11.167278 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:11.167278 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:10:11.190331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-543fc061-61bd-4585-8d1d-4330d54ae7ee req-c7b12784-4f9d-443e-bcc9-59168b86fc1d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:11.190798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-543fc061-61bd-4585-8d1d-4330d54ae7ee req-c7b12784-4f9d-443e-bcc9-59168b86fc1d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:11.225915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-543fc061-61bd-4585-8d1d-4330d54ae7ee req-c7b12784-4f9d-443e-bcc9-59168b86fc1d service nova] Creating event network-vif-deleted:f1860d8e-c101-497b-93b4-18753b0bd5c6 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:11.237125 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-543fc061-61bd-4585-8d1d-4330d54ae7ee req-c7b12784-4f9d-443e-bcc9-59168b86fc1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090909 Dec 18 21:10:11.237830 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d8984225-0b66-4753-9f0e-9e762c3cb32a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.127343 Dec 18 21:10:11.238232 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2829/5620] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:11.252089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48199f9b-9bdf-48d4-814f-8237c6e778e6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:11.254928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48199f9b-9bdf-48d4-814f-8237c6e778e6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:11.265836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48199f9b-9bdf-48d4-814f-8237c6e778e6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:11.266974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48199f9b-9bdf-48d4-814f-8237c6e778e6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:11.268098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48199f9b-9bdf-48d4-814f-8237c6e778e6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:11.268835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48199f9b-9bdf-48d4-814f-8237c6e778e6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:11.271232 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2792/5621] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:11 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:11.343042 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48199f9b-9bdf-48d4-814f-8237c6e778e6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.101727 Dec 18 21:10:11.343966 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2830/5622] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:11 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:12.083608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:12.085359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:12.095228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.095901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.097142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.098274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.147188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.147636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.148109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lazy-loading 'fault' on Instance uuid b4f6c651-66b5-429c-8db2-13f49236ec82 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:10:12.163213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:12.164011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:12.172326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.172792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.173900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.174379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.211293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:12.223009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:12.224557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e80a2e31964348e7b4abd7c321e713b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fc19b054a54a08aec65b0870725eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:12.225844 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-306f9c2b-2910-4bfd-906b-ad516ae769ef tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 200 len: 1609 microversion: 2.42 time: 0.148628 Dec 18 21:10:12.226606 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2793/5623] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:12 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 1609 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:10:12.310579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-84c94b91-47b9-4f53-a06b-174aa2852a05 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:12.311963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-84c94b91-47b9-4f53-a06b-174aa2852a05 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:12.323796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84c94b91-47b9-4f53-a06b-174aa2852a05 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.324717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84c94b91-47b9-4f53-a06b-174aa2852a05 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.326755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84c94b91-47b9-4f53-a06b-174aa2852a05 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.328443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84c94b91-47b9-4f53-a06b-174aa2852a05 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.420051 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-84c94b91-47b9-4f53-a06b-174aa2852a05 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.141468 Dec 18 21:10:12.421143 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2794/5624] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:12 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:12.436776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-734cd766-845a-466e-9c55-32c2fa3bc220 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:12.439429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-734cd766-845a-466e-9c55-32c2fa3bc220 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:12.444486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:12.458048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734cd766-845a-466e-9c55-32c2fa3bc220 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.458583 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31ce0932-0684-47bf-a08d-51318821030f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.297626 Dec 18 21:10:12.459145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734cd766-845a-466e-9c55-32c2fa3bc220 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.460212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734cd766-845a-466e-9c55-32c2fa3bc220 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:12.460938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-734cd766-845a-466e-9c55-32c2fa3bc220 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:12.464173 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2831/5625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:12 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:12.556168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-734cd766-845a-466e-9c55-32c2fa3bc220 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 24126 microversion: 2.1 time: 0.131742 Dec 18 21:10:12.557682 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2795/5626] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:12 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 24126 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:13.248347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:13.250393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:13.265509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-5074a461-94b7-453b-bd8c-9c09d6551156 req-c902b13f-c9c7-4741-aa27-027c3fca1926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f6c651-66b5-429c-8db2-13f49236ec82", "name": "network-vif-deleted", "tag": "59526aeb-f155-46bf-ba7e-15d8467624a2"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:13.267132 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:13.267132 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:13.272828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.275838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.283895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.285342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.290403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5074a461-94b7-453b-bd8c-9c09d6551156 req-c902b13f-c9c7-4741-aa27-027c3fca1926 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.291512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5074a461-94b7-453b-bd8c-9c09d6551156 req-c902b13f-c9c7-4741-aa27-027c3fca1926 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.311639 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] HTTP exception thrown: Instance b4f6c651-66b5-429c-8db2-13f49236ec82 could not be found. Dec 18 21:10:13.313106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Returning 404 to user: Instance b4f6c651-66b5-429c-8db2-13f49236ec82 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:13.314183 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-5074a461-94b7-453b-bd8c-9c09d6551156 req-c902b13f-c9c7-4741-aa27-027c3fca1926 service nova] Creating event network-vif-deleted:59526aeb-f155-46bf-ba7e-15d8467624a2 for instance b4f6c651-66b5-429c-8db2-13f49236ec82 on nch2-master-1 Dec 18 21:10:13.318124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74dc7eda-f71c-46da-a8e2-e147de8c8971 tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 404 len: 111 microversion: 2.42 time: 0.076265 Dec 18 21:10:13.320481 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2832/5627] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:13 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:10:13.321442 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-5074a461-94b7-453b-bd8c-9c09d6551156 req-c902b13f-c9c7-4741-aa27-027c3fca1926 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061483 Dec 18 21:10:13.330794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbe173aa-4b5c-4aca-8fda-a7583161d5de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '.version_select at 0x7f714eedd8b0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:13.338561 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2796/5628] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:10:13.361032 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbe173aa-4b5c-4aca-8fda-a7583161d5de tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096132544" status: 204 len: 0 microversion: 2.42 time: 0.036528 Dec 18 21:10:13.363890 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2833/5629] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Dec 18 21:10:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096132544 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 18 21:10:13.436326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cab45056-3618-4431-b505-96633caa86bc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:13.437396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cab45056-3618-4431-b505-96633caa86bc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:13.455465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab45056-3618-4431-b505-96633caa86bc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.457098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab45056-3618-4431-b505-96633caa86bc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.458321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab45056-3618-4431-b505-96633caa86bc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.463028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab45056-3618-4431-b505-96633caa86bc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.479286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:13.480004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:13.493891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.497483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.500065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.501091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.551993 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cab45056-3618-4431-b505-96633caa86bc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.122942 Dec 18 21:10:13.555865 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2797/5630] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:13 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:13.571477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f593125a-c775-4369-a916-369ec9211542 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:13.572551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f593125a-c775-4369-a916-369ec9211542 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:13.594688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f593125a-c775-4369-a916-369ec9211542 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.595176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f593125a-c775-4369-a916-369ec9211542 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.599277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f593125a-c775-4369-a916-369ec9211542 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:13.599277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f593125a-c775-4369-a916-369ec9211542 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:13.702810 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f593125a-c775-4369-a916-369ec9211542 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.137870 Dec 18 21:10:13.703916 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2798/5631] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:13 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:13.860926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:13.881401 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-491108b2-d64a-4373-b6f5-fdb27daf9202 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.407561 Dec 18 21:10:13.884886 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2834/5632] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:13 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:14.117315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a91f9f36-b506-487f-b02c-9542f66b70f9 req-aa3efc36-a488-4185-bb35-2d1b39d5f28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "name": "network-vif-plugged", "status": "completed", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:14.120214 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:14.120214 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:14.139591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a91f9f36-b506-487f-b02c-9542f66b70f9 req-aa3efc36-a488-4185-bb35-2d1b39d5f28a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:14.141662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a91f9f36-b506-487f-b02c-9542f66b70f9 req-aa3efc36-a488-4185-bb35-2d1b39d5f28a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:14.174587 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a91f9f36-b506-487f-b02c-9542f66b70f9 req-aa3efc36-a488-4185-bb35-2d1b39d5f28a service nova] Creating event network-vif-plugged:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch1-master-1 Dec 18 21:10:14.184311 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a91f9f36-b506-487f-b02c-9542f66b70f9 req-aa3efc36-a488-4185-bb35-2d1b39d5f28a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076340 Dec 18 21:10:14.185193 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2799/5633] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:14.564866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-515f949b-37d5-4119-9157-c2e8fdea5050 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:14.566687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-515f949b-37d5-4119-9157-c2e8fdea5050 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:14.585098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-515f949b-37d5-4119-9157-c2e8fdea5050 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:14.588090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-515f949b-37d5-4119-9157-c2e8fdea5050 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:14.590582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-515f949b-37d5-4119-9157-c2e8fdea5050 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:14.592733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-515f949b-37d5-4119-9157-c2e8fdea5050 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:14.716904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92771058-40b0-4feb-8c2a-e5f386b414a3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:14.717858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92771058-40b0-4feb-8c2a-e5f386b414a3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:14.758132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92771058-40b0-4feb-8c2a-e5f386b414a3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:14.759455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92771058-40b0-4feb-8c2a-e5f386b414a3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:14.761770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92771058-40b0-4feb-8c2a-e5f386b414a3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:14.762951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92771058-40b0-4feb-8c2a-e5f386b414a3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:14.766895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-515f949b-37d5-4119-9157-c2e8fdea5050 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.206004 Dec 18 21:10:14.768013 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2835/5634] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:14 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:14.866543 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92771058-40b0-4feb-8c2a-e5f386b414a3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.153765 Dec 18 21:10:14.869726 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2800/5635] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:14 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:14.905172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:14.918335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:14.932258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:14.932958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:14.934054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:14.935074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:15.313800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:15.326965 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c6d08474-d2ad-4653-9d0b-a52934d168cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1391 microversion: 2.1 time: 0.430489 Dec 18 21:10:15.341724 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2836/5636] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:14 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:15.780573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d910a984-5c02-4f75-98f1-1cec1c0b15f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:15.781637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d910a984-5c02-4f75-98f1-1cec1c0b15f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:15.804542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d910a984-5c02-4f75-98f1-1cec1c0b15f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:15.806946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d910a984-5c02-4f75-98f1-1cec1c0b15f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:15.808133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d910a984-5c02-4f75-98f1-1cec1c0b15f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:15.810821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d910a984-5c02-4f75-98f1-1cec1c0b15f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:15.887789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78a513e1-f344-47d3-8c94-70cc3b50b63e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:15.889826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-78a513e1-f344-47d3-8c94-70cc3b50b63e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:15.904492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78a513e1-f344-47d3-8c94-70cc3b50b63e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:15.905280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78a513e1-f344-47d3-8c94-70cc3b50b63e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:15.906830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78a513e1-f344-47d3-8c94-70cc3b50b63e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:15.907495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78a513e1-f344-47d3-8c94-70cc3b50b63e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:15.908273 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d910a984-5c02-4f75-98f1-1cec1c0b15f0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.132236 Dec 18 21:10:15.911432 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2801/5637] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:15 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:16.008800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78a513e1-f344-47d3-8c94-70cc3b50b63e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.130262 Dec 18 21:10:16.010489 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2837/5638] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:15 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:16.346033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:16.347784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:16.373875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:16.374609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:16.377902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:16.380427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:16.925734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6f3601b-e29c-4a5e-9899-7a8e5c363a30 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:16.926880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6f3601b-e29c-4a5e-9899-7a8e5c363a30 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:16.949864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f3601b-e29c-4a5e-9899-7a8e5c363a30 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:16.951520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f3601b-e29c-4a5e-9899-7a8e5c363a30 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:16.952808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f3601b-e29c-4a5e-9899-7a8e5c363a30 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:16.953663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6f3601b-e29c-4a5e-9899-7a8e5c363a30 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:17.041603 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6f3601b-e29c-4a5e-9899-7a8e5c363a30 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.122330 Dec 18 21:10:17.047919 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2838/5639] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:16 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:17.055738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-681eff6b-c94d-437d-8120-c492e88ed037 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:17.058030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-681eff6b-c94d-437d-8120-c492e88ed037 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:17.070228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-681eff6b-c94d-437d-8120-c492e88ed037 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:17.071896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-681eff6b-c94d-437d-8120-c492e88ed037 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:17.072977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-681eff6b-c94d-437d-8120-c492e88ed037 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:17.073660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-681eff6b-c94d-437d-8120-c492e88ed037 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:17.126246 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-681eff6b-c94d-437d-8120-c492e88ed037 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.076079 Dec 18 21:10:17.127232 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2839/5640] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:17 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:17.218874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:17.232061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb7f3142-1218-4d0c-807d-4685edfca40c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1562 microversion: 2.1 time: 0.890051 Dec 18 21:10:17.233512 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2802/5641] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:16 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1562 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:17.252213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:17.253124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:17.264747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:17.270848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:17.271784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:17.274804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:17.805268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:17.821786 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fc122977-0a50-477a-bb85-cad88f4766db tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1562 microversion: 2.1 time: 0.575375 Dec 18 21:10:17.826570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2840/5642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:17 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1562 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:18.057512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8390b4da-e9a9-4a28-9a06-2e2efc759e7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:18.059524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8390b4da-e9a9-4a28-9a06-2e2efc759e7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:18.071665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8390b4da-e9a9-4a28-9a06-2e2efc759e7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:18.072848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8390b4da-e9a9-4a28-9a06-2e2efc759e7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:18.074834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8390b4da-e9a9-4a28-9a06-2e2efc759e7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:18.075991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8390b4da-e9a9-4a28-9a06-2e2efc759e7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:18.140208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75c5b912-26ac-49be-b155-00dd1292f71d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:18.141168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75c5b912-26ac-49be-b155-00dd1292f71d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:18.151261 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8390b4da-e9a9-4a28-9a06-2e2efc759e7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.097260 Dec 18 21:10:18.151620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c5b912-26ac-49be-b155-00dd1292f71d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:18.152077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c5b912-26ac-49be-b155-00dd1292f71d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:18.153125 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2803/5643] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:18 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:18.168579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c5b912-26ac-49be-b155-00dd1292f71d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:18.170006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c5b912-26ac-49be-b155-00dd1292f71d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:18.240775 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75c5b912-26ac-49be-b155-00dd1292f71d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.101814 Dec 18 21:10:18.241415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2841/5644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:18 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:19.174800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-611ac8b4-82b2-490c-96c2-c2e33c0799b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:19.185521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-611ac8b4-82b2-490c-96c2-c2e33c0799b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:19.203517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-611ac8b4-82b2-490c-96c2-c2e33c0799b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:19.204752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-611ac8b4-82b2-490c-96c2-c2e33c0799b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:19.205772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-611ac8b4-82b2-490c-96c2-c2e33c0799b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:19.206674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-611ac8b4-82b2-490c-96c2-c2e33c0799b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:19.255062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e52d411f-f6db-4536-ba1e-eb0aad3c6658 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:19.256832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e52d411f-f6db-4536-ba1e-eb0aad3c6658 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:19.270399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e52d411f-f6db-4536-ba1e-eb0aad3c6658 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:19.276932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e52d411f-f6db-4536-ba1e-eb0aad3c6658 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:19.277843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e52d411f-f6db-4536-ba1e-eb0aad3c6658 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:19.278550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e52d411f-f6db-4536-ba1e-eb0aad3c6658 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:19.287940 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-611ac8b4-82b2-490c-96c2-c2e33c0799b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.125248 Dec 18 21:10:19.293494 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2804/5645] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:19 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:19.354715 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e52d411f-f6db-4536-ba1e-eb0aad3c6658 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.103514 Dec 18 21:10:19.358685 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2842/5646] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:19 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:20.314155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-015edf32-672e-4d31-b336-5fc1943c3e46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:20.316163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-015edf32-672e-4d31-b336-5fc1943c3e46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:20.325516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-015edf32-672e-4d31-b336-5fc1943c3e46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.326418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-015edf32-672e-4d31-b336-5fc1943c3e46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.327494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-015edf32-672e-4d31-b336-5fc1943c3e46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.328100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-015edf32-672e-4d31-b336-5fc1943c3e46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.371595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-139e3818-2941-4b38-b5a5-a7d10062c54a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:20.373549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-139e3818-2941-4b38-b5a5-a7d10062c54a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:20.398036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139e3818-2941-4b38-b5a5-a7d10062c54a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.402390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139e3818-2941-4b38-b5a5-a7d10062c54a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.403469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139e3818-2941-4b38-b5a5-a7d10062c54a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.404406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-139e3818-2941-4b38-b5a5-a7d10062c54a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.438983 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-015edf32-672e-4d31-b336-5fc1943c3e46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.141161 Dec 18 21:10:20.442884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2805/5647] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:20 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:20.466959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:20.470135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:20.502585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.506122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-139e3818-2941-4b38-b5a5-a7d10062c54a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.141356 Dec 18 21:10:20.507679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.512293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.512971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.516409 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2843/5648] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:20 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:20.556290 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] HTTP exception thrown: Instance b4f6c651-66b5-429c-8db2-13f49236ec82 could not be found. Dec 18 21:10:20.557232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Returning 404 to user: Instance b4f6c651-66b5-429c-8db2-13f49236ec82 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:20.558750 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8934d8df-b95f-4bc3-8e76-12f4dbcdc4bc tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 404 len: 111 microversion: 2.42 time: 0.114343 Dec 18 21:10:20.559876 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2806/5649] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:10:20 2021] DELETE /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:10:20.571112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:20.572012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] [instance: b4f6c651-66b5-429c-8db2-13f49236ec82] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:20.582437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.583080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.584092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.584680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.606741 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] HTTP exception thrown: Instance b4f6c651-66b5-429c-8db2-13f49236ec82 could not be found. Dec 18 21:10:20.607356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] Returning 404 to user: Instance b4f6c651-66b5-429c-8db2-13f49236ec82 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:20.608570 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-db8fb2dc-2c2a-4071-a99f-d286ae28e14b tempest-TaggedBootDevicesTest_v242-1367484865 tempest-TaggedBootDevicesTest_v242-1367484865-project] 10.222.0.13 "GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82" status: 404 len: 111 microversion: 2.42 time: 0.044140 Dec 18 21:10:20.609241 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2844/5650] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:10:20 2021] GET /compute/v2.1/servers/b4f6c651-66b5-429c-8db2-13f49236ec82 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:10:20.898914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:20.899833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:20.909161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-146ed310-96c4-4394-8afd-54660fd34dcb req-28cb80a6-a288-4c56-b7c1-80aa5c27f1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:20.910728 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:20.910728 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:10:20.923460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.923961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.924924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.925332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.929215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-146ed310-96c4-4394-8afd-54660fd34dcb req-28cb80a6-a288-4c56-b7c1-80aa5c27f1f2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:20.929687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-146ed310-96c4-4394-8afd-54660fd34dcb req-28cb80a6-a288-4c56-b7c1-80aa5c27f1f2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:20.956485 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-146ed310-96c4-4394-8afd-54660fd34dcb req-28cb80a6-a288-4c56-b7c1-80aa5c27f1f2 service nova] Creating event network-changed:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch1-master-1 Dec 18 21:10:20.963702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-146ed310-96c4-4394-8afd-54660fd34dcb req-28cb80a6-a288-4c56-b7c1-80aa5c27f1f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059691 Dec 18 21:10:20.964359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2845/5651] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:21.259631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:21.268877 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68701203-0ea2-4b92-9f71-2bb5febf8a7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1562 microversion: 2.1 time: 0.376094 Dec 18 21:10:21.274494 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2807/5652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:20 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1562 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:21.453075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f8be21d-95ce-4169-b6fd-456ed5a7dafb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:21.454119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f8be21d-95ce-4169-b6fd-456ed5a7dafb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:21.465316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f8be21d-95ce-4169-b6fd-456ed5a7dafb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:21.475181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f8be21d-95ce-4169-b6fd-456ed5a7dafb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:21.476382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f8be21d-95ce-4169-b6fd-456ed5a7dafb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:21.477573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f8be21d-95ce-4169-b6fd-456ed5a7dafb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:21.524323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d929e3e0-8b2a-476c-9a21-fbd0d662d67f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:21.525972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d929e3e0-8b2a-476c-9a21-fbd0d662d67f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:21.555731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d929e3e0-8b2a-476c-9a21-fbd0d662d67f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:21.557373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d929e3e0-8b2a-476c-9a21-fbd0d662d67f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:21.560477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d929e3e0-8b2a-476c-9a21-fbd0d662d67f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:21.562633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d929e3e0-8b2a-476c-9a21-fbd0d662d67f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:21.604621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f8be21d-95ce-4169-b6fd-456ed5a7dafb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 24573 microversion: 2.20 time: 0.157196 Dec 18 21:10:21.607572 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2846/5653] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:21 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 24573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:21.658757 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d929e3e0-8b2a-476c-9a21-fbd0d662d67f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.138557 Dec 18 21:10:21.659607 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2808/5654] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:21 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:22.624898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01a874cc-4fd5-4654-bc78-f95f220f68fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:22.626608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-01a874cc-4fd5-4654-bc78-f95f220f68fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:22.636481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01a874cc-4fd5-4654-bc78-f95f220f68fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:22.637102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01a874cc-4fd5-4654-bc78-f95f220f68fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:22.638412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01a874cc-4fd5-4654-bc78-f95f220f68fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:22.638959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01a874cc-4fd5-4654-bc78-f95f220f68fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:22.674051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2c64d139-2d72-4c57-80ff-2a8693b0caac tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:22.675185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2c64d139-2d72-4c57-80ff-2a8693b0caac tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:22.690895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c64d139-2d72-4c57-80ff-2a8693b0caac tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:22.691383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c64d139-2d72-4c57-80ff-2a8693b0caac tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:22.692454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c64d139-2d72-4c57-80ff-2a8693b0caac tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:22.699594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c64d139-2d72-4c57-80ff-2a8693b0caac tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:22.739246 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01a874cc-4fd5-4654-bc78-f95f220f68fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.122065 Dec 18 21:10:22.739979 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2847/5655] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:22 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:22.778589 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2c64d139-2d72-4c57-80ff-2a8693b0caac tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.110337 Dec 18 21:10:22.785124 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2809/5656] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:22 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:23.752524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1796eb0b-f500-40f8-95b2-01de16ff1cc4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:23.753564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1796eb0b-f500-40f8-95b2-01de16ff1cc4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:23.762108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1796eb0b-f500-40f8-95b2-01de16ff1cc4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:23.762596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1796eb0b-f500-40f8-95b2-01de16ff1cc4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:23.763405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1796eb0b-f500-40f8-95b2-01de16ff1cc4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:23.763835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1796eb0b-f500-40f8-95b2-01de16ff1cc4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:23.793281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04f16061-42b5-4d5c-9bd0-2f48b5f974ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:23.794785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04f16061-42b5-4d5c-9bd0-2f48b5f974ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:23.802275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f16061-42b5-4d5c-9bd0-2f48b5f974ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:23.802758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f16061-42b5-4d5c-9bd0-2f48b5f974ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:23.803567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f16061-42b5-4d5c-9bd0-2f48b5f974ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:23.804016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f16061-42b5-4d5c-9bd0-2f48b5f974ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:23.810431 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1796eb0b-f500-40f8-95b2-01de16ff1cc4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.061722 Dec 18 21:10:23.812143 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2848/5657] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:23 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:23.860626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04f16061-42b5-4d5c-9bd0-2f48b5f974ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.071690 Dec 18 21:10:23.864776 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2810/5658] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:23 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:24.823548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e4f7b638-ca74-4da7-8e96-463be7fdc224 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:24.824521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e4f7b638-ca74-4da7-8e96-463be7fdc224 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:24.832401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4f7b638-ca74-4da7-8e96-463be7fdc224 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:24.832989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4f7b638-ca74-4da7-8e96-463be7fdc224 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:24.833865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4f7b638-ca74-4da7-8e96-463be7fdc224 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:24.834372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4f7b638-ca74-4da7-8e96-463be7fdc224 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:24.874030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-30181352-1f6b-4a47-a1e6-5ee260984a00 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:24.875896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-30181352-1f6b-4a47-a1e6-5ee260984a00 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:24.882197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e4f7b638-ca74-4da7-8e96-463be7fdc224 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.063480 Dec 18 21:10:24.886136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30181352-1f6b-4a47-a1e6-5ee260984a00 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:24.886637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30181352-1f6b-4a47-a1e6-5ee260984a00 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:24.887454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30181352-1f6b-4a47-a1e6-5ee260984a00 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:24.887969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30181352-1f6b-4a47-a1e6-5ee260984a00 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:24.888341 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2849/5659] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:24 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:24.933998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-30181352-1f6b-4a47-a1e6-5ee260984a00 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.064414 Dec 18 21:10:24.935980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2811/5660] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:24 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:25.895786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-813df79b-7200-4ada-8d93-306bc219100d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:25.896750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-813df79b-7200-4ada-8d93-306bc219100d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:25.904749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-813df79b-7200-4ada-8d93-306bc219100d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:25.905208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-813df79b-7200-4ada-8d93-306bc219100d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:25.906015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-813df79b-7200-4ada-8d93-306bc219100d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:25.906502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-813df79b-7200-4ada-8d93-306bc219100d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:25.946936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d8201f39-0ef1-439a-bce8-613b4a4db4d3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:25.947956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d8201f39-0ef1-439a-bce8-613b4a4db4d3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:25.954547 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-813df79b-7200-4ada-8d93-306bc219100d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.062841 Dec 18 21:10:25.955355 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2850/5661] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:25 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:25.955482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8201f39-0ef1-439a-bce8-613b4a4db4d3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:25.955908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8201f39-0ef1-439a-bce8-613b4a4db4d3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:25.956725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8201f39-0ef1-439a-bce8-613b4a4db4d3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:25.957185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8201f39-0ef1-439a-bce8-613b4a4db4d3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:25.998930 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d8201f39-0ef1-439a-bce8-613b4a4db4d3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.055798 Dec 18 21:10:25.999570 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2812/5662] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:25 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:26.999209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28aaf825-f107-4dbe-a0ef-bb2b89c03ab7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:27.000853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28aaf825-f107-4dbe-a0ef-bb2b89c03ab7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:27.010966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28aaf825-f107-4dbe-a0ef-bb2b89c03ab7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:27.011717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28aaf825-f107-4dbe-a0ef-bb2b89c03ab7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:27.011867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b1862f7-524d-4eba-bcba-eb449ff68c08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:27.012522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28aaf825-f107-4dbe-a0ef-bb2b89c03ab7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:27.012768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b1862f7-524d-4eba-bcba-eb449ff68c08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:27.012963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28aaf825-f107-4dbe-a0ef-bb2b89c03ab7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:27.020087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b1862f7-524d-4eba-bcba-eb449ff68c08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:27.020824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b1862f7-524d-4eba-bcba-eb449ff68c08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:27.021797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b1862f7-524d-4eba-bcba-eb449ff68c08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:27.022278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b1862f7-524d-4eba-bcba-eb449ff68c08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:27.058566 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28aaf825-f107-4dbe-a0ef-bb2b89c03ab7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.080194 Dec 18 21:10:27.059750 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2851/5663] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:26 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:27.067672 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b1862f7-524d-4eba-bcba-eb449ff68c08 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.059591 Dec 18 21:10:27.068821 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2813/5664] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:27 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:28.072876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff36b7ac-f5a6-46a1-ad83-15765832e982 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:28.075489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ff36b7ac-f5a6-46a1-ad83-15765832e982 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:28.089754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff36b7ac-f5a6-46a1-ad83-15765832e982 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:28.090808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d9d4613c-7153-47e6-9b91-266b41da3786 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:28.091420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff36b7ac-f5a6-46a1-ad83-15765832e982 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:28.091880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d9d4613c-7153-47e6-9b91-266b41da3786 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:28.092544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff36b7ac-f5a6-46a1-ad83-15765832e982 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:28.093119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff36b7ac-f5a6-46a1-ad83-15765832e982 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:28.108206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9d4613c-7153-47e6-9b91-266b41da3786 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:28.108688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9d4613c-7153-47e6-9b91-266b41da3786 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:28.110187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9d4613c-7153-47e6-9b91-266b41da3786 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:28.110951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9d4613c-7153-47e6-9b91-266b41da3786 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:28.151972 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ff36b7ac-f5a6-46a1-ad83-15765832e982 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.083493 Dec 18 21:10:28.153040 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2852/5665] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:28 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:28.185575 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d9d4613c-7153-47e6-9b91-266b41da3786 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.104847 Dec 18 21:10:28.187072 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2814/5666] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:28 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:29.168673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9b4d014-6f59-4b55-9626-4d9e4783cf18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:29.169828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9b4d014-6f59-4b55-9626-4d9e4783cf18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:29.202468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9b4d014-6f59-4b55-9626-4d9e4783cf18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:29.203589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9b4d014-6f59-4b55-9626-4d9e4783cf18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:29.208501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9b4d014-6f59-4b55-9626-4d9e4783cf18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:29.208809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c3e3497c-d493-4484-85bc-ad3515da49ec tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:29.209374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9b4d014-6f59-4b55-9626-4d9e4783cf18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:29.210176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c3e3497c-d493-4484-85bc-ad3515da49ec tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:29.219599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3e3497c-d493-4484-85bc-ad3515da49ec tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:29.220369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3e3497c-d493-4484-85bc-ad3515da49ec tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:29.221301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3e3497c-d493-4484-85bc-ad3515da49ec tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:29.221976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c3e3497c-d493-4484-85bc-ad3515da49ec tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:29.268516 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9b4d014-6f59-4b55-9626-4d9e4783cf18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.105948 Dec 18 21:10:29.273147 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c3e3497c-d493-4484-85bc-ad3515da49ec tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.077561 Dec 18 21:10:29.273868 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2853/5667] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:29 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:29.275665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2815/5668] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:29 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:30.286168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46ef37d3-9b46-4abb-99b3-69dbb14df833 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:30.287938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46ef37d3-9b46-4abb-99b3-69dbb14df833 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:30.288638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16fa8520-9f0d-4a13-8081-c35c03bd1422 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:30.293306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-16fa8520-9f0d-4a13-8081-c35c03bd1422 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:30.300645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef37d3-9b46-4abb-99b3-69dbb14df833 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:30.301111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef37d3-9b46-4abb-99b3-69dbb14df833 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:30.301992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef37d3-9b46-4abb-99b3-69dbb14df833 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:30.302465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef37d3-9b46-4abb-99b3-69dbb14df833 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:30.305266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16fa8520-9f0d-4a13-8081-c35c03bd1422 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:30.305266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16fa8520-9f0d-4a13-8081-c35c03bd1422 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:30.305848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16fa8520-9f0d-4a13-8081-c35c03bd1422 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:30.306599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16fa8520-9f0d-4a13-8081-c35c03bd1422 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:30.386995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-16fa8520-9f0d-4a13-8081-c35c03bd1422 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.105786 Dec 18 21:10:30.404392 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2854/5669] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:30 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:30.435592 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46ef37d3-9b46-4abb-99b3-69dbb14df833 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.147610 Dec 18 21:10:30.436380 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2816/5670] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:30 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:31.416260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b23d1cc-c059-4533-99c4-cb2d12302232 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:31.417276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b23d1cc-c059-4533-99c4-cb2d12302232 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:31.424670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b23d1cc-c059-4533-99c4-cb2d12302232 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:31.425360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b23d1cc-c059-4533-99c4-cb2d12302232 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:31.429183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b23d1cc-c059-4533-99c4-cb2d12302232 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:31.429183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b23d1cc-c059-4533-99c4-cb2d12302232 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:31.450815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-16045477-b349-42bb-9432-854996e28b32 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:31.452505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-16045477-b349-42bb-9432-854996e28b32 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:31.459686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16045477-b349-42bb-9432-854996e28b32 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:31.460147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16045477-b349-42bb-9432-854996e28b32 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:31.460955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16045477-b349-42bb-9432-854996e28b32 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:31.461725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16045477-b349-42bb-9432-854996e28b32 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:31.475035 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b23d1cc-c059-4533-99c4-cb2d12302232 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.063689 Dec 18 21:10:31.476009 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2855/5671] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:31 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:31.506480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-16045477-b349-42bb-9432-854996e28b32 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.061767 Dec 18 21:10:31.507769 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2817/5672] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:31 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:32.487959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a5a62d3-e3e2-479f-9fcb-a5d96dd6aeeb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:32.489074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a5a62d3-e3e2-479f-9fcb-a5d96dd6aeeb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:32.497308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a5a62d3-e3e2-479f-9fcb-a5d96dd6aeeb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:32.498358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a5a62d3-e3e2-479f-9fcb-a5d96dd6aeeb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:32.499452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a5a62d3-e3e2-479f-9fcb-a5d96dd6aeeb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:32.500121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a5a62d3-e3e2-479f-9fcb-a5d96dd6aeeb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:32.524360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-529993ea-77f4-4577-b412-5c0c73edd951 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:32.526541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-529993ea-77f4-4577-b412-5c0c73edd951 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:32.534987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-529993ea-77f4-4577-b412-5c0c73edd951 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:32.535713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-529993ea-77f4-4577-b412-5c0c73edd951 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:32.536602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-529993ea-77f4-4577-b412-5c0c73edd951 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:32.537218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-529993ea-77f4-4577-b412-5c0c73edd951 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:32.582820 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a5a62d3-e3e2-479f-9fcb-a5d96dd6aeeb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.098943 Dec 18 21:10:32.584482 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2856/5673] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:32 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:32.588244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-529993ea-77f4-4577-b412-5c0c73edd951 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.065087 Dec 18 21:10:32.589304 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2818/5674] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:32 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:33.599185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3aad13bb-27a8-46c4-bca0-55e02032339d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:33.600255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3aad13bb-27a8-46c4-bca0-55e02032339d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:33.603476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bcf447e2-2dbb-477f-949f-92b6a37edc44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:33.608021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bcf447e2-2dbb-477f-949f-92b6a37edc44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:33.613394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf447e2-2dbb-477f-949f-92b6a37edc44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:33.613909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf447e2-2dbb-477f-949f-92b6a37edc44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:33.614727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf447e2-2dbb-477f-949f-92b6a37edc44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:33.614875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3aad13bb-27a8-46c4-bca0-55e02032339d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:33.615266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3aad13bb-27a8-46c4-bca0-55e02032339d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:33.615693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bcf447e2-2dbb-477f-949f-92b6a37edc44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:33.616086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3aad13bb-27a8-46c4-bca0-55e02032339d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:33.616533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3aad13bb-27a8-46c4-bca0-55e02032339d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:33.661275 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bcf447e2-2dbb-477f-949f-92b6a37edc44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.063846 Dec 18 21:10:33.669838 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2819/5675] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:33 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:33.677401 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3aad13bb-27a8-46c4-bca0-55e02032339d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.084930 Dec 18 21:10:33.682121 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2857/5676] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:33 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:34.680211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1324297e-eb1b-4a9d-9e2a-b496d06f0ab4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:34.682524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1324297e-eb1b-4a9d-9e2a-b496d06f0ab4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:34.692312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0bda8a9a-2a83-48d4-b913-9f061d041444 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:34.694032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bda8a9a-2a83-48d4-b913-9f061d041444 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:34.708873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bda8a9a-2a83-48d4-b913-9f061d041444 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.709332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bda8a9a-2a83-48d4-b913-9f061d041444 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:34.710209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bda8a9a-2a83-48d4-b913-9f061d041444 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.710832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1324297e-eb1b-4a9d-9e2a-b496d06f0ab4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.710970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bda8a9a-2a83-48d4-b913-9f061d041444 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:34.711642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1324297e-eb1b-4a9d-9e2a-b496d06f0ab4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:34.713651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1324297e-eb1b-4a9d-9e2a-b496d06f0ab4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.714220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1324297e-eb1b-4a9d-9e2a-b496d06f0ab4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:34.769604 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1324297e-eb1b-4a9d-9e2a-b496d06f0ab4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.094722 Dec 18 21:10:34.771412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2820/5677] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:34 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:34.781346 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0bda8a9a-2a83-48d4-b913-9f061d041444 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.095548 Dec 18 21:10:34.783193 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2858/5678] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:34 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:34.806977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:34.807669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:34.815690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.816278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:34.817490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.817955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:34.850749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:10:34.956317 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f2d5e601-9552-4568-bf69-5e27bad59f47 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 204 len: 0 microversion: 2.1 time: 0.153972 Dec 18 21:10:34.956924 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2821/5679] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:10:34 2021] DELETE /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:10:34.966330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:34.967045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:34.976284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.976740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:34.977567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:34.978006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:35.130465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:35.139684 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6dd24e9c-5fa9-4a37-b0fd-616f7e8ceaab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1410 microversion: 2.1 time: 0.176229 Dec 18 21:10:35.140265 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2859/5680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:34 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1410 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:35.784068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6dfa007c-d4ae-412c-b2f6-381f854adbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:35.785452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6dfa007c-d4ae-412c-b2f6-381f854adbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:35.794149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4cac69c-c022-434b-aaf8-fa4f946a2187 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:35.795206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4cac69c-c022-434b-aaf8-fa4f946a2187 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:35.797515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dfa007c-d4ae-412c-b2f6-381f854adbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:35.798082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dfa007c-d4ae-412c-b2f6-381f854adbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:35.799629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dfa007c-d4ae-412c-b2f6-381f854adbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:35.800851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dfa007c-d4ae-412c-b2f6-381f854adbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:35.802925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4cac69c-c022-434b-aaf8-fa4f946a2187 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:35.803575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4cac69c-c022-434b-aaf8-fa4f946a2187 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:35.804654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4cac69c-c022-434b-aaf8-fa4f946a2187 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:35.805772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4cac69c-c022-434b-aaf8-fa4f946a2187 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:35.850714 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6dfa007c-d4ae-412c-b2f6-381f854adbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.071557 Dec 18 21:10:35.855748 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2822/5681] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:35 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:35.860909 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4cac69c-c022-434b-aaf8-fa4f946a2187 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.071208 Dec 18 21:10:35.862127 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2860/5682] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:35 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:36.157218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:36.157919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:36.165537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:36.166000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:36.166855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:36.167495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:36.306609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:36.314212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2acf53fc-5925-43af-a516-96521050678e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1410 microversion: 2.1 time: 0.160918 Dec 18 21:10:36.314955 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2823/5683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:36 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:36.864924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a27ab18c-ad09-4f41-8e8a-b467b6022fcb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:36.867394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a27ab18c-ad09-4f41-8e8a-b467b6022fcb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:36.872930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7e802dc-1e94-412e-827e-7b01661cb5b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:36.874041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7e802dc-1e94-412e-827e-7b01661cb5b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:36.875840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a27ab18c-ad09-4f41-8e8a-b467b6022fcb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:36.876330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a27ab18c-ad09-4f41-8e8a-b467b6022fcb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:36.877122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a27ab18c-ad09-4f41-8e8a-b467b6022fcb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:36.877569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a27ab18c-ad09-4f41-8e8a-b467b6022fcb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:36.881145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7e802dc-1e94-412e-827e-7b01661cb5b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:36.881921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7e802dc-1e94-412e-827e-7b01661cb5b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:36.882989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7e802dc-1e94-412e-827e-7b01661cb5b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:36.884187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7e802dc-1e94-412e-827e-7b01661cb5b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:36.923384 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a27ab18c-ad09-4f41-8e8a-b467b6022fcb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.063395 Dec 18 21:10:36.927664 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2861/5684] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:36 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:36.958415 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7e802dc-1e94-412e-827e-7b01661cb5b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.088957 Dec 18 21:10:36.960980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2824/5685] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:36 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:37.333195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:37.335222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:37.346285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:37.346774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:37.348062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:37.348816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:37.617172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1082417440", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:37.640120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:37.656763 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0feafd8c-6cb4-4354-8356-02b9a9a791e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1410 microversion: 2.1 time: 0.328932 Dec 18 21:10:37.658357 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2862/5686] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:37 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1410 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:37.709115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:10:37.768433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a4d60f82-db9f-4989-8a6d-6265253699f0 req-a798a3ef-ac4e-4699-b26e-c1af2fdbc042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfef2208-39a2-4867-b92e-b779754f95e6", "name": "network-vif-deleted", "tag": "f16db603-fc8c-45ee-85f8-94d3470ee5f5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:37.770503 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:37.770503 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:10:37.780375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a4d60f82-db9f-4989-8a6d-6265253699f0 req-a798a3ef-ac4e-4699-b26e-c1af2fdbc042 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:37.781109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a4d60f82-db9f-4989-8a6d-6265253699f0 req-a798a3ef-ac4e-4699-b26e-c1af2fdbc042 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:37.836616 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a4d60f82-db9f-4989-8a6d-6265253699f0 req-a798a3ef-ac4e-4699-b26e-c1af2fdbc042 service nova] Creating event network-vif-deleted:f16db603-fc8c-45ee-85f8-94d3470ee5f5 for instance bfef2208-39a2-4867-b92e-b779754f95e6 on nch1-master-1 Dec 18 21:10:37.853269 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a4d60f82-db9f-4989-8a6d-6265253699f0 req-a798a3ef-ac4e-4699-b26e-c1af2fdbc042 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089016 Dec 18 21:10:37.857992 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2863/5687] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:10:37.939849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa507104-864d-4ade-9348-4d9559b39d4a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:37.942371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa507104-864d-4ade-9348-4d9559b39d4a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:37.962962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa507104-864d-4ade-9348-4d9559b39d4a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:37.963847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa507104-864d-4ade-9348-4d9559b39d4a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:37.965030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa507104-864d-4ade-9348-4d9559b39d4a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:37.965731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa507104-864d-4ade-9348-4d9559b39d4a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.039981 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa507104-864d-4ade-9348-4d9559b39d4a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.107089 Dec 18 21:10:38.041390 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2864/5688] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:37 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:38.048902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d04fb094-aa8a-4a18-8e1a-39ea94019f82 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:38.051013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d04fb094-aa8a-4a18-8e1a-39ea94019f82 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:38.059702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04fb094-aa8a-4a18-8e1a-39ea94019f82 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:38.061090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04fb094-aa8a-4a18-8e1a-39ea94019f82 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.062150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04fb094-aa8a-4a18-8e1a-39ea94019f82 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:38.062956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d04fb094-aa8a-4a18-8e1a-39ea94019f82 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.173305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d04fb094-aa8a-4a18-8e1a-39ea94019f82 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.130292 Dec 18 21:10:38.175211 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2865/5689] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:38 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:38.677146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:38.678209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:38.694172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:38.695142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.699358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:38.700292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.778303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:38.779082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.779626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lazy-loading 'fault' on Instance uuid bfef2208-39a2-4867-b92e-b779754f95e6 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:10:38.879649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:38.899649 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ee5197e-cab6-48a0-ad3c-1f703d884874 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 200 len: 1160 microversion: 2.1 time: 0.226531 Dec 18 21:10:38.904406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:10:38.905673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:10:38.906166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:10:38.906631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:10:38.907060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:10:38.913159 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2866/5690] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:38 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 1160 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:38.919253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:38.919722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.920579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:38.922146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:38.944427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:38.952611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:38.971616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:10:38.974898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:10:39.035225 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da3bbd99-228f-4ef4-8a7f-0b53d85f4952 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.655258 Dec 18 21:10:39.036273 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2825/5691] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:10:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:10:39.050342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49f6a189-8347-4b8c-a059-41b8f6034ec2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:39.052043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-49f6a189-8347-4b8c-a059-41b8f6034ec2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:39.060739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f22dff2d-ee87-4841-a425-07593220ae76 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:39.061845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f22dff2d-ee87-4841-a425-07593220ae76 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:39.078379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22dff2d-ee87-4841-a425-07593220ae76 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:39.079274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22dff2d-ee87-4841-a425-07593220ae76 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:39.080345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22dff2d-ee87-4841-a425-07593220ae76 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:39.080793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f22dff2d-ee87-4841-a425-07593220ae76 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:39.152465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-49f6a189-8347-4b8c-a059-41b8f6034ec2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:39.152642 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f22dff2d-ee87-4841-a425-07593220ae76 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.101669 Dec 18 21:10:39.154338 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2826/5692] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:39 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:39.160995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49f6a189-8347-4b8c-a059-41b8f6034ec2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1193 microversion: 2.1 time: 0.116116 Dec 18 21:10:39.162623 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2867/5693] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:39 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1193 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:39.188645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ce11b41-c6bd-4197-87a2-5e8098e589ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:39.191450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ce11b41-c6bd-4197-87a2-5e8098e589ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:39.199970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ce11b41-c6bd-4197-87a2-5e8098e589ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:39.200728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ce11b41-c6bd-4197-87a2-5e8098e589ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:39.201585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ce11b41-c6bd-4197-87a2-5e8098e589ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:39.202229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ce11b41-c6bd-4197-87a2-5e8098e589ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:39.252926 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ce11b41-c6bd-4197-87a2-5e8098e589ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.069873 Dec 18 21:10:39.253704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2827/5694] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:39 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:39.927517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:39.928131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:39.939144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:39.939630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:39.940419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:39.941445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:39.959001 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance bfef2208-39a2-4867-b92e-b779754f95e6 could not be found. Dec 18 21:10:39.959858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance bfef2208-39a2-4867-b92e-b779754f95e6 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:39.960708 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f078919-ac5b-4e3a-8514-8ff3e3c0d4bc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 404 len: 111 microversion: 2.1 time: 0.038640 Dec 18 21:10:39.966027 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2868/5695] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:39 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:10:40.165655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0cf6ebe8-5c0f-4b8f-826b-a51e5d380451 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:40.166713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0cf6ebe8-5c0f-4b8f-826b-a51e5d380451 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:40.177421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf6ebe8-5c0f-4b8f-826b-a51e5d380451 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:40.177941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf6ebe8-5c0f-4b8f-826b-a51e5d380451 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:40.179147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf6ebe8-5c0f-4b8f-826b-a51e5d380451 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:40.181801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:40.182401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf6ebe8-5c0f-4b8f-826b-a51e5d380451 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:40.183581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:40.194090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:40.195116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:40.196910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:40.198819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:40.250025 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0cf6ebe8-5c0f-4b8f-826b-a51e5d380451 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.088816 Dec 18 21:10:40.255070 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2828/5696] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:40 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:40.282046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21010fba-6c75-40d5-82c9-4155190f3a94 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:40.283240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-21010fba-6c75-40d5-82c9-4155190f3a94 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:40.298756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21010fba-6c75-40d5-82c9-4155190f3a94 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:40.299380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21010fba-6c75-40d5-82c9-4155190f3a94 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:40.304008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21010fba-6c75-40d5-82c9-4155190f3a94 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:40.304008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21010fba-6c75-40d5-82c9-4155190f3a94 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:40.322423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:40.332961 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9ca09f8-6e2a-4134-8a86-5548634ada77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1245 microversion: 2.1 time: 0.156097 Dec 18 21:10:40.334302 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2869/5697] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:40 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1245 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:40.360636 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21010fba-6c75-40d5-82c9-4155190f3a94 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.091565 Dec 18 21:10:40.374724 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2829/5698] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:40 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:41.055391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:41.055931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:41.062546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.063005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.063838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.064282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.078635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 could not be found. Dec 18 21:10:41.079224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:41.080055 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a93a3e9f-9418-4734-9c93-ce6ea17d70ec tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 404 len: 111 microversion: 2.1 time: 0.029988 Dec 18 21:10:41.080595 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2870/5699] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:10:41 2021] DELETE /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:10:41.089696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:41.090471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: ceaaab41-fbd2-47ed-b72a-90caaa32d9c7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:41.097827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.098168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.099002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.099523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.113849 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 could not be found. Dec 18 21:10:41.114631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:41.115485 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67e32366-0020-4b54-8765-9af28bf45d8b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7" status: 404 len: 111 microversion: 2.1 time: 0.030211 Dec 18 21:10:41.116040 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2830/5700] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:41 2021] GET /compute/v2.1/servers/ceaaab41-fbd2-47ed-b72a-90caaa32d9c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:10:41.262663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad97b73c-fa26-480c-9044-14e15b563edf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:41.263569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ad97b73c-fa26-480c-9044-14e15b563edf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:41.270180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad97b73c-fa26-480c-9044-14e15b563edf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.270873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad97b73c-fa26-480c-9044-14e15b563edf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.271665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad97b73c-fa26-480c-9044-14e15b563edf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.272102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad97b73c-fa26-480c-9044-14e15b563edf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.315328 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ad97b73c-fa26-480c-9044-14e15b563edf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.056161 Dec 18 21:10:41.316153 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2871/5701] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:41 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:41.350557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:41.351340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:41.358554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.359258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.360257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.360709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.379986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f08152c6-060a-4299-9e5e-2e590d4f23e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:41.381034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f08152c6-060a-4299-9e5e-2e590d4f23e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:41.395356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f08152c6-060a-4299-9e5e-2e590d4f23e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.395847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f08152c6-060a-4299-9e5e-2e590d4f23e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.396630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f08152c6-060a-4299-9e5e-2e590d4f23e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.397023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f08152c6-060a-4299-9e5e-2e590d4f23e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.440992 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f08152c6-060a-4299-9e5e-2e590d4f23e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.069244 Dec 18 21:10:41.442207 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2872/5702] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:41 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:41.589994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:41.598493 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-495a5156-0dcc-472f-9ee2-bd3ce7e2361f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1293 microversion: 2.1 time: 0.251477 Dec 18 21:10:41.599217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2831/5703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:41 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1293 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:41.659321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:41.661130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:41.668976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.669439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.670234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.671093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.687171 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance bfef2208-39a2-4867-b92e-b779754f95e6 could not be found. Dec 18 21:10:41.687687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance bfef2208-39a2-4867-b92e-b779754f95e6 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:41.688520 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56751201-6613-4b54-bb44-afd71ee2aab3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 404 len: 111 microversion: 2.1 time: 0.035160 Dec 18 21:10:41.689292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2873/5704] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:10:41 2021] DELETE /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:10:41.700682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:41.701447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: bfef2208-39a2-4867-b92e-b779754f95e6] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:41.712032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.712511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.713303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.713753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.728996 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance bfef2208-39a2-4867-b92e-b779754f95e6 could not be found. Dec 18 21:10:41.729618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance bfef2208-39a2-4867-b92e-b779754f95e6 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:41.730501 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3290cb9f-9530-49ea-a9b8-150a8f00ee89 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6" status: 404 len: 111 microversion: 2.1 time: 0.036828 Dec 18 21:10:41.731050 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2832/5705] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:41 2021] GET /compute/v2.1/servers/bfef2208-39a2-4867-b92e-b779754f95e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:10:41.793662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64309bde-7de6-4bc1-a60e-9eb9aaa8385c tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'create', calling method: .version_select at 0x7f714fb325e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-716702626"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:41.810450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-64309bde-7de6-4bc1-a60e-9eb9aaa8385c tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:41.816407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-64309bde-7de6-4bc1-a60e-9eb9aaa8385c tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:41.871024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-5200e511-820f-4739-bfd3-58530c2f7a0a req-053a18f5-e653-463b-9d0c-a8edcc68e654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb51a0f-5058-4d20-b42e-eb65fa93481b", "tag": "bb247fd1-b352-4374-a8bf-d70e3684560c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:41.872730 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:41.872730 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:41.893834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5200e511-820f-4739-bfd3-58530c2f7a0a req-053a18f5-e653-463b-9d0c-a8edcc68e654 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:41.894686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5200e511-820f-4739-bfd3-58530c2f7a0a req-053a18f5-e653-463b-9d0c-a8edcc68e654 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:41.915597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-5200e511-820f-4739-bfd3-58530c2f7a0a req-053a18f5-e653-463b-9d0c-a8edcc68e654 service nova] Creating event network-changed:bb247fd1-b352-4374-a8bf-d70e3684560c for instance dcb51a0f-5058-4d20-b42e-eb65fa93481b on nch2-master-1 Dec 18 21:10:41.925709 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-5200e511-820f-4739-bfd3-58530c2f7a0a req-053a18f5-e653-463b-9d0c-a8edcc68e654 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060869 Dec 18 21:10:41.926959 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2833/5706] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:42.134922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-64309bde-7de6-4bc1-a60e-9eb9aaa8385c tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:42.140183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-64309bde-7de6-4bc1-a60e-9eb9aaa8385c tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:42.160390 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64309bde-7de6-4bc1-a60e-9eb9aaa8385c tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.371632 Dec 18 21:10:42.161219 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2874/5707] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:10:41 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:42.330306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dfee2434-0c2f-4b71-b1c9-7e14ea44b59b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:42.332993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dfee2434-0c2f-4b71-b1c9-7e14ea44b59b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:42.347986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfee2434-0c2f-4b71-b1c9-7e14ea44b59b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:42.348442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfee2434-0c2f-4b71-b1c9-7e14ea44b59b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:42.349351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfee2434-0c2f-4b71-b1c9-7e14ea44b59b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:42.349898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dfee2434-0c2f-4b71-b1c9-7e14ea44b59b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:42.418670 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dfee2434-0c2f-4b71-b1c9-7e14ea44b59b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.094075 Dec 18 21:10:42.419757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2834/5708] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:42 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:42.453873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72dd4c1a-8c97-479e-b403-dfb75d17eff9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:42.454830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72dd4c1a-8c97-479e-b403-dfb75d17eff9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:42.461359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72dd4c1a-8c97-479e-b403-dfb75d17eff9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:42.461819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72dd4c1a-8c97-479e-b403-dfb75d17eff9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:42.462671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72dd4c1a-8c97-479e-b403-dfb75d17eff9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:42.463177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72dd4c1a-8c97-479e-b403-dfb75d17eff9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:42.504420 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72dd4c1a-8c97-479e-b403-dfb75d17eff9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.054761 Dec 18 21:10:42.509109 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2875/5709] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:42 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:42.616011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:42.617041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:42.624709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:42.625248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:42.625987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:42.626478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:42.874911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:42.883657 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4257dde3-5ff6-4b1e-835d-70ab82b65f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1293 microversion: 2.1 time: 0.271740 Dec 18 21:10:42.884603 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2835/5710] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:42 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1293 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:43.154490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f999e8ec-4037-4e4c-ac39-e9cf0e5f4074 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Action: 'create', calling method: .version_select at 0x7f714fa0ba60>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1445983151"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:43.173886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f999e8ec-4037-4e4c-ac39-e9cf0e5f4074 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Getting quotas for project 62fd960aee2d408d8c9977b60fcabd61. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:43.185114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f999e8ec-4037-4e4c-ac39-e9cf0e5f4074 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Getting quotas for user 0a9b1c58215046afb6974d9a4b654326 and project 62fd960aee2d408d8c9977b60fcabd61. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:43.431541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-09df0dce-16eb-4a84-9ee0-19140c0c2d26 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:43.432680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-09df0dce-16eb-4a84-9ee0-19140c0c2d26 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:43.443760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09df0dce-16eb-4a84-9ee0-19140c0c2d26 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:43.444315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09df0dce-16eb-4a84-9ee0-19140c0c2d26 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:43.445176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09df0dce-16eb-4a84-9ee0-19140c0c2d26 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:43.445748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09df0dce-16eb-4a84-9ee0-19140c0c2d26 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:43.486358 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-09df0dce-16eb-4a84-9ee0-19140c0c2d26 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.059348 Dec 18 21:10:43.487485 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2836/5711] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:43 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:43.517102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1aa70ac8-f8ac-4093-a818-34c74c1f1c40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:43.518373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1aa70ac8-f8ac-4093-a818-34c74c1f1c40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:43.526524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1aa70ac8-f8ac-4093-a818-34c74c1f1c40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:43.526983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1aa70ac8-f8ac-4093-a818-34c74c1f1c40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:43.528659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1aa70ac8-f8ac-4093-a818-34c74c1f1c40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:43.529308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1aa70ac8-f8ac-4093-a818-34c74c1f1c40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:43.572098 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1aa70ac8-f8ac-4093-a818-34c74c1f1c40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.058879 Dec 18 21:10:43.573574 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2837/5712] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:43 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:43.652173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f999e8ec-4037-4e4c-ac39-e9cf0e5f4074 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Getting quotas for project 62fd960aee2d408d8c9977b60fcabd61. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:43.657014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f999e8ec-4037-4e4c-ac39-e9cf0e5f4074 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Getting quotas for user 0a9b1c58215046afb6974d9a4b654326 and project 62fd960aee2d408d8c9977b60fcabd61. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:43.671858 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f999e8ec-4037-4e4c-ac39-e9cf0e5f4074 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.521637 Dec 18 21:10:43.677069 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2876/5713] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:10:43 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:43.902384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:43.903109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:43.910369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:43.910947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:43.911669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:43.912090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:44.081502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:44.091750 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5f8d1519-1508-4d1c-84d4-03956bf08aa5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1293 microversion: 2.1 time: 0.193762 Dec 18 21:10:44.092541 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2838/5714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:43 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1293 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:44.498947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-805f8cac-df3e-4288-9c57-f4fb11b5bf6d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:44.500341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-805f8cac-df3e-4288-9c57-f4fb11b5bf6d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:44.506372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805f8cac-df3e-4288-9c57-f4fb11b5bf6d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:44.506830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805f8cac-df3e-4288-9c57-f4fb11b5bf6d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:44.507618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805f8cac-df3e-4288-9c57-f4fb11b5bf6d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:44.508554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-805f8cac-df3e-4288-9c57-f4fb11b5bf6d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:44.549591 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-805f8cac-df3e-4288-9c57-f4fb11b5bf6d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.055179 Dec 18 21:10:44.551253 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2877/5715] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:44 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:44.586379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39a32879-8ae1-40f5-9659-880822c0671e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:44.587570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39a32879-8ae1-40f5-9659-880822c0671e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:44.595932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a32879-8ae1-40f5-9659-880822c0671e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:44.596471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a32879-8ae1-40f5-9659-880822c0671e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:44.597442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a32879-8ae1-40f5-9659-880822c0671e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:44.597929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39a32879-8ae1-40f5-9659-880822c0671e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:44.648936 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39a32879-8ae1-40f5-9659-880822c0671e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.067268 Dec 18 21:10:44.649591 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2839/5716] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:44 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:44.714083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-111669298", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4d1a0629-0c83-4586-abdd-6a090066b332", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1445983151", "security_groups": [{"name": "tempest-secgroup-smoke-1191490882"}], "networks": [{"uuid": "c62ef8c3-463b-4e15-8f35-55a2c15acde0"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:44.824073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] validate_networks() for [('c62ef8c3-463b-4e15-8f35-55a2c15acde0', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:10:45.115744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:45.119097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:45.127370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.128157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.129351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.129812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.253482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:10:45.253937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:10:45.254450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:10:45.254866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:10:45.255284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:10:45.266402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.266782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.267612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.268054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.286004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Getting quotas for project 62fd960aee2d408d8c9977b60fcabd61. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:45.291908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Getting quotas for user 0a9b1c58215046afb6974d9a4b654326 and project 62fd960aee2d408d8c9977b60fcabd61. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:45.301053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:45.308691 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72e3c558-e93b-419d-93df-35bc1bfd284f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1293 microversion: 2.1 time: 0.203383 Dec 18 21:10:45.309390 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2840/5717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:45 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1293 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:45.347748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:10:45.349987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d1a0629-0c83-4586-abdd-6a090066b332',volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:10:45.472688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c5f4283-de5d-4536-aaa8-2538d758dda2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762755 Dec 18 21:10:45.473334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2878/5718] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:10:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:10:45.484002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c3c24945-050d-4b5e-a9c9-dcfc16c214d7 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:45.484728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c3c24945-050d-4b5e-a9c9-dcfc16c214d7 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:45.541702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c3c24945-050d-4b5e-a9c9-dcfc16c214d7 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:45.549635 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c3c24945-050d-4b5e-a9c9-dcfc16c214d7 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1098 microversion: 2.1 time: 0.069662 Dec 18 21:10:45.550608 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2841/5719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:45 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1098 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:45.564389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-144a2dee-b35a-4b2e-993b-6fd03bbb5224 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:45.565396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-144a2dee-b35a-4b2e-993b-6fd03bbb5224 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:45.572340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-144a2dee-b35a-4b2e-993b-6fd03bbb5224 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.572795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-144a2dee-b35a-4b2e-993b-6fd03bbb5224 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.573594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-144a2dee-b35a-4b2e-993b-6fd03bbb5224 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.574040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-144a2dee-b35a-4b2e-993b-6fd03bbb5224 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.628700 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-144a2dee-b35a-4b2e-993b-6fd03bbb5224 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.068268 Dec 18 21:10:45.635496 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2879/5720] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:45 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:45.661031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92b22115-182b-49fc-91b6-d95b0e321eb0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:45.662131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92b22115-182b-49fc-91b6-d95b0e321eb0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:45.671071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92b22115-182b-49fc-91b6-d95b0e321eb0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.671724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92b22115-182b-49fc-91b6-d95b0e321eb0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.672701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92b22115-182b-49fc-91b6-d95b0e321eb0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.673343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92b22115-182b-49fc-91b6-d95b0e321eb0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.720916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92b22115-182b-49fc-91b6-d95b0e321eb0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.063639 Dec 18 21:10:45.722200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2842/5721] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:45 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:45.739001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6257ab78-f763-4400-a445-808cb7b9b015 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:45.740724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6257ab78-f763-4400-a445-808cb7b9b015 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:45.748261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6257ab78-f763-4400-a445-808cb7b9b015 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.749189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6257ab78-f763-4400-a445-808cb7b9b015 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.750524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6257ab78-f763-4400-a445-808cb7b9b015 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:45.750969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6257ab78-f763-4400-a445-808cb7b9b015 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:45.812960 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6257ab78-f763-4400-a445-808cb7b9b015 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action" status: 200 len: 24572 microversion: 2.1 time: 0.078763 Dec 18 21:10:45.814198 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2880/5722] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:45 2021] POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action => generated 24572 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:45.999625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1017799051", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716702626", "security_groups": [{"name": "tempest-secgroup-smoke-1903789239"}], "block_device_mapping_v2": [{"uuid": "13376864-8f52-4c3a-8fb8-d44948ce92e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "719d1db8-90bc-4a29-9e67-d552b1d87f10"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:46.135881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] validate_networks() for [('719d1db8-90bc-4a29-9e67-d552b1d87f10', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:10:46.325250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:46.325947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:46.333179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.333634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.334495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.334936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.639985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:46.654640 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0aafde6c-c6cb-4d63-94a8-59d3e2de19af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1293 microversion: 2.1 time: 0.326905 Dec 18 21:10:46.655298 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2881/5723] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:46 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1293 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:46.660083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:46.660894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:46.667928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.668576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.669387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.669835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.676427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:10:46.676924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:10:46.677332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:10:46.677750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:10:46.678167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:10:46.687807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.688284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.689104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.689746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.709843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:46.721738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:46.765587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:46.774526 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09abceed-48a3-4fff-8426-61e580e07506 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1214 microversion: 2.1 time: 0.117984 Dec 18 21:10:46.782232 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2882/5724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:46 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:46.787294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-028fc7cc-879c-433d-bc4f-2a688791d534 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:46.789690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-028fc7cc-879c-433d-bc4f-2a688791d534 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:46.793659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:10:46.796101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13376864-8f52-4c3a-8fb8-d44948ce92e4',volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:10:46.798687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-028fc7cc-879c-433d-bc4f-2a688791d534 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.799404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-028fc7cc-879c-433d-bc4f-2a688791d534 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.800494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-028fc7cc-879c-433d-bc4f-2a688791d534 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.801843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-028fc7cc-879c-433d-bc4f-2a688791d534 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.856439 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-028fc7cc-879c-433d-bc4f-2a688791d534 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.072475 Dec 18 21:10:46.857376 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2883/5725] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:46 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:46.867546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e54dd1aa-61d8-41e0-95b8-11799078e72a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:46.869032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e54dd1aa-61d8-41e0-95b8-11799078e72a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:46.876671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e54dd1aa-61d8-41e0-95b8-11799078e72a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.878318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e54dd1aa-61d8-41e0-95b8-11799078e72a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.879374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e54dd1aa-61d8-41e0-95b8-11799078e72a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:46.879971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e54dd1aa-61d8-41e0-95b8-11799078e72a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:46.936021 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e54dd1aa-61d8-41e0-95b8-11799078e72a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.076446 Dec 18 21:10:46.936957 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2884/5726] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:46 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:46.952220 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2341d65-88e8-4eb8-933b-add96e3a47a7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.956835 Dec 18 21:10:46.958682 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2843/5727] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:10:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:10:46.964167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de8f0c28-33b1-464f-b55f-1243b5be0820 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:46.964873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de8f0c28-33b1-464f-b55f-1243b5be0820 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:47.034690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-de8f0c28-33b1-464f-b55f-1243b5be0820 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:47.043912 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de8f0c28-33b1-464f-b55f-1243b5be0820 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1094 microversion: 2.1 time: 0.084477 Dec 18 21:10:47.044998 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2885/5728] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:46 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:47.676233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:47.677687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:47.703009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:47.703908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:47.706140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:47.706859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:47.800629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:47.802316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:47.811174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:47.811892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:47.812998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:47.813594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:47.996372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:48.004555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-33ff61e8-837c-4464-9b5e-37fc7e892d77 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1293 microversion: 2.1 time: 0.336753 Dec 18 21:10:48.005151 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2844/5729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:47 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1293 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:48.018579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6328f5b9-f2ff-4551-961e-221f095d3189 req-ff19cb67-2429-4816-9aee-c9e1c8f73fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb51a0f-5058-4d20-b42e-eb65fa93481b", "name": "network-vif-plugged", "status": "completed", "tag": "bb247fd1-b352-4374-a8bf-d70e3684560c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:48.020171 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:48.020171 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:48.028505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6328f5b9-f2ff-4551-961e-221f095d3189 req-ff19cb67-2429-4816-9aee-c9e1c8f73fde service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.029214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6328f5b9-f2ff-4551-961e-221f095d3189 req-ff19cb67-2429-4816-9aee-c9e1c8f73fde service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.041620 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6328f5b9-f2ff-4551-961e-221f095d3189 req-ff19cb67-2429-4816-9aee-c9e1c8f73fde service nova] Creating event network-vif-plugged:bb247fd1-b352-4374-a8bf-d70e3684560c for instance dcb51a0f-5058-4d20-b42e-eb65fa93481b on nch2-master-1 Dec 18 21:10:48.047004 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6328f5b9-f2ff-4551-961e-221f095d3189 req-ff19cb67-2429-4816-9aee-c9e1c8f73fde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040456 Dec 18 21:10:48.047606 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2845/5730] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:48.053845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-da56c795-ffc0-4091-b710-1b203ac57be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:48.054934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-da56c795-ffc0-4091-b710-1b203ac57be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:48.061688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da56c795-ffc0-4091-b710-1b203ac57be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.062412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da56c795-ffc0-4091-b710-1b203ac57be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.063423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da56c795-ffc0-4091-b710-1b203ac57be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.064046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-da56c795-ffc0-4091-b710-1b203ac57be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.093764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:48.106907 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70056c39-bb5d-473e-a97d-3940bf106d68 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.311437 Dec 18 21:10:48.108788 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-da56c795-ffc0-4091-b710-1b203ac57be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.059490 Dec 18 21:10:48.109884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2846/5731] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:48 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:48.116020 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2886/5732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:47 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:48.127268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04e68f54-c712-4ce6-87cb-f4fd7f9e44a4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:48.127722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:48.128547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:48.128692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04e68f54-c712-4ce6-87cb-f4fd7f9e44a4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:48.137025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04e68f54-c712-4ce6-87cb-f4fd7f9e44a4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.137507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04e68f54-c712-4ce6-87cb-f4fd7f9e44a4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.138202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.138833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.140054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.140751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.153120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04e68f54-c712-4ce6-87cb-f4fd7f9e44a4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.153614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04e68f54-c712-4ce6-87cb-f4fd7f9e44a4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.238555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04e68f54-c712-4ce6-87cb-f4fd7f9e44a4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.126883 Dec 18 21:10:48.239601 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2847/5733] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:48 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:48.303320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:48.318878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65ce8aaf-4f6b-4cb3-99fa-4ce7d4806bbc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1200 microversion: 2.1 time: 0.196719 Dec 18 21:10:48.320086 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2887/5734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:48 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1200 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:48.630594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-55fd0385-cd8c-47cf-93c9-ad04e7303c0f req-c62d4199-4793-4c76-89aa-ac9b619aa2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5153e88-ea06-4895-a8f2-9cd58000c109", "tag": "6952405e-dd10-48ed-b3df-0dbd6bb82a96"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:48.632146 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:48.632146 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:48.649165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-55fd0385-cd8c-47cf-93c9-ad04e7303c0f req-c62d4199-4793-4c76-89aa-ac9b619aa2f6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:48.649829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-55fd0385-cd8c-47cf-93c9-ad04e7303c0f req-c62d4199-4793-4c76-89aa-ac9b619aa2f6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:48.662398 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-55fd0385-cd8c-47cf-93c9-ad04e7303c0f req-c62d4199-4793-4c76-89aa-ac9b619aa2f6 service nova] Creating event network-changed:6952405e-dd10-48ed-b3df-0dbd6bb82a96 for instance f5153e88-ea06-4895-a8f2-9cd58000c109 on nch2-master-1 Dec 18 21:10:48.668675 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-55fd0385-cd8c-47cf-93c9-ad04e7303c0f req-c62d4199-4793-4c76-89aa-ac9b619aa2f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043653 Dec 18 21:10:48.669514 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2848/5735] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:49.021259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:49.021784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:49.029736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.030193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.031021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.031855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.121877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75b0a093-b0c8-4f2d-874c-bb937f251ad9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:49.123681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75b0a093-b0c8-4f2d-874c-bb937f251ad9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:49.131703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b0a093-b0c8-4f2d-874c-bb937f251ad9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.132438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b0a093-b0c8-4f2d-874c-bb937f251ad9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.133842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b0a093-b0c8-4f2d-874c-bb937f251ad9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.134774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75b0a093-b0c8-4f2d-874c-bb937f251ad9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.186828 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75b0a093-b0c8-4f2d-874c-bb937f251ad9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.069251 Dec 18 21:10:49.190802 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2849/5736] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:49 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:49.195097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:49.196493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:49.205813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.206291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.207378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.207833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.629711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:49.636692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:49.637206 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4055a507-fe6b-47d9-9090-bf5dbd9f805e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1293 microversion: 2.1 time: 0.619921 Dec 18 21:10:49.637797 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2888/5737] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:49 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1293 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:49.642671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb673305-e1c7-4964-962f-e35228541323 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:49.643994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bb673305-e1c7-4964-962f-e35228541323 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:49.651621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb673305-e1c7-4964-962f-e35228541323 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.652077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb673305-e1c7-4964-962f-e35228541323 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.653061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb673305-e1c7-4964-962f-e35228541323 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.653673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb673305-e1c7-4964-962f-e35228541323 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.654370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dc8782f6-f215-41b4-852b-7a1db31318ff tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.465125 Dec 18 21:10:49.655054 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2850/5738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:49 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:49.669122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:49.669746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:49.675756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.676220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.677025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:49.677635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:49.696000 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb673305-e1c7-4964-962f-e35228541323 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.056757 Dec 18 21:10:49.696670 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2889/5739] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:49 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:49.763812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:49.771263 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9180c9cc-6515-47cf-9bbc-309919146b91 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1198 microversion: 2.1 time: 0.105790 Dec 18 21:10:49.771924 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2851/5740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:49 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:50.198709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ffb32ec-b793-42e2-a4b5-88337b260651 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:50.199674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ffb32ec-b793-42e2-a4b5-88337b260651 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:50.207670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ffb32ec-b793-42e2-a4b5-88337b260651 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:50.208166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ffb32ec-b793-42e2-a4b5-88337b260651 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:50.209057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ffb32ec-b793-42e2-a4b5-88337b260651 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:50.209496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ffb32ec-b793-42e2-a4b5-88337b260651 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:50.259113 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ffb32ec-b793-42e2-a4b5-88337b260651 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.064433 Dec 18 21:10:50.259773 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2890/5741] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:50 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:50.654571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:50.655770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:50.662834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:50.663308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:50.664762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:50.665219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:50.671480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:50.672188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:50.680845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:50.681611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:50.683028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:50.683475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:50.984847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:50.989881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:50.993352 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9f7c712-5877-4db2-8e91-f4cc50ccc7aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1473 microversion: 2.1 time: 0.342617 Dec 18 21:10:50.994390 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2852/5742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:50 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:51.008827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c8d56fb5-5b08-48f5-a8a9-013d2d306b04 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:51.013844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c8d56fb5-5b08-48f5-a8a9-013d2d306b04 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:51.021807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1815c67-9d0d-45fe-9935-fdcd421741d0 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.354306 Dec 18 21:10:51.024293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8d56fb5-5b08-48f5-a8a9-013d2d306b04 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.024861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8d56fb5-5b08-48f5-a8a9-013d2d306b04 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.025892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8d56fb5-5b08-48f5-a8a9-013d2d306b04 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.026490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8d56fb5-5b08-48f5-a8a9-013d2d306b04 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.030956 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2891/5743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:50 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:51.036959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:51.037677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:51.044065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.044750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.045605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.046161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.071210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c8d56fb5-5b08-48f5-a8a9-013d2d306b04 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.074678 Dec 18 21:10:51.071880 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2853/5744] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:50 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:51.077182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-192170746", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:51.138557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:10:51.388664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:51.396368 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f66ee89a-9307-4da7-b0b1-521caab8d0b8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1266 microversion: 2.1 time: 0.364258 Dec 18 21:10:51.396942 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2892/5745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:51 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:51.401558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-2bdcaa20-0dd4-4280-8116-fbb8408707e2 req-e789f1e9-8f0d-4b3c-aed4-fc08b5aa289e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4677eac8-1f9e-4309-b018-4b60ce5b1eb4", "tag": "66e4db18-6da1-4474-8bda-7ecda4c5e03f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:51.403101 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:51.403101 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:10:51.410695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2bdcaa20-0dd4-4280-8116-fbb8408707e2 req-e789f1e9-8f0d-4b3c-aed4-fc08b5aa289e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.411229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2bdcaa20-0dd4-4280-8116-fbb8408707e2 req-e789f1e9-8f0d-4b3c-aed4-fc08b5aa289e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.422294 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-2bdcaa20-0dd4-4280-8116-fbb8408707e2 req-e789f1e9-8f0d-4b3c-aed4-fc08b5aa289e service nova] Creating event network-changed:66e4db18-6da1-4474-8bda-7ecda4c5e03f for instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 on nch1-master-1 Dec 18 21:10:51.427048 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-2bdcaa20-0dd4-4280-8116-fbb8408707e2 req-e789f1e9-8f0d-4b3c-aed4-fc08b5aa289e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029005 Dec 18 21:10:51.427821 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2893/5746] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:51.433193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f73f82c-0968-4d9f-84a4-99600ce49c15 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:51.434095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5f73f82c-0968-4d9f-84a4-99600ce49c15 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:51.440081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f73f82c-0968-4d9f-84a4-99600ce49c15 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.440542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f73f82c-0968-4d9f-84a4-99600ce49c15 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.441347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f73f82c-0968-4d9f-84a4-99600ce49c15 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.441788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f73f82c-0968-4d9f-84a4-99600ce49c15 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.483897 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f73f82c-0968-4d9f-84a4-99600ce49c15 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.054874 Dec 18 21:10:51.488103 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2894/5747] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:51 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:51.821510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:10:51.822493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:10:51.822988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:10:51.823413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:10:51.823836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:10:51.833469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.833854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.834725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:51.835180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:51.853495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:51.859604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:51.872581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:10:51.875064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:10:51.925908 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b15aa969-bdff-4d2a-8033-4eaf421c1078 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851514 Dec 18 21:10:51.926141 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2854/5748] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:10:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:10:51.945328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2047b19-1ad5-4684-814f-c42f21107b02 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:51.947376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e2047b19-1ad5-4684-814f-c42f21107b02 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:51.980920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e2047b19-1ad5-4684-814f-c42f21107b02 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:10:52.038417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:52.039684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:52.047401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.047876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.048691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.049152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.321052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:52.329453 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ee6eb20-d955-436e-b66e-ab7f1e299aad tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.294722 Dec 18 21:10:52.330604 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2855/5749] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:52 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:52.335325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57d9f493-ae9f-4f2e-8db4-1911e8070a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:52.336857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57d9f493-ae9f-4f2e-8db4-1911e8070a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:52.346995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57d9f493-ae9f-4f2e-8db4-1911e8070a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.347594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57d9f493-ae9f-4f2e-8db4-1911e8070a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.348716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57d9f493-ae9f-4f2e-8db4-1911e8070a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.349349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57d9f493-ae9f-4f2e-8db4-1911e8070a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.416086 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.scheduler.client.report [None req-e2047b19-1ad5-4684-814f-c42f21107b02 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Deleted allocations for instance ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 Dec 18 21:10:52.416915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57d9f493-ae9f-4f2e-8db4-1911e8070a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.084947 Dec 18 21:10:52.417565 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2856/5750] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:52 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:52.421536 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.compute.api [None req-e2047b19-1ad5-4684-814f-c42f21107b02 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3] Instance Mapping does not exist while attempting local delete cleanup. Dec 18 21:10:52.422538 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2047b19-1ad5-4684-814f-c42f21107b02 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3" status: 204 len: 0 microversion: 2.1 time: 0.485546 Dec 18 21:10:52.423424 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2895/5751] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:10:51 2021] DELETE /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:10:52.425143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:52.426759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:52.432860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-beed3e6d-5288-4eda-8922-576a9bb48677 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:52.433795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-beed3e6d-5288-4eda-8922-576a9bb48677 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:52.434142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.434635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.435696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.436150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.440865 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-beed3e6d-5288-4eda-8922-576a9bb48677 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 could not be found. Dec 18 21:10:52.441847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-beed3e6d-5288-4eda-8922-576a9bb48677 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:10:52.443057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-beed3e6d-5288-4eda-8922-576a9bb48677 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3" status: 404 len: 111 microversion: 2.1 time: 0.015487 Dec 18 21:10:52.459381 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2896/5752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:52 2021] GET /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:10:52.496709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1f48a04b-16f3-4666-9cf3-7af7fdae3b9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:52.497662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1f48a04b-16f3-4666-9cf3-7af7fdae3b9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:52.505280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f48a04b-16f3-4666-9cf3-7af7fdae3b9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.505731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f48a04b-16f3-4666-9cf3-7af7fdae3b9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.506601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f48a04b-16f3-4666-9cf3-7af7fdae3b9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:52.507072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f48a04b-16f3-4666-9cf3-7af7fdae3b9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:52.549933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1f48a04b-16f3-4666-9cf3-7af7fdae3b9a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.057574 Dec 18 21:10:52.551408 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2897/5753] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:52 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:52.564706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1745746190", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:52.620257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:10:53.047459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:53.055353 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e63b9720-a5cf-4c5c-82be-b62bf936fada tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1266 microversion: 2.1 time: 0.635602 Dec 18 21:10:53.056270 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2857/5754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:52 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1266 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:53.335266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:10:53.336301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:10:53.336783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:10:53.337194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:10:53.337606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:10:53.346475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:53.346630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.347066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.347418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:53.347887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.348332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.354284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.354759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.355680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.356007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.365438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:10:53.371905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:10:53.391050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:10:53.394964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:10:53.448820 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b927434c-eddd-4ec7-8c15-566687b31a10 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888252 Dec 18 21:10:53.456941 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2898/5755] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:10:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:10:53.456941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c7156656-400b-495b-b88b-30b2c1cd4bcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:53.456941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c7156656-400b-495b-b88b-30b2c1cd4bcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:53.463276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7156656-400b-495b-b88b-30b2c1cd4bcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.463674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7156656-400b-495b-b88b-30b2c1cd4bcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.464540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7156656-400b-495b-b88b-30b2c1cd4bcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.464990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c7156656-400b-495b-b88b-30b2c1cd4bcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.509440 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c7156656-400b-495b-b88b-30b2c1cd4bcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.058680 Dec 18 21:10:53.510789 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2899/5756] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:53 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:53.512742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:53.516101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c91f966-3006-4fe0-bcad-241239cf1a4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:53.516797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4c91f966-3006-4fe0-bcad-241239cf1a4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:53.522489 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3c9b48c-cf05-4482-8695-f07163040969 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.179680 Dec 18 21:10:53.523726 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2858/5757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:53 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:53.561550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0abbe11-00e7-41e3-beea-215c3c848a1d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:53.563012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0abbe11-00e7-41e3-beea-215c3c848a1d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:53.570943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0abbe11-00e7-41e3-beea-215c3c848a1d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.571731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0abbe11-00e7-41e3-beea-215c3c848a1d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.573934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0abbe11-00e7-41e3-beea-215c3c848a1d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:53.574426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0abbe11-00e7-41e3-beea-215c3c848a1d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:53.593013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4c91f966-3006-4fe0-bcad-241239cf1a4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:53.604214 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c91f966-3006-4fe0-bcad-241239cf1a4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1221 microversion: 2.1 time: 0.092094 Dec 18 21:10:53.604889 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2900/5758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:53 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:53.627692 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0abbe11-00e7-41e3-beea-215c3c848a1d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.069644 Dec 18 21:10:53.628355 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2859/5759] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:53 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:54.072944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:54.073545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:54.080281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.080739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.081532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.082115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.219144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:54.227094 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b9c3bcc-7768-4239-a105-546cabc698a9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1266 microversion: 2.1 time: 0.158174 Dec 18 21:10:54.227668 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2901/5760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:54 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:54.522225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b42d20b7-af00-4c68-a065-f0e3877ff98a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:54.524016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b42d20b7-af00-4c68-a065-f0e3877ff98a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:54.531449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b42d20b7-af00-4c68-a065-f0e3877ff98a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.531919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b42d20b7-af00-4c68-a065-f0e3877ff98a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.532738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b42d20b7-af00-4c68-a065-f0e3877ff98a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.533196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b42d20b7-af00-4c68-a065-f0e3877ff98a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.540227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:54.540855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:54.547246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.547704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.548501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.549118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.577599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b42d20b7-af00-4c68-a065-f0e3877ff98a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.059342 Dec 18 21:10:54.582674 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2860/5761] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:54 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:54.622306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:54.622306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:54.629044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.629500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.630391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.630839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.713668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:54.721865 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-77209ce7-e9c1-4b59-98e8-6ca712d89e63 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1279 microversion: 2.1 time: 0.104492 Dec 18 21:10:54.722763 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2861/5762] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:54 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:54.727300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7145224-b616-4f58-b65e-a240f9f29421 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:54.728217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7145224-b616-4f58-b65e-a240f9f29421 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:54.734823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7145224-b616-4f58-b65e-a240f9f29421 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.735287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7145224-b616-4f58-b65e-a240f9f29421 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.736124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7145224-b616-4f58-b65e-a240f9f29421 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:54.736548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7145224-b616-4f58-b65e-a240f9f29421 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:54.771901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:54.777468 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7145224-b616-4f58-b65e-a240f9f29421 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.053563 Dec 18 21:10:54.781570 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2862/5763] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:54 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:54.783654 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01203524-5020-44c4-a61a-bc464f84ce5f tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.247683 Dec 18 21:10:54.784274 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2902/5764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:54 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:55.244849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:55.245560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:55.252453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.252921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.253714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.254160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.528055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:55.535957 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f2098b05-c170-4bea-a06f-47f794980494 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1266 microversion: 2.1 time: 0.295709 Dec 18 21:10:55.545461 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2863/5765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:55 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:55.596918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81661c8e-cf25-4b98-b649-1fd1098a1fab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:55.597989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81661c8e-cf25-4b98-b649-1fd1098a1fab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:55.605477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81661c8e-cf25-4b98-b649-1fd1098a1fab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.606058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81661c8e-cf25-4b98-b649-1fd1098a1fab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.606986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81661c8e-cf25-4b98-b649-1fd1098a1fab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.607530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81661c8e-cf25-4b98-b649-1fd1098a1fab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.651540 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81661c8e-cf25-4b98-b649-1fd1098a1fab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.058871 Dec 18 21:10:55.653682 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2903/5766] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:55 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:55.738684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:55.739615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:55.749041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.749907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.751508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.752040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.790081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d363de3-c6bc-4561-a3a5-1ab26e230fc6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:55.791978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0d363de3-c6bc-4561-a3a5-1ab26e230fc6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:55.803551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d363de3-c6bc-4561-a3a5-1ab26e230fc6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.804308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d363de3-c6bc-4561-a3a5-1ab26e230fc6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.805137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d363de3-c6bc-4561-a3a5-1ab26e230fc6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.805586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d363de3-c6bc-4561-a3a5-1ab26e230fc6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.855012 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d363de3-c6bc-4561-a3a5-1ab26e230fc6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.069333 Dec 18 21:10:55.856415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2904/5767] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:55 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:55.862059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:55.863043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:55.870168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.870689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:55.871547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:55.872148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.083687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:56.092629 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aee286f1-1b25-465b-9227-dd2d47c3a918 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1321 microversion: 2.1 time: 0.357872 Dec 18 21:10:56.103674 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2864/5768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:55 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:56.116625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-28e50aeb-db51-4a86-85c6-54f6e1291cdc req-781cb57b-bd33-40ad-ae3c-58e8a520a092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5153e88-ea06-4895-a8f2-9cd58000c109", "name": "network-vif-plugged", "status": "completed", "tag": "6952405e-dd10-48ed-b3df-0dbd6bb82a96"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:56.118286 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:56.118286 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:56.125394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-28e50aeb-db51-4a86-85c6-54f6e1291cdc req-781cb57b-bd33-40ad-ae3c-58e8a520a092 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.125836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-28e50aeb-db51-4a86-85c6-54f6e1291cdc req-781cb57b-bd33-40ad-ae3c-58e8a520a092 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.137754 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-28e50aeb-db51-4a86-85c6-54f6e1291cdc req-781cb57b-bd33-40ad-ae3c-58e8a520a092 service nova] Creating event network-vif-plugged:6952405e-dd10-48ed-b3df-0dbd6bb82a96 for instance f5153e88-ea06-4895-a8f2-9cd58000c109 on nch2-master-1 Dec 18 21:10:56.143253 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-28e50aeb-db51-4a86-85c6-54f6e1291cdc req-781cb57b-bd33-40ad-ae3c-58e8a520a092 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030064 Dec 18 21:10:56.144461 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2865/5769] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:56.150095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d0a809f1-55da-40a5-85c5-051d21c428cf req-f1b3b966-0678-4826-9d69-3dd280a17c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b733c412-1cdb-45f5-9fa7-b68e4121ec4a", "tag": "2515fc60-3b2e-4cc2-999d-5614da915260"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:56.152607 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:56.152607 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:10:56.160245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d0a809f1-55da-40a5-85c5-051d21c428cf req-f1b3b966-0678-4826-9d69-3dd280a17c6b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.160702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d0a809f1-55da-40a5-85c5-051d21c428cf req-f1b3b966-0678-4826-9d69-3dd280a17c6b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.174441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d0a809f1-55da-40a5-85c5-051d21c428cf req-f1b3b966-0678-4826-9d69-3dd280a17c6b service nova] Creating event network-changed:2515fc60-3b2e-4cc2-999d-5614da915260 for instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a on nch1-master-1 Dec 18 21:10:56.180471 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d0a809f1-55da-40a5-85c5-051d21c428cf req-f1b3b966-0678-4826-9d69-3dd280a17c6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034742 Dec 18 21:10:56.181827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2866/5770] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:10:56.236533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:56.243961 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fe74b887-75ce-49e1-8a26-5dfbbfcd37f9 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.386075 Dec 18 21:10:56.244535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2905/5771] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:55 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:56.555593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:56.556305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:56.563509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.563977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.564771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.565218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.664241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a8973c46-4834-4977-9b6a-da2002ded475 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:56.665160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a8973c46-4834-4977-9b6a-da2002ded475 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:56.672622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8973c46-4834-4977-9b6a-da2002ded475 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.673074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8973c46-4834-4977-9b6a-da2002ded475 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.673866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8973c46-4834-4977-9b6a-da2002ded475 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.674335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8973c46-4834-4977-9b6a-da2002ded475 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.714746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a8973c46-4834-4977-9b6a-da2002ded475 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.054089 Dec 18 21:10:56.719071 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2906/5772] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:56 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:56.784946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:56.792890 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66117619-3192-439a-a060-24f81e1f1848 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1266 microversion: 2.1 time: 0.243692 Dec 18 21:10:56.793464 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2867/5773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:56 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:56.868592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-feaecb49-eb8f-4496-b9a4-3b0c8970b514 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:56.869597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-feaecb49-eb8f-4496-b9a4-3b0c8970b514 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:56.876570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feaecb49-eb8f-4496-b9a4-3b0c8970b514 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.877006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feaecb49-eb8f-4496-b9a4-3b0c8970b514 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.877787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feaecb49-eb8f-4496-b9a4-3b0c8970b514 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.878225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-feaecb49-eb8f-4496-b9a4-3b0c8970b514 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.918337 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-feaecb49-eb8f-4496-b9a4-3b0c8970b514 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.054400 Dec 18 21:10:56.919624 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2907/5774] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:56 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:56.924500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ec7014ae-2960-41cb-90d5-4b139488b812 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:56.925122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ec7014ae-2960-41cb-90d5-4b139488b812 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:56.932387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec7014ae-2960-41cb-90d5-4b139488b812 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.932858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec7014ae-2960-41cb-90d5-4b139488b812 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:56.933700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec7014ae-2960-41cb-90d5-4b139488b812 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:56.934156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ec7014ae-2960-41cb-90d5-4b139488b812 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.119669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:57.120379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.127353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.127851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.128609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.129054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.303073 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ec7014ae-2960-41cb-90d5-4b139488b812 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1832 microversion: 2.1 time: 0.382156 Dec 18 21:10:57.303753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2868/5775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:56 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1832 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:57.308827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:57.309639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.315552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.316171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.317326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.317849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.335720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:57.343222 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-206812de-1c49-4599-be55-71cef3274f6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1321 microversion: 2.1 time: 0.227597 Dec 18 21:10:57.351395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2908/5776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:57 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:57.355569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:57.356343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.364343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.364803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.365669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.367874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.512506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:57.520823 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93f4d968-3899-4b48-b3e3-9857bef54c5d tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1270 microversion: 2.1 time: 0.215460 Dec 18 21:10:57.521632 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2869/5777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:57 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:57.558765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:57.566310 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8189c2b6-6f50-4736-a10a-ec04eb43871e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1681 microversion: 2.1 time: 0.221373 Dec 18 21:10:57.567419 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2909/5778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:57 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:57.663455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5fa9ccf-31e2-45b8-bc2c-19d964acdf31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:57.664958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5fa9ccf-31e2-45b8-bc2c-19d964acdf31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.671992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ccf-31e2-45b8-bc2c-19d964acdf31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.672470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ccf-31e2-45b8-bc2c-19d964acdf31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.673280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ccf-31e2-45b8-bc2c-19d964acdf31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.673738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ccf-31e2-45b8-bc2c-19d964acdf31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.726748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c43a1cd0-b1a7-4f0b-b402-f94344444ad0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:57.727806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c43a1cd0-b1a7-4f0b-b402-f94344444ad0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.729634 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5fa9ccf-31e2-45b8-bc2c-19d964acdf31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action" status: 200 len: 32646 microversion: 2.1 time: 0.069818 Dec 18 21:10:57.730364 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2870/5779] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:57 2021] POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:57.736443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c43a1cd0-b1a7-4f0b-b402-f94344444ad0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.737440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c43a1cd0-b1a7-4f0b-b402-f94344444ad0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.738399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c43a1cd0-b1a7-4f0b-b402-f94344444ad0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.739063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c43a1cd0-b1a7-4f0b-b402-f94344444ad0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.793286 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c43a1cd0-b1a7-4f0b-b402-f94344444ad0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.070338 Dec 18 21:10:57.793950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2910/5780] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:57 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:10:57.810681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:57.811501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.818890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.819348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.820639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.821086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.910994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:57.911650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.918631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.919079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.919862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.920294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.955943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:57.962840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0532fa2fbc544ce09628c91a9b834a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534e25782c045aeb336ae118921c450', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:57.963436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] flavor_id is None. Assuming migration. {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 18 21:10:57.964034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:10:57.967227 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7612b6c-8bd2-469d-9235-7e0a5e396674 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1266 microversion: 2.1 time: 0.161671 Dec 18 21:10:57.967824 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2871/5781] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:57 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:57.973159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7c0b3ed-68af-4e99-aa8f-f3e9e637da27 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:57.974096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7c0b3ed-68af-4e99-aa8f-f3e9e637da27 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:57.980420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7c0b3ed-68af-4e99-aa8f-f3e9e637da27 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.980904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7c0b3ed-68af-4e99-aa8f-f3e9e637da27 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:57.981721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7c0b3ed-68af-4e99-aa8f-f3e9e637da27 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:57.982184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7c0b3ed-68af-4e99-aa8f-f3e9e637da27 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.022431 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7c0b3ed-68af-4e99-aa8f-f3e9e637da27 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.053304 Dec 18 21:10:58.023782 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2872/5782] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:57 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:10:58.142025 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d4717d52-44bb-4904-97ad-3c88d2bda3c4 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action" status: 202 len: 0 microversion: 2.1 time: 0.234954 Dec 18 21:10:58.150336 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2911/5783] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:57 2021] POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:58.151561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:58.152304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:58.159274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.159735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.160548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.161004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.161865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b482fa78-4688-4b52-943c-7747bc0733ed req-92f0d62e-37c1-4310-b960-974a59237435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4677eac8-1f9e-4309-b018-4b60ce5b1eb4", "name": "network-vif-plugged", "status": "completed", "tag": "66e4db18-6da1-4474-8bda-7ecda4c5e03f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:58.163734 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:10:58.163734 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:10:58.170837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b482fa78-4688-4b52-943c-7747bc0733ed req-92f0d62e-37c1-4310-b960-974a59237435 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.171290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b482fa78-4688-4b52-943c-7747bc0733ed req-92f0d62e-37c1-4310-b960-974a59237435 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.183957 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b482fa78-4688-4b52-943c-7747bc0733ed req-92f0d62e-37c1-4310-b960-974a59237435 service nova] Creating event network-vif-plugged:66e4db18-6da1-4474-8bda-7ecda4c5e03f for instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 on nch1-master-1 Dec 18 21:10:58.188719 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b482fa78-4688-4b52-943c-7747bc0733ed req-92f0d62e-37c1-4310-b960-974a59237435 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030484 Dec 18 21:10:58.189590 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2912/5784] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:10:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:10:58.360693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:58.361392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:58.368786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.369242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.370042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.370513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.375193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:58.386120 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-124186b2-9255-4f2e-8cd2-7dc77a8139dc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1690 microversion: 2.1 time: 0.238527 Dec 18 21:10:58.387044 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2873/5785] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:58 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:58.520271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:58.528427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39cae48d-deca-45a6-b2ef-3307ef09c21c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1321 microversion: 2.1 time: 0.171730 Dec 18 21:10:58.529038 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2913/5786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:58 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:58.537427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:58.538241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:58.545439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.545929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.546766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.547220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.691137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:58.699184 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-381f8594-2fdc-4dd1-9cec-d5cec0071218 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1459 microversion: 2.1 time: 0.165490 Dec 18 21:10:58.699751 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2874/5787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:58 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1459 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:58.717882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:58.718522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:58.724485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.724935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.725719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.726711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.804946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11709017-0283-4f3c-bebe-2c500c87fd1a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:58.805958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11709017-0283-4f3c-bebe-2c500c87fd1a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:58.812907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11709017-0283-4f3c-bebe-2c500c87fd1a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.813738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11709017-0283-4f3c-bebe-2c500c87fd1a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.814977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11709017-0283-4f3c-bebe-2c500c87fd1a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.815583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11709017-0283-4f3c-bebe-2c500c87fd1a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.861025 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11709017-0283-4f3c-bebe-2c500c87fd1a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.059812 Dec 18 21:10:58.864983 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2875/5788] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:58 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:10:58.890037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:58.897594 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af58d4bf-d658-412e-b778-57637fc22a7b tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1459 microversion: 2.1 time: 0.183344 Dec 18 21:10:58.898712 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2914/5789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:58 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1459 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:58.986226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:58.987153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:58.995575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.996352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:58.997380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:58.997912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.033825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c859206-778c-4c49-99bb-8d27655e23e5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:59.034815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c859206-778c-4c49-99bb-8d27655e23e5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:59.042309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c859206-778c-4c49-99bb-8d27655e23e5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.043097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c859206-778c-4c49-99bb-8d27655e23e5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.044059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c859206-778c-4c49-99bb-8d27655e23e5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.044502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c859206-778c-4c49-99bb-8d27655e23e5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.086620 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c859206-778c-4c49-99bb-8d27655e23e5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.055692 Dec 18 21:10:59.087622 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2915/5790] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:10:59 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:10:59.165227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:59.173262 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9cb5c9c8-a75e-4374-8f57-83e3c37e4322 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1266 microversion: 2.1 time: 0.191942 Dec 18 21:10:59.173827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2876/5791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:58 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:59.407609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:59.408629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:59.421021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.421448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.422522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.423150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.559118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:10:59.562518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:59.584819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.587503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.589991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.591899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.702188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:59.729917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f70193e4-2625-421c-be9b-08a8e57f27b8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1690 microversion: 2.1 time: 0.327568 Dec 18 21:10:59.741191 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2916/5792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:59 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1690 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:10:59.873596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4e4bee4-54e9-433f-bab4-c7686aa4e493 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:10:59.874767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4e4bee4-54e9-433f-bab4-c7686aa4e493 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:10:59.884991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4e4bee4-54e9-433f-bab4-c7686aa4e493 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.885446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4e4bee4-54e9-433f-bab4-c7686aa4e493 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.886474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4e4bee4-54e9-433f-bab4-c7686aa4e493 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:10:59.886915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4e4bee4-54e9-433f-bab4-c7686aa4e493 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:10:59.914828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:10:59.925526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9db17b00-3dfc-4baa-a75a-5f139e3114f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1321 microversion: 2.1 time: 0.382642 Dec 18 21:10:59.926691 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2877/5793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:10:59 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:10:59.933477 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4e4bee4-54e9-433f-bab4-c7686aa4e493 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.063519 Dec 18 21:10:59.934134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2917/5794] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:10:59 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:00.102050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c08d904f-582e-4cce-beda-50204c2208f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:00.104199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c08d904f-582e-4cce-beda-50204c2208f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:00.115142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08d904f-582e-4cce-beda-50204c2208f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.115941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08d904f-582e-4cce-beda-50204c2208f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.117768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08d904f-582e-4cce-beda-50204c2208f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.118456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08d904f-582e-4cce-beda-50204c2208f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.169622 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c08d904f-582e-4cce-beda-50204c2208f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.074447 Dec 18 21:11:00.170217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2878/5795] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:00 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:00.191290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:00.192317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:00.201204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.201790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.202827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.203329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.347546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:00.355553 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b37585b7-f912-4d6e-9cda-bb85a002d390 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1453 microversion: 2.1 time: 0.168726 Dec 18 21:11:00.356126 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2918/5796] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:00 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:00.372301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:00.373010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:00.380052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.380531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.381319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.381770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.521222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:00.529451 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d81d3632-4654-4290-87e6-b03ec31ba451 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1453 microversion: 2.1 time: 0.161357 Dec 18 21:11:00.530324 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2879/5797] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:00 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:00.750715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:00.752006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:00.762099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.763149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.764481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.765758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.943260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:00.944477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:00.952033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.952755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:00.953724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:00.954814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:01.014241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:01.025962 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-73933302-fd03-421f-91cb-40834d10d6a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.281397 Dec 18 21:11:01.037968 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2919/5798] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:00 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:01.044340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-737fa173-25ce-494d-8fea-f8c42be4c8e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:01.045511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-737fa173-25ce-494d-8fea-f8c42be4c8e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:01.052669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-737fa173-25ce-494d-8fea-f8c42be4c8e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:01.053359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-737fa173-25ce-494d-8fea-f8c42be4c8e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:01.054491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-737fa173-25ce-494d-8fea-f8c42be4c8e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:01.055138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-737fa173-25ce-494d-8fea-f8c42be4c8e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:01.108214 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-737fa173-25ce-494d-8fea-f8c42be4c8e4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.067167 Dec 18 21:11:01.111558 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2920/5799] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:01 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:01.117785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8f9a8cbb-7e61-411c-bd7b-633577104f8f req-e5b040ef-368e-420b-ab3f-de71932f7211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5153e88-ea06-4895-a8f2-9cd58000c109", "tag": "6952405e-dd10-48ed-b3df-0dbd6bb82a96"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:01.119923 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:01.119923 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:01.130346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8f9a8cbb-7e61-411c-bd7b-633577104f8f req-e5b040ef-368e-420b-ab3f-de71932f7211 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:01.131182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8f9a8cbb-7e61-411c-bd7b-633577104f8f req-e5b040ef-368e-420b-ab3f-de71932f7211 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:01.145766 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8f9a8cbb-7e61-411c-bd7b-633577104f8f req-e5b040ef-368e-420b-ab3f-de71932f7211 service nova] Creating event network-changed:6952405e-dd10-48ed-b3df-0dbd6bb82a96 for instance f5153e88-ea06-4895-a8f2-9cd58000c109 on nch2-master-1 Dec 18 21:11:01.152550 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8f9a8cbb-7e61-411c-bd7b-633577104f8f req-e5b040ef-368e-420b-ab3f-de71932f7211 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 Dec 18 21:11:01.153319 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2921/5800] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:01.185149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6460348d-1460-46ac-ae88-8af3fa56806b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:01.186181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6460348d-1460-46ac-ae88-8af3fa56806b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:01.199534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6460348d-1460-46ac-ae88-8af3fa56806b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:01.201030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6460348d-1460-46ac-ae88-8af3fa56806b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:01.202427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6460348d-1460-46ac-ae88-8af3fa56806b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:01.203583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6460348d-1460-46ac-ae88-8af3fa56806b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:01.267676 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6460348d-1460-46ac-ae88-8af3fa56806b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.086917 Dec 18 21:11:01.269314 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2922/5801] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:01 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:01.644532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:01.653060 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4939505e-6063-4a4e-81a7-f5ab2397fb67 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1321 microversion: 2.1 time: 0.713782 Dec 18 21:11:01.660948 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2880/5802] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:00 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:01.691714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-2382268a-e7fe-4839-b479-05ec1e1a948d req-0d6e5653-ca7c-47c3-bce5-6316360708cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b733c412-1cdb-45f5-9fa7-b68e4121ec4a", "name": "network-vif-plugged", "status": "completed", "tag": "2515fc60-3b2e-4cc2-999d-5614da915260"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:01.693830 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:01.693830 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:01.721623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2382268a-e7fe-4839-b479-05ec1e1a948d req-0d6e5653-ca7c-47c3-bce5-6316360708cc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:01.722513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2382268a-e7fe-4839-b479-05ec1e1a948d req-0d6e5653-ca7c-47c3-bce5-6316360708cc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:01.754300 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-2382268a-e7fe-4839-b479-05ec1e1a948d req-0d6e5653-ca7c-47c3-bce5-6316360708cc service nova] Creating event network-vif-plugged:2515fc60-3b2e-4cc2-999d-5614da915260 for instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a on nch1-master-1 Dec 18 21:11:01.761887 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-2382268a-e7fe-4839-b479-05ec1e1a948d req-0d6e5653-ca7c-47c3-bce5-6316360708cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074095 Dec 18 21:11:01.762537 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2923/5803] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:11:02.044853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:02.045538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:02.055029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.055947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.057087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.057611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.122750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-937111f9-7f38-4f5c-8a68-82c0dda25a62 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:02.124402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-937111f9-7f38-4f5c-8a68-82c0dda25a62 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:02.131956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937111f9-7f38-4f5c-8a68-82c0dda25a62 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.138684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937111f9-7f38-4f5c-8a68-82c0dda25a62 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.140361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937111f9-7f38-4f5c-8a68-82c0dda25a62 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.141229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-937111f9-7f38-4f5c-8a68-82c0dda25a62 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.199914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-937111f9-7f38-4f5c-8a68-82c0dda25a62 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.081105 Dec 18 21:11:02.201484 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2924/5804] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:02 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:02.281768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f955612-4c4b-44f2-b5c8-d1c3cec2c613 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:02.283428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f955612-4c4b-44f2-b5c8-d1c3cec2c613 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:02.292963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f955612-4c4b-44f2-b5c8-d1c3cec2c613 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.294053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f955612-4c4b-44f2-b5c8-d1c3cec2c613 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.304753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f955612-4c4b-44f2-b5c8-d1c3cec2c613 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.305468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f955612-4c4b-44f2-b5c8-d1c3cec2c613 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.351783 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f955612-4c4b-44f2-b5c8-d1c3cec2c613 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.073891 Dec 18 21:11:02.352791 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2925/5805] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:02 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:02.506720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:02.516025 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c30911e-f9cb-4c3d-931b-2ec62af64297 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.474572 Dec 18 21:11:02.516704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2881/5806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:02 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:02.669922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:02.670644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:02.677750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.678233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.679366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:02.679839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:02.923551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:02.933752 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb51e477-5084-4f72-8fe6-377319dae7d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1321 microversion: 2.1 time: 0.267606 Dec 18 21:11:02.934648 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2926/5807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:02 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:03.169828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-510da061-6a83-4e6f-9558-838100c81b88 req-30f176c3-276a-4328-99eb-dd88f053fb09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5153e88-ea06-4895-a8f2-9cd58000c109", "tag": "6952405e-dd10-48ed-b3df-0dbd6bb82a96"}, {"name": "network-changed", "server_uuid": "f5153e88-ea06-4895-a8f2-9cd58000c109", "tag": "6952405e-dd10-48ed-b3df-0dbd6bb82a96"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:03.171665 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:03.171665 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:03.179682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-510da061-6a83-4e6f-9558-838100c81b88 req-30f176c3-276a-4328-99eb-dd88f053fb09 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.180384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-510da061-6a83-4e6f-9558-838100c81b88 req-30f176c3-276a-4328-99eb-dd88f053fb09 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.196549 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-510da061-6a83-4e6f-9558-838100c81b88 req-30f176c3-276a-4328-99eb-dd88f053fb09 service nova] Creating event network-changed:6952405e-dd10-48ed-b3df-0dbd6bb82a96 for instance f5153e88-ea06-4895-a8f2-9cd58000c109 on nch2-master-1 Dec 18 21:11:03.197067 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-510da061-6a83-4e6f-9558-838100c81b88 req-30f176c3-276a-4328-99eb-dd88f053fb09 service nova] Creating event network-changed:6952405e-dd10-48ed-b3df-0dbd6bb82a96 for instance f5153e88-ea06-4895-a8f2-9cd58000c109 on nch2-master-1 Dec 18 21:11:03.204085 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-510da061-6a83-4e6f-9558-838100c81b88 req-30f176c3-276a-4328-99eb-dd88f053fb09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037472 Dec 18 21:11:03.204707 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2882/5808] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:03 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:11:03.213955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6b0dd2ba-a04e-4b39-ab0d-b92f4cdcaa63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:03.216172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6b0dd2ba-a04e-4b39-ab0d-b92f4cdcaa63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:03.230875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b0dd2ba-a04e-4b39-ab0d-b92f4cdcaa63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.231463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b0dd2ba-a04e-4b39-ab0d-b92f4cdcaa63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.232446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b0dd2ba-a04e-4b39-ab0d-b92f4cdcaa63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.232892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b0dd2ba-a04e-4b39-ab0d-b92f4cdcaa63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.284735 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6b0dd2ba-a04e-4b39-ab0d-b92f4cdcaa63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.075133 Dec 18 21:11:03.286879 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2927/5809] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:03 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:03.364258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79ceb899-0586-4e0d-b30d-0a3fd0756429 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:03.365913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-79ceb899-0586-4e0d-b30d-0a3fd0756429 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:03.375085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79ceb899-0586-4e0d-b30d-0a3fd0756429 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.375565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79ceb899-0586-4e0d-b30d-0a3fd0756429 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.376386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79ceb899-0586-4e0d-b30d-0a3fd0756429 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.376847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79ceb899-0586-4e0d-b30d-0a3fd0756429 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.430126 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-79ceb899-0586-4e0d-b30d-0a3fd0756429 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.069296 Dec 18 21:11:03.430938 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2883/5810] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:03 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:03.535632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:03.536369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:03.544109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.544567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.545361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.545973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.884770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:03.894624 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4e1941cd-2218-4c04-95c3-8515a0a551ab tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.363858 Dec 18 21:11:03.896946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d120cee1-e5af-41c2-904c-c3486642161e req-6ea01ece-158b-43fb-8803-e31406f29096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4677eac8-1f9e-4309-b018-4b60ce5b1eb4", "tag": "66e4db18-6da1-4474-8bda-7ecda4c5e03f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:03.898917 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:03.898917 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:03.905415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2928/5811] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:03 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:03.907251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d120cee1-e5af-41c2-904c-c3486642161e req-6ea01ece-158b-43fb-8803-e31406f29096 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.907696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d120cee1-e5af-41c2-904c-c3486642161e req-6ea01ece-158b-43fb-8803-e31406f29096 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.919719 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d120cee1-e5af-41c2-904c-c3486642161e req-6ea01ece-158b-43fb-8803-e31406f29096 service nova] Creating event network-changed:66e4db18-6da1-4474-8bda-7ecda4c5e03f for instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 on nch1-master-1 Dec 18 21:11:03.924832 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d120cee1-e5af-41c2-904c-c3486642161e req-6ea01ece-158b-43fb-8803-e31406f29096 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032037 Dec 18 21:11:03.925529 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2884/5812] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:03.951088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:03.951793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:03.957950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.958545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:03.959552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:03.959999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.299146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b6576fb-c4f0-40e6-a2fc-5dc7dcc9db32 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:04.301069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b6576fb-c4f0-40e6-a2fc-5dc7dcc9db32 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:04.309539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b6576fb-c4f0-40e6-a2fc-5dc7dcc9db32 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.310308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b6576fb-c4f0-40e6-a2fc-5dc7dcc9db32 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.311323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b6576fb-c4f0-40e6-a2fc-5dc7dcc9db32 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.311927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b6576fb-c4f0-40e6-a2fc-5dc7dcc9db32 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.356214 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b6576fb-c4f0-40e6-a2fc-5dc7dcc9db32 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.062310 Dec 18 21:11:04.360627 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2885/5813] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:04 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:04.443100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60578de8-5cb5-4bd8-8223-57ee42e73ea8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:04.444131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60578de8-5cb5-4bd8-8223-57ee42e73ea8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:04.451452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60578de8-5cb5-4bd8-8223-57ee42e73ea8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.451925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60578de8-5cb5-4bd8-8223-57ee42e73ea8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.452747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60578de8-5cb5-4bd8-8223-57ee42e73ea8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.453206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60578de8-5cb5-4bd8-8223-57ee42e73ea8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.495798 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60578de8-5cb5-4bd8-8223-57ee42e73ea8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.056912 Dec 18 21:11:04.496871 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2886/5814] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:04 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:04.627414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:04.636985 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f401554c-1c1b-400b-8cda-ed3eedd0fd5e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1501 microversion: 2.1 time: 0.689763 Dec 18 21:11:04.650318 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2929/5815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:03 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1501 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:04.653736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:04.654639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:04.661501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.662451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.664584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.665249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.912366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:04.913335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:04.920107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.920563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:04.921359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:04.921797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.007695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:05.017402 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d587f141-4ac2-4df5-8596-6e297e62432a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1501 microversion: 2.1 time: 0.368024 Dec 18 21:11:05.018104 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2887/5816] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:04 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:05.034387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:05.035454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:05.041945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.042463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.043277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.043729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.074509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:11:05.164037 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a88385a4-f376-41fe-9ee6-ff1dfb6cda95 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 204 len: 0 microversion: 2.1 time: 0.133193 Dec 18 21:11:05.165242 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2888/5817] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:11:05 2021] DELETE /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:11:05.174996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:05.175752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:05.182784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.183263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.184103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.184565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.350899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:05.358231 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c1777385-4cde-4f66-a6e1-80091c27351b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.449645 Dec 18 21:11:05.358832 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2930/5818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:04 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:05.368247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1fdb3c6-b1c2-436b-9646-dd3d886c7ac0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:05.369200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1fdb3c6-b1c2-436b-9646-dd3d886c7ac0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:05.375277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1fdb3c6-b1c2-436b-9646-dd3d886c7ac0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.375943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1fdb3c6-b1c2-436b-9646-dd3d886c7ac0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.376746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1fdb3c6-b1c2-436b-9646-dd3d886c7ac0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.377211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1fdb3c6-b1c2-436b-9646-dd3d886c7ac0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.420746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1fdb3c6-b1c2-436b-9646-dd3d886c7ac0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.055994 Dec 18 21:11:05.424754 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2931/5819] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:05 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:05.499658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:05.508097 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97988f3d-83e4-4f4e-93b1-b70250d23f07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1507 microversion: 2.1 time: 0.338511 Dec 18 21:11:05.508677 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2889/5820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:05 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:05.508880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a5fdb5b4-c3ce-4ce2-b389-e9642ce53f07 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:05.510055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a5fdb5b4-c3ce-4ce2-b389-e9642ce53f07 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:05.518243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5fdb5b4-c3ce-4ce2-b389-e9642ce53f07 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.518764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5fdb5b4-c3ce-4ce2-b389-e9642ce53f07 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.519660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5fdb5b4-c3ce-4ce2-b389-e9642ce53f07 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:05.520147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5fdb5b4-c3ce-4ce2-b389-e9642ce53f07 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:05.562552 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a5fdb5b4-c3ce-4ce2-b389-e9642ce53f07 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.058187 Dec 18 21:11:05.563209 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2932/5821] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:05 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:06.374934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:06.375568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:06.383037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.383508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.384319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.384782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.433463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b0116bab-a488-4774-8fd7-2998ee377ea4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:06.434539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b0116bab-a488-4774-8fd7-2998ee377ea4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:06.441592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0116bab-a488-4774-8fd7-2998ee377ea4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.442326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0116bab-a488-4774-8fd7-2998ee377ea4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.443116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0116bab-a488-4774-8fd7-2998ee377ea4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.443554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0116bab-a488-4774-8fd7-2998ee377ea4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.483433 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b0116bab-a488-4774-8fd7-2998ee377ea4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.054345 Dec 18 21:11:06.484089 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2933/5822] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:06 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:06.525397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:06.526106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:06.529589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:06.536926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.537389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.538226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.539309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.540205 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3921a83f-1c16-44b7-b682-6de56a0d613c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.168944 Dec 18 21:11:06.540896 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2890/5823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:06 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:06.574203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c4e9fcea-0bfd-43c8-bd0c-01e5cf09e3c0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:06.575158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c4e9fcea-0bfd-43c8-bd0c-01e5cf09e3c0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:06.581215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4e9fcea-0bfd-43c8-bd0c-01e5cf09e3c0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.581785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4e9fcea-0bfd-43c8-bd0c-01e5cf09e3c0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.582708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4e9fcea-0bfd-43c8-bd0c-01e5cf09e3c0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:06.585550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4e9fcea-0bfd-43c8-bd0c-01e5cf09e3c0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:06.629083 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c4e9fcea-0bfd-43c8-bd0c-01e5cf09e3c0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.058908 Dec 18 21:11:06.630146 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2891/5824] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:06 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:06.701344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:06.709310 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5054a7fa-b71f-4331-977f-a451748351e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 200 len: 1507 microversion: 2.1 time: 0.188057 Dec 18 21:11:06.710191 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2934/5825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:06 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:07.127031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-690c392d-0736-4479-8352-3a365082feab req-e01f0726-a410-4aed-a2df-3fd25baa8fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b733c412-1cdb-45f5-9fa7-b68e4121ec4a", "name": "network-vif-deleted", "tag": "2515fc60-3b2e-4cc2-999d-5614da915260"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:07.128942 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:07.128942 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:07.137684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-690c392d-0736-4479-8352-3a365082feab req-e01f0726-a410-4aed-a2df-3fd25baa8fea service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.138157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-690c392d-0736-4479-8352-3a365082feab req-e01f0726-a410-4aed-a2df-3fd25baa8fea service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.159971 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-690c392d-0736-4479-8352-3a365082feab req-e01f0726-a410-4aed-a2df-3fd25baa8fea service nova] Creating event network-vif-deleted:2515fc60-3b2e-4cc2-999d-5614da915260 for instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a on nch1-master-1 Dec 18 21:11:07.165377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-690c392d-0736-4479-8352-3a365082feab req-e01f0726-a410-4aed-a2df-3fd25baa8fea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042512 Dec 18 21:11:07.165982 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2892/5826] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:07.494926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a13aff3c-664f-42e4-8d04-0ba07b950d10 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:07.495770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a13aff3c-664f-42e4-8d04-0ba07b950d10 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:07.503261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13aff3c-664f-42e4-8d04-0ba07b950d10 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.503732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13aff3c-664f-42e4-8d04-0ba07b950d10 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.504525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13aff3c-664f-42e4-8d04-0ba07b950d10 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.504965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a13aff3c-664f-42e4-8d04-0ba07b950d10 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.547751 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a13aff3c-664f-42e4-8d04-0ba07b950d10 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.056598 Dec 18 21:11:07.548388 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2935/5827] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:07 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:07.557937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:07.558692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:07.564790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.565264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.566073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.566556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.641861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf7c8ad6-c568-4509-96b9-37ae7c21513b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:07.642906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf7c8ad6-c568-4509-96b9-37ae7c21513b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:07.650977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf7c8ad6-c568-4509-96b9-37ae7c21513b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.651685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf7c8ad6-c568-4509-96b9-37ae7c21513b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.652674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf7c8ad6-c568-4509-96b9-37ae7c21513b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.653116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf7c8ad6-c568-4509-96b9-37ae7c21513b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.694344 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf7c8ad6-c568-4509-96b9-37ae7c21513b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.056490 Dec 18 21:11:07.698847 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2936/5828] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:07 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:07.714307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:07.722155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dcb3f6d2-d387-4417-8ec1-8ce6305d0690 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.169038 Dec 18 21:11:07.722810 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2893/5829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:07 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:07.726963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:07.727694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:07.734565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.735015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.735791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:07.736226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:07.750630 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a could not be found. Dec 18 21:11:07.751152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:11:07.751975 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09926481-bcad-4dec-aae8-880c7363ed52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 404 len: 111 microversion: 2.1 time: 0.029232 Dec 18 21:11:07.752511 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2937/5830] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:07 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:11:07.762648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d63af83-401b-4edb-a058-29d96238a577 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: .version_select at 0x7f714fae4940>, body: {"keypair": {"name": "tempest-key-1279198803"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:07.776957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8d63af83-401b-4edb-a058-29d96238a577 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:11:07.781841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8d63af83-401b-4edb-a058-29d96238a577 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:11:07.949354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8d63af83-401b-4edb-a058-29d96238a577 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:11:07.954043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8d63af83-401b-4edb-a058-29d96238a577 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:11:07.967785 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d63af83-401b-4edb-a058-29d96238a577 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.208864 Dec 18 21:11:07.968387 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2894/5831] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:11:07 2021] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:07.977605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f353e9d9-f537-473a-945d-f59b41f77f74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '.version_select at 0x7f714f031af0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:07.980580 ncdv-master-1 devstack@n-api.service[140732]: WARNING oslo_db.sqlalchemy.utils [None req-f353e9d9-f537-473a-945d-f59b41f77f74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 18 21:11:07.986011 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f353e9d9-f537-473a-945d-f59b41f77f74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.012148 Dec 18 21:11:07.986586 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2938/5832] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 21:11:07 2021] GET /compute/v2.1/os-keypairs => generated 545 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:08.032971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1309809677", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "key_name": "tempest-key-1279198803", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:08.084356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:11:08.439221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:11:08.439704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:11:08.440201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:11:08.440692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:11:08.441128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:11:08.451646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.452105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.452947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.453399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.474850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:11:08.482707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:11:08.497677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:11:08.500075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:11:08.548540 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1da04aa-1831-4a79-bc0b-bad30a19505c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519430 Dec 18 21:11:08.549196 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2895/5833] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:11:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:11:08.559140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3d7fd42-5d65-4e6b-87cc-1f7ef40012f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:08.560318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3d7fd42-5d65-4e6b-87cc-1f7ef40012f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:08.561402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1f62e36-bf60-47f2-920c-f380192e1662 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:08.562471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1f62e36-bf60-47f2-920c-f380192e1662 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:08.574438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f62e36-bf60-47f2-920c-f380192e1662 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.575121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f62e36-bf60-47f2-920c-f380192e1662 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.576187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f62e36-bf60-47f2-920c-f380192e1662 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.576819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1f62e36-bf60-47f2-920c-f380192e1662 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.626856 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1f62e36-bf60-47f2-920c-f380192e1662 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.068647 Dec 18 21:11:08.627812 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2896/5834] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:08 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:08.628599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d3d7fd42-5d65-4e6b-87cc-1f7ef40012f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:08.636945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3d7fd42-5d65-4e6b-87cc-1f7ef40012f8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1229 microversion: 2.1 time: 0.081383 Dec 18 21:11:08.637531 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2939/5835] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:08 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1229 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:08.708286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-02c2146d-e24e-480d-b6f8-e8a3dbd1adaa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:08.709641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-02c2146d-e24e-480d-b6f8-e8a3dbd1adaa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:08.718419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02c2146d-e24e-480d-b6f8-e8a3dbd1adaa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.718677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02c2146d-e24e-480d-b6f8-e8a3dbd1adaa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.719493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02c2146d-e24e-480d-b6f8-e8a3dbd1adaa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.719950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02c2146d-e24e-480d-b6f8-e8a3dbd1adaa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.740986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:08.742478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:08.748980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.749583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.750459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:08.750948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:08.764102 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-02c2146d-e24e-480d-b6f8-e8a3dbd1adaa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.061153 Dec 18 21:11:08.765287 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2897/5836] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:08 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:08.896411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:08.905327 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-527774eb-782a-437e-b84a-eaa6e758e9a9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.168830 Dec 18 21:11:08.906174 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2940/5837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:08 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:09.641280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43f2d649-944d-4b15-9085-897158fbc874 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:09.642418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-43f2d649-944d-4b15-9085-897158fbc874 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:09.650615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43f2d649-944d-4b15-9085-897158fbc874 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.651171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43f2d649-944d-4b15-9085-897158fbc874 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:09.652055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43f2d649-944d-4b15-9085-897158fbc874 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.653070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43f2d649-944d-4b15-9085-897158fbc874 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:09.654201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:09.654844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:09.661865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.662366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:09.663880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.664348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:09.701871 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43f2d649-944d-4b15-9085-897158fbc874 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.061836 Dec 18 21:11:09.706290 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2898/5838] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:09 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:09.743825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:09.751203 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d33b4a12-9572-4dd6-a00c-720917f402aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1287 microversion: 2.1 time: 0.101074 Dec 18 21:11:09.761275 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2941/5839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:09 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:09.777417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f67917f8-0dc0-42a3-acc2-72592579bff5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:09.778511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f67917f8-0dc0-42a3-acc2-72592579bff5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:09.785624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67917f8-0dc0-42a3-acc2-72592579bff5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.786082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67917f8-0dc0-42a3-acc2-72592579bff5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:09.786916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67917f8-0dc0-42a3-acc2-72592579bff5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.787371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67917f8-0dc0-42a3-acc2-72592579bff5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:09.827893 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f67917f8-0dc0-42a3-acc2-72592579bff5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.055294 Dec 18 21:11:09.828544 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2899/5840] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:09 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:09.924627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:09.925272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:09.931366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.931819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:09.932619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:09.933058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.147692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:10.155207 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-292af5fa-0be7-46fd-92b8-f9e1d01c9902 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.234324 Dec 18 21:11:10.155878 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2942/5841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:09 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:10.713658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7f76a54e-f9e9-490d-abdf-6af06ad2202d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:10.714746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7f76a54e-f9e9-490d-abdf-6af06ad2202d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:10.722764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f76a54e-f9e9-490d-abdf-6af06ad2202d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:10.723235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f76a54e-f9e9-490d-abdf-6af06ad2202d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.724054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f76a54e-f9e9-490d-abdf-6af06ad2202d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:10.724510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f76a54e-f9e9-490d-abdf-6af06ad2202d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.765626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7f76a54e-f9e9-490d-abdf-6af06ad2202d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.055945 Dec 18 21:11:10.766527 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2900/5842] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:10 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:10.772243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:10.773555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:10.780308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:10.780758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.781545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:10.781979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.840593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee689e49-f378-4b40-bd1e-acff77876faf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:10.841657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee689e49-f378-4b40-bd1e-acff77876faf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:10.848611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee689e49-f378-4b40-bd1e-acff77876faf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:10.849148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee689e49-f378-4b40-bd1e-acff77876faf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.849991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee689e49-f378-4b40-bd1e-acff77876faf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:10.850452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee689e49-f378-4b40-bd1e-acff77876faf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.892750 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee689e49-f378-4b40-bd1e-acff77876faf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.056087 Dec 18 21:11:10.893404 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2901/5843] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:10 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:10.945909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-bad3204c-eb2a-4fbd-b1ae-8db931972735 req-1f52e211-3f8c-4f53-aa29-889e97704172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce", "tag": "129f263a-24f1-418d-886c-a43ff93acd2f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:10.947857 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:10.947857 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:10.955774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bad3204c-eb2a-4fbd-b1ae-8db931972735 req-1f52e211-3f8c-4f53-aa29-889e97704172 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:10.956240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bad3204c-eb2a-4fbd-b1ae-8db931972735 req-1f52e211-3f8c-4f53-aa29-889e97704172 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:10.970065 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-bad3204c-eb2a-4fbd-b1ae-8db931972735 req-1f52e211-3f8c-4f53-aa29-889e97704172 service nova] Creating event network-changed:129f263a-24f1-418d-886c-a43ff93acd2f for instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce on nch1-master-1 Dec 18 21:11:10.974857 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-bad3204c-eb2a-4fbd-b1ae-8db931972735 req-1f52e211-3f8c-4f53-aa29-889e97704172 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034954 Dec 18 21:11:10.975606 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2902/5844] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:11.037239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:11.045568 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fdaf6f71-7eeb-4bf2-af3f-30f744697942 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1329 microversion: 2.1 time: 0.280593 Dec 18 21:11:11.046155 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2943/5845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:10 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1329 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:11.174354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:11.175093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:11.181311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:11.181798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:11.182650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:11.183110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:11.427822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:11.435825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee3e4734-daed-4446-ac47-9b6cf74722a0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.265931 Dec 18 21:11:11.436435 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2903/5846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:11 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:11.777346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7885215c-8cfb-4f7a-b20c-3d23edc779f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:11.778333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7885215c-8cfb-4f7a-b20c-3d23edc779f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:11.785212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7885215c-8cfb-4f7a-b20c-3d23edc779f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:11.785674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7885215c-8cfb-4f7a-b20c-3d23edc779f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:11.786504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7885215c-8cfb-4f7a-b20c-3d23edc779f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:11.786951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7885215c-8cfb-4f7a-b20c-3d23edc779f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:11.831047 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7885215c-8cfb-4f7a-b20c-3d23edc779f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.057382 Dec 18 21:11:11.832206 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2944/5847] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:11 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:11.904803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c92e08c3-3e27-45d8-a069-763eaede2ea3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:11.905766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c92e08c3-3e27-45d8-a069-763eaede2ea3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:11.912565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c92e08c3-3e27-45d8-a069-763eaede2ea3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:11.913515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c92e08c3-3e27-45d8-a069-763eaede2ea3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:11.914537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c92e08c3-3e27-45d8-a069-763eaede2ea3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:11.914996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c92e08c3-3e27-45d8-a069-763eaede2ea3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:11.956741 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c92e08c3-3e27-45d8-a069-763eaede2ea3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.055546 Dec 18 21:11:11.960982 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2904/5848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:11 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:12.062455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:12.063160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:12.072469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.072931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:12.073745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.074218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:12.210521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:12.218093 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13459f99-8f4d-4080-adef-237ab469d833 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1329 microversion: 2.1 time: 0.160059 Dec 18 21:11:12.218704 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2945/5849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:12 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1329 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:12.455772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:12.456521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:12.464393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.464909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:12.465801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.466337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:12.611035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:12.618981 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a726f455-468a-417d-8c03-af512797f896 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.167564 Dec 18 21:11:12.619602 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2905/5850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:12 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:12.849883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4562fc41-0307-4d3e-bc97-1f4f3ef0d454 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:12.851772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4562fc41-0307-4d3e-bc97-1f4f3ef0d454 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:12.860414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562fc41-0307-4d3e-bc97-1f4f3ef0d454 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.860894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562fc41-0307-4d3e-bc97-1f4f3ef0d454 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:12.861691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562fc41-0307-4d3e-bc97-1f4f3ef0d454 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.862133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4562fc41-0307-4d3e-bc97-1f4f3ef0d454 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:12.902460 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4562fc41-0307-4d3e-bc97-1f4f3ef0d454 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.057344 Dec 18 21:11:12.903126 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2946/5851] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:12 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:12.968730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f4eb56f8-9662-4208-9e1c-cc3c66d49afd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:12.969606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f4eb56f8-9662-4208-9e1c-cc3c66d49afd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:12.977207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4eb56f8-9662-4208-9e1c-cc3c66d49afd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.977687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4eb56f8-9662-4208-9e1c-cc3c66d49afd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:12.978531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4eb56f8-9662-4208-9e1c-cc3c66d49afd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:12.978999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f4eb56f8-9662-4208-9e1c-cc3c66d49afd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:13.025033 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f4eb56f8-9662-4208-9e1c-cc3c66d49afd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.059884 Dec 18 21:11:13.026300 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2906/5852] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:12 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:13.239398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:13.240388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:13.248219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:13.248678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:13.249472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:13.249920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:13.381232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:13.389091 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-247092be-3d6d-4d8b-a5e4-371651b6d481 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1329 microversion: 2.1 time: 0.157279 Dec 18 21:11:13.389662 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2947/5853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:13 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1329 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:13.637462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:13.638173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:13.645231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:13.645693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:13.646513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:13.646971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:13.781131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:13.788486 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47006906-eead-41bf-8678-6ebd25f0de7f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.155091 Dec 18 21:11:13.789051 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2907/5854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:13 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:13.914499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-262cb1c7-ed3b-42d8-9b45-804ac39e2212 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:13.915377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-262cb1c7-ed3b-42d8-9b45-804ac39e2212 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:13.922908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262cb1c7-ed3b-42d8-9b45-804ac39e2212 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:13.923374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262cb1c7-ed3b-42d8-9b45-804ac39e2212 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:13.924167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262cb1c7-ed3b-42d8-9b45-804ac39e2212 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:13.924624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-262cb1c7-ed3b-42d8-9b45-804ac39e2212 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:13.965879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-262cb1c7-ed3b-42d8-9b45-804ac39e2212 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.055220 Dec 18 21:11:13.966544 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2948/5855] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:13 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:14.035775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0cdb7e8f-4407-4a71-beeb-9a60c6aec1ee tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:14.036705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0cdb7e8f-4407-4a71-beeb-9a60c6aec1ee tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:14.044897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cdb7e8f-4407-4a71-beeb-9a60c6aec1ee tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.045373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cdb7e8f-4407-4a71-beeb-9a60c6aec1ee tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:14.046171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cdb7e8f-4407-4a71-beeb-9a60c6aec1ee tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.046655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cdb7e8f-4407-4a71-beeb-9a60c6aec1ee tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:14.093270 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0cdb7e8f-4407-4a71-beeb-9a60c6aec1ee tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.061032 Dec 18 21:11:14.093893 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2908/5856] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:14 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:14.406654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:14.407355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:14.414851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.415308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:14.416093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.416535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:14.544428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:14.552129 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c88325ae-0d4b-4b1b-9d6c-5b73ebd675fd tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1329 microversion: 2.1 time: 0.149595 Dec 18 21:11:14.552701 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2949/5857] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:14 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1329 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:14.805823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:14.806599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:14.813627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.814102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:14.814932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.815397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:14.958831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:14.966860 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ba489dc-ba1b-49e6-95a4-325032d6f536 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.165217 Dec 18 21:11:14.967485 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2909/5858] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:14 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:14.977382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2bb6b8f-b411-4d60-bdb9-d417b333adca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:14.978416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2bb6b8f-b411-4d60-bdb9-d417b333adca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:14.985961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bb6b8f-b411-4d60-bdb9-d417b333adca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.986463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bb6b8f-b411-4d60-bdb9-d417b333adca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:14.987256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bb6b8f-b411-4d60-bdb9-d417b333adca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:14.987703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bb6b8f-b411-4d60-bdb9-d417b333adca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:15.027120 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2bb6b8f-b411-4d60-bdb9-d417b333adca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.053584 Dec 18 21:11:15.027758 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2950/5859] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:14 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:15.105032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ef743c4-1050-477c-8b3a-c68abfb97bb1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:15.106102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ef743c4-1050-477c-8b3a-c68abfb97bb1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:15.113722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ef743c4-1050-477c-8b3a-c68abfb97bb1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:15.114195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ef743c4-1050-477c-8b3a-c68abfb97bb1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:15.115037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ef743c4-1050-477c-8b3a-c68abfb97bb1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:15.115535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ef743c4-1050-477c-8b3a-c68abfb97bb1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:15.154117 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ef743c4-1050-477c-8b3a-c68abfb97bb1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.052886 Dec 18 21:11:15.154995 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2910/5860] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:15 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:15.569366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:15.570065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:15.576506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:15.576957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:15.577741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:15.578179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:15.728370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:15.741176 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15775ff1-4473-44bd-a819-32e37f815835 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1329 microversion: 2.1 time: 0.176530 Dec 18 21:11:15.742147 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2951/5861] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:15 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1329 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:15.984421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:15.985129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:15.992119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:15.992585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:15.993378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:15.993830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:16.039020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca3780f0-ad10-451f-b1c8-1a433db36a46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:16.040551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca3780f0-ad10-451f-b1c8-1a433db36a46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:16.048073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca3780f0-ad10-451f-b1c8-1a433db36a46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:16.048648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca3780f0-ad10-451f-b1c8-1a433db36a46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:16.049582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca3780f0-ad10-451f-b1c8-1a433db36a46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:16.050246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca3780f0-ad10-451f-b1c8-1a433db36a46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:16.098003 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca3780f0-ad10-451f-b1c8-1a433db36a46 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.062533 Dec 18 21:11:16.098767 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2952/5862] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:16 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:16.132885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:16.140446 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ac3caf1-2a66-427d-b2b8-8a4dae9c779f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.160172 Dec 18 21:11:16.141033 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2911/5863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:15 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:16.167645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dfa0b876-8bd5-463a-b914-b86c3789e20d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:16.168661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dfa0b876-8bd5-463a-b914-b86c3789e20d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:16.176186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0b876-8bd5-463a-b914-b86c3789e20d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:16.176839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0b876-8bd5-463a-b914-b86c3789e20d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:16.177635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0b876-8bd5-463a-b914-b86c3789e20d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:16.178072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0b876-8bd5-463a-b914-b86c3789e20d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:16.233196 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dfa0b876-8bd5-463a-b914-b86c3789e20d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.070999 Dec 18 21:11:16.234112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2953/5864] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:16 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:16.758239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:16.758924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:16.765503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:16.765980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:16.766891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:16.767354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.110202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62e39be9-26c3-40df-be77-1ab65e7b2b01 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:17.111353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62e39be9-26c3-40df-be77-1ab65e7b2b01 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:17.119915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62e39be9-26c3-40df-be77-1ab65e7b2b01 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.120379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62e39be9-26c3-40df-be77-1ab65e7b2b01 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.121276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62e39be9-26c3-40df-be77-1ab65e7b2b01 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.121725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62e39be9-26c3-40df-be77-1ab65e7b2b01 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.174954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62e39be9-26c3-40df-be77-1ab65e7b2b01 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.069096 Dec 18 21:11:17.176521 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2954/5865] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:17 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:17.181696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:17.182487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:17.189926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.190414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.191219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.191654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.302892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:17.310862 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-14fc093f-c5f9-45fd-a754-6e23aa7f0132 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1329 microversion: 2.1 time: 0.556362 Dec 18 21:11:17.311436 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2912/5866] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:16 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1329 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:17.315786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d3ddea15-3425-4a56-9106-d4d7163f7e7c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:17.316713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d3ddea15-3425-4a56-9106-d4d7163f7e7c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:17.325452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ddea15-3425-4a56-9106-d4d7163f7e7c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.325997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ddea15-3425-4a56-9106-d4d7163f7e7c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.326894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ddea15-3425-4a56-9106-d4d7163f7e7c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.327414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3ddea15-3425-4a56-9106-d4d7163f7e7c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.369631 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d3ddea15-3425-4a56-9106-d4d7163f7e7c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.056849 Dec 18 21:11:17.370870 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2913/5867] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:17 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:17.375438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:17.383665 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c92dff3a-083b-4f69-a6ac-a253a5fead31 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1695 microversion: 2.1 time: 0.206483 Dec 18 21:11:17.384232 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2955/5868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:17 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:17.729726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4eb667e8-35e4-45ee-8314-b2f65cbea57d req-f28d6326-7d39-4ba1-b884-a8e9463c8b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce", "name": "network-vif-plugged", "status": "completed", "tag": "129f263a-24f1-418d-886c-a43ff93acd2f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:17.731748 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:17.731748 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:17.745465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4eb667e8-35e4-45ee-8314-b2f65cbea57d req-f28d6326-7d39-4ba1-b884-a8e9463c8b87 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.745927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4eb667e8-35e4-45ee-8314-b2f65cbea57d req-f28d6326-7d39-4ba1-b884-a8e9463c8b87 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.758442 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4eb667e8-35e4-45ee-8314-b2f65cbea57d req-f28d6326-7d39-4ba1-b884-a8e9463c8b87 service nova] Creating event network-vif-plugged:129f263a-24f1-418d-886c-a43ff93acd2f for instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce on nch1-master-1 Dec 18 21:11:17.763370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4eb667e8-35e4-45ee-8314-b2f65cbea57d req-f28d6326-7d39-4ba1-b884-a8e9463c8b87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038319 Dec 18 21:11:17.764065 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2914/5869] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:17.930743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-36ef5e77-39f8-42f1-af84-f294c91dbb51 req-cc757a81-dceb-4e28-888b-b8dedfe75c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "name": "network-vif-unplugged", "status": "completed", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:17.932400 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:17.932400 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:17.939798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-36ef5e77-39f8-42f1-af84-f294c91dbb51 req-cc757a81-dceb-4e28-888b-b8dedfe75c44 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:17.940252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-36ef5e77-39f8-42f1-af84-f294c91dbb51 req-cc757a81-dceb-4e28-888b-b8dedfe75c44 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:17.952922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-36ef5e77-39f8-42f1-af84-f294c91dbb51 req-cc757a81-dceb-4e28-888b-b8dedfe75c44 service nova] Creating event network-vif-unplugged:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch2-master-1 Dec 18 21:11:17.958405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-36ef5e77-39f8-42f1-af84-f294c91dbb51 req-cc757a81-dceb-4e28-888b-b8dedfe75c44 service nova] Instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:11:17.968852 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-36ef5e77-39f8-42f1-af84-f294c91dbb51 req-cc757a81-dceb-4e28-888b-b8dedfe75c44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042828 Dec 18 21:11:17.969465 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2956/5870] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:18.189014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a83f843-9dca-4544-b18b-c76b17529293 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:18.190027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a83f843-9dca-4544-b18b-c76b17529293 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:18.197273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a83f843-9dca-4544-b18b-c76b17529293 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.197683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a83f843-9dca-4544-b18b-c76b17529293 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.198541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a83f843-9dca-4544-b18b-c76b17529293 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.198994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a83f843-9dca-4544-b18b-c76b17529293 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.318203 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a83f843-9dca-4544-b18b-c76b17529293 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.133332 Dec 18 21:11:18.322414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2915/5871] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:18 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:18.329301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:18.330030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:18.336646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.337106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.337896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.338397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.382227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8141f8c5-2170-410a-a4b8-a445e4c39550 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:18.383597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8141f8c5-2170-410a-a4b8-a445e4c39550 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:18.391171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8141f8c5-2170-410a-a4b8-a445e4c39550 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.391646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8141f8c5-2170-410a-a4b8-a445e4c39550 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.392436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8141f8c5-2170-410a-a4b8-a445e4c39550 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.392888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8141f8c5-2170-410a-a4b8-a445e4c39550 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.437883 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8141f8c5-2170-410a-a4b8-a445e4c39550 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.059991 Dec 18 21:11:18.438665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2916/5872] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:18 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:18.506093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:18.506868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:18.514679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.515339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.516411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:18.517134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:18.571201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:18.580009 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84036008-25a3-458e-9e25-c1e903e550c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1329 microversion: 2.1 time: 0.255145 Dec 18 21:11:18.581286 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2957/5873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:18 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1329 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:18.745248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:18.752783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54ef8a62-6b56-4c54-91d9-ea26f17da95c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1694 microversion: 2.1 time: 0.250978 Dec 18 21:11:18.753297 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2917/5874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:18 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:19.329944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-04da4c91-222d-4c46-aeeb-81fde1892d5c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:19.330934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-04da4c91-222d-4c46-aeeb-81fde1892d5c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:19.338416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04da4c91-222d-4c46-aeeb-81fde1892d5c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.338874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04da4c91-222d-4c46-aeeb-81fde1892d5c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.339692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04da4c91-222d-4c46-aeeb-81fde1892d5c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.340140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04da4c91-222d-4c46-aeeb-81fde1892d5c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.380084 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-04da4c91-222d-4c46-aeeb-81fde1892d5c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.054000 Dec 18 21:11:19.380743 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2958/5875] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:19 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:19.450648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aede27e6-56e5-4643-a49e-756127b4475b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:19.451572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aede27e6-56e5-4643-a49e-756127b4475b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:19.458445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aede27e6-56e5-4643-a49e-756127b4475b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.458917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aede27e6-56e5-4643-a49e-756127b4475b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.460356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aede27e6-56e5-4643-a49e-756127b4475b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.460817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aede27e6-56e5-4643-a49e-756127b4475b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.503792 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aede27e6-56e5-4643-a49e-756127b4475b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.056822 Dec 18 21:11:19.504453 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2918/5876] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:19 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:19.597929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:19.598666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:19.605799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.606240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.607071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.607505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.742779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:19.750690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4762bb7a-01c8-4e19-94a1-d5400f37077f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1509 microversion: 2.1 time: 0.156866 Dec 18 21:11:19.751256 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2959/5877] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:19 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:19.767612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:19.768322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:19.769444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:19.770085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:19.775906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.776369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.776533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.776994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.777160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.777614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.777781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:19.778224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:19.979845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:19.983595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:19.987730 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a83eebd5-3e7a-4334-8c59-eb29f521e1e5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1509 microversion: 2.1 time: 0.224173 Dec 18 21:11:19.988445 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2919/5878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:19 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:20.001761 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-236e77a9-9665-4fbd-b70a-a2a343e32a77 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1692 microversion: 2.1 time: 0.235705 Dec 18 21:11:20.010303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2960/5879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:19 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1692 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:20.010475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:20.010613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-838fe0ac-475a-44ab-9b19-81898377ab31 req-18cf306d-e76d-4fd3-8b6e-a2fd7eaa99c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:20.010714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:20.010796 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:20.010796 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:20.014522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.015004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.015809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.015922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-838fe0ac-475a-44ab-9b19-81898377ab31 req-18cf306d-e76d-4fd3-8b6e-a2fd7eaa99c6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.016273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.016425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-838fe0ac-475a-44ab-9b19-81898377ab31 req-18cf306d-e76d-4fd3-8b6e-a2fd7eaa99c6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.027818 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-838fe0ac-475a-44ab-9b19-81898377ab31 req-18cf306d-e76d-4fd3-8b6e-a2fd7eaa99c6 service nova] Creating event network-changed:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch2-master-1 Dec 18 21:11:20.033033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-838fe0ac-475a-44ab-9b19-81898377ab31 req-18cf306d-e76d-4fd3-8b6e-a2fd7eaa99c6 service nova] Instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:11:20.041741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:11:20.043893 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-838fe0ac-475a-44ab-9b19-81898377ab31 req-18cf306d-e76d-4fd3-8b6e-a2fd7eaa99c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040129 Dec 18 21:11:20.044761 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2961/5880] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:20.129011 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-442c2b38-2ef4-4389-9f63-fa8e26f65100 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 204 len: 0 microversion: 2.1 time: 0.126984 Dec 18 21:11:20.129818 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2920/5881] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:11:19 2021] DELETE /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:11:20.143404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:20.144749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:20.151768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.152149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.152940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.153378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.393647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-845d92f9-1b9d-424e-848a-54e709f5777e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:20.394355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-845d92f9-1b9d-424e-848a-54e709f5777e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:20.401671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-845d92f9-1b9d-424e-848a-54e709f5777e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.402173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-845d92f9-1b9d-424e-848a-54e709f5777e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.403197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-845d92f9-1b9d-424e-848a-54e709f5777e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.403657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-845d92f9-1b9d-424e-848a-54e709f5777e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.449487 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-845d92f9-1b9d-424e-848a-54e709f5777e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.060499 Dec 18 21:11:20.450167 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2921/5882] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:20 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:20.515173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:20.517911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48fe2140-0c0f-45d9-ba55-4a91801bc718 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:20.517911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48fe2140-0c0f-45d9-ba55-4a91801bc718 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:20.527713 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c3ae223e-90bb-4380-9b3a-40782b4da451 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1515 microversion: 2.1 time: 0.392038 Dec 18 21:11:20.529123 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2962/5883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:20 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1515 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:20.530367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48fe2140-0c0f-45d9-ba55-4a91801bc718 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.530845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48fe2140-0c0f-45d9-ba55-4a91801bc718 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.531675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48fe2140-0c0f-45d9-ba55-4a91801bc718 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:20.532128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48fe2140-0c0f-45d9-ba55-4a91801bc718 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:20.577059 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48fe2140-0c0f-45d9-ba55-4a91801bc718 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.064446 Dec 18 21:11:20.577719 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2922/5884] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:20 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:21.019720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:21.020749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:21.027275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.028013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.028992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.029620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.172643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:21.180551 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0feed9ca-c9c0-488e-a81f-6d23eee6a90b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1692 microversion: 2.1 time: 0.164705 Dec 18 21:11:21.181115 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2963/5885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:21 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:21.463359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5d18766-f609-4c9f-bd6a-35ec0d3bb84b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:21.464540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5d18766-f609-4c9f-bd6a-35ec0d3bb84b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:21.472022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5d18766-f609-4c9f-bd6a-35ec0d3bb84b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.472518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5d18766-f609-4c9f-bd6a-35ec0d3bb84b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.473403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5d18766-f609-4c9f-bd6a-35ec0d3bb84b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.473921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5d18766-f609-4c9f-bd6a-35ec0d3bb84b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.520731 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5d18766-f609-4c9f-bd6a-35ec0d3bb84b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.062099 Dec 18 21:11:21.521514 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2923/5886] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:21 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:21.546847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:21.547456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:21.554070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.554551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.555371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.555837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.591565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-578274b9-09c3-4e22-929e-14e543695cc1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:21.592955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-578274b9-09c3-4e22-929e-14e543695cc1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:21.605412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578274b9-09c3-4e22-929e-14e543695cc1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.605888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578274b9-09c3-4e22-929e-14e543695cc1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.606754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578274b9-09c3-4e22-929e-14e543695cc1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:21.607923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-578274b9-09c3-4e22-929e-14e543695cc1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:21.652547 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-578274b9-09c3-4e22-929e-14e543695cc1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 32190 microversion: 2.1 time: 0.065705 Dec 18 21:11:21.654297 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2924/5887] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:21 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 32190 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:21.724343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:21.735658 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0da004ec-d3c7-4f96-8fb2-05389056d528 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 200 len: 1515 microversion: 2.1 time: 0.192588 Dec 18 21:11:21.736608 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2964/5888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:21 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:22.164719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-33a467f5-0054-4ba4-8992-e242de59c04e req-1fe2c2b6-8f12-4299-b282-d6c12b74768a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce", "name": "network-vif-deleted", "tag": "129f263a-24f1-418d-886c-a43ff93acd2f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:22.166417 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:22.166417 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:22.175262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-33a467f5-0054-4ba4-8992-e242de59c04e req-1fe2c2b6-8f12-4299-b282-d6c12b74768a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.176218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-33a467f5-0054-4ba4-8992-e242de59c04e req-1fe2c2b6-8f12-4299-b282-d6c12b74768a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.189358 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-33a467f5-0054-4ba4-8992-e242de59c04e req-1fe2c2b6-8f12-4299-b282-d6c12b74768a service nova] Creating event network-vif-deleted:129f263a-24f1-418d-886c-a43ff93acd2f for instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce on nch1-master-1 Dec 18 21:11:22.195926 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-33a467f5-0054-4ba4-8992-e242de59c04e req-1fe2c2b6-8f12-4299-b282-d6c12b74768a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035709 Dec 18 21:11:22.200257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:22.200754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:22.200955 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2925/5889] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:22.217340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.224051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.224915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.226033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.394596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:22.402566 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b5e17d3a-3db1-4fcb-afb1-f86a93676f00 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1689 microversion: 2.1 time: 0.208545 Dec 18 21:11:22.403153 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2965/5890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:22 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:22.420176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ade63960-823c-4071-8328-012212ec0ff0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:22.420812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ade63960-823c-4071-8328-012212ec0ff0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:22.426820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade63960-823c-4071-8328-012212ec0ff0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.427271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade63960-823c-4071-8328-012212ec0ff0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.428076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade63960-823c-4071-8328-012212ec0ff0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.429093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ade63960-823c-4071-8328-012212ec0ff0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.486672 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ade63960-823c-4071-8328-012212ec0ff0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action" status: 204 len: 0 microversion: 2.1 time: 0.070766 Dec 18 21:11:22.487481 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2926/5891] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:22 2021] POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:11:22.495432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:22.496047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:22.502074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.502532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.503322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.503795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.533838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3160f019-f054-48d2-be06-049176cca20a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:22.535011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3160f019-f054-48d2-be06-049176cca20a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:22.542787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3160f019-f054-48d2-be06-049176cca20a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.543610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3160f019-f054-48d2-be06-049176cca20a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.544700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3160f019-f054-48d2-be06-049176cca20a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.545307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3160f019-f054-48d2-be06-049176cca20a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.597080 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3160f019-f054-48d2-be06-049176cca20a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.067037 Dec 18 21:11:22.597961 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2927/5892] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:22 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:22.666941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7cd9a4a-141d-4de6-911b-2de2869ad78a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:22.667995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7cd9a4a-141d-4de6-911b-2de2869ad78a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:22.675358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7cd9a4a-141d-4de6-911b-2de2869ad78a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.675974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7cd9a4a-141d-4de6-911b-2de2869ad78a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.676790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7cd9a4a-141d-4de6-911b-2de2869ad78a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.677448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7cd9a4a-141d-4de6-911b-2de2869ad78a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.749419 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7cd9a4a-141d-4de6-911b-2de2869ad78a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 200 len: 40341 microversion: 2.1 time: 0.086970 Dec 18 21:11:22.750413 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2928/5893] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:22 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 40341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:22.756434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:22.757344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:22.764549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.765103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.765992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.766556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.783184 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce could not be found. Dec 18 21:11:22.783965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:11:22.785000 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d64bd143-31a7-4723-89ac-4c05016f9540 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 404 len: 111 microversion: 2.1 time: 0.032932 Dec 18 21:11:22.785599 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2929/5894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:22 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:11:22.786691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:22.790890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67aec44c-c097-4339-acf4-37925d7d005f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:22.791441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67aec44c-c097-4339-acf4-37925d7d005f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:22.797516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67aec44c-c097-4339-acf4-37925d7d005f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.797986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67aec44c-c097-4339-acf4-37925d7d005f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.798822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67aec44c-c097-4339-acf4-37925d7d005f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:22.799273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67aec44c-c097-4339-acf4-37925d7d005f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:22.806846 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a64690e4-ae37-471f-a19b-1d2a66d3dfd9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1689 microversion: 2.1 time: 0.309837 Dec 18 21:11:22.808269 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2966/5895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:22 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1689 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:22.814551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff2b5465-6f93-4ef0-95e7-9a8c13e7dc28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '.version_select at 0x7f714fb0e3a0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:22.839048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67aec44c-c097-4339-acf4-37925d7d005f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/ips" status: 200 len: 144 microversion: 2.1 time: 0.052270 Dec 18 21:11:22.839817 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2930/5896] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:11:22 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/ips => generated 144 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:22.847114 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ff2b5465-6f93-4ef0-95e7-9a8c13e7dc28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-key-1279198803" status: 202 len: 0 microversion: 2.1 time: 0.030094 Dec 18 21:11:22.848108 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2967/5897] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 21:11:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-key-1279198803 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:22.907549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1664761423", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:22.964380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:11:23.610093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8cadc0b7-628d-4714-b2a2-c8125dffdee3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:23.611053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8cadc0b7-628d-4714-b2a2-c8125dffdee3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:23.621487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cadc0b7-628d-4714-b2a2-c8125dffdee3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:23.622025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cadc0b7-628d-4714-b2a2-c8125dffdee3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:23.622855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cadc0b7-628d-4714-b2a2-c8125dffdee3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:23.623293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cadc0b7-628d-4714-b2a2-c8125dffdee3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:23.680268 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8cadc0b7-628d-4714-b2a2-c8125dffdee3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.074472 Dec 18 21:11:23.681129 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2968/5898] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:23 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:23.827963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:23.828980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:23.847246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:23.848060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:23.849850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:23.851307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:24.079364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:11:24.080407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:11:24.081293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:11:24.081950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:11:24.082632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:11:24.094620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:24.095521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:24.096775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:24.097648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:24.118887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:11:24.125592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:11:24.140944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:11:24.143949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:11:24.175673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:24.183954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c251d032-4a08-414a-9e32-dce07bbcf49e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1689 microversion: 2.1 time: 0.362262 Dec 18 21:11:24.184753 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2969/5899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:23 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1689 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:24.189590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-36ba9a98-029e-4871-8db2-b687247abb91 req-7533430a-63e3-4b7c-a884-0368601cbfaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "name": "network-vif-plugged", "status": "completed", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:24.191205 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:24.191205 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:24.200528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-36ba9a98-029e-4871-8db2-b687247abb91 req-7533430a-63e3-4b7c-a884-0368601cbfaf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:24.201100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-36ba9a98-029e-4871-8db2-b687247abb91 req-7533430a-63e3-4b7c-a884-0368601cbfaf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:24.229186 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67922b35-b4bf-4a4c-add9-1c9688f540c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324523 Dec 18 21:11:24.230064 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2931/5900] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:11:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:11:24.241399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b0f9ffad-6375-450a-b658-2052af86dd07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:24.242133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b0f9ffad-6375-450a-b658-2052af86dd07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:24.248336 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-36ba9a98-029e-4871-8db2-b687247abb91 req-7533430a-63e3-4b7c-a884-0368601cbfaf service nova] Creating event network-vif-plugged:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch2-master-1 Dec 18 21:11:24.255301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-36ba9a98-029e-4871-8db2-b687247abb91 req-7533430a-63e3-4b7c-a884-0368601cbfaf service nova] Instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:11:24.270606 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-36ba9a98-029e-4871-8db2-b687247abb91 req-7533430a-63e3-4b7c-a884-0368601cbfaf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084121 Dec 18 21:11:24.271334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2970/5901] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:24.346793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b0f9ffad-6375-450a-b658-2052af86dd07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:24.355115 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b0f9ffad-6375-450a-b658-2052af86dd07 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1209 microversion: 2.1 time: 0.118381 Dec 18 21:11:24.356245 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2932/5902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:24 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:24.694425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c9713199-f0f5-4e9c-8528-eff900db3922 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:24.695495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c9713199-f0f5-4e9c-8528-eff900db3922 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:24.702836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9713199-f0f5-4e9c-8528-eff900db3922 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:24.703199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9713199-f0f5-4e9c-8528-eff900db3922 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:24.704043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9713199-f0f5-4e9c-8528-eff900db3922 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:24.704528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9713199-f0f5-4e9c-8528-eff900db3922 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:24.756672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c9713199-f0f5-4e9c-8528-eff900db3922 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.067428 Dec 18 21:11:24.757700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2971/5903] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:24 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:25.201629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:25.202352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:25.210763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.211271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.212121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.212585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.374298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:25.374298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:25.381043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.381807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.382863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.383768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.502964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:25.512223 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6bec8d6d-b7e1-4222-8582-16c24cb858ac tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1269 microversion: 2.1 time: 0.143448 Dec 18 21:11:25.513397 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2972/5904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:25 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:25.515548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:25.518714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5478ba5b-5307-4543-9b4b-f9c206f808d4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:25.519930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5478ba5b-5307-4543-9b4b-f9c206f808d4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:25.527166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5478ba5b-5307-4543-9b4b-f9c206f808d4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.527620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5478ba5b-5307-4543-9b4b-f9c206f808d4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.529154 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-50f3a8c6-2658-4293-87d4-e9f3f3813d15 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1681 microversion: 2.1 time: 0.329566 Dec 18 21:11:25.530459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5478ba5b-5307-4543-9b4b-f9c206f808d4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.531180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5478ba5b-5307-4543-9b4b-f9c206f808d4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.548951 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2933/5905] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:25 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1681 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:25.771682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa6d172a-8893-4bec-86e0-2d1c0f2c77c3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:25.773338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa6d172a-8893-4bec-86e0-2d1c0f2c77c3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:25.781792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6d172a-8893-4bec-86e0-2d1c0f2c77c3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.782527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6d172a-8893-4bec-86e0-2d1c0f2c77c3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.783633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6d172a-8893-4bec-86e0-2d1c0f2c77c3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:25.784338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6d172a-8893-4bec-86e0-2d1c0f2c77c3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:25.840481 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa6d172a-8893-4bec-86e0-2d1c0f2c77c3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.074120 Dec 18 21:11:25.841775 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2934/5906] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:25 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:25.893126 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5478ba5b-5307-4543-9b4b-f9c206f808d4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377995 Dec 18 21:11:25.893913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2973/5907] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:11:25 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:26.538585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:26.542504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:26.562455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:26.563737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:26.564967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:26.565494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:26.843673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:26.854536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3cc0aa14-3015-47f7-9469-78a02ca634be tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:26.855802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3cc0aa14-3015-47f7-9469-78a02ca634be tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:26.864204 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2195556-6105-4d38-be68-65c45e493dbf tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1309 microversion: 2.1 time: 0.335652 Dec 18 21:11:26.866619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2935/5908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:26 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:26.870199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cc0aa14-3015-47f7-9469-78a02ca634be tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:26.870936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cc0aa14-3015-47f7-9469-78a02ca634be tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:26.871739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cc0aa14-3015-47f7-9469-78a02ca634be tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:26.872180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cc0aa14-3015-47f7-9469-78a02ca634be tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:26.920653 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3cc0aa14-3015-47f7-9469-78a02ca634be tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.070717 Dec 18 21:11:26.921443 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2974/5909] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:26 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:27.036622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2ec9f343-ce24-42e8-ab3c-3b66e4df7ef0 req-a130eabf-9e52-4d43-a887-aa52d1acf77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7893530-a701-4c2f-8b28-18e55d0f3110", "tag": "2a4210e6-9e25-4f49-8bbb-72cbab194ca3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:27.038724 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:27.038724 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:27.046894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2ec9f343-ce24-42e8-ab3c-3b66e4df7ef0 req-a130eabf-9e52-4d43-a887-aa52d1acf77b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:27.047483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2ec9f343-ce24-42e8-ab3c-3b66e4df7ef0 req-a130eabf-9e52-4d43-a887-aa52d1acf77b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:27.060290 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2ec9f343-ce24-42e8-ab3c-3b66e4df7ef0 req-a130eabf-9e52-4d43-a887-aa52d1acf77b service nova] Creating event network-changed:2a4210e6-9e25-4f49-8bbb-72cbab194ca3 for instance e7893530-a701-4c2f-8b28-18e55d0f3110 on nch1-master-1 Dec 18 21:11:27.065629 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2ec9f343-ce24-42e8-ab3c-3b66e4df7ef0 req-a130eabf-9e52-4d43-a887-aa52d1acf77b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033968 Dec 18 21:11:27.066404 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2936/5910] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:27.887567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:27.888278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:27.899370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:27.899836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:27.900759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:27.901212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:27.935392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aa48412c-c5ce-4da5-8688-66966a54b307 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:27.936932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa48412c-c5ce-4da5-8688-66966a54b307 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:27.944463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa48412c-c5ce-4da5-8688-66966a54b307 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:27.944869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa48412c-c5ce-4da5-8688-66966a54b307 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:27.945689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa48412c-c5ce-4da5-8688-66966a54b307 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:27.946274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa48412c-c5ce-4da5-8688-66966a54b307 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:28.000947 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aa48412c-c5ce-4da5-8688-66966a54b307 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.071060 Dec 18 21:11:28.007756 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2937/5911] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:27 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:28.149340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:28.162067 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a673152a-118b-4148-81ff-586c9902ca4b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1309 microversion: 2.1 time: 0.280322 Dec 18 21:11:28.164254 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2975/5912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:27 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:29.014038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d60a0fa-e7f5-4acb-9a73-7bbd738308e9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:29.015025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2d60a0fa-e7f5-4acb-9a73-7bbd738308e9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:29.023305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d60a0fa-e7f5-4acb-9a73-7bbd738308e9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:29.023777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d60a0fa-e7f5-4acb-9a73-7bbd738308e9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:29.024583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d60a0fa-e7f5-4acb-9a73-7bbd738308e9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:29.025043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d60a0fa-e7f5-4acb-9a73-7bbd738308e9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:29.073279 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d60a0fa-e7f5-4acb-9a73-7bbd738308e9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.063447 Dec 18 21:11:29.073983 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2938/5913] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:29 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:29.180289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:29.181112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:29.192529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:29.192529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:29.192529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:29.192529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:29.202304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca7c1db6-1fc8-451f-98d5-49a604cab6a6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:29.209904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca7c1db6-1fc8-451f-98d5-49a604cab6a6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:29.210418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca7c1db6-1fc8-451f-98d5-49a604cab6a6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:29.238141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca7c1db6-1fc8-451f-98d5-49a604cab6a6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Going to try to stop instance {{(pid=140731) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 21:11:29.284660 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca7c1db6-1fc8-451f-98d5-49a604cab6a6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 202 len: 0 microversion: 2.1 time: 0.085983 Dec 18 21:11:29.285313 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2939/5914] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:29 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:29.294886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:29.295611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:29.304566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:29.304751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:29.305652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:29.306417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:29.347734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:29.356695 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8b3a442-a543-4569-99a6-e7af40568985 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1309 microversion: 2.1 time: 0.180142 Dec 18 21:11:29.357284 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2976/5915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:29 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1309 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:29.464827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:29.473965 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-08e697e0-51f7-4d7f-9497-0f74eed906bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.183703 Dec 18 21:11:29.474672 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2940/5916] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:29 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:30.086898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-130e6267-cd77-4b7f-a2e8-32539b32c272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:30.087977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-130e6267-cd77-4b7f-a2e8-32539b32c272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:30.095443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130e6267-cd77-4b7f-a2e8-32539b32c272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:30.096000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130e6267-cd77-4b7f-a2e8-32539b32c272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:30.096947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130e6267-cd77-4b7f-a2e8-32539b32c272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:30.097517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-130e6267-cd77-4b7f-a2e8-32539b32c272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:30.141880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-130e6267-cd77-4b7f-a2e8-32539b32c272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 32641 microversion: 2.20 time: 0.060086 Dec 18 21:11:30.142560 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2977/5917] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:30 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:30.373741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:30.374428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:30.381692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:30.382173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:30.383055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:30.383503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:30.492973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:30.494574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:30.502125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:30.502608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:30.503412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:30.503853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:30.525442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:30.534421 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-916a0099-333b-4e9b-b84b-39c531c2214d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1309 microversion: 2.1 time: 0.164372 Dec 18 21:11:30.535061 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2941/5918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:30 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:30.652343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:30.661494 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c059cea3-2c22-43a4-9973-e7ff43c286ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.173723 Dec 18 21:11:30.662178 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2978/5919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:30 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:31.154895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab7f66c3-b0f7-468d-b521-cdc191b54cf9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:31.156303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab7f66c3-b0f7-468d-b521-cdc191b54cf9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:31.164984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7f66c3-b0f7-468d-b521-cdc191b54cf9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.165508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7f66c3-b0f7-468d-b521-cdc191b54cf9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.166795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7f66c3-b0f7-468d-b521-cdc191b54cf9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.167551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7f66c3-b0f7-468d-b521-cdc191b54cf9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.231377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab7f66c3-b0f7-468d-b521-cdc191b54cf9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 200 len: 40796 microversion: 2.20 time: 0.080844 Dec 18 21:11:31.232064 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2942/5920] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:31 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 40796 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:31.243079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25ac9b42-6958-4a9d-a6ad-f5f6cdc20852 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:31.243577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25ac9b42-6958-4a9d-a6ad-f5f6cdc20852 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:31.250936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25ac9b42-6958-4a9d-a6ad-f5f6cdc20852 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.251458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25ac9b42-6958-4a9d-a6ad-f5f6cdc20852 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.252327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25ac9b42-6958-4a9d-a6ad-f5f6cdc20852 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.252791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25ac9b42-6958-4a9d-a6ad-f5f6cdc20852 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.279534 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25ac9b42-6958-4a9d-a6ad-f5f6cdc20852 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/ips" status: 200 len: 151 microversion: 2.20 time: 0.040401 Dec 18 21:11:31.280134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2979/5921] 10.222.0.13 () {60 vars in 1288 bytes} [Sat Dec 18 21:11:31 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:11:31.553611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:31.562978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:31.580368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.580799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.581636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.594572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.679792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:31.680987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:31.688980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.689701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.690746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:31.691393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:31.890227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:31.907578 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ebe43229-ae8b-4a61-909c-45db7466a1ae tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1309 microversion: 2.1 time: 0.359193 Dec 18 21:11:31.908490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2943/5922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:31 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:32.045565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:32.055498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3b0e8ae-fad2-4a2f-93f7-6b1e7bd251a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.379842 Dec 18 21:11:32.056548 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2980/5923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:31 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:32.924938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:32.925589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:32.933740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:32.934206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:32.935056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:32.935511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.074075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:33.074851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:33.081600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:33.081983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.082818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:33.083255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.087206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:33.096291 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc1eac23-b5c2-4355-92e3-8e4d9152d6aa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1309 microversion: 2.1 time: 0.175007 Dec 18 21:11:33.097195 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2944/5924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:32 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:33.240214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:33.250182 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f8a8da0-f7c6-4b63-8b30-ab498f334f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.180777 Dec 18 21:11:33.251073 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2981/5925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:33 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:33.400097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:33.400684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:33.407638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:33.408199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.409157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:33.409623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.436103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lazy-loading 'flavor' on Instance uuid 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:11:33.705964 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8e161a8-d844-4455-9a0c-f3f84b31436c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 202 len: 0 microversion: 2.20 time: 0.309776 Dec 18 21:11:33.706666 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2945/5926] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:11:33 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:11:33.726197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:33.727503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:33.734109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:33.734990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.735817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:33.736249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.845282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d5c2da2e-7262-45ae-80a5-cb308b203f02 req-268ac012-153c-4b56-9ba9-5cff63a95017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7893530-a701-4c2f-8b28-18e55d0f3110", "name": "network-vif-plugged", "status": "completed", "tag": "2a4210e6-9e25-4f49-8bbb-72cbab194ca3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:33.847147 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:33.847147 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:33.855442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d5c2da2e-7262-45ae-80a5-cb308b203f02 req-268ac012-153c-4b56-9ba9-5cff63a95017 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:33.856187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d5c2da2e-7262-45ae-80a5-cb308b203f02 req-268ac012-153c-4b56-9ba9-5cff63a95017 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:33.872952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d5c2da2e-7262-45ae-80a5-cb308b203f02 req-268ac012-153c-4b56-9ba9-5cff63a95017 service nova] Creating event network-vif-plugged:2a4210e6-9e25-4f49-8bbb-72cbab194ca3 for instance e7893530-a701-4c2f-8b28-18e55d0f3110 on nch1-master-1 Dec 18 21:11:33.878970 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d5c2da2e-7262-45ae-80a5-cb308b203f02 req-268ac012-153c-4b56-9ba9-5cff63a95017 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037629 Dec 18 21:11:33.880226 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2946/5927] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:33.894117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:33.904432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:33.906278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:33.908196 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5d6a6c77-a3f0-4f32-8058-ba33abf1ed56 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.196764 Dec 18 21:11:33.908787 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2982/5928] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:33 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:34.118572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:34.119239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:34.125379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:34.125981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:34.126816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:34.127279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:34.268426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:34.269385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:34.276730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:34.277193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:34.278140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:34.278623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:34.280928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:34.289531 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-acbe679f-e215-4412-a735-6879ce7783b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1309 microversion: 2.1 time: 0.175959 Dec 18 21:11:34.290396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2947/5929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:34 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:34.434158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:34.443860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aec3d8be-0a84-49c4-9ac9-7117af0cb204 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.179570 Dec 18 21:11:34.444453 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2983/5930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:34 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:34.928236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:34.928959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:34.936526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:34.937035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:34.938151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:34.938719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:35.086714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:35.095570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:35.097462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:35.098927 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b4e64b4-3366-451b-a2e0-8b8a1d62b59b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.174845 Dec 18 21:11:35.099488 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2948/5931] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:34 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:35.309350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:35.309974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:35.317202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:35.317658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:35.318492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:35.318930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:35.460644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:35.462463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:35.463404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:35.470083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:35.470682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:35.471012 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa6c073c-381a-4b72-9fe3-d5a21419173e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1490 microversion: 2.1 time: 0.165804 Dec 18 21:11:35.471437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2984/5932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:35 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1490 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:35.471672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:35.472125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:35.542181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1664761423", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:35.596729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:11:35.680473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:35.694599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d067af65-0677-474d-b07a-c5ed323321fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.236740 Dec 18 21:11:35.695406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2949/5933] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:35 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:36.021717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:11:36.022144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:11:36.023054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:11:36.023465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:11:36.023878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:11:36.033652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:36.034105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:36.034998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:36.035432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:36.052682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:11:36.057883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:11:36.071622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:11:36.074067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:11:36.118196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:36.118904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:36.120763 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-503e9374-e05e-4bba-bcc2-0379ea2d94f4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583852 Dec 18 21:11:36.122334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2985/5934] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:11:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:11:36.127252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:36.127252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:36.132661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:36.133194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:36.135767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e018c5d-90d0-4d42-be9c-bc318b0b8eb7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:36.136431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e018c5d-90d0-4d42-be9c-bc318b0b8eb7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:36.204809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7e018c5d-90d0-4d42-be9c-bc318b0b8eb7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:36.214956 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e018c5d-90d0-4d42-be9c-bc318b0b8eb7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1209 microversion: 2.1 time: 0.085611 Dec 18 21:11:36.215677 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2986/5935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:36 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:36.337341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:36.349384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:36.351494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:36.353113 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8be85fca-814e-442a-a6de-e6cdf7961d53 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.238683 Dec 18 21:11:36.353880 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2950/5936] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:36 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:36.714196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:36.714986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:36.723060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:36.723626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:36.724477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:36.724993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:36.870418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:36.879957 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-27ff4d32-397f-4a88-96a3-5b082cd55561 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.170246 Dec 18 21:11:36.880667 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2987/5937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:36 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:37.234053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:37.235063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:37.242560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:37.243349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:37.245468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:37.245997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:37.361400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:37.371402 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-80651173-7860-4e2c-99f4-a24eb137dea4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1279 microversion: 2.1 time: 0.142437 Dec 18 21:11:37.372024 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2951/5938] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:37 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:37.382143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:37.383142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:37.389449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:37.390036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:37.390908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:37.391351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:37.652651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:37.662388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:37.664142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:37.666008 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fc6e7fda-48bf-4c8b-851d-ffc42f0f731a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.288348 Dec 18 21:11:37.666881 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2988/5939] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:37 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:11:37.898882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:37.900620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:37.909775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:37.910813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:37.912111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:37.912816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:38.175323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:38.188304 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-270ce990-3eb3-4173-b8b8-c459b38d3b17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.293359 Dec 18 21:11:38.189867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2952/5940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:37 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:38.395066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:38.395814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:38.414265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:38.414762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:38.416516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:38.417026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:38.688322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:38.689058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:38.698480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:38.698957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:38.700206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:38.700747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:38.919522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:38.938948 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67e0dffd-5922-4081-9151-2bf2a6c8b9da tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.551978 Dec 18 21:11:38.939937 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2989/5941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:38 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:39.025775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:39.036456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:39.038713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:39.040215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2340a909-f1cc-4712-ab1b-dfbe10d82073 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.356350 Dec 18 21:11:39.040999 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2953/5942] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:38 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:11:39.207619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:39.209042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:39.216056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:39.216950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:39.217771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:39.218216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:39.358504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2cbb656e-9f38-4299-9e08-1eee803c0ca9 req-6ae63fa5-0b80-4665-be61-db7550568f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d964e9dd-27c3-4ad1-aac9-b91bad02537a", "tag": "8faf2ed9-ee6a-4551-b51e-004836ba1d41"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:39.360965 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:39.360965 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:39.371196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2cbb656e-9f38-4299-9e08-1eee803c0ca9 req-6ae63fa5-0b80-4665-be61-db7550568f0d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:39.371780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2cbb656e-9f38-4299-9e08-1eee803c0ca9 req-6ae63fa5-0b80-4665-be61-db7550568f0d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:39.385443 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2cbb656e-9f38-4299-9e08-1eee803c0ca9 req-6ae63fa5-0b80-4665-be61-db7550568f0d service nova] Creating event network-changed:8faf2ed9-ee6a-4551-b51e-004836ba1d41 for instance d964e9dd-27c3-4ad1-aac9-b91bad02537a on nch2-master-1 Dec 18 21:11:39.390903 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2cbb656e-9f38-4299-9e08-1eee803c0ca9 req-6ae63fa5-0b80-4665-be61-db7550568f0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036846 Dec 18 21:11:39.391929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2954/5943] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:39.491321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:39.501168 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef3fb33b-3c44-41a3-935b-b42b106438dd tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1722 microversion: 2.1 time: 0.297625 Dec 18 21:11:39.503890 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2990/5944] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:39 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:39.958903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:39.959773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:39.968511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:39.969354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:39.970472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:39.970939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:40.060197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:40.060730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:40.068573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:40.068945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:40.069737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:40.070613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:40.254451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:40.266298 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f5feaa7-327b-4cfc-bdcf-b1086991e5cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.311942 Dec 18 21:11:40.266902 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2955/5945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:39 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:40.403968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:40.413988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:40.416131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:40.417582 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6da65b01-7d13-4bc2-a98f-2db31a3161a7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.361822 Dec 18 21:11:40.418364 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2991/5946] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:40 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:11:40.519800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:40.520438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:40.527100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:40.527610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:40.528425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:40.528877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:40.755160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:40.763839 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54571b58-511d-40a2-96f7-396450533736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1699 microversion: 2.1 time: 0.247767 Dec 18 21:11:40.764429 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2956/5947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:40 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1699 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:40.782031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab2b8e67-70de-4d85-9164-21c7448a2005 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:40.788951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab2b8e67-70de-4d85-9164-21c7448a2005 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:40.789456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab2b8e67-70de-4d85-9164-21c7448a2005 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:40.814292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab2b8e67-70de-4d85-9164-21c7448a2005 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Going to try to start instance {{(pid=140732) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 21:11:40.861770 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab2b8e67-70de-4d85-9164-21c7448a2005 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 202 len: 0 microversion: 2.1 time: 0.083529 Dec 18 21:11:40.862919 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2992/5948] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:40 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:11:40.871460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:40.872248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:40.879145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:40.879711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:40.880674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:40.881350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:41.088203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:41.096371 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07b41d76-35f9-435d-ac16-b070bf6c481e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1708 microversion: 2.1 time: 0.229035 Dec 18 21:11:41.096959 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2957/5949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:40 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1708 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:41.285757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:41.286779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:41.295668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:41.296160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:41.297575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:41.298077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:41.439272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:41.440322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:41.448774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:41.448774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:41.450245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:41.450936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:41.539391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:41.549339 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c82cec44-0839-44f9-af02-e4ca67402034 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.269130 Dec 18 21:11:41.550511 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2993/5950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:41 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:41.688036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:41.697669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:41.699412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:41.700856 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45ab0206-384e-45fd-aff7-afd40d94b178 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.265904 Dec 18 21:11:41.701524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2958/5951] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:41 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:42.113175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:42.113764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:42.120903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:42.121361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:42.122140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:42.122598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:42.353171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:42.366956 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0dade2fa-b697-4f34-bb1b-3d69e3372dc4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1708 microversion: 2.1 time: 0.257038 Dec 18 21:11:42.367665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2994/5952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:42 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1708 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:42.568040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:42.568670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:42.576289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:42.576760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:42.577573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:42.578043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:42.720815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:42.721310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:42.722337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:42.728827 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-749f6ba0-7249-492d-bba3-cfb4a23cf294 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.164759 Dec 18 21:11:42.738634 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2959/5953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:42 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:42.738859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:42.738859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:42.738859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:42.738859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:42.878167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:42.887312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:42.888862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:42.890101 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f36910a4-91e1-45dd-a475-ede1915ce432 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.173366 Dec 18 21:11:42.890829 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2995/5954] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:42 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:43.387774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:43.388488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:43.395199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:43.395675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:43.396482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:43.396943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:43.540378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:43.548744 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95573ead-175f-4639-9fea-306ecb36abbe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1712 microversion: 2.1 time: 0.165445 Dec 18 21:11:43.549439 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2960/5955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:43 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1712 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:43.751940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:43.753295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:43.762656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:43.763111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:43.764159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:43.764712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:43.908787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:43.909480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:43.916987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:43.917453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:43.918319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:43.918788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:43.925686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:43.935372 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2b3ffee-d6ea-49a0-90c6-724b723cdde4 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.188148 Dec 18 21:11:43.945637 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2996/5956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:43 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:44.074633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:44.083368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:44.085474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:44.086816 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2396672d-175d-4160-b5e9-48dd4d004714 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.182270 Dec 18 21:11:44.087549 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2961/5957] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:43 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:44.953498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:44.954101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:44.961002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:44.961456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:44.962297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:44.962847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:45.106897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:45.107729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:45.114608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:45.115032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:45.115972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:45.116287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:45.116566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:45.124043 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e86b5459-d955-490b-b180-5baa5de54f29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.174433 Dec 18 21:11:45.124647 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2997/5958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:44 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:45.263477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:45.271277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:45.272805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:45.274031 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1cbcdd04-e5ca-46c3-9ce2-eb37ffdffe02 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1743 microversion: 2.20 time: 0.171165 Dec 18 21:11:45.274670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2962/5959] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:45 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:11:46.063898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c29e26ee-5b82-4d70-acb3-d315a8e5eeff req-90330ce9-df82-4fd8-b0e5-1c50eb2e3284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d964e9dd-27c3-4ad1-aac9-b91bad02537a", "name": "network-vif-plugged", "status": "completed", "tag": "8faf2ed9-ee6a-4551-b51e-004836ba1d41"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:46.066243 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:46.066243 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:46.080969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c29e26ee-5b82-4d70-acb3-d315a8e5eeff req-90330ce9-df82-4fd8-b0e5-1c50eb2e3284 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:46.081741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c29e26ee-5b82-4d70-acb3-d315a8e5eeff req-90330ce9-df82-4fd8-b0e5-1c50eb2e3284 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:46.098647 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c29e26ee-5b82-4d70-acb3-d315a8e5eeff req-90330ce9-df82-4fd8-b0e5-1c50eb2e3284 service nova] Creating event network-vif-plugged:8faf2ed9-ee6a-4551-b51e-004836ba1d41 for instance d964e9dd-27c3-4ad1-aac9-b91bad02537a on nch2-master-1 Dec 18 21:11:46.106973 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c29e26ee-5b82-4d70-acb3-d315a8e5eeff req-90330ce9-df82-4fd8-b0e5-1c50eb2e3284 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047307 Dec 18 21:11:46.107875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2998/5960] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:46.146943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:46.147627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:46.158490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:46.159004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:46.160836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:46.161384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:46.294689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:46.296019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:46.305768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:46.306559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:46.307851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:46.309409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:46.354623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:46.362433 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5db85e7f-c4dc-41fe-a6e4-2811207d93c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.223697 Dec 18 21:11:46.363105 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2963/5961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:46 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:46.460921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:46.469003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:46.470578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:46.471764 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c51d4dda-a8f0-4aca-ab8f-56b38e895115 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.183167 Dec 18 21:11:46.472325 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 2999/5962] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:46 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:47.382048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:47.383826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:47.392216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:47.392701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:47.393617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:47.394729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:47.495887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:47.509755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:47.531932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:47.534022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:47.534919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:47.536448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:47.606506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:47.623724 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7638075c-7dab-4443-96df-a5a45ee715c1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1309 microversion: 2.1 time: 0.247749 Dec 18 21:11:47.646880 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2964/5963] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:47 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:47.738629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:47.753058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:47.756702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:47.758147 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2a96bb0a-eaeb-4290-b145-d0b498c084fa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.267815 Dec 18 21:11:47.761638 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3000/5964] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:47 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:48.129971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b37e99d6-ad7d-44ec-ad15-a2900f44b234 req-88d17569-a9e8-4d88-83f4-bbddfb4b1530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "name": "network-vif-plugged", "status": "completed", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:48.131606 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:48.131606 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:48.140228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b37e99d6-ad7d-44ec-ad15-a2900f44b234 req-88d17569-a9e8-4d88-83f4-bbddfb4b1530 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:48.140789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b37e99d6-ad7d-44ec-ad15-a2900f44b234 req-88d17569-a9e8-4d88-83f4-bbddfb4b1530 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:48.166905 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b37e99d6-ad7d-44ec-ad15-a2900f44b234 req-88d17569-a9e8-4d88-83f4-bbddfb4b1530 service nova] Creating event network-vif-plugged:108c8a1c-0915-4513-8659-185ce5146ce7 for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 on nch1-master-1 Dec 18 21:11:48.172813 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b37e99d6-ad7d-44ec-ad15-a2900f44b234 req-88d17569-a9e8-4d88-83f4-bbddfb4b1530 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046108 Dec 18 21:11:48.173382 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2965/5965] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:48.653498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:48.654914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:48.665736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:48.666222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:48.667084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:48.667524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:48.799235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:48.800725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:48.809484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:48.811239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:48.812838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:48.813455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:48.843066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:48.850945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cb27b114-d3ff-466c-a3a8-e3e9479e96b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1489 microversion: 2.1 time: 0.201808 Dec 18 21:11:48.868334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3001/5966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:48 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1489 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:48.874078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:48.875221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:48.882724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:48.886610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:48.889007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:48.889645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.049400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:49.060011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:49.063472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:49.065926 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d923d967-c068-490e-8c39-bb30a141e9b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.272494 Dec 18 21:11:49.067320 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2966/5967] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:48 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:11:49.115325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:49.129287 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40497c05-abcf-46a2-bb80-01887a3c5c1e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1490 microversion: 2.1 time: 0.258314 Dec 18 21:11:49.130038 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3002/5968] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:48 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1490 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:49.148326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:49.149330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:49.156048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.156519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.157339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.157981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.337694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:49.348168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23719713-d77c-47e8-b6e1-58259b5cc171 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1489 microversion: 2.1 time: 0.203960 Dec 18 21:11:49.348748 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2967/5969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:49 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1489 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:49.370746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:49.371283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:49.379616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.380204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.381136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.381686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.423408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:11:49.546387 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e7b9e40c-fa36-49c5-bf07-28742ba3a4a7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 204 len: 0 microversion: 2.1 time: 0.174578 Dec 18 21:11:49.546387 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3003/5970] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:11:49 2021] DELETE /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:11:49.550014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:49.550776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:49.558179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.558835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.559774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.560306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.752913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:49.752913 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d5419ff4-fbb9-4a3c-8336-2d8cce9815af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1495 microversion: 2.1 time: 0.192149 Dec 18 21:11:49.752913 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2968/5971] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:49 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1495 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:49.767335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d7160fc6-e219-4151-85ce-de4a62f83627 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:49.768366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d7160fc6-e219-4151-85ce-de4a62f83627 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:49.776419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7160fc6-e219-4151-85ce-de4a62f83627 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.776884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7160fc6-e219-4151-85ce-de4a62f83627 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.777734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7160fc6-e219-4151-85ce-de4a62f83627 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:49.778215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7160fc6-e219-4151-85ce-de4a62f83627 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:49.841758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d7160fc6-e219-4151-85ce-de4a62f83627 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action" status: 200 len: 24571 microversion: 2.1 time: 0.078131 Dec 18 21:11:49.843542 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3004/5972] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:11:49 2021] POST /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:11:50.085315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:50.086760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:50.097398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:50.098074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:50.099275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:50.099780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:50.263265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:50.276723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:50.279912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:50.281599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0fba8614-f357-4476-b59d-9210be9d114d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.200347 Dec 18 21:11:50.286306 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2969/5973] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:50 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:50.772708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:50.773853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:50.782972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:50.783506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:50.784373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:50.784887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:50.952599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:50.960586 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-90ff7722-3b2c-4038-a0f0-30246b91cc17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1495 microversion: 2.1 time: 0.193055 Dec 18 21:11:50.961170 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3005/5974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:50 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1495 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:51.303334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:51.304071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:51.313533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:51.314099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:51.316120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:51.316352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:51.571001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:51.591518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:51.594761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:51.596359 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b127c277-7c1b-4ba5-8935-48b85d99d341 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.297561 Dec 18 21:11:51.597705 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2970/5975] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:51 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:51.841075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7cef6f26-bcf5-44f3-9677-4991a2900d1c req-0a0d3d1e-c518-496a-b353-538d26b4d79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d964e9dd-27c3-4ad1-aac9-b91bad02537a", "name": "network-vif-deleted", "tag": "8faf2ed9-ee6a-4551-b51e-004836ba1d41"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:51.845509 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:51.845509 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:51.858295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7cef6f26-bcf5-44f3-9677-4991a2900d1c req-0a0d3d1e-c518-496a-b353-538d26b4d79e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:51.859114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7cef6f26-bcf5-44f3-9677-4991a2900d1c req-0a0d3d1e-c518-496a-b353-538d26b4d79e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:51.881675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7cef6f26-bcf5-44f3-9677-4991a2900d1c req-0a0d3d1e-c518-496a-b353-538d26b4d79e service nova] Creating event network-vif-deleted:8faf2ed9-ee6a-4551-b51e-004836ba1d41 for instance d964e9dd-27c3-4ad1-aac9-b91bad02537a on nch2-master-1 Dec 18 21:11:51.888471 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7cef6f26-bcf5-44f3-9677-4991a2900d1c req-0a0d3d1e-c518-496a-b353-538d26b4d79e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054768 Dec 18 21:11:51.889610 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3006/5976] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:51.976952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:51.977518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:51.986000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:51.986621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:51.987376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:51.987798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:52.043871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:52.044742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:52.045946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lazy-loading 'fault' on Instance uuid d964e9dd-27c3-4ad1-aac9-b91bad02537a {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:11:52.111470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:52.127168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6d06b53-d6a9-4ee5-b42a-ef72c62980fe tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 200 len: 1299 microversion: 2.1 time: 0.153903 Dec 18 21:11:52.127891 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2971/5977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:51 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:52.617425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:52.618206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:52.625754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:52.626359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:52.627240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:52.627752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:52.884928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:52.887845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:52.890376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:52.891690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19f9632f-c018-4dbc-8da2-e426e18837ad tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.279156 Dec 18 21:11:52.892301 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3007/5978] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:52 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:53.148676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:53.149348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:53.157025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.158827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:53.161466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.162828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:53.185347 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance d964e9dd-27c3-4ad1-aac9-b91bad02537a could not be found. Dec 18 21:11:53.186388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance d964e9dd-27c3-4ad1-aac9-b91bad02537a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:11:53.187445 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22819506-ce49-48cc-bd6b-e884cd1a0998 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 404 len: 111 microversion: 2.1 time: 0.043640 Dec 18 21:11:53.188230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2972/5979] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:53 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:11:53.200942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:53.201492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:53.208346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.209252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:53.210304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.210904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:53.251604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:11:53.356498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ea95286-2615-4482-a23c-df313facb8c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 204 len: 0 microversion: 2.1 time: 0.162875 Dec 18 21:11:53.357531 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3008/5980] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:11:53 2021] DELETE /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:11:53.365887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:53.366656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:53.379368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.382347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:53.383617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.384267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:53.633355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:53.648719 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0f67b4c0-ba68-4751-9ec6-118573ab74e1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1496 microversion: 2.1 time: 0.286522 Dec 18 21:11:53.649774 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2973/5981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:53 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1496 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:53.920480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:53.923595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:53.936575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.937560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:53.939083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:53.939957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:54.134517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:54.144523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:54.146989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:54.149076 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-42f874b8-015a-41a4-b181-31b493f6f01c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.235821 Dec 18 21:11:54.149599 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3009/5982] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:53 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:54.618759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:54.620145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:54.622136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b18168fa-5795-473a-b10b-f0cb0067cca5 req-bbd961a3-b247-4119-a3cb-f93add0c6d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5153e88-ea06-4895-a8f2-9cd58000c109", "tag": "6952405e-dd10-48ed-b3df-0dbd6bb82a96"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:54.626323 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:54.626323 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:54.631789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:54.632673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:54.633798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:54.635251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:54.642801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b18168fa-5795-473a-b10b-f0cb0067cca5 req-bbd961a3-b247-4119-a3cb-f93add0c6d17 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:54.643690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b18168fa-5795-473a-b10b-f0cb0067cca5 req-bbd961a3-b247-4119-a3cb-f93add0c6d17 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:54.668939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:11:54.678357 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b18168fa-5795-473a-b10b-f0cb0067cca5 req-bbd961a3-b247-4119-a3cb-f93add0c6d17 service nova] Creating event network-changed:6952405e-dd10-48ed-b3df-0dbd6bb82a96 for instance f5153e88-ea06-4895-a8f2-9cd58000c109 on nch2-master-1 Dec 18 21:11:54.692394 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b18168fa-5795-473a-b10b-f0cb0067cca5 req-bbd961a3-b247-4119-a3cb-f93add0c6d17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075191 Dec 18 21:11:54.693744 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3010/5983] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:54.700531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:54.701486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:54.721305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:54.722461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:54.730298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:54.730992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:54.857058 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59aa39ad-76aa-4589-b75c-e8a91c25463e tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 204 len: 0 microversion: 2.1 time: 0.242949 Dec 18 21:11:54.863133 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2974/5984] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:11:54 2021] DELETE /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:11:54.877571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:54.880364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:54.894445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:54.907426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:54.908773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:54.909663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:55.515934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:55.528190 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3c2d534-eac6-496c-ab49-78f8c64139ea tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1496 microversion: 2.1 time: 0.832971 Dec 18 21:11:55.534620 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3011/5985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:54 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1496 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:55.542484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:55.543152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:55.561152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:55.564016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:55.564824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:55.576975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:55.909731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:55.926466 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-08ad9da4-eaa8-4e44-bec8-b1692f4d61f2 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1584 microversion: 2.1 time: 1.058589 Dec 18 21:11:55.927036 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2975/5986] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:54 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1584 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:56.068852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:56.127751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:56.129733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:56.144295 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b0c4924b-cd61-4845-94ed-fdd5e2e782cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.595010 Dec 18 21:11:56.144295 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3012/5987] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:55 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:56.159349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f242ff9e-8547-4c79-a4e3-324431b91dcb tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:56.160301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f242ff9e-8547-4c79-a4e3-324431b91dcb tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:56.179387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f242ff9e-8547-4c79-a4e3-324431b91dcb tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:56.180301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f242ff9e-8547-4c79-a4e3-324431b91dcb tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:56.181454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f242ff9e-8547-4c79-a4e3-324431b91dcb tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:56.182150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f242ff9e-8547-4c79-a4e3-324431b91dcb tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:56.546573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:56.548164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:56.566747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:56.570085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:56.571486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:56.572497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:56.612061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f242ff9e-8547-4c79-a4e3-324431b91dcb tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1832 microversion: 2.1 time: 0.473345 Dec 18 21:11:56.617361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2976/5988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:56 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1832 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:56.946158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:56.948123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:56.967330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:56.968105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:56.970500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:56.971140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:57.076868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:57.090585 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-00b59c43-fc79-4ee3-a006-63b71aadb4af tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 200 len: 1496 microversion: 2.1 time: 0.548767 Dec 18 21:11:57.104317 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3013/5989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:56 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 1496 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:57.110686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-446cba72-0616-4db5-b786-18c4ac6d9068 req-44c35c28-39e4-4bfd-8000-6bf03096d3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7893530-a701-4c2f-8b28-18e55d0f3110", "name": "network-vif-deleted", "tag": "2a4210e6-9e25-4f49-8bbb-72cbab194ca3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:57.112697 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:57.112697 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:11:57.121728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-446cba72-0616-4db5-b786-18c4ac6d9068 req-44c35c28-39e4-4bfd-8000-6bf03096d3b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:57.122506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-446cba72-0616-4db5-b786-18c4ac6d9068 req-44c35c28-39e4-4bfd-8000-6bf03096d3b9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:57.139599 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-446cba72-0616-4db5-b786-18c4ac6d9068 req-44c35c28-39e4-4bfd-8000-6bf03096d3b9 service nova] Creating event network-vif-deleted:2a4210e6-9e25-4f49-8bbb-72cbab194ca3 for instance e7893530-a701-4c2f-8b28-18e55d0f3110 on nch1-master-1 Dec 18 21:11:57.148464 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-446cba72-0616-4db5-b786-18c4ac6d9068 req-44c35c28-39e4-4bfd-8000-6bf03096d3b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042303 Dec 18 21:11:57.149379 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3014/5990] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:11:57.173141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:57.178579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:57.193177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:57.198680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:57.199794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:57.200483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:57.215209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:57.224096 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4d2839a0-c5f6-4d9a-b7e0-318277ef814a tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1465 microversion: 2.1 time: 0.282522 Dec 18 21:11:57.225423 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2977/5991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:56 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1465 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:57.379107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:57.389573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:57.391565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:57.393063 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4b78f78-97b3-4c50-8c18-8af3a0b3b9ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.234890 Dec 18 21:11:57.393816 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3015/5992] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:57 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:11:58.121873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:58.123544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:58.130268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.130824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.131854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.132301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.153355 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance e7893530-a701-4c2f-8b28-18e55d0f3110 could not be found. Dec 18 21:11:58.153960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance e7893530-a701-4c2f-8b28-18e55d0f3110 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:11:58.154871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-138441ef-3676-4e45-88fd-8008945b3e65 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 404 len: 111 microversion: 2.1 time: 0.047491 Dec 18 21:11:58.155447 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3016/5993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:58 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:11:58.243377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:58.244133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:58.253033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-799516a6-f956-4739-8931-672db0839c51 req-244aaff1-5ad0-47da-887b-3ab975d76976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5153e88-ea06-4895-a8f2-9cd58000c109", "name": "network-vif-deleted", "tag": "6952405e-dd10-48ed-b3df-0dbd6bb82a96"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:58.255409 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:11:58.255409 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:11:58.267736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.268156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.268976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.272042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-799516a6-f956-4739-8931-672db0839c51 req-244aaff1-5ad0-47da-887b-3ab975d76976 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.273140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.274914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-799516a6-f956-4739-8931-672db0839c51 req-244aaff1-5ad0-47da-887b-3ab975d76976 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.305990 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-799516a6-f956-4739-8931-672db0839c51 req-244aaff1-5ad0-47da-887b-3ab975d76976 service nova] Creating event network-vif-deleted:6952405e-dd10-48ed-b3df-0dbd6bb82a96 for instance f5153e88-ea06-4895-a8f2-9cd58000c109 on nch2-master-1 Dec 18 21:11:58.331136 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-799516a6-f956-4739-8931-672db0839c51 req-244aaff1-5ad0-47da-887b-3ab975d76976 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255318 Dec 18 21:11:58.332884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2978/5994] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:11:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:11:58.340131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-97942660", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:11:58.354126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9b1c58215046afb6974d9a4b654326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fd960aee2d408d8c9977b60fcabd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:58.362970 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b396577f-d1d0-4230-96b5-5831cf9512ba tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 200 len: 1229 microversion: 2.1 time: 0.125601 Dec 18 21:11:58.363686 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3017/5995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:58 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 1229 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:58.412413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:58.413009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:58.424897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.426905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.428146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.428753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.440419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:11:58.707051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:58.721605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:58.723562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:58.724864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1836c892-7310-4950-b657-49e8b3e0e09f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1738 microversion: 2.20 time: 0.316655 Dec 18 21:11:58.737297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3018/5996] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:58 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:11:58.747668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:58.748252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:58.755502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.757522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.759247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.760666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.798098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:11:58.930010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ee381235-f41a-4abd-9c0c-04e36aa0c884 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 204 len: 0 microversion: 2.1 time: 0.190150 Dec 18 21:11:58.930908 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3019/5997] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:11:58 2021] DELETE /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:11:58.944490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:58.951739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:58.962140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.962845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:58.963661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:58.964182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:59.160310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:11:59.161567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:11:59.162334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:11:59.163004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:11:59.163606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:11:59.176746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:59.177170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:59.178809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:59.179381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:59.202301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:11:59.209210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:11:59.225367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:11:59.229359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:11:59.264054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:59.278616 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41806ef2-71b5-40b4-aa29-509e45f5bb91 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1687 microversion: 2.1 time: 0.338474 Dec 18 21:11:59.280266 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3020/5998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:58 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1687 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:11:59.289898 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-092088bb-e99b-415b-b275-8e28c0e786fa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955569 Dec 18 21:11:59.291777 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2979/5999] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:11:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:11:59.305759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b05d1d93-4d8f-4c88-8a09-cd39c0425c2d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:59.307136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b05d1d93-4d8f-4c88-8a09-cd39c0425c2d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:59.382888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:59.385081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] [instance: f5153e88-ea06-4895-a8f2-9cd58000c109] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:59.404314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:59.404762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:59.405874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:59.406587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:59.425469 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] HTTP exception thrown: Instance f5153e88-ea06-4895-a8f2-9cd58000c109 could not be found. Dec 18 21:11:59.426080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Returning 404 to user: Instance f5153e88-ea06-4895-a8f2-9cd58000c109 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:11:59.427172 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c8f0e26e-6e24-4cd7-995a-b804db696a88 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109" status: 404 len: 111 microversion: 2.1 time: 0.050225 Dec 18 21:11:59.428502 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2980/6000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:59 2021] GET /compute/v2.1/servers/f5153e88-ea06-4895-a8f2-9cd58000c109 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:11:59.484132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b05d1d93-4d8f-4c88-8a09-cd39c0425c2d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:11:59.492794 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b05d1d93-4d8f-4c88-8a09-cd39c0425c2d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1207 microversion: 2.1 time: 0.190720 Dec 18 21:11:59.494786 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3021/6001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:11:59 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1207 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:11:59.691588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47da3277-3f8a-44c9-8e81-2c4302d65497 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] Calling method '.version_select at 0x7f716140d310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:59.726960 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47da3277-3f8a-44c9-8e81-2c4302d65497 tempest-TestVolumeBackupRestore-2104047399 tempest-TestVolumeBackupRestore-2104047399-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1445983151" status: 202 len: 0 microversion: 2.1 time: 0.039947 Dec 18 21:11:59.727568 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2981/6002] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:11:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1445983151 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:11:59.743487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:11:59.745138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:11:59.757480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:59.757962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:11:59.758923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:11:59.761404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:00.162489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:00.177517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:00.179337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:00.184542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-553d4240-98f4-4af7-9849-250cac9cd6cf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1720 microversion: 2.20 time: 0.444336 Dec 18 21:12:00.185334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3022/6003] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:11:59 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1720 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:00.299021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:00.299666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:00.307639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:00.307871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:00.308793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:00.309259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:00.400860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-291adefd-b131-4332-b0bd-7b3e9fd9ce10 req-e2a1b419-e12a-4800-a25c-f4c6516e9a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:00.403961 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:00.403961 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:00.412544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-291adefd-b131-4332-b0bd-7b3e9fd9ce10 req-e2a1b419-e12a-4800-a25c-f4c6516e9a39 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:00.413058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-291adefd-b131-4332-b0bd-7b3e9fd9ce10 req-e2a1b419-e12a-4800-a25c-f4c6516e9a39 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:00.428344 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-291adefd-b131-4332-b0bd-7b3e9fd9ce10 req-e2a1b419-e12a-4800-a25c-f4c6516e9a39 service nova] Creating event network-changed:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch2-master-1 Dec 18 21:12:00.434996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-291adefd-b131-4332-b0bd-7b3e9fd9ce10 req-e2a1b419-e12a-4800-a25c-f4c6516e9a39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039182 Dec 18 21:12:00.435614 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3023/6004] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:12:00.461250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:00.471535 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a953df7d-cc9e-4535-992c-26f56820b034 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1687 microversion: 2.1 time: 0.177370 Dec 18 21:12:00.472468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2982/6005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:00 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:00.510987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:00.511805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:00.523033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:00.523836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:00.525643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:00.526090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:00.619526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:00.630097 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-167a377b-20c9-49ce-9b34-e9861464f591 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1259 microversion: 2.1 time: 0.123523 Dec 18 21:12:00.642594 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3024/6006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:00 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1259 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:01.204320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:01.204983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:01.212923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:01.213485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:01.214669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:01.215186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:01.489409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:01.490028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:01.504672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:01.505510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:01.506655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:01.507377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:01.539775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:01.559771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:01.560708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:01.561587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lazy-loading 'fault' on Instance uuid 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:12:01.571087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:01.573285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:01.575041 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56d699d1-37e7-4a36-9ae2-f26ec2486cb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1720 microversion: 2.20 time: 0.374631 Dec 18 21:12:01.575934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2983/6007] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:01 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1720 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:01.629366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:01.639449 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-008bdd52-7aed-4fc5-b153-068e9e84f39c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 200 len: 1506 microversion: 2.1 time: 0.153775 Dec 18 21:12:01.640437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3025/6008] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:01 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:01.651555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:01.652177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:01.660993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:01.661680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:01.662955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:01.663459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:01.749169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:01.759279 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d2798587-bcb6-472e-9679-9d6aff299268 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1265 microversion: 2.1 time: 0.112340 Dec 18 21:12:01.761982 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2984/6009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:01 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:02.471132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-19f49a39-81b4-4fd6-afee-bff0add87d38 req-9b246acb-d527-42da-a179-de34eb953a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9750ec-8b70-4af6-97b0-8a4bc07f5b31", "name": "network-vif-deleted", "tag": "7174a37a-13ce-4590-8989-11e0c1e06a4c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:02.472950 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:02.472950 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:02.481899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-19f49a39-81b4-4fd6-afee-bff0add87d38 req-9b246acb-d527-42da-a179-de34eb953a2b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.482381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-19f49a39-81b4-4fd6-afee-bff0add87d38 req-9b246acb-d527-42da-a179-de34eb953a2b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.494868 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-19f49a39-81b4-4fd6-afee-bff0add87d38 req-9b246acb-d527-42da-a179-de34eb953a2b service nova] Creating event network-vif-deleted:7174a37a-13ce-4590-8989-11e0c1e06a4c for instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 on nch2-master-1 Dec 18 21:12:02.500896 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-19f49a39-81b4-4fd6-afee-bff0add87d38 req-9b246acb-d527-42da-a179-de34eb953a2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034402 Dec 18 21:12:02.501629 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3026/6010] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:02.595958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:02.597008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:02.605695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.606220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.607249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.607683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.659985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:02.660747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:02.669570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.670099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.671130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.671795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.688057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] HTTP exception thrown: Instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 could not be found. Dec 18 21:12:02.688665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Returning 404 to user: Instance 0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:12:02.689557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-783c066a-04fb-46af-a31d-f38235d86b6f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31" status: 404 len: 111 microversion: 2.1 time: 0.034782 Dec 18 21:12:02.690394 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3027/6011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:02 2021] GET /compute/v2.1/servers/0a9750ec-8b70-4af6-97b0-8a4bc07f5b31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:12:02.782406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:02.786949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:02.798885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.799753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.801145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.801589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.863950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:02.891324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:02.895878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:02.901338 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb01877e-d688-4e2f-a249-41a2f990a705 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1663 microversion: 2.20 time: 0.310117 Dec 18 21:12:02.905460 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2985/6012] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:02 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1663 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:02.928001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6af593b-26cf-4a75-a841-5b2c3d38393c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87b40d06-8666-40c6-a69a-c359ce3aa4fc"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:02.931075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6af593b-26cf-4a75-a841-5b2c3d38393c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:02.943434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6af593b-26cf-4a75-a841-5b2c3d38393c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.948412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6af593b-26cf-4a75-a841-5b2c3d38393c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:02.950752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6af593b-26cf-4a75-a841-5b2c3d38393c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:02.951671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6af593b-26cf-4a75-a841-5b2c3d38393c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:03.171415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:03.185159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2e99cdb8-5d18-4c83-be07-b0c76f786d61 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1307 microversion: 2.1 time: 0.409078 Dec 18 21:12:03.195406 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3028/6013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:02 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:03.271971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-9b47b8bc-a539-4cd4-914a-dd29ad11738f req-e8e58ce3-8aae-402b-b01e-aba5ea325989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1ebc26-c04e-4230-8bb2-457ab3dbb36d", "tag": "9a08357b-10fb-4163-84f0-1d7b3903abdd"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:03.273635 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:03.273635 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:03.289943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9b47b8bc-a539-4cd4-914a-dd29ad11738f req-e8e58ce3-8aae-402b-b01e-aba5ea325989 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:03.290612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-9b47b8bc-a539-4cd4-914a-dd29ad11738f req-e8e58ce3-8aae-402b-b01e-aba5ea325989 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:03.321070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-9b47b8bc-a539-4cd4-914a-dd29ad11738f req-e8e58ce3-8aae-402b-b01e-aba5ea325989 service nova] Creating event network-changed:9a08357b-10fb-4163-84f0-1d7b3903abdd for instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d on nch1-master-1 Dec 18 21:12:03.326691 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-9b47b8bc-a539-4cd4-914a-dd29ad11738f req-e8e58ce3-8aae-402b-b01e-aba5ea325989 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058306 Dec 18 21:12:03.327639 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3029/6014] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:12:03.427469 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6af593b-26cf-4a75-a841-5b2c3d38393c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.502550 Dec 18 21:12:03.428126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2986/6015] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Dec 18 21:12:02 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments => generated 188 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:12:03.574874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e89bbcf4-477a-470f-ba44-5cb9701c200c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:03.575534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e89bbcf4-477a-470f-ba44-5cb9701c200c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:03.583276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e89bbcf4-477a-470f-ba44-5cb9701c200c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:03.584044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e89bbcf4-477a-470f-ba44-5cb9701c200c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:03.584940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e89bbcf4-477a-470f-ba44-5cb9701c200c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:03.585580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e89bbcf4-477a-470f-ba44-5cb9701c200c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:03.679397 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e89bbcf4-477a-470f-ba44-5cb9701c200c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action" status: 202 len: 0 microversion: 2.20 time: 0.109020 Dec 18 21:12:03.680700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3030/6016] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:12:03 2021] POST /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:12:03.689443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:03.691401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:03.702964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:03.703560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:03.704889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:03.705632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:03.936607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f9a4d33d-0623-49f4-8093-662d1533c6bc req-8dd72211-9a4a-4d40-81ea-19a4cc4f07bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "name": "network-vif-unplugged", "status": "completed", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:03.938505 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:03.938505 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:03.948554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f9a4d33d-0623-49f4-8093-662d1533c6bc req-8dd72211-9a4a-4d40-81ea-19a4cc4f07bb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:03.949431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f9a4d33d-0623-49f4-8093-662d1533c6bc req-8dd72211-9a4a-4d40-81ea-19a4cc4f07bb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:03.968371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.server_external_events [req-f9a4d33d-0623-49f4-8093-662d1533c6bc req-8dd72211-9a4a-4d40-81ea-19a4cc4f07bb service nova] Unable to find a host for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9. Dropping event network-vif-unplugged {{(pid=140732) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 18 21:12:03.971094 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f9a4d33d-0623-49f4-8093-662d1533c6bc req-8dd72211-9a4a-4d40-81ea-19a4cc4f07bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039895 Dec 18 21:12:03.972321 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3031/6017] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:03 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 18 21:12:04.205325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:04.209407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:04.210354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:04.226805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:04.228645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:04.229826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:04.230308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:04.232429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:04.234202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:04.239797 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-baf23feb-02ae-47f1-bd71-0ab75f745dbb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1749 microversion: 2.20 time: 0.554615 Dec 18 21:12:04.253527 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2987/6018] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:03 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1749 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:04.714821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:04.726159 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03fb9330-442a-4198-a74e-c2c0eac6a431 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1307 microversion: 2.1 time: 0.526792 Dec 18 21:12:04.727170 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3032/6019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:04 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:05.276864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:05.277580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:05.294596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:05.296946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:05.298076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:05.302166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:05.612469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:05.623947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:05.630781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:05.633181 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c077f155-d90a-4fe7-8d15-71a5cccfabd9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1751 microversion: 2.20 time: 0.376770 Dec 18 21:12:05.634135 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2988/6020] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:05 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1751 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:05.750760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:05.752064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:05.762691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:05.764192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:05.767508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:05.768280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:06.200696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:06.209351 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-794de8bd-20e4-43f1-8af2-3cebc758ecfb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1307 microversion: 2.1 time: 0.462436 Dec 18 21:12:06.210513 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3033/6021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:05 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:06.655721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:06.656592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:06.680691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:06.682239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:06.683390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:06.684072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:07.148237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa9eb4d3-fe51-44c8-b4d8-1873d65849f6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '.version_select at 0x7f714f70c5e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:07.170853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa9eb4d3-fe51-44c8-b4d8-1873d65849f6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1539721925" status: 202 len: 0 microversion: 2.1 time: 0.026153 Dec 18 21:12:07.172066 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3034/6022] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Dec 18 21:12:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1539721925 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:12:07.211700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35b7f971-cf1e-49c7-bc95-0c574d60d8d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: .version_select at 0x7f714e57dc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1629853471"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:07.228053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-35b7f971-cf1e-49c7-bc95-0c574d60d8d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:12:07.234353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-35b7f971-cf1e-49c7-bc95-0c574d60d8d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:12:07.411771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:07.426173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:07.429492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:07.431443 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39c2abfe-13ce-4737-ae0f-c1f24e96fee2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.782996 Dec 18 21:12:07.433148 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2989/6023] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:06 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:07.439406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:07.440207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:07.448194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:07.449025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:07.450017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:07.450667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:07.583048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-35b7f971-cf1e-49c7-bc95-0c574d60d8d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:12:07.589581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-35b7f971-cf1e-49c7-bc95-0c574d60d8d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:12:07.605095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35b7f971-cf1e-49c7-bc95-0c574d60d8d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.402104 Dec 18 21:12:07.606033 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3035/6024] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:12:07 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:07.819249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:07.831644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47f1ad1a-d9b1-4078-9262-03ef9295d9b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1307 microversion: 2.1 time: 0.395848 Dec 18 21:12:07.842620 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2990/6025] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:07 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1307 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:08.454145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:08.454826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:08.468387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:08.469187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:08.470469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:08.471860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:08.852137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:08.854386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:08.855745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:08.865530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:08.865748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:08.866527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:08.868101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:08.868992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:08.869726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:08.870147 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e14d767-dad0-4da7-b069-375541f5ce92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.423709 Dec 18 21:12:08.871147 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3036/6026] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:08 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:09.145169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-26eafb24-60e2-4bbf-93ff-83e7a66cb2c8 req-d7977186-0630-467c-869b-b25e185e0045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:09.147327 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:09.147327 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:09.166022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-26eafb24-60e2-4bbf-93ff-83e7a66cb2c8 req-d7977186-0630-467c-869b-b25e185e0045 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:09.166953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-26eafb24-60e2-4bbf-93ff-83e7a66cb2c8 req-d7977186-0630-467c-869b-b25e185e0045 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:09.185947 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-26eafb24-60e2-4bbf-93ff-83e7a66cb2c8 req-d7977186-0630-467c-869b-b25e185e0045 service nova] Creating event network-changed:108c8a1c-0915-4513-8659-185ce5146ce7 for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 on nch2-master-1 Dec 18 21:12:09.193923 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-26eafb24-60e2-4bbf-93ff-83e7a66cb2c8 req-d7977186-0630-467c-869b-b25e185e0045 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052960 Dec 18 21:12:09.195239 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3037/6027] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:09.327554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:09.347818 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e8ca4a2-5b92-4891-96b1-a36ffae7ceef tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1307 microversion: 2.1 time: 0.502282 Dec 18 21:12:09.350142 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2991/6028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:08 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1307 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:09.890403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:09.891816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:09.899023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:09.899816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:09.900888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:09.901563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:10.146032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a9ca1e5c-cadd-41bb-8e73-9896a31b2afe req-26386c4a-e9ef-46fe-8edb-4ae5bd76ab52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1ebc26-c04e-4230-8bb2-457ab3dbb36d", "name": "network-vif-plugged", "status": "completed", "tag": "9a08357b-10fb-4163-84f0-1d7b3903abdd"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:10.147868 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:10.147868 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:12:10.157439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a9ca1e5c-cadd-41bb-8e73-9896a31b2afe req-26386c4a-e9ef-46fe-8edb-4ae5bd76ab52 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:10.157904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a9ca1e5c-cadd-41bb-8e73-9896a31b2afe req-26386c4a-e9ef-46fe-8edb-4ae5bd76ab52 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:10.177756 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a9ca1e5c-cadd-41bb-8e73-9896a31b2afe req-26386c4a-e9ef-46fe-8edb-4ae5bd76ab52 service nova] Creating event network-vif-plugged:9a08357b-10fb-4163-84f0-1d7b3903abdd for instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d on nch1-master-1 Dec 18 21:12:10.183884 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a9ca1e5c-cadd-41bb-8e73-9896a31b2afe req-26386c4a-e9ef-46fe-8edb-4ae5bd76ab52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041615 Dec 18 21:12:10.184698 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2992/6029] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:12:10.366157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:10.366909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:10.373465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:10.373940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:10.374779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:10.375426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:10.381695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:10.399105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:10.403237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:10.417918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6ac77bd-418e-453b-807b-ba474a8acd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.519855 Dec 18 21:12:10.419551 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3038/6030] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:09 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:12:10.704157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:10.724455 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8bf61f24-fb21-4f3a-b5d3-b9f8d04cdb18 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1307 microversion: 2.1 time: 0.362254 Dec 18 21:12:10.725044 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2993/6031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:10 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:11.437002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:11.438222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:11.445670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:11.447053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:11.448027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:11.448631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:11.744301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:11.745112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:11.767433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:11.768070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:11.769509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:11.770394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:12.372995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:12.382055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:12.383980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:12.400065 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8cbc554e-d8e6-445c-b8ec-e310d5621878 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.966117 Dec 18 21:12:12.400970 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3039/6032] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:11 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:12:12.558623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:12.589947 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-480c0164-6e67-4b83-8548-17ad9dc20e64 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1307 microversion: 2.1 time: 0.850406 Dec 18 21:12:12.592145 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2994/6033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:11 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1307 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:13.422179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:13.423528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:13.437278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:13.438883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:13.439962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:13.440701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:13.622626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:13.623306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:13.639296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:13.639776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:13.643308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:13.644512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:13.969341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:13.985705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:13.987595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:13.988871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cdcdb3ee-454b-451b-8368-16fedfb8e784 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.571901 Dec 18 21:12:13.994546 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3040/6034] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:13 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:12:14.579426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:14.591588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-69ef8c61-d913-4ade-81d1-ba37834002d2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1488 microversion: 2.1 time: 0.985617 Dec 18 21:12:14.605913 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2995/6035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:13 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1488 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:14.615933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fea20627-110d-47e8-a174-3c012be079b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:14.618019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fea20627-110d-47e8-a174-3c012be079b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:14.626294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fea20627-110d-47e8-a174-3c012be079b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:14.627092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fea20627-110d-47e8-a174-3c012be079b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:14.628371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fea20627-110d-47e8-a174-3c012be079b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:14.629074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fea20627-110d-47e8-a174-3c012be079b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:14.766543 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fea20627-110d-47e8-a174-3c012be079b0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "PUT /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1083 microversion: 2.1 time: 0.156315 Dec 18 21:12:14.767297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3041/6036] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:12:14 2021] PUT /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1083 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:14.782957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:14.783701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:14.798323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:14.803591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:14.806393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:14.809963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:15.011726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:15.013073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:15.025867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:15.027976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:15.030897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:15.032105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:15.518052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:15.535945 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9a8223e0-beb7-4a52-a8ea-883d4f27fb71 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1509 microversion: 2.1 time: 0.756184 Dec 18 21:12:15.539461 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2996/6037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:14 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1509 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:15.565484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:15.566684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:15.578387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:15.579177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:15.580347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:15.588857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:15.800415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:15.835632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:15.851205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:15.853489 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0234bfe5-836c-4b95-b0dd-2f2306a935cb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.850022 Dec 18 21:12:15.854351 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3042/6038] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:15 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:15.942663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:15.951128 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40768354-5b3a-4a65-8962-efa0740884c0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1509 microversion: 2.1 time: 0.400435 Dec 18 21:12:15.951882 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2997/6039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:15 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:15.968977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:15.970312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:15.980195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:15.980936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:15.981884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:15.982353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:16.025599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:12:16.155163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32fa47f2-db4f-421c-8ead-9f33364aaa87 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 204 len: 0 microversion: 2.1 time: 0.190826 Dec 18 21:12:16.156103 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3043/6040] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:12:15 2021] DELETE /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:12:16.170888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:16.171631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:16.179340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:16.180384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:16.181372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:16.181945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:16.881486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:16.882859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:16.906326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:16.907724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:16.915807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:16.916771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:17.251681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:17.267866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bafb5da3-351d-4649-a6f6-ba844a2d2900 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1515 microversion: 2.1 time: 1.103578 Dec 18 21:12:17.269041 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2998/6041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:16 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1515 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:17.408325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:17.417063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:17.419099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:17.420555 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31dc7d13-520d-474a-b741-ee6ae82e440a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.550160 Dec 18 21:12:17.431509 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3044/6042] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:16 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:18.286160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:18.287470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:18.318080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:18.318875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:18.319713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:18.320166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:18.439014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:18.439621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:18.456001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:18.456461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:18.457257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:18.457693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:19.450037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:19.471475 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82b736f9-c05c-46c9-95db-3bf76a38d7f2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 200 len: 1515 microversion: 2.1 time: 1.188937 Dec 18 21:12:19.472600 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 2999/6043] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:18 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 1515 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:19.477621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:19.478048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:19.481733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:19.495617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:19.497719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:19.498096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:19.505560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:19.514231 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eaa9837c-f638-47e7-a723-d25c0cf535d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 1.073509 Dec 18 21:12:19.516764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:19.517258 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3045/6044] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:18 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:19.523158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:19.557005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f0a48f29-e9be-4703-9b7c-5b957e70818c req-c3839787-b3b5-4e5b-b3a9-4f10adb0764d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1ebc26-c04e-4230-8bb2-457ab3dbb36d", "name": "network-vif-deleted", "tag": "9a08357b-10fb-4163-84f0-1d7b3903abdd"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:19.560047 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:19.560047 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:19.584930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f0a48f29-e9be-4703-9b7c-5b957e70818c req-c3839787-b3b5-4e5b-b3a9-4f10adb0764d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:19.585688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f0a48f29-e9be-4703-9b7c-5b957e70818c req-c3839787-b3b5-4e5b-b3a9-4f10adb0764d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:19.632379 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f0a48f29-e9be-4703-9b7c-5b957e70818c req-c3839787-b3b5-4e5b-b3a9-4f10adb0764d service nova] Creating event network-vif-deleted:9a08357b-10fb-4163-84f0-1d7b3903abdd for instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d on nch1-master-1 Dec 18 21:12:19.648789 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f0a48f29-e9be-4703-9b7c-5b957e70818c req-c3839787-b3b5-4e5b-b3a9-4f10adb0764d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098346 Dec 18 21:12:19.652236 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3046/6045] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:19.796025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lazy-loading 'services' on Instance uuid befd31cf-08d3-4d80-a3e6-101af7256703 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:12:19.878597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1813378982", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "14b65cba-3c23-4bc0-913c-c316c167c76d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1629853471", "security_groups": [{"name": "tempest-secgroup-smoke-524893202"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:19.964909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-84a0ea34-ce81-47ac-a535-d248b06527e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-volume_attachments/2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046" status: 202 len: 0 microversion: 2.1 time: 0.488233 Dec 18 21:12:19.967980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3000/6046] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:12:19 2021] DELETE /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-volume_attachments/2bd5b569-0c9f-4252-ba7f-6fa3ddb1c046 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:12:20.072705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] validate_networks() for [('14b65cba-3c23-4bc0-913c-c316c167c76d', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:12:20.494271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:20.495826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:20.514585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:20.515344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:20.517227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:20.519241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:20.555162 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d could not be found. Dec 18 21:12:20.556771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:12:20.557952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67f987fc-acb6-408d-8f09-3de1e0485f49 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 404 len: 111 microversion: 2.1 time: 0.069687 Dec 18 21:12:20.560413 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3001/6047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:20 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:12:20.565603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:20.566650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:20.585205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:20.585705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:20.586626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:20.587230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:20.911182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:12:20.912139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:12:20.913578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:20.915215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:12:20.916311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:12:20.916849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:12:20.923598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:20.925216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:20.926356 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06d79630-5ad0-4701-a6cb-6340117529de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.364631 Dec 18 21:12:20.927629 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3002/6048] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:20 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:20.932412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-873068235", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "3a5db276-ddbb-4d99-a69c-3e20248c5144"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:20.967155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:20.975743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:20.981273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:20.984517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:21.007473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] validate_networks() for [('3a5db276-ddbb-4d99-a69c-3e20248c5144', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:12:21.061385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:12:21.080174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:12:21.115612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:12:21.118721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:12:21.248862 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a5939ee-ff1a-4b72-a77e-2e1a88208f47 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.373584 Dec 18 21:12:21.257455 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3047/6049] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:12:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:12:21.270480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ffa6161-8507-476f-9cd5-706d50e4f947 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:21.271997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ffa6161-8507-476f-9cd5-706d50e4f947 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:21.365875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1ffa6161-8507-476f-9cd5-706d50e4f947 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:21.386510 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ffa6161-8507-476f-9cd5-706d50e4f947 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1267 microversion: 2.1 time: 0.122516 Dec 18 21:12:21.400352 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3048/6050] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:21 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:21.895617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:12:21.896240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:12:21.896553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:12:21.896965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:12:21.897392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:12:21.921263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:21.922505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:21.923691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:21.924384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:21.951001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:21.952396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:21.966552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:12:21.969180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:21.969638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:21.970472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:21.978905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:21.991652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Getting quotas for user b49bec6d90274fde9af81d52cc9bbf30 and project c36bc0b6ca0849f58c6b8f41df80db6f. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:12:22.035725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:12:22.041749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:12:22.202499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75fe6696-c147-4a2a-8a37-1961257637f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272319 Dec 18 21:12:22.203950 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3003/6051] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:12:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:12:22.205213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:22.217157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:22.219112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:22.221352 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2a6d698b-9abf-4850-ba4f-1c7312036e34 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.278758 Dec 18 21:12:22.221595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-db029a39-6a2c-43c8-8df2-0a75d30b82d6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:22.222634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-db029a39-6a2c-43c8-8df2-0a75d30b82d6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:22.223708 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3049/6052] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:21 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:12:22.338068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-db029a39-6a2c-43c8-8df2-0a75d30b82d6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:22.351433 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-db029a39-6a2c-43c8-8df2-0a75d30b82d6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1208 microversion: 2.1 time: 0.137814 Dec 18 21:12:22.358306 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3004/6053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:22 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1208 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:22.405522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:22.406518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:22.415395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:22.416111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:22.417322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:22.417964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:22.499779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:22.509185 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39a9d6b3-884f-4cae-8915-f5d2b8dabe80 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1263 microversion: 2.1 time: 0.107942 Dec 18 21:12:22.510095 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3050/6054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:22 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1263 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:23.244694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:23.246461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:23.262415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:23.262772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:23.263863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:23.264616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:23.371316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:23.373022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:23.382821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:23.383722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:23.385178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:23.385853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:23.538867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:23.552668 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fcdd93bf-9cf3-4f38-a610-7079e8e99ffa tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1268 microversion: 2.1 time: 0.186448 Dec 18 21:12:23.553495 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3051/6055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:23 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:23.572964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:23.573592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:23.583168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:23.583740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:23.585785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:23.587385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:23.647834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:23.661601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:23.667131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:23.668658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-409fd901-0518-4ad9-85fe-c6e8d090ef2d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.429640 Dec 18 21:12:23.669641 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3005/6056] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:23 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:23.717858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:23.726169 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c366721-fe53-46fa-8f4f-392d1f8796e2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1325 microversion: 2.1 time: 0.158280 Dec 18 21:12:23.729227 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3052/6057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:23 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1325 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:24.463476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03566817-98c2-48b1-8cdf-478d737812eb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:24.473111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03566817-98c2-48b1-8cdf-478d737812eb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:24.473589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03566817-98c2-48b1-8cdf-478d737812eb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:24.515376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03566817-98c2-48b1-8cdf-478d737812eb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Going to try to stop instance {{(pid=140731) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 21:12:24.573436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:24.574951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:24.586142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:24.587578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:24.588078 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03566817-98c2-48b1-8cdf-478d737812eb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 202 len: 0 microversion: 2.1 time: 0.128258 Dec 18 21:12:24.589258 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3006/6058] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:12:24 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:12:24.589570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:24.590563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:24.597400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:24.598119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:24.614962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:24.619340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:24.622566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:24.623841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:25.059200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:25.073138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:25.075339 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a6e04a9-aec6-43ab-b1ec-8b1267bb381d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.482029 Dec 18 21:12:25.088468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3007/6059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:24 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:25.096641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:25.101006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:25.102383 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df8f2552-cc84-435d-8ce7-9014fb8cf58c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1308 microversion: 2.1 time: 0.530976 Dec 18 21:12:25.106438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3053/6060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:24 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:25.115839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:25.116826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:25.118346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:25.118508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:25.119343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:25.119635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:25.126643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:25.127383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:25.128305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:25.129009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:25.468531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:25.476111 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b60febf9-c509-47ee-a54b-0caa30e8b50b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.367269 Dec 18 21:12:25.476714 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3054/6061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:25 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:25.481491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b2e624ec-79e1-4c33-a5fa-c73918c8d5a6 req-c41517cb-2344-490c-8b90-471f28f6dccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c88de396-cb2e-44fd-b912-c5fe7d197b57", "tag": "fe47da2c-2636-4147-8b6f-da54fc0f8764"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:25.483599 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:25.483599 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:25.490727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b2e624ec-79e1-4c33-a5fa-c73918c8d5a6 req-c41517cb-2344-490c-8b90-471f28f6dccf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:25.491605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b2e624ec-79e1-4c33-a5fa-c73918c8d5a6 req-c41517cb-2344-490c-8b90-471f28f6dccf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:25.502904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:25.504113 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b2e624ec-79e1-4c33-a5fa-c73918c8d5a6 req-c41517cb-2344-490c-8b90-471f28f6dccf service nova] Creating event network-changed:fe47da2c-2636-4147-8b6f-da54fc0f8764 for instance c88de396-cb2e-44fd-b912-c5fe7d197b57 on nch1-master-1 Dec 18 21:12:25.509918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b2e624ec-79e1-4c33-a5fa-c73918c8d5a6 req-c41517cb-2344-490c-8b90-471f28f6dccf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031854 Dec 18 21:12:25.510558 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3055/6062] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:25.520041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:25.521841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:25.523413 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4c32c71-599d-4343-9e7f-ed1f1d33388c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.442443 Dec 18 21:12:25.524572 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3008/6063] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:25 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:25.612875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b4a792b9-d790-40b5-ac47-45f8d4e608df req-ea663a3e-25f7-4fe6-b15f-32a7da02ac11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:25.614968 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:25.614968 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:25.628853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b4a792b9-d790-40b5-ac47-45f8d4e608df req-ea663a3e-25f7-4fe6-b15f-32a7da02ac11 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:25.629582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b4a792b9-d790-40b5-ac47-45f8d4e608df req-ea663a3e-25f7-4fe6-b15f-32a7da02ac11 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:25.647379 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b4a792b9-d790-40b5-ac47-45f8d4e608df req-ea663a3e-25f7-4fe6-b15f-32a7da02ac11 service nova] Creating event network-changed:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:12:25.654226 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b4a792b9-d790-40b5-ac47-45f8d4e608df req-ea663a3e-25f7-4fe6-b15f-32a7da02ac11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045681 Dec 18 21:12:25.655102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3056/6064] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:26.095762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:26.096515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:26.107713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.108108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.108937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.109590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.122937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:26.123918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:26.131414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.132147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.133051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.133755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.424879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:26.433232 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-33d71d12-7698-412e-a753-1e4e481d138a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1308 microversion: 2.1 time: 0.315825 Dec 18 21:12:26.436012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:26.439864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3057/6065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:26 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:26.445127 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03828814-cb45-45dc-b1c4-b1879c007be4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.353430 Dec 18 21:12:26.446027 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3009/6066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:26 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:26.492943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:26.493554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:26.499511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.499968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.500929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.501726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.551184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:26.551866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:26.559274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.559864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.560762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:26.561486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:26.696043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:26.704525 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ef1a1f1-6be8-4a59-8cda-72c78bd28df7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.215299 Dec 18 21:12:26.705193 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3058/6067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:26 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:26.747616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:26.755932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:26.757452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:26.758670 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52e3d7e7-8def-4a7e-bed0-28973dbc0342 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.211232 Dec 18 21:12:26.759256 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3010/6068] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:26 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:27.450826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:27.451429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:27.457389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.457863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.458664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.459101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.462392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:27.463171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:27.469075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.469527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.470363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.470824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.700555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:27.707460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:27.707930 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66f4fb77-6d6b-4fd3-afe0-56fd49ed96d9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1308 microversion: 2.1 time: 0.260776 Dec 18 21:12:27.708520 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3059/6069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:27 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:27.716927 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-15b18e3a-e5f8-46e4-9d9c-5067b14191ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.257137 Dec 18 21:12:27.722597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:27.722901 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3011/6070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:27 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:27.723201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:27.729085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.729536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.730355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.730800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.776346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:27.776972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:27.782963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.783439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.784244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:27.784701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:27.908678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:27.917505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40195253-2907-4f09-b9f2-20ab49c98b4a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.198424 Dec 18 21:12:27.918096 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3060/6071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:27 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:27.960747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:27.969337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:27.971133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:27.972571 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b44b32a-d657-44d9-a4bb-f822b8d764a5 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.200907 Dec 18 21:12:27.973247 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3012/6072] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:27 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:12:28.223754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-14dbbce9-79a3-409f-b9fb-761f564c8dd4 req-725a0ea1-ca19-4505-bd4a-c3fa27726930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "name": "network-vif-plugged", "status": "completed", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:28.225319 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:28.225319 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:28.232557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-14dbbce9-79a3-409f-b9fb-761f564c8dd4 req-725a0ea1-ca19-4505-bd4a-c3fa27726930 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.233027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-14dbbce9-79a3-409f-b9fb-761f564c8dd4 req-725a0ea1-ca19-4505-bd4a-c3fa27726930 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.245001 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-14dbbce9-79a3-409f-b9fb-761f564c8dd4 req-725a0ea1-ca19-4505-bd4a-c3fa27726930 service nova] Creating event network-vif-plugged:108c8a1c-0915-4513-8659-185ce5146ce7 for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 on nch2-master-1 Dec 18 21:12:28.249854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-14dbbce9-79a3-409f-b9fb-761f564c8dd4 req-725a0ea1-ca19-4505-bd4a-c3fa27726930 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029874 Dec 18 21:12:28.251313 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3061/6073] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:28.725550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:28.726171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:28.733850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.734062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:28.734681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.734784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:28.735065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.735571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.742681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.743135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.743931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.744370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.932403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:28.936094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:28.940058 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b3f9706f-e774-4ee8-bbee-18c3bf4b7490 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1308 microversion: 2.1 time: 0.218230 Dec 18 21:12:28.940795 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3013/6074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:28 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:28.943711 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e72e7456-679d-4fce-9da2-c84a576a512d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.214555 Dec 18 21:12:28.944424 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3062/6075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:28 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:28.945616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:28.946266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:28.952269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.952731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.953538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.954123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.990659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:28.991176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:28.997987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.998500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:28.999286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:28.999747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:29.122603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:29.130027 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-026cd047-3da6-4811-b3cc-5155f6d0d9c5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.188226 Dec 18 21:12:29.130644 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3014/6076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:28 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:29.165816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:29.174075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:29.175616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:29.176772 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c83b9eb7-fc80-486d-a9e4-d06c5a10c03d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.190006 Dec 18 21:12:29.177333 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3063/6077] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:28 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:12:29.957415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:29.958125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:29.960577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:29.961228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:29.965360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:29.965913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:29.966993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:29.967505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:29.968429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:29.968893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:29.969694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:29.970174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:30.180571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:30.193117 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7921ad0e-9738-4fbe-9f32-0234719416c8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.236324 Dec 18 21:12:30.193916 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3064/6078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:29 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:30.195515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:30.206530 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b05a6fca-06d7-45c2-822d-d44e11063501 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1308 microversion: 2.1 time: 0.253261 Dec 18 21:12:30.208576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:30.209704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:30.217538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3015/6079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:29 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:30.222658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:30.223456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:30.223750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:30.224479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:30.225549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:30.226283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:30.231161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:30.231979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:30.233191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:30.233878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:30.451483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:30.460106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:30.462349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:30.463625 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a20b0f2-e198-4028-af01-5521cc009278 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1807 microversion: 2.20 time: 0.244747 Dec 18 21:12:30.464581 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3016/6080] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:30 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:30.469254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c71e3aac-4fa3-4f89-b5b9-c9c311e2f838 req-7824f92d-93d6-438f-b69e-ed0fbe3896b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88de396-cb2e-44fd-b912-c5fe7d197b57", "name": "network-vif-plugged", "status": "completed", "tag": "fe47da2c-2636-4147-8b6f-da54fc0f8764"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:30.470956 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:30.470956 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:12:30.478848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c71e3aac-4fa3-4f89-b5b9-c9c311e2f838 req-7824f92d-93d6-438f-b69e-ed0fbe3896b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:30.479388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c71e3aac-4fa3-4f89-b5b9-c9c311e2f838 req-7824f92d-93d6-438f-b69e-ed0fbe3896b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:30.482480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:30.490804 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aba8d4a7-6e87-4f83-bcc2-99aeab95414a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.295544 Dec 18 21:12:30.490993 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c71e3aac-4fa3-4f89-b5b9-c9c311e2f838 req-7824f92d-93d6-438f-b69e-ed0fbe3896b7 service nova] Creating event network-vif-plugged:fe47da2c-2636-4147-8b6f-da54fc0f8764 for instance c88de396-cb2e-44fd-b912-c5fe7d197b57 on nch1-master-1 Dec 18 21:12:30.491913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3065/6081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:30 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:30.496969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c71e3aac-4fa3-4f89-b5b9-c9c311e2f838 req-7824f92d-93d6-438f-b69e-ed0fbe3896b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030665 Dec 18 21:12:30.497519 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3017/6082] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:31.210816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:31.211993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:31.218713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.219177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.219964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.220410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.225418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:31.226129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:31.238934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.238934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.238934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.238934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.423117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:31.429972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:31.430787 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f10c0d34-d826-4c41-a263-7f4bde896f4e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.223710 Dec 18 21:12:31.431477 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3066/6083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:31 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:31.437407 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fbd86f6a-0f21-4a44-aa96-9ce398ab29ec tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1308 microversion: 2.1 time: 0.216886 Dec 18 21:12:31.437972 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3018/6084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:31 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:31.480405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:31.480940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:31.486700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.487153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.487933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.488372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.508674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:31.509299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:31.515131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.515599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.516670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:31.517132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:31.715862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:31.726129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:31.727671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:31.728890 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef2d8935-cd04-4815-9ce8-933795ee5a81 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1794 microversion: 2.20 time: 0.252096 Dec 18 21:12:31.729615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3067/6085] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:12:31 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1794 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:12:31.737505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:31.746640 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d401131-7bf4-4135-993b-e81bc07390bf tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.241976 Dec 18 21:12:31.747399 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3019/6086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:31 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:32.448335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:32.449081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:32.454441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:32.455084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:32.455950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.456414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.457209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.457659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.462233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.462733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.463543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.464034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.656260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:32.663524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:32.663779 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-87a50056-47f3-4264-8703-188eb95ac7ff tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.219223 Dec 18 21:12:32.665019 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3068/6087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:32 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:32.669448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0608dc26-8e06-4fb7-ad70-d1fe62c7cdf9 req-2ae598d4-2da9-465c-b9a7-d8622e21572d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "name": "network-vif-plugged", "status": "completed", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:32.671092 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:32.671092 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:32.672166 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95b41507-2945-4047-828e-feefde5b9f56 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1488 microversion: 2.1 time: 0.221493 Dec 18 21:12:32.672743 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3020/6088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:32 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1488 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:32.677946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0608dc26-8e06-4fb7-ad70-d1fe62c7cdf9 req-2ae598d4-2da9-465c-b9a7-d8622e21572d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.678426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0608dc26-8e06-4fb7-ad70-d1fe62c7cdf9 req-2ae598d4-2da9-465c-b9a7-d8622e21572d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.688065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-33eb9fe7-2bc6-4b15-9ff9-7dc67e076689 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1884782937"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:32.689081 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0608dc26-8e06-4fb7-ad70-d1fe62c7cdf9 req-2ae598d4-2da9-465c-b9a7-d8622e21572d service nova] Creating event network-vif-plugged:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:12:32.689372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-33eb9fe7-2bc6-4b15-9ff9-7dc67e076689 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:32.694564 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0608dc26-8e06-4fb7-ad70-d1fe62c7cdf9 req-2ae598d4-2da9-465c-b9a7-d8622e21572d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028330 Dec 18 21:12:32.695155 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3069/6089] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:12:32.695901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33eb9fe7-2bc6-4b15-9ff9-7dc67e076689 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.696465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33eb9fe7-2bc6-4b15-9ff9-7dc67e076689 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.697345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33eb9fe7-2bc6-4b15-9ff9-7dc67e076689 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.697871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33eb9fe7-2bc6-4b15-9ff9-7dc67e076689 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.764731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:32.765675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:32.771286 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-33eb9fe7-2bc6-4b15-9ff9-7dc67e076689 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "PUT /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1074 microversion: 2.1 time: 0.086719 Dec 18 21:12:32.772116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.772720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.774092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.774445 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3021/6090] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:12:32 2021] PUT /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1074 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:32.774701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.786241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:32.786922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:32.794227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.794740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.795562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:32.796022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:32.986106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:32.990545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:32.993777 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0a9af76d-96e2-4f46-af09-616dc2dfa42b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.233968 Dec 18 21:12:32.994386 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3070/6091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:32 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:32.998090 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-898653a0-e3cc-4b8a-8359-bc4bc3af6e7f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1500 microversion: 2.1 time: 0.215946 Dec 18 21:12:32.998844 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3022/6092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:32 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1500 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:33.014019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:33.014666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:33.020648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:33.021142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:33.021919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:33.022386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:33.154491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:33.161854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-658871db-7e2e-4ee4-9376-ee5347471c6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1500 microversion: 2.1 time: 0.151551 Dec 18 21:12:33.162454 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3071/6093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:33 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1500 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:33.177346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-536e4102-da02-43f1-9922-2dc7fdd8ae74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:33.183869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-536e4102-da02-43f1-9922-2dc7fdd8ae74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:33.184343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-536e4102-da02-43f1-9922-2dc7fdd8ae74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:33.206959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-536e4102-da02-43f1-9922-2dc7fdd8ae74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Going to try to stop instance {{(pid=140731) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 21:12:33.247379 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-536e4102-da02-43f1-9922-2dc7fdd8ae74 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "POST /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57/action" status: 202 len: 0 microversion: 2.1 time: 0.073526 Dec 18 21:12:33.248173 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3023/6094] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:12:33 2021] POST /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:12:33.257179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:33.257936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:33.264720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:33.265170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:33.265961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:33.266435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:33.398183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:33.405762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-085b94bd-8713-4946-becc-d76e9470575a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.152653 Dec 18 21:12:33.406364 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3072/6095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:33 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:33.682556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:33.683274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:33.690188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:33.690717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:33.691515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:33.692226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:33.820042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:33.827935 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56b1568c-7a35-43af-ba86-487ad6a727aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.150061 Dec 18 21:12:33.828445 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3024/6096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:33 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:34.010786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:34.011387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:34.017877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:34.018354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:34.019140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:34.019578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:34.157629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:34.165742 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b6621af2-d900-4be1-997e-c1474164b065 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1392 microversion: 2.1 time: 0.159102 Dec 18 21:12:34.166333 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3073/6097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:34 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:34.422888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:34.423535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:34.429634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:34.430101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:34.431240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:34.431699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:34.560381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:34.568099 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c0f909fe-dcaf-4d35-9e1d-0340f4c34e29 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.148919 Dec 18 21:12:34.568663 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3025/6098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:34 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:34.844835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:34.845452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:34.851858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:34.852301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:34.853163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:34.853609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:34.989925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:34.999003 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-811c9127-a0ca-4525-911c-0afb1a1a928e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1676 microversion: 2.1 time: 0.158024 Dec 18 21:12:34.999579 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3074/6099] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:34 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:35.182928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:35.183632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:35.190369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:35.190840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:35.191644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:35.192359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:35.324993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:35.332459 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4df34a1-c424-464e-b000-7c2bdd472931 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1563 microversion: 2.1 time: 0.153967 Dec 18 21:12:35.333031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3026/6100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:35 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:35.348035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:35.348650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:35.355932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:35.356390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:35.357175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:35.357618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:35.489892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:35.497384 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e388998f-97af-49c7-8f5e-fcb35f0591fc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1563 microversion: 2.1 time: 0.153013 Dec 18 21:12:35.497960 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3075/6101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:35 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:35.587594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:35.588214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:35.594791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:35.595264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:35.596074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:35.596530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:35.764340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:35.772064 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35f3cb9f-b02b-4f75-bc75-2ef8f418bb23 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.188962 Dec 18 21:12:35.772700 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3027/6102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:35 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:36.016686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:36.017296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:36.023194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:36.024276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:36.025518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:36.025518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:36.271679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:36.279122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c483c77-d9f9-4369-9404-ef86a171f0d1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1653 microversion: 2.1 time: 0.266237 Dec 18 21:12:36.279898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3076/6103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:36 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1653 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:36.295297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-27a87cda-12d6-4675-9ee6-8b0749eb13bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:36.302375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27a87cda-12d6-4675-9ee6-8b0749eb13bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:36.302844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-27a87cda-12d6-4675-9ee6-8b0749eb13bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:36.326303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-27a87cda-12d6-4675-9ee6-8b0749eb13bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Going to try to start instance {{(pid=140731) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 21:12:36.370172 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-27a87cda-12d6-4675-9ee6-8b0749eb13bb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action" status: 202 len: 0 microversion: 2.1 time: 0.078417 Dec 18 21:12:36.371038 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3028/6104] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:12:36 2021] POST /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:12:36.378705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:36.379309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:36.387979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:36.388776 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:36.405960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:36.406947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:36.747496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:36.755215 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9df87d86-78b1-4dc7-a11f-6b6c4f489997 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1662 microversion: 2.1 time: 0.380140 Dec 18 21:12:36.755804 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3077/6105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:36 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1662 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:12:36.789890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:36.790670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:36.796937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:36.797406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:36.798217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:36.798703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:37.460927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:37.468902 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7a66c6a-2686-4ae5-94f2-1afe375d0ce9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.683747 Dec 18 21:12:37.469473 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3029/6106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:36 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:37.772281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:37.772922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:37.779675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:37.780132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:37.780929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:37.781376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:38.029874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:38.037550 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a97f17ef-5b04-4303-8cbd-4f33ae02c695 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1662 microversion: 2.1 time: 0.269051 Dec 18 21:12:38.048211 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3078/6107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:37 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1662 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:38.204509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:38.205129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:38.207229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a09da7d3-de06-47be-823a-39aa5026df13 req-bd7f2668-5988-46aa-b7cc-727c7624dc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:12:38.208852 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:12:38.208852 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:12:38.211526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:38.212003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:38.212932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:38.213325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:38.216813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a09da7d3-de06-47be-823a-39aa5026df13 req-bd7f2668-5988-46aa-b7cc-727c7624dc77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:38.217219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a09da7d3-de06-47be-823a-39aa5026df13 req-bd7f2668-5988-46aa-b7cc-727c7624dc77 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:38.229295 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a09da7d3-de06-47be-823a-39aa5026df13 req-bd7f2668-5988-46aa-b7cc-727c7624dc77 service nova] Creating event network-changed:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:12:38.234643 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a09da7d3-de06-47be-823a-39aa5026df13 req-bd7f2668-5988-46aa-b7cc-727c7624dc77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030951 Dec 18 21:12:38.235465 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3079/6108] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:12:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:12:38.363298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:38.371626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-584bd9d4-715c-49bf-85c9-51a34a1469b0 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1563 microversion: 2.1 time: 0.170825 Dec 18 21:12:38.372192 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3030/6109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:38 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:38.485431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:38.486128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:38.493356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:38.494244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:38.494620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:38.495054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:38.644764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:38.652623 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e941a95-a54e-47cb-8adf-fac09dea4701 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.171310 Dec 18 21:12:38.653321 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3080/6110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:38 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:39.055406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:39.056027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:39.062063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:39.062564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:39.063376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:39.063827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:39.199005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:39.208164 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b9ee546-9901-4dc1-aba9-d1dd8519077e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1666 microversion: 2.1 time: 0.156976 Dec 18 21:12:39.208759 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3031/6111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:39 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:39.668960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:39.669500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:39.676208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:39.676662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:39.677477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:39.677917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:39.805455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:39.812876 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bcea0300-f3e6-48b5-8fd0-9854dbd2adfc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.147847 Dec 18 21:12:39.813442 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3081/6112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:39 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:40.829798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:40.830449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:40.837659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:40.838123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:40.838938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:40.839389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:40.971002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:40.978991 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a29ae4a-8456-4603-8b5f-7f26b4e5f7f7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.152926 Dec 18 21:12:40.979557 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3032/6113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:40 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:41.996502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:41.997058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:42.003830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:42.004282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:42.005066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:42.005503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:42.136932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:42.144363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a8bed4e-8c23-49d4-8680-a5ec1d76890d tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.152372 Dec 18 21:12:42.144939 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3082/6114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:41 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:43.160881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:43.161511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:43.168280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:43.168751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:43.169549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:43.170005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:43.307815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:43.315529 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-076199b5-3dd4-4b27-8125-a5690ef5a7ff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.158448 Dec 18 21:12:43.316115 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3033/6115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:43 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:44.332808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:44.333444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:44.341751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:44.342208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:44.343049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:44.343487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:44.473922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:44.481209 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-00a9494a-f6f8-4c48-a1aa-b22dbeb42946 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.152159 Dec 18 21:12:44.481781 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3083/6116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:44 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:45.497830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:45.498486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:45.505152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:45.505612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:45.506434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:45.506881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:45.640438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:45.647956 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0f0646a-e079-4b4f-b84b-43018e287dbb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.153927 Dec 18 21:12:45.649189 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3034/6117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:45 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:46.665237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:46.665870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:46.672832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:46.673284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:46.674147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:46.674624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:46.808854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:46.816186 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d552a575-fb02-4b42-8442-218d62cf68e0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.155190 Dec 18 21:12:46.817005 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3084/6118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:46 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:47.832833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:47.833459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:47.840383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:47.840846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:47.841639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:47.842092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:47.973753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:47.981766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-49e0f270-c4c2-42a0-a407-c94531ecc1b2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.152717 Dec 18 21:12:47.982353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3035/6119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:47 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:48.998700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:48.999240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:49.005992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:49.006490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:49.007295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:49.008421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:49.140996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:49.148340 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4848e3c-314c-4a72-bf74-73a2d71255f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.153472 Dec 18 21:12:49.148918 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3085/6120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:48 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:50.164909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:50.165565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:50.172395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:50.172862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:50.173662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:50.174114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:50.304462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:50.311918 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-caf1d330-dd28-422c-b1d9-8010adf2bd6c tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.150736 Dec 18 21:12:50.312499 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3036/6121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:50 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:51.328730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:51.329330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:51.337421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:51.338002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:51.338761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:51.339169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:51.470309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:51.478229 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e64a4ac-8908-4566-9251-9aa916980c19 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.153324 Dec 18 21:12:51.478822 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3086/6122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:51 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:52.495611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:52.496238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:52.503047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:52.503514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:52.504310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:52.504766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:52.639217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:52.646771 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b1ac4f1-fe08-4c67-a36b-45c0655235b9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.155427 Dec 18 21:12:52.647352 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3037/6123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:52 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:53.664128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:53.664699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:53.671432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:53.671893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:53.672682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:53.673127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:53.800705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:53.808598 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-794c22ce-f02d-433f-a7db-59ff3a6fe1de tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.148317 Dec 18 21:12:53.809171 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3087/6124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:53 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:54.826533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:54.827158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:54.834127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:54.834643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:54.835449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:54.835909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:54.969248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:54.976520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6eaad5cd-5c57-46fe-a0bb-7b4c5c5c1206 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.154105 Dec 18 21:12:54.977081 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3038/6125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:54 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:55.993767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:55.994345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:56.001058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:56.001512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:56.002395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:56.002842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:56.130710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:56.137896 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-96029fd3-62f5-4ad7-a468-b1cdb1fce276 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.148429 Dec 18 21:12:56.138497 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3088/6126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:55 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:57.155080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:57.155700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:57.162246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:57.162728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:57.163521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:57.163974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:57.296615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:57.304083 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9886325d-7075-49d3-b18f-80bcdbc56ded tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.152752 Dec 18 21:12:57.304658 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3039/6127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:57 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:58.321025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:58.321667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:58.328457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:58.328912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:58.329691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:58.330131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:58.460138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:58.467508 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0edb0f5c-c3cb-4ccd-bbec-2a26a6a77696 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.150465 Dec 18 21:12:58.468107 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3089/6128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:58 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:12:59.484669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:12:59.485305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:12:59.492127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:59.493105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:59.493904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:12:59.494396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:12:59.624623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:12:59.632469 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81c1706a-f12c-4340-beb7-a15b6222c255 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.151554 Dec 18 21:12:59.633677 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3040/6129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:12:59 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:00.652418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:00.653018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:00.659658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:00.660107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:00.660882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:00.661317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:00.797800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:00.806836 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5827f6bd-f5fc-457f-bc17-9ba3f0602af7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.158169 Dec 18 21:13:00.807412 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3090/6130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:00 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:01.625441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cf1fcee2-77de-4aab-bc1e-701f1374fc6a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:01.626503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cf1fcee2-77de-4aab-bc1e-701f1374fc6a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:01.633734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf1fcee2-77de-4aab-bc1e-701f1374fc6a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:01.634207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf1fcee2-77de-4aab-bc1e-701f1374fc6a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:01.635055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf1fcee2-77de-4aab-bc1e-701f1374fc6a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:01.635521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cf1fcee2-77de-4aab-bc1e-701f1374fc6a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:01.688188 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cf1fcee2-77de-4aab-bc1e-701f1374fc6a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action" status: 200 len: 24569 microversion: 2.1 time: 0.066380 Dec 18 21:13:01.688832 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3041/6131] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:01 2021] POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action => generated 24569 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:01.823955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:01.824554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:01.831277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:01.831727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:01.832497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:01.832935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:01.967303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:01.974575 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2f0c04fa-1392-4988-b1e4-728c2ed7aafb tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.154963 Dec 18 21:13:01.975141 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3091/6132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:01 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:02.991871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:02.992529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:02.999900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.000367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.001167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.001624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.138131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:03.145576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1502d513-fd94-4352-9dc9-097614ba7a85 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1510 microversion: 2.1 time: 0.157866 Dec 18 21:13:03.146141 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3042/6133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:02 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:03.555606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52621a41-ada0-4c6e-b014-953a60f91da3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:03.556184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52621a41-ada0-4c6e-b014-953a60f91da3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:03.562845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52621a41-ada0-4c6e-b014-953a60f91da3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.563298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52621a41-ada0-4c6e-b014-953a60f91da3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.564102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52621a41-ada0-4c6e-b014-953a60f91da3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.564535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52621a41-ada0-4c6e-b014-953a60f91da3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.596515 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52621a41-ada0-4c6e-b014-953a60f91da3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments/87b40d06-8666-40c6-a69a-c359ce3aa4fc" status: 200 len: 194 microversion: 2.20 time: 0.044720 Dec 18 21:13:03.597140 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3092/6134] 10.222.0.13 () {60 vars in 1453 bytes} [Sat Dec 18 21:13:03 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments/87b40d06-8666-40c6-a69a-c359ce3aa4fc => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:03.659101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:03.659619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:03.666176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.666763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.667532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.668033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.746316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lazy-loading 'services' on Instance uuid 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:13:03.812772 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2fbcca58-8070-484a-a6d6-c3199dbed29c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments/87b40d06-8666-40c6-a69a-c359ce3aa4fc" status: 202 len: 0 microversion: 2.20 time: 0.157359 Dec 18 21:13:03.813362 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3043/6135] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Dec 18 21:13:03 2021] DELETE /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments/87b40d06-8666-40c6-a69a-c359ce3aa4fc => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:13:03.822492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d281d402-0261-494d-a1f6-3b791af97f16 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:03.823416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d281d402-0261-494d-a1f6-3b791af97f16 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:03.829433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d281d402-0261-494d-a1f6-3b791af97f16 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.829910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d281d402-0261-494d-a1f6-3b791af97f16 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.830733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d281d402-0261-494d-a1f6-3b791af97f16 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:03.831178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d281d402-0261-494d-a1f6-3b791af97f16 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:03.862360 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d281d402-0261-494d-a1f6-3b791af97f16 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044156 Dec 18 21:13:03.862870 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3093/6136] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Dec 18 21:13:03 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:04.164512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:04.165250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.171455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.171923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.172727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.173183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.301127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:04.309175 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9827b9d4-405a-450c-aca8-d99b9817cec5 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1487 microversion: 2.1 time: 0.149667 Dec 18 21:13:04.309750 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3044/6137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:04 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1487 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:04.324909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03ba16b6-ff60-4e40-af4d-05e21f042603 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1372114353"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:04.326039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03ba16b6-ff60-4e40-af4d-05e21f042603 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.331899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ba16b6-ff60-4e40-af4d-05e21f042603 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.332333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ba16b6-ff60-4e40-af4d-05e21f042603 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.333106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ba16b6-ff60-4e40-af4d-05e21f042603 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.333542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03ba16b6-ff60-4e40-af4d-05e21f042603 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.394156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03ba16b6-ff60-4e40-af4d-05e21f042603 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "PUT /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1060 microversion: 2.1 time: 0.072838 Dec 18 21:13:04.394805 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3094/6138] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:13:04 2021] PUT /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1060 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:04.408013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:04.408637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.415451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.415864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.416671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.417131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.557322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:04.565294 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5da365fc-589f-43d7-9174-59956d14cc52 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1487 microversion: 2.1 time: 0.160671 Dec 18 21:13:04.566002 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3045/6139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:04 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1487 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:04.582818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:04.583464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.591215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.591983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.593291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.593772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.731547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:04.739233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c513830-dcd1-4b46-8e41-c50d46ed4aff tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1487 microversion: 2.1 time: 0.161168 Dec 18 21:13:04.739808 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3095/6140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:04 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1487 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:04.755253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:04.755790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.762806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.763268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.764062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.764509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.788611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:13:04.872566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7207b6d8-d88a-4832-8d02-953931c6d093 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 204 len: 0 microversion: 2.1 time: 0.120682 Dec 18 21:13:04.873782 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3046/6141] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:04 2021] DELETE /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:13:04.879139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2bf3eb7a-b124-4ff8-b6d8-b7e297d91191 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:04.880066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2bf3eb7a-b124-4ff8-b6d8-b7e297d91191 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.884175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:04.885167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.887901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bf3eb7a-b124-4ff8-b6d8-b7e297d91191 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.888401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bf3eb7a-b124-4ff8-b6d8-b7e297d91191 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.889393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bf3eb7a-b124-4ff8-b6d8-b7e297d91191 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.889948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2bf3eb7a-b124-4ff8-b6d8-b7e297d91191 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.892068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.892607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.893443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.893999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.925758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2bf3eb7a-b124-4ff8-b6d8-b7e297d91191 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055332 Dec 18 21:13:04.926593 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3096/6142] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Dec 18 21:13:04 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:04.986210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:04.986733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:04.993510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.993963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:04.994783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:04.995219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:05.024357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:13:05.047056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:05.056829 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6493b240-75d9-43d5-a014-caf9af35ddc0 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1493 microversion: 2.1 time: 0.178148 Dec 18 21:13:05.057784 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3047/6143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:04 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:05.101333 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-318eb075-607d-4e1f-a7db-01af4aee9c27 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 204 len: 0 microversion: 2.20 time: 0.118217 Dec 18 21:13:05.102720 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3097/6144] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:13:04 2021] DELETE /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 18 21:13:05.111622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:05.112252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:05.119553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:05.120062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:05.120859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:05.121311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:05.266358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:05.275236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:05.276760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:05.277947 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6d70e7d8-b690-4235-a069-f47a964e52ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.170326 Dec 18 21:13:05.278540 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3048/6145] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:05 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:06.076263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:06.076874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:06.083514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:06.083959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:06.084740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:06.085175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:06.213725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:06.221010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7599a307-69c3-4d98-8202-8be042f4b7e9 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1493 microversion: 2.1 time: 0.149205 Dec 18 21:13:06.221581 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3098/6146] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:06 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1493 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:06.296570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:06.297197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:06.304351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:06.305314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:06.306174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:06.306668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:06.445183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:06.459308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:06.460834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:06.462024 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68230b74-003c-460a-b44b-fc3734d19c13 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1722 microversion: 2.20 time: 0.169339 Dec 18 21:13:06.462692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3049/6147] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:06 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:06.809423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-df4797b9-4167-445e-b829-9a443d0a63e3 req-c6571361-a637-4fcf-a75f-11ad4eb1aef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88de396-cb2e-44fd-b912-c5fe7d197b57", "name": "network-vif-deleted", "tag": "fe47da2c-2636-4147-8b6f-da54fc0f8764"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:06.813318 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:06.813318 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:06.831467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-df4797b9-4167-445e-b829-9a443d0a63e3 req-c6571361-a637-4fcf-a75f-11ad4eb1aef3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:06.832519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-df4797b9-4167-445e-b829-9a443d0a63e3 req-c6571361-a637-4fcf-a75f-11ad4eb1aef3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:06.849508 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-df4797b9-4167-445e-b829-9a443d0a63e3 req-c6571361-a637-4fcf-a75f-11ad4eb1aef3 service nova] Creating event network-vif-deleted:fe47da2c-2636-4147-8b6f-da54fc0f8764 for instance c88de396-cb2e-44fd-b912-c5fe7d197b57 on nch1-master-1 Dec 18 21:13:06.856879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-df4797b9-4167-445e-b829-9a443d0a63e3 req-c6571361-a637-4fcf-a75f-11ad4eb1aef3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052588 Dec 18 21:13:06.861667 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3099/6148] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:07.240593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:07.241581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:07.252645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:07.253380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:07.253926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:07.254404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:07.301493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:07.302375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:07.302611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lazy-loading 'fault' on Instance uuid c88de396-cb2e-44fd-b912-c5fe7d197b57 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:13:07.377690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:07.387664 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-47dd1c40-1021-4981-8165-a88fd407afb1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 200 len: 1310 microversion: 2.1 time: 0.153442 Dec 18 21:13:07.388693 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3050/6149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:07 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 1310 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:07.482770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:07.484402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:07.492762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:07.493427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:07.494513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:07.495131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:07.597949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:07.608136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-10e20839-39b0-4e50-8d84-02623ce4f746 req-c4ab7841-2da3-4938-9dc4-eb52b709133f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9", "name": "network-vif-deleted", "tag": "108c8a1c-0915-4513-8659-185ce5146ce7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:07.610561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:07.612264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:07.612751 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:07.612751 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:13:07.614904 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f7e06212-9bad-4935-9ba3-a97146dcfbcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 200 len: 1654 microversion: 2.20 time: 0.137258 Dec 18 21:13:07.616075 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3100/6150] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:07 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 1654 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:13:07.624078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-10e20839-39b0-4e50-8d84-02623ce4f746 req-c4ab7841-2da3-4938-9dc4-eb52b709133f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:07.624846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-10e20839-39b0-4e50-8d84-02623ce4f746 req-c4ab7841-2da3-4938-9dc4-eb52b709133f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:07.645238 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-10e20839-39b0-4e50-8d84-02623ce4f746 req-c4ab7841-2da3-4938-9dc4-eb52b709133f service nova] Creating event network-vif-deleted:108c8a1c-0915-4513-8659-185ce5146ce7 for instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 on nch2-master-1 Dec 18 21:13:07.654060 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-10e20839-39b0-4e50-8d84-02623ce4f746 req-c4ab7841-2da3-4938-9dc4-eb52b709133f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050161 Dec 18 21:13:07.655851 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3051/6151] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:08.406700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.408243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.415813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.416268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.417108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.417765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.433822 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance c88de396-cb2e-44fd-b912-c5fe7d197b57 could not be found. Dec 18 21:13:08.434444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance c88de396-cb2e-44fd-b912-c5fe7d197b57 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.435323 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64518a3b-74a1-4861-b6d9-b775796a8d7b tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 404 len: 111 microversion: 2.1 time: 0.033125 Dec 18 21:13:08.436162 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3101/6152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.451580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.453418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.460361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.460994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.462095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.462646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.477160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance c88de396-cb2e-44fd-b912-c5fe7d197b57 could not be found. Dec 18 21:13:08.477865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance c88de396-cb2e-44fd-b912-c5fe7d197b57 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.478848 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b699ae09-20bb-419c-bca0-666b5b69d7b3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 404 len: 111 microversion: 2.1 time: 0.032240 Dec 18 21:13:08.479407 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3052/6153] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.487719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.488329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: c88de396-cb2e-44fd-b912-c5fe7d197b57] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.495368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.495878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.496706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.497144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.514795 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance c88de396-cb2e-44fd-b912-c5fe7d197b57 could not be found. Dec 18 21:13:08.515444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance c88de396-cb2e-44fd-b912-c5fe7d197b57 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.516366 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1169d633-f3e1-44f6-8dad-507b873d21bc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57" status: 404 len: 111 microversion: 2.1 time: 0.032943 Dec 18 21:13:08.517218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3102/6154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/c88de396-cb2e-44fd-b912-c5fe7d197b57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.525471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.526287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.533349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.534107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.534673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.535375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.556472 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d could not be found. Dec 18 21:13:08.557089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.557954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f397c8dd-752c-4117-82bc-445374072c01 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 404 len: 111 microversion: 2.1 time: 0.036600 Dec 18 21:13:08.558538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3053/6155] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.574862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.575932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.582562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.583030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.583864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.584314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.601099 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d could not be found. Dec 18 21:13:08.601738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance 9f1ebc26-c04e-4230-8bb2-457ab3dbb36d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.602664 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de57d398-c0cc-44bf-8bc4-01640b1941f3 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d" status: 404 len: 111 microversion: 2.1 time: 0.034065 Dec 18 21:13:08.603226 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3103/6156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/9f1ebc26-c04e-4230-8bb2-457ab3dbb36d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.612434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.613085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.623367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.624152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.625429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.626073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.637151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.637778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.645221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.645845 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance d964e9dd-27c3-4ad1-aac9-b91bad02537a could not be found. Dec 18 21:13:08.646175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.646541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance d964e9dd-27c3-4ad1-aac9-b91bad02537a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.647520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f94bda6b-f0ef-43e1-a0e7-4534f8a94c9f tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 404 len: 111 microversion: 2.1 time: 0.039911 Dec 18 21:13:08.647905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.648920 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3054/6157] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.649577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.659487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.660178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: d964e9dd-27c3-4ad1-aac9-b91bad02537a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.667227 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] HTTP exception thrown: Instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 could not be found. Dec 18 21:13:08.667634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.668339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.668552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Returning 404 to user: Instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.669143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.669594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.669905 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2bd4a22-dfb7-438d-9b99-b3bf02734ea9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 404 len: 111 microversion: 2.20 time: 0.040599 Dec 18 21:13:08.670681 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3104/6158] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:13:08.680984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4553e419-4880-448b-8e40-8393f76797ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '.version_select at 0x7f71614ab670>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.688330 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance d964e9dd-27c3-4ad1-aac9-b91bad02537a could not be found. Dec 18 21:13:08.690340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance d964e9dd-27c3-4ad1-aac9-b91bad02537a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.691942 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70e6208d-fa65-4590-9a08-290fd8938343 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a" status: 404 len: 111 microversion: 2.1 time: 0.036331 Dec 18 21:13:08.692938 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3055/6159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/d964e9dd-27c3-4ad1-aac9-b91bad02537a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.702625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.703701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.706791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4553e419-4880-448b-8e40-8393f76797ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-414375820" status: 204 len: 0 microversion: 2.20 time: 0.030577 Dec 18 21:13:08.707370 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3105/6160] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-414375820 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 18 21:13:08.720473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.721263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.723287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.723978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.743099 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance e7893530-a701-4c2f-8b28-18e55d0f3110 could not be found. Dec 18 21:13:08.744278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance e7893530-a701-4c2f-8b28-18e55d0f3110 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.745388 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae8c0a34-182c-482d-ae60-f97c699798cc tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 404 len: 111 microversion: 2.1 time: 0.047285 Dec 18 21:13:08.746460 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3056/6161] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.758405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.759121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: e7893530-a701-4c2f-8b28-18e55d0f3110] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.767723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.768355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.769471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.770610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.791079 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance e7893530-a701-4c2f-8b28-18e55d0f3110 could not be found. Dec 18 21:13:08.791810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance e7893530-a701-4c2f-8b28-18e55d0f3110 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.792791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9ee9c67-4a9d-4f5e-82dd-1164d749ade7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110" status: 404 len: 111 microversion: 2.1 time: 0.041752 Dec 18 21:13:08.794493 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3106/6162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/e7893530-a701-4c2f-8b28-18e55d0f3110 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.802019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.802679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.810210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.810659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.811519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.812310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.829033 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce could not be found. Dec 18 21:13:08.829639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.831663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc89ee70-41d8-4a30-a04a-68b8bb55e9a2 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 404 len: 111 microversion: 2.1 time: 0.033820 Dec 18 21:13:08.832736 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3057/6163] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.841731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.842536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.848941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.849400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.850354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.850794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.871021 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce could not be found. Dec 18 21:13:08.871691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance 2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.872779 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-881fc314-720b-4396-8b4f-780774896e28 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce" status: 404 len: 111 microversion: 2.1 time: 0.035603 Dec 18 21:13:08.873447 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3107/6164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/2cc2dca2-2075-4ff5-bbd1-f1a135e4fcce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:13:08.883615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.884159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.901382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.902140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.903379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.904174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.922101 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a could not be found. Dec 18 21:13:08.923005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.924133 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af1e6925-da62-4c3b-9583-98456641f958 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 404 len: 111 microversion: 2.1 time: 0.045426 Dec 18 21:13:08.927845 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3058/6165] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.933146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.933761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: b733c412-1cdb-45f5-9fa7-b68e4121ec4a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.940437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.940900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.941974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:08.942535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:08.956427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a could not be found. Dec 18 21:13:08.957019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance b733c412-1cdb-45f5-9fa7-b68e4121ec4a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.958069 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ee0c33a-39a1-458d-97bf-e5d0e44ecbf7 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a" status: 404 len: 111 microversion: 2.1 time: 0.029229 Dec 18 21:13:08.958635 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3108/6166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/b733c412-1cdb-45f5-9fa7-b68e4121ec4a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.968281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d946f2b5-8fa5-4dfd-8595-6f83e5287c4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.968787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d946f2b5-8fa5-4dfd-8595-6f83e5287c4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.974843 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-d946f2b5-8fa5-4dfd-8595-6f83e5287c4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 could not be found. Dec 18 21:13:08.975460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d946f2b5-8fa5-4dfd-8595-6f83e5287c4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.976805 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d946f2b5-8fa5-4dfd-8595-6f83e5287c4a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3" status: 404 len: 111 microversion: 2.1 time: 0.013184 Dec 18 21:13:08.977353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3059/6167] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:08.986420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ad7bf17-d466-4c06-8b38-3602f81a771a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:08.987384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4ad7bf17-d466-4c06-8b38-3602f81a771a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:08.993644 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4ad7bf17-d466-4c06-8b38-3602f81a771a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 could not be found. Dec 18 21:13:08.994195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ad7bf17-d466-4c06-8b38-3602f81a771a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:08.995066 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ad7bf17-d466-4c06-8b38-3602f81a771a tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3" status: 404 len: 111 microversion: 2.1 time: 0.012990 Dec 18 21:13:08.995647 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3109/6168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:08 2021] GET /compute/v2.1/servers/ec95b4cb-6e0e-4025-9af2-b77a6ddf6dc3 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:09.004585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:09.005215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:09.013152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:09.013724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:09.014618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:09.015211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:09.045004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:13:09.140476 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93d81e91-280f-41d3-9c62-f5be1b0fa06e tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 204 len: 0 microversion: 2.1 time: 0.139297 Dec 18 21:13:09.141646 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3060/6169] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:08 2021] DELETE /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:13:09.153140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:09.154264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:09.162726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:09.163455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:09.165279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:09.165841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:09.314794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:09.322949 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d40b8208-33f7-43e9-87da-b72e287e34b8 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1479 microversion: 2.1 time: 0.175558 Dec 18 21:13:09.323736 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3110/6170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:09 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1479 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:09.490871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-00288c3f-4746-4e8f-aac0-1273c0f053fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'create', calling method: .version_select at 0x7f714fe70430>, body: {"keypair": {"name": "tempest-keypair-820285946"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:09.505543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-00288c3f-4746-4e8f-aac0-1273c0f053fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:13:09.511553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-00288c3f-4746-4e8f-aac0-1273c0f053fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for user bdd05da990fb4f7290fb926a258de4eb and project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:13:09.845977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-00288c3f-4746-4e8f-aac0-1273c0f053fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:13:09.852603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-00288c3f-4746-4e8f-aac0-1273c0f053fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for user bdd05da990fb4f7290fb926a258de4eb and project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:13:09.868580 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-00288c3f-4746-4e8f-aac0-1273c0f053fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.381849 Dec 18 21:13:09.869420 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3061/6171] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Dec 18 21:13:09 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 383 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:13:10.340479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:10.341128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:10.348925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:10.349370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:10.350178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:10.350628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:10.570815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:10.580709 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5433aa98-2968-40af-a91f-17d23b8f6dd6 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1479 microversion: 2.1 time: 0.244029 Dec 18 21:13:10.581339 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3111/6172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:10 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1479 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:11.600919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:11.602450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:11.610110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:11.611203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:11.612446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:11.613350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:11.704004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e7f22293-d25f-476c-9a4c-2da0c9b8d237 req-801000fe-29ee-4afd-8b80-0b9312814061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb51a0f-5058-4d20-b42e-eb65fa93481b", "name": "network-vif-deleted", "tag": "bb247fd1-b352-4374-a8bf-d70e3684560c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:11.705694 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:11.705694 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:11.720156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49bec6d90274fde9af81d52cc9bbf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:11.723756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e7f22293-d25f-476c-9a4c-2da0c9b8d237 req-801000fe-29ee-4afd-8b80-0b9312814061 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:11.724248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e7f22293-d25f-476c-9a4c-2da0c9b8d237 req-801000fe-29ee-4afd-8b80-0b9312814061 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:11.730336 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f04bd3b-b438-436a-aaf3-d87eb5a90af1 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 200 len: 1437 microversion: 2.1 time: 0.133628 Dec 18 21:13:11.736971 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e7f22293-d25f-476c-9a4c-2da0c9b8d237 req-801000fe-29ee-4afd-8b80-0b9312814061 service nova] Creating event network-vif-deleted:bb247fd1-b352-4374-a8bf-d70e3684560c for instance dcb51a0f-5058-4d20-b42e-eb65fa93481b on nch2-master-1 Dec 18 21:13:11.743757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3062/6173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:11 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:11.745401 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e7f22293-d25f-476c-9a4c-2da0c9b8d237 req-801000fe-29ee-4afd-8b80-0b9312814061 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047610 Dec 18 21:13:11.746230 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3112/6174] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:12.168390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2072627151", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a73f33f-bbbf-4537-b0c3-79abe445c89e"}], "security_groups": [{"name": "tempest-securitygroup--15438139"}], "key_name": "tempest-keypair-820285946", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:12.296903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] validate_networks() for [('7a73f33f-bbbf-4537-b0c3-79abe445c89e', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:13:12.674403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:13:12.674975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:13:12.675355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:13:12.675778 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:13:12.676321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:13:12.685172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.685651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:12.686548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.687002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:12.704088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:13:12.709057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Getting quotas for user bdd05da990fb4f7290fb926a258de4eb and project 64ef041cd6724458b053cde5c1afe4fa. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:13:12.721693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:13:12.724088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:13:12.740074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b74a52ea-c667-4c47-a6f6-45ebe8208c1a tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:12.740798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b74a52ea-c667-4c47-a6f6-45ebe8208c1a tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:12.747597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b74a52ea-c667-4c47-a6f6-45ebe8208c1a tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.748067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b74a52ea-c667-4c47-a6f6-45ebe8208c1a tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:12.748870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b74a52ea-c667-4c47-a6f6-45ebe8208c1a tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.749298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b74a52ea-c667-4c47-a6f6-45ebe8208c1a tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:12.769854 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a6766401-d644-4623-9f18-07f63b1d697d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.607975 Dec 18 21:13:12.776577 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3063/6175] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Dec 18 21:13:12 2021] POST /compute/v2.1/servers => generated 400 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 21:13:12.776577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:12.776577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] [instance: dcb51a0f-5058-4d20-b42e-eb65fa93481b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:12.782934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.783596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:12.784560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.785229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:12.800783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] HTTP exception thrown: Instance dcb51a0f-5058-4d20-b42e-eb65fa93481b could not be found. Dec 18 21:13:12.801492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] Returning 404 to user: Instance dcb51a0f-5058-4d20-b42e-eb65fa93481b could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:12.802535 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7774bd91-d44d-424f-841a-d31ffbb77e17 tempest-ServersTestJSON-1975196967 tempest-ServersTestJSON-1975196967-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b" status: 404 len: 111 microversion: 2.1 time: 0.030695 Dec 18 21:13:12.803249 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3064/6176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:12 2021] GET /compute/v2.1/servers/dcb51a0f-5058-4d20-b42e-eb65fa93481b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:12.807581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2bc4cff9-64b9-4778-837d-8eebc0133e8d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:12.808409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2bc4cff9-64b9-4778-837d-8eebc0133e8d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:12.867875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2bc4cff9-64b9-4778-837d-8eebc0133e8d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:12.875531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2bc4cff9-64b9-4778-837d-8eebc0133e8d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:12.877072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2bc4cff9-64b9-4778-837d-8eebc0133e8d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:12.878215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2bc4cff9-64b9-4778-837d-8eebc0133e8d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1281 microversion: 2.20 time: 0.074200 Dec 18 21:13:12.879012 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3065/6177] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:12 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:12.938733 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b74a52ea-c667-4c47-a6f6-45ebe8208c1a tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1833 microversion: 2.1 time: 0.203721 Dec 18 21:13:12.939401 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3113/6178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:12 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1833 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:12.957774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:12.958500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:12.964572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.965998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:12.966913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:12.967442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.124300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:13.134708 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-553f38a2-5817-4526-99dc-d4e0e41d1fcd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1682 microversion: 2.1 time: 0.181637 Dec 18 21:13:13.138330 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3066/6179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:12 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:13.233160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57215d3d-cb6e-4c69-b533-9a1b7619158a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:13.234262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57215d3d-cb6e-4c69-b533-9a1b7619158a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:13.241126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57215d3d-cb6e-4c69-b533-9a1b7619158a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.242472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57215d3d-cb6e-4c69-b533-9a1b7619158a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.243994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57215d3d-cb6e-4c69-b533-9a1b7619158a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.244784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57215d3d-cb6e-4c69-b533-9a1b7619158a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.308380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57215d3d-cb6e-4c69-b533-9a1b7619158a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action" status: 200 len: 32634 microversion: 2.1 time: 0.077502 Dec 18 21:13:13.310238 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3114/6180] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:13 2021] POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action => generated 32634 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:13.470375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:13.470977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:13.477867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.478434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.479187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.480463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.524568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0532fa2fbc544ce09628c91a9b834a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534e25782c045aeb336ae118921c450', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:13.525319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] flavor_id is None. Assuming migration. {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 18 21:13:13.525676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:13:13.794682 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0620969-f2f3-4860-a43f-8e0c1e596016 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action" status: 202 len: 0 microversion: 2.1 time: 0.327959 Dec 18 21:13:13.795364 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3067/6181] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:13 2021] POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:13.804916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:13.805654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:13.813553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.814015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.814975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.815283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.897679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:13.898369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:13.905225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.906007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:13.907831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:13.908306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:14.038143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:14.049590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:14.051586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:14.053054 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-adb9070a-7494-406f-a2e5-60c45d4157fc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1341 microversion: 2.20 time: 0.159773 Dec 18 21:13:14.055741 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3068/6182] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:13 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:14.150009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:14.161122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c0e03210-c391-4a17-8cee-4a31769bf226 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1691 microversion: 2.1 time: 0.361138 Dec 18 21:13:14.162028 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3115/6183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:13 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1691 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:14.219205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5cfd6ac3-a9e1-497f-9e3e-30167e01ec0d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:14.220274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5cfd6ac3-a9e1-497f-9e3e-30167e01ec0d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:14.228620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6ac3-a9e1-497f-9e3e-30167e01ec0d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:14.229288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6ac3-a9e1-497f-9e3e-30167e01ec0d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:14.230333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6ac3-a9e1-497f-9e3e-30167e01ec0d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:14.230954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6ac3-a9e1-497f-9e3e-30167e01ec0d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:14.264212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5cfd6ac3-a9e1-497f-9e3e-30167e01ec0d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049417 Dec 18 21:13:14.264853 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3069/6184] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:13:14 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:14.336342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:14.337138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:14.345168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:14.346547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:14.347432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:14.348128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:14.385430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:13:14.514089 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef15085e-5812-4589-94b4-f8500c0c1493 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 204 len: 0 microversion: 2.1 time: 0.182088 Dec 18 21:13:14.518415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3116/6185] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:14 2021] DELETE /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:13:14.526661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:14.527461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:14.534751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:14.535394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:14.536212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:14.536756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:14.797130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:14.801367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a8bd38b-ce71-479d-9e9d-7eff7a2103e5 tempest-ExtensionsTest-1470372119 tempest-ExtensionsTest-1470372119-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:14.806664 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a8bd38b-ce71-479d-9e9d-7eff7a2103e5 tempest-ExtensionsTest-1470372119 tempest-ExtensionsTest-1470372119-project] 10.222.0.13 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.154949 Dec 18 21:13:14.807252 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3117/6186] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Dec 18 21:13:14 2021] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:14.815595 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c8fdfc4c-4369-4c0f-b597-cabd6ed1dd33 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1672 microversion: 2.1 time: 0.295914 Dec 18 21:13:14.822390 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3070/6187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:14 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1672 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:14.824548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6a4f9ed-5de2-4f00-bf65-acba9c54634c tempest-ExtensionsTest-1470372119 tempest-ExtensionsTest-1470372119-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:14.826702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6a4f9ed-5de2-4f00-bf65-acba9c54634c tempest-ExtensionsTest-1470372119 tempest-ExtensionsTest-1470372119-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.014425 Dec 18 21:13:14.827240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3118/6188] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 21:13:14 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:15.072716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:15.073710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:15.081560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:15.082139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:15.083387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:15.083943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:15.180868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:15.182498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:15.192362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:15.193483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:15.194878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:15.195988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:15.484961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:15.493985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:15.495599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:15.496766 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6da2b27-6c89-4d12-b716-5798bd02febe tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1405 microversion: 2.20 time: 0.428508 Dec 18 21:13:15.497398 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3071/6189] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:15 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:15.534139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:15.544817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-770c6a39-77a1-491b-ae6e-c113e4f9f9ff tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1691 microversion: 2.1 time: 0.369821 Dec 18 21:13:15.545695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3119/6190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:15 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1691 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:15.835477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:15.836819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:15.845611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:15.846079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:15.846912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:15.847364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:16.095806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1ac90531-e49a-4fcd-be8c-ed47c44fc934 req-aa28ed13-71ab-4300-b1df-ac1687ff514a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:16.097323 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:16.097323 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:16.113719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1ac90531-e49a-4fcd-be8c-ed47c44fc934 req-aa28ed13-71ab-4300-b1df-ac1687ff514a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:16.114173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1ac90531-e49a-4fcd-be8c-ed47c44fc934 req-aa28ed13-71ab-4300-b1df-ac1687ff514a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:16.135643 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1ac90531-e49a-4fcd-be8c-ed47c44fc934 req-aa28ed13-71ab-4300-b1df-ac1687ff514a service nova] Creating event network-changed:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch2-master-1 Dec 18 21:13:16.141379 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1ac90531-e49a-4fcd-be8c-ed47c44fc934 req-aa28ed13-71ab-4300-b1df-ac1687ff514a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049353 Dec 18 21:13:16.142407 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3120/6191] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:16.151245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:16.164357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6bb5729-30d7-4b21-80bb-f065e7d61a7f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1672 microversion: 2.1 time: 0.334718 Dec 18 21:13:16.165533 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3072/6192] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:15 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1672 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:16.517704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:16.518861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:16.528592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:16.529227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:16.530778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:16.531391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:16.563875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:16.565963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:16.578089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:16.581792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:16.584553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:16.587579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:16.874033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:16.885399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:16.887612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:16.887863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:16.889292 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b3d513e5-1e0f-490f-b6c9-b121bbad24f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1405 microversion: 2.20 time: 0.376220 Dec 18 21:13:16.890091 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3121/6193] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:16 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1405 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:16.897611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-16ba2f29-375d-4a65-bb8e-c32dac9c6e39 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.338636 Dec 18 21:13:16.900659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3073/6194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:16 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:17.181535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:17.181535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:17.197202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:17.197658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:17.198491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:17.198928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:17.424504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:17.433153 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28fd8bbb-860d-411b-99ac-3d6f121ceaea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 200 len: 1672 microversion: 2.1 time: 0.255822 Dec 18 21:13:17.450458 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3122/6195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:17 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 1672 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:17.692801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a6e1c071-dea8-4528-bf79-908233e60faa req-515cb516-6079-4a6d-8746-0d4b2329ef42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befd31cf-08d3-4d80-a3e6-101af7256703", "name": "network-vif-deleted", "tag": "83ebec85-c173-4b36-8f22-c0da8cd772d9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:17.694316 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:17.694316 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:17.702948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a6e1c071-dea8-4528-bf79-908233e60faa req-515cb516-6079-4a6d-8746-0d4b2329ef42 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:17.703619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a6e1c071-dea8-4528-bf79-908233e60faa req-515cb516-6079-4a6d-8746-0d4b2329ef42 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:17.717710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6363b98c-fd7e-4194-a92b-c91e61f73f28 tempest-ComputeTenantNetworksTest-1128867785 tempest-ComputeTenantNetworksTest-1128867785-project] Calling method '.version_select at 0x7f714ffc5160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:17.721178 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a6e1c071-dea8-4528-bf79-908233e60faa req-515cb516-6079-4a6d-8746-0d4b2329ef42 service nova] Creating event network-vif-deleted:83ebec85-c173-4b36-8f22-c0da8cd772d9 for instance befd31cf-08d3-4d80-a3e6-101af7256703 on nch2-master-1 Dec 18 21:13:17.730898 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a6e1c071-dea8-4528-bf79-908233e60faa req-515cb516-6079-4a6d-8746-0d4b2329ef42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041861 Dec 18 21:13:17.731826 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3123/6196] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:17.887556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6363b98c-fd7e-4194-a92b-c91e61f73f28 tempest-ComputeTenantNetworksTest-1128867785 tempest-ComputeTenantNetworksTest-1128867785-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.302669 Dec 18 21:13:17.893764 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3074/6197] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 21:13:17 2021] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:17.899503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52f25470-b7f7-494f-a3d4-64490101af3c tempest-ComputeTenantNetworksTest-1128867785 tempest-ComputeTenantNetworksTest-1128867785-project] Calling method '.version_select at 0x7f714ee85790>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:17.910199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:17.911227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:17.926571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:17.927464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:17.928538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:17.929900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:18.033146 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52f25470-b7f7-494f-a3d4-64490101af3c tempest-ComputeTenantNetworksTest-1128867785 tempest-ComputeTenantNetworksTest-1128867785-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks/2568d98c-d3ea-4d8a-80a4-1c39a91dab92" status: 200 len: 140 microversion: 2.1 time: 0.137755 Dec 18 21:13:18.033888 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3124/6198] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:13:17 2021] GET /compute/v2.1/os-tenant-networks/2568d98c-d3ea-4d8a-80a4-1c39a91dab92 => generated 140 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:18.044951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:18.046131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:18.069559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:18.072255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:18.073921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:18.074980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:18.168386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:18.181935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:18.193679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:18.194987 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f709b429-a8dd-4e69-abe2-e7b0f7dfed25 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1405 microversion: 2.20 time: 0.290637 Dec 18 21:13:18.200127 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3075/6199] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:17 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:13:18.322360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:18.330098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-90001e0d-2e7a-44bc-ada0-cba2c6ecfa6e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.288827 Dec 18 21:13:18.331301 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3125/6200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:18 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:18.457000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:18.457776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:18.464390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:18.465118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:18.466560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:18.467195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:18.486124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] HTTP exception thrown: Instance befd31cf-08d3-4d80-a3e6-101af7256703 could not be found. Dec 18 21:13:18.487138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Returning 404 to user: Instance befd31cf-08d3-4d80-a3e6-101af7256703 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:18.488422 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5006a0a-f674-456f-aee3-01e49c70bcd1 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 404 len: 111 microversion: 2.1 time: 0.035193 Dec 18 21:13:18.489528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3076/6201] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:18 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:13:18.497725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-67bfc9d7-9a8c-41dc-bdfa-56ce089ea363 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '.version_select at 0x7f714e402ca0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:18.517364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-67bfc9d7-9a8c-41dc-bdfa-56ce089ea363 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099073238" status: 202 len: 0 microversion: 2.1 time: 0.023236 Dec 18 21:13:18.522112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3126/6202] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:13:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099073238 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:19.219504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:19.220687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:19.227965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:19.228627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:19.229437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:19.230865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:19.250942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b60b1d59-2d6f-41a2-a45d-f4549043fbc2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'create', calling method: .version_select at 0x7f71613a8ca0>, body: {"keypair": {"name": "tempest-keypair-433518357"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:19.270662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b60b1d59-2d6f-41a2-a45d-f4549043fbc2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:13:19.276979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b60b1d59-2d6f-41a2-a45d-f4549043fbc2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for user a3e6bef41b9948099215b02cdca829bf and project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:13:19.392096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:19.402389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:19.403975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:19.406177 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9e0f0af2-6af7-463e-8748-4bb3cb40bb36 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1405 microversion: 2.20 time: 0.190562 Dec 18 21:13:19.407721 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3077/6203] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:19 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:19.412652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:19.414064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:19.420316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:19.420785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:19.421583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:19.422038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:19.576227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:19.585050 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ec051a8-9c54-405b-a7f4-725abd0716e9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.175912 Dec 18 21:13:19.586769 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3078/6204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:19 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:19.628244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b60b1d59-2d6f-41a2-a45d-f4549043fbc2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:13:19.633111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b60b1d59-2d6f-41a2-a45d-f4549043fbc2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for user a3e6bef41b9948099215b02cdca829bf and project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:13:19.647124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b60b1d59-2d6f-41a2-a45d-f4549043fbc2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.401257 Dec 18 21:13:19.648416 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3127/6205] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:13:19 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:20.425019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:20.425878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:20.437416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:20.437887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:20.438729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:20.439181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:20.608080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:20.610074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:20.618787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:20.619516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:20.620925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:20.621704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:20.946390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:20.954431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:20.955955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:20.957155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ccefb80-9f0b-421a-aa22-3fff2bebef2c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1405 microversion: 2.20 time: 0.536036 Dec 18 21:13:20.958165 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3079/6206] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:20 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:20.964533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:20.972744 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e25f225a-07d7-4c35-98b7-9cf4eca4cf6b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.371228 Dec 18 21:13:20.973290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3128/6207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:20 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:21.150029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:21.151589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:21.156845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:21.157452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:21.158332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:21.158824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:21.185736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:13:21.269481 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7a1ee70-953c-4312-acc7-cd29903f1ac3 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 204 len: 0 microversion: 2.1 time: 0.124512 Dec 18 21:13:21.270692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3080/6208] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:13:21 2021] DELETE /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:13:21.280129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:21.281127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:21.287998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:21.289205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:21.290147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:21.290715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:21.513080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:21.520977 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-258bc720-4e4e-4297-a295-4eef2c98eee0 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1578 microversion: 2.1 time: 0.244873 Dec 18 21:13:21.521612 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3129/6209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:21 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:21.565843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2100031260", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fa9a6b3-e419-4c2c-9375-8a9a95a008ff"}], "security_groups": [{"name": "tempest-securitygroup--263990552"}], "key_name": "tempest-keypair-433518357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:21.695315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] validate_networks() for [('3fa9a6b3-e419-4c2c-9375-8a9a95a008ff', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:13:21.976291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:21.976964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:21.983338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:21.984101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:21.984940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:21.985275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.228826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:22.239783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:22.242677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:22.243876 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7915b45-c3a0-4223-9218-4e0e889dea89 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1405 microversion: 2.20 time: 0.272497 Dec 18 21:13:22.247127 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3130/6210] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:21 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:22.248559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:13:22.249681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:13:22.250179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:13:22.250632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:13:22.251489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:13:22.253325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:22.254148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:22.261506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:22.262223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.263248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:22.263888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.264441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:22.265337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.266752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:22.267411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.293683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:13:22.308320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Getting quotas for user a3e6bef41b9948099215b02cdca829bf and project 0115052ed7dd4b60b9c729f1daa095c2. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:13:22.326465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:13:22.330567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:13:22.383584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aa53fee8-9276-4b91-bf70-b641eaec48c2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.822499 Dec 18 21:13:22.385273 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3081/6211] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:13:21 2021] POST /compute/v2.1/servers => generated 401 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:13:22.444249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:22.452477 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65641d45-b3ca-4b4f-b880-f2f3c0aa0724 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.203909 Dec 18 21:13:22.453056 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3131/6212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:22 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:22.481385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50fc12b2-e8b9-419b-b88d-b749fbf2a641 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:22.482003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50fc12b2-e8b9-419b-b88d-b749fbf2a641 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:22.542758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-50fc12b2-e8b9-419b-b88d-b749fbf2a641 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:22.551503 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50fc12b2-e8b9-419b-b88d-b749fbf2a641 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1237 microversion: 2.1 time: 0.073699 Dec 18 21:13:22.553761 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3132/6213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:22 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:22.559336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:22.560185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:22.568716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:22.569404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.571131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:22.571897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.713133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e55f8fa4-08a4-4fbd-9246-1b8a31a7cf9d req-20ef68c5-c7b4-45df-a1b4-3811e27201dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "name": "network-vif-plugged", "status": "completed", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:22.714786 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:22.714786 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:13:22.743416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e55f8fa4-08a4-4fbd-9246-1b8a31a7cf9d req-20ef68c5-c7b4-45df-a1b4-3811e27201dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:22.744144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e55f8fa4-08a4-4fbd-9246-1b8a31a7cf9d req-20ef68c5-c7b4-45df-a1b4-3811e27201dd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:22.766023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:22.778065 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f566999-1afb-4188-8799-7f2ea45c5fa5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1578 microversion: 2.1 time: 0.222053 Dec 18 21:13:22.778918 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3133/6214] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:22 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:22.781196 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e55f8fa4-08a4-4fbd-9246-1b8a31a7cf9d req-20ef68c5-c7b4-45df-a1b4-3811e27201dd service nova] Creating event network-vif-plugged:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch2-master-1 Dec 18 21:13:22.787002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e55f8fa4-08a4-4fbd-9246-1b8a31a7cf9d req-20ef68c5-c7b4-45df-a1b4-3811e27201dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.400401 Dec 18 21:13:22.787611 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3082/6215] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:23.264084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:23.264771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:23.272050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.272497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.274113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.274363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.417785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:23.436224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:23.438981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:23.440998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18fbabf1-1fc4-402e-a12e-5402d4f2ea38 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1405 microversion: 2.20 time: 0.180733 Dec 18 21:13:23.452338 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3134/6216] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:23 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:23.474567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:23.475735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:23.487253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.488538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.490823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.491922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.571558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:23.572569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:23.584651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.585410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.586595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.588169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.731855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:23.739665 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c11c898-a6a5-4e94-ab89-948b0ce94787 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1297 microversion: 2.1 time: 0.172616 Dec 18 21:13:23.746227 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3135/6217] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:23 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1297 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:23.773315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:23.782543 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cca94986-aff1-49a1-a9c4-8376b57d6d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.315439 Dec 18 21:13:23.783462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3083/6218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:23 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:23.795412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:23.796581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:23.805349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.805883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.820394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:23.820870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:23.907175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:23.918555 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2807eb39-8950-437d-9bda-22395cf28b09 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 200 len: 1510 microversion: 2.1 time: 0.126772 Dec 18 21:13:23.919752 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3136/6219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:23 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 1510 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:24.459428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:24.460558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:24.465877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-deea3d13-4abd-454a-8dc7-bc74e74ed070 req-f52d0185-f48a-423e-b165-c817f8863da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4677eac8-1f9e-4309-b018-4b60ce5b1eb4", "name": "network-vif-deleted", "tag": "66e4db18-6da1-4474-8bda-7ecda4c5e03f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:24.467398 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:24.467398 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:24.478667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:24.479167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:24.479990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:24.480446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:24.491328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-deea3d13-4abd-454a-8dc7-bc74e74ed070 req-f52d0185-f48a-423e-b165-c817f8863da3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:24.493424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-deea3d13-4abd-454a-8dc7-bc74e74ed070 req-f52d0185-f48a-423e-b165-c817f8863da3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:24.535324 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-deea3d13-4abd-454a-8dc7-bc74e74ed070 req-f52d0185-f48a-423e-b165-c817f8863da3 service nova] Creating event network-vif-deleted:66e4db18-6da1-4474-8bda-7ecda4c5e03f for instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 on nch1-master-1 Dec 18 21:13:24.552070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-deea3d13-4abd-454a-8dc7-bc74e74ed070 req-f52d0185-f48a-423e-b165-c817f8863da3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088630 Dec 18 21:13:24.554354 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3137/6220] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:24.758876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:24.759570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:24.776204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:24.783048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:24.784554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:24.785493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:24.949370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:24.961707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:24.963606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:24.964999 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a18eebdb-eed0-4c0f-97d5-73b270ffabee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1596 microversion: 2.20 time: 0.509349 Dec 18 21:13:24.976900 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3084/6221] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:13:24 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1596 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:24.985032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:24.986047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:24.995085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:24.996420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:24.997245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:24.997729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:25.214165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:25.226166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-97aec6cb-9bfe-4a02-999f-317b2365f013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1362 microversion: 2.1 time: 0.470880 Dec 18 21:13:25.232111 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3138/6222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:24 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:25.243109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:25.244120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:25.252946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:25.254162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:25.255270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:25.255842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:25.273891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 could not be found. Dec 18 21:13:25.274756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:13:25.275869 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-92d16e17-28a6-4ada-87ea-5dc090397273 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 404 len: 111 microversion: 2.1 time: 0.042121 Dec 18 21:13:25.276652 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3139/6223] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:25 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:25.282464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ac471fe-372e-4aa8-bfc1-251f19cdb02b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:25.284007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ac471fe-372e-4aa8-bfc1-251f19cdb02b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:25.308672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac471fe-372e-4aa8-bfc1-251f19cdb02b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:25.310492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac471fe-372e-4aa8-bfc1-251f19cdb02b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:25.311572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac471fe-372e-4aa8-bfc1-251f19cdb02b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:25.314987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ac471fe-372e-4aa8-bfc1-251f19cdb02b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:25.426166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:25.434837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-91cd6862-2d53-4ad8-816c-b9a1c3d5461b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.458962 Dec 18 21:13:25.436763 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3085/6224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:24 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:25.452041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-26108521", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716702626", "security_groups": [{"name": "tempest-secgroup-smoke-1903789239"}], "block_device_mapping_v2": [{"uuid": "13376864-8f52-4c3a-8fb8-d44948ce92e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "719d1db8-90bc-4a29-9e67-d552b1d87f10"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:25.496688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ac471fe-372e-4aa8-bfc1-251f19cdb02b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.218267 Dec 18 21:13:25.497782 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3140/6225] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Dec 18 21:13:25 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:25.701092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] validate_networks() for [('719d1db8-90bc-4a29-9e67-d552b1d87f10', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:13:26.386221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-3d5ad5e1-c532-46c7-8014-b08cca766479 req-62f46b4a-266c-458f-8b73-4d4e41b8adde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dead3a0-55e1-4aa5-91e9-5a4eefe5e192", "tag": "afd82864-3497-4dbf-be5e-465b8fe8ede6"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:26.387803 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:26.387803 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:26.400620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3d5ad5e1-c532-46c7-8014-b08cca766479 req-62f46b4a-266c-458f-8b73-4d4e41b8adde service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:26.400971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-3d5ad5e1-c532-46c7-8014-b08cca766479 req-62f46b4a-266c-458f-8b73-4d4e41b8adde service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:26.417544 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-3d5ad5e1-c532-46c7-8014-b08cca766479 req-62f46b4a-266c-458f-8b73-4d4e41b8adde service nova] Creating event network-changed:afd82864-3497-4dbf-be5e-465b8fe8ede6 for instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 on nch1-master-1 Dec 18 21:13:26.425280 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-3d5ad5e1-c532-46c7-8014-b08cca766479 req-62f46b4a-266c-458f-8b73-4d4e41b8adde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249709 Dec 18 21:13:26.426173 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3141/6226] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:26.443514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:26.445189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:26.460053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:26.461371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:26.463071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:26.463851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:26.541351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:13:26.543650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:13:26.545090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:13:26.545747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:13:26.546539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:13:26.563893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:26.564916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:26.566504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:26.567209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:26.587512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:13:26.594453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:13:26.673894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:13:26.676105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13376864-8f52-4c3a-8fb8-d44948ce92e4',volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:13:26.747775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:26.756354 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-287dd7a5-3ffc-4144-bb9e-1357ee6462f4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1362 microversion: 2.1 time: 0.324043 Dec 18 21:13:26.758313 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3142/6227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:26 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:26.771068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:26.771677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:26.779506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:26.780297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:26.781358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:26.782030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:26.830777 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab71e39f-2f39-4410-b48e-26bf990d6153 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.392407 Dec 18 21:13:26.831728 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3086/6228] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:13:25 2021] POST /compute/v2.1/servers => generated 406 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:13:26.842102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5aa743d1-b39e-49ac-a539-b88e39c1107e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:26.843020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5aa743d1-b39e-49ac-a539-b88e39c1107e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:26.933955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5aa743d1-b39e-49ac-a539-b88e39c1107e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:26.944331 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5aa743d1-b39e-49ac-a539-b88e39c1107e tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1092 microversion: 2.1 time: 0.106259 Dec 18 21:13:26.954200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3087/6229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:26 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1092 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:27.036583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2184a965-af1a-4fda-af1e-ae0ca2a02c76 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:27.037598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2184a965-af1a-4fda-af1e-ae0ca2a02c76 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:27.047629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2184a965-af1a-4fda-af1e-ae0ca2a02c76 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:27.049480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2184a965-af1a-4fda-af1e-ae0ca2a02c76 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:27.050758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2184a965-af1a-4fda-af1e-ae0ca2a02c76 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:27.051735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2184a965-af1a-4fda-af1e-ae0ca2a02c76 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:27.086818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:27.101736 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83ed0e94-4573-45bd-b0a6-2d091185f2ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.341439 Dec 18 21:13:27.102833 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3143/6230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:26 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:27.115874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-6767232c-31a9-4a20-b11a-cfea51bc1831 req-b3beb5bf-fb54-4def-9773-b337428dd04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:27.118392 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2184a965-af1a-4fda-af1e-ae0ca2a02c76 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.084565 Dec 18 21:13:27.118730 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:27.118730 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:27.119428 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3088/6231] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:27 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:27.128559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6767232c-31a9-4a20-b11a-cfea51bc1831 req-b3beb5bf-fb54-4def-9773-b337428dd04a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:27.129470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-6767232c-31a9-4a20-b11a-cfea51bc1831 req-b3beb5bf-fb54-4def-9773-b337428dd04a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:27.146961 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-6767232c-31a9-4a20-b11a-cfea51bc1831 req-b3beb5bf-fb54-4def-9773-b337428dd04a service nova] Creating event network-changed:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch2-master-1 Dec 18 21:13:27.154889 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-6767232c-31a9-4a20-b11a-cfea51bc1831 req-b3beb5bf-fb54-4def-9773-b337428dd04a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050472 Dec 18 21:13:27.156055 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3144/6232] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:27.780617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:27.782160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:27.793905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:27.794839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:27.796788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:27.797475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:27.966134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:27.967488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:27.979286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:27.979741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:27.982181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:27.984089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:27.989075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:28.000246 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-85ee34c2-75a1-456a-9344-ac0aaff9f8aa tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1362 microversion: 2.1 time: 0.228692 Dec 18 21:13:28.001957 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3089/6233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:27 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:28.075369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:28.084238 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-403b005c-7afb-4435-99dc-f323df2aab73 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1190 microversion: 2.1 time: 0.124542 Dec 18 21:13:28.085742 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3145/6234] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:27 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1190 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:28.121103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:28.121755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:28.129653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82f2ed7d-9639-40b4-ae48-6ffcd6711ba0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:28.130349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:28.131118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:28.131353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82f2ed7d-9639-40b4-ae48-6ffcd6711ba0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:28.133082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:28.134017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:28.145572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f2ed7d-9639-40b4-ae48-6ffcd6711ba0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:28.146033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f2ed7d-9639-40b4-ae48-6ffcd6711ba0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:28.147138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f2ed7d-9639-40b4-ae48-6ffcd6711ba0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:28.147760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82f2ed7d-9639-40b4-ae48-6ffcd6711ba0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:28.221672 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82f2ed7d-9639-40b4-ae48-6ffcd6711ba0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.093018 Dec 18 21:13:28.224196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3146/6235] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:28 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:28.327251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:28.341125 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-011d893d-a754-4b9b-9f4d-1116388e5b7c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.225075 Dec 18 21:13:28.352610 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3090/6236] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:28 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:29.020139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:29.020900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:29.038559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.039012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.039814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.040254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.102281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:29.102963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:29.127922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.128400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.129507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.129961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.405513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:29.406716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:29.415174 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-966a8ee1-f03e-488b-bda5-ee3786b47aab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1276 microversion: 2.1 time: 0.316522 Dec 18 21:13:29.415764 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3091/6237] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:29 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:29.416213 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e50eac31-f385-4a04-a87e-2546874ef22e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1362 microversion: 2.1 time: 0.399987 Dec 18 21:13:29.424873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca059f22-abce-4df7-afa7-6bc48df5772c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:29.427416 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3147/6238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:29 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:29.427786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca059f22-abce-4df7-afa7-6bc48df5772c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:29.434212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:29.435368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca059f22-abce-4df7-afa7-6bc48df5772c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.435846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:29.436305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca059f22-abce-4df7-afa7-6bc48df5772c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.437344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca059f22-abce-4df7-afa7-6bc48df5772c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.438008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca059f22-abce-4df7-afa7-6bc48df5772c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.443017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.443474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.445056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:29.445503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:29.509062 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca059f22-abce-4df7-afa7-6bc48df5772c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.091011 Dec 18 21:13:29.510854 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3092/6239] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:29 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:29.997851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:30.008538 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a03d6c3f-08df-4c3a-99e7-f5a0daee341f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.579933 Dec 18 21:13:30.011096 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3148/6240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:29 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:30.071581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-036ab3aa-2cd7-4b4a-965b-65299dbe4e57 req-2f2f282f-10c2-4e00-9f1e-f75a82cc69be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95123f6f-b540-4847-b6c1-d89287d69e5c", "tag": "c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:30.073797 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:30.073797 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:13:30.087317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-036ab3aa-2cd7-4b4a-965b-65299dbe4e57 req-2f2f282f-10c2-4e00-9f1e-f75a82cc69be service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:30.088052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-036ab3aa-2cd7-4b4a-965b-65299dbe4e57 req-2f2f282f-10c2-4e00-9f1e-f75a82cc69be service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:30.108258 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-036ab3aa-2cd7-4b4a-965b-65299dbe4e57 req-2f2f282f-10c2-4e00-9f1e-f75a82cc69be service nova] Creating event network-changed:c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b for instance 95123f6f-b540-4847-b6c1-d89287d69e5c on nch2-master-1 Dec 18 21:13:30.114776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-036ab3aa-2cd7-4b4a-965b-65299dbe4e57 req-2f2f282f-10c2-4e00-9f1e-f75a82cc69be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051050 Dec 18 21:13:30.115638 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3093/6241] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:30.433142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:30.433730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:30.436760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:30.437859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:30.443428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:30.444249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:30.445852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:30.446534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:30.449494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:30.450373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:30.451275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:30.451738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:30.686389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:30.689686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:30.697880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fcec93ba-944f-48df-89ac-a03fb29bff2d tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1264 microversion: 2.1 time: 0.268906 Dec 18 21:13:30.707438 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3149/6242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:30 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:30.713683 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45a48269-27af-444b-ae31-e5fe36338b0c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1362 microversion: 2.1 time: 0.279951 Dec 18 21:13:30.714586 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3094/6243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:30 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:30.717335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66f74631-57c2-47ac-923c-97e64802ad63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:30.718338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66f74631-57c2-47ac-923c-97e64802ad63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:30.725323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f74631-57c2-47ac-923c-97e64802ad63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:30.726470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f74631-57c2-47ac-923c-97e64802ad63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:30.727545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f74631-57c2-47ac-923c-97e64802ad63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:30.728329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f74631-57c2-47ac-923c-97e64802ad63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:30.770181 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66f74631-57c2-47ac-923c-97e64802ad63 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.061221 Dec 18 21:13:30.770922 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3150/6244] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:30 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:31.028470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:31.029103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:31.035914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.036723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:31.037551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.038604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:31.194041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:31.202438 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-179fa87b-ed03-4a9a-951a-fdb4274664c7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.177852 Dec 18 21:13:31.203569 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3095/6245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:31 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:31.718980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:31.719690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:31.728042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.728646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:31.729865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.730383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:31.730539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:31.731290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:31.741686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.742384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:31.743448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.744114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:31.942912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:31.951186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:31.951482 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7d7a8d9-2745-4808-b71d-4a0de154abab tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1264 microversion: 2.1 time: 0.236473 Dec 18 21:13:31.952266 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3151/6246] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:31 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:31.957004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0835908-ff01-44cc-9269-b6fd44798ec1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:31.958170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0835908-ff01-44cc-9269-b6fd44798ec1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:31.959254 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cc70c88-7f19-4b17-ae03-21e964c106f8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1362 microversion: 2.1 time: 0.233012 Dec 18 21:13:31.959935 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3096/6247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:31 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:31.964252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0835908-ff01-44cc-9269-b6fd44798ec1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.964977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0835908-ff01-44cc-9269-b6fd44798ec1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:31.966080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0835908-ff01-44cc-9269-b6fd44798ec1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:31.966636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0835908-ff01-44cc-9269-b6fd44798ec1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:32.010840 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0835908-ff01-44cc-9269-b6fd44798ec1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.057082 Dec 18 21:13:32.011665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3152/6248] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:31 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:32.221014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:32.221609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:32.228419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:32.228893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:32.229709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:32.230186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:32.352313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-09df5100-1b48-46dd-ab78-20a737cf6f65 req-075d4edd-c339-4cc3-9e61-9d96abcbe036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dead3a0-55e1-4aa5-91e9-5a4eefe5e192", "name": "network-vif-plugged", "status": "completed", "tag": "afd82864-3497-4dbf-be5e-465b8fe8ede6"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:32.354290 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:32.354290 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:32.364229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-09df5100-1b48-46dd-ab78-20a737cf6f65 req-075d4edd-c339-4cc3-9e61-9d96abcbe036 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:32.364616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-09df5100-1b48-46dd-ab78-20a737cf6f65 req-075d4edd-c339-4cc3-9e61-9d96abcbe036 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:32.379458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-09df5100-1b48-46dd-ab78-20a737cf6f65 req-075d4edd-c339-4cc3-9e61-9d96abcbe036 service nova] Creating event network-vif-plugged:afd82864-3497-4dbf-be5e-465b8fe8ede6 for instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 on nch1-master-1 Dec 18 21:13:32.385535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-09df5100-1b48-46dd-ab78-20a737cf6f65 req-075d4edd-c339-4cc3-9e61-9d96abcbe036 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039642 Dec 18 21:13:32.386773 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3153/6249] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:32.390091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:32.398627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6763f5ad-c700-450f-85d2-84d731805ed2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.181682 Dec 18 21:13:32.409681 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3097/6250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:32 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:32.968692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:32.969536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:32.978008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:32.978219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:32.978752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:32.978952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:32.979852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:32.980557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:32.986045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:32.986545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:32.987345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:32.987818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:33.191009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:33.199791 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97b92fd1-99c0-46de-8aa1-e1b5334b253a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1362 microversion: 2.1 time: 0.226418 Dec 18 21:13:33.200873 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3098/6251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:32 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:33.206035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fcedb425-3b2e-4f27-918b-58bfc8814372 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:33.206516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:33.209493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fcedb425-3b2e-4f27-918b-58bfc8814372 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:33.213724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcedb425-3b2e-4f27-918b-58bfc8814372 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:33.215255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcedb425-3b2e-4f27-918b-58bfc8814372 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:33.216351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcedb425-3b2e-4f27-918b-58bfc8814372 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:33.216986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcedb425-3b2e-4f27-918b-58bfc8814372 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:33.219864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d1c6512a-7c70-4178-90ee-8b5ce42301d8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1264 microversion: 2.1 time: 0.255103 Dec 18 21:13:33.222647 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3154/6252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:32 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1264 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:33.259833 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fcedb425-3b2e-4f27-918b-58bfc8814372 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.057229 Dec 18 21:13:33.262965 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3099/6253] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:33 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:33.414664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:33.415419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:33.421330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:33.421786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:33.422600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:33.423048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:33.559878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:33.568617 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f67326a-fffc-4f98-b632-5334fba8b569 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1696 microversion: 2.1 time: 0.157654 Dec 18 21:13:33.569291 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3155/6254] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:33 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:34.219407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:34.221517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:34.229948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.232604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.233725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.234460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.236773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:34.237506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:34.250069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.250606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.251921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.252378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.494226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:34.503548 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-88c9d75e-7d0d-42b5-bfb0-941635617f87 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1547 microversion: 2.1 time: 0.289836 Dec 18 21:13:34.508528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3100/6255] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:34 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1547 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:34.519906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-33743c5d-8469-4983-b97f-53143e348c44 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:34.532593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-33743c5d-8469-4983-b97f-53143e348c44 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:34.547883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:34.549657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33743c5d-8469-4983-b97f-53143e348c44 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.550128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33743c5d-8469-4983-b97f-53143e348c44 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.550987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33743c5d-8469-4983-b97f-53143e348c44 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.555011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-33743c5d-8469-4983-b97f-53143e348c44 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.562936 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98e7ede5-65a0-4b86-b7ce-960e7fd87bfa tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1264 microversion: 2.1 time: 0.329702 Dec 18 21:13:34.563976 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3156/6256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:34 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1264 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:34.575254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-65ebc82b-9196-4664-91fa-2406fb5f5be9 req-1d5f8e0a-3e24-47ee-b7eb-8053da9975ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "name": "network-vif-unplugged", "status": "completed", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:34.577026 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:34.577026 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:34.585703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-65ebc82b-9196-4664-91fa-2406fb5f5be9 req-1d5f8e0a-3e24-47ee-b7eb-8053da9975ba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.586381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-65ebc82b-9196-4664-91fa-2406fb5f5be9 req-1d5f8e0a-3e24-47ee-b7eb-8053da9975ba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.599544 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-65ebc82b-9196-4664-91fa-2406fb5f5be9 req-1d5f8e0a-3e24-47ee-b7eb-8053da9975ba service nova] Creating event network-vif-unplugged:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch2-master-1 Dec 18 21:13:34.612659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-65ebc82b-9196-4664-91fa-2406fb5f5be9 req-1d5f8e0a-3e24-47ee-b7eb-8053da9975ba service nova] Instance d5bd7afd-a4da-4163-b4ac-245be65e705b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:13:34.624648 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-33743c5d-8469-4983-b97f-53143e348c44 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.114571 Dec 18 21:13:34.630572 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3101/6257] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:34 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:34.637215 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-65ebc82b-9196-4664-91fa-2406fb5f5be9 req-1d5f8e0a-3e24-47ee-b7eb-8053da9975ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066223 Dec 18 21:13:34.639077 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3157/6258] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:34.639371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b315be8e-dd67-4d9a-9c7e-b085a8fd3c51 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:34.640729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b315be8e-dd67-4d9a-9c7e-b085a8fd3c51 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:34.650192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:34.651358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:34.664083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.664549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.665827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.666513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.668852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b315be8e-dd67-4d9a-9c7e-b085a8fd3c51 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.671273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b315be8e-dd67-4d9a-9c7e-b085a8fd3c51 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.674716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b315be8e-dd67-4d9a-9c7e-b085a8fd3c51 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:34.675316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b315be8e-dd67-4d9a-9c7e-b085a8fd3c51 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:34.871570 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b315be8e-dd67-4d9a-9c7e-b085a8fd3c51 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.238489 Dec 18 21:13:34.872049 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3102/6259] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:13:34 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:35.214951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:35.222858 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-effd8f0d-1443-4619-be40-fa53dc44e5ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1695 microversion: 2.1 time: 0.581396 Dec 18 21:13:35.226596 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3158/6260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:34 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1695 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:35.582055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:35.583460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:35.599185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:35.599981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:35.601958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:35.602681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:35.638176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-672b087b-dd0e-439a-b1e4-6b55b9070a4e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:35.640556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-672b087b-dd0e-439a-b1e4-6b55b9070a4e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:35.651008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-672b087b-dd0e-439a-b1e4-6b55b9070a4e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:35.651972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-672b087b-dd0e-439a-b1e4-6b55b9070a4e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:35.653001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-672b087b-dd0e-439a-b1e4-6b55b9070a4e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:35.653682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-672b087b-dd0e-439a-b1e4-6b55b9070a4e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:35.703877 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-672b087b-dd0e-439a-b1e4-6b55b9070a4e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.070269 Dec 18 21:13:35.704803 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3159/6261] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:35 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:35.853938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:35.863537 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-05b0300a-6d9e-4c76-a3cf-6d2c0122cbe9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1264 microversion: 2.1 time: 0.286294 Dec 18 21:13:35.864875 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3103/6262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:35 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:36.114639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f80a39fb-bf83-4d58-819c-ba5a6b5f5e3f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:36.115951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f80a39fb-bf83-4d58-819c-ba5a6b5f5e3f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:36.128154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80a39fb-bf83-4d58-819c-ba5a6b5f5e3f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.130775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80a39fb-bf83-4d58-819c-ba5a6b5f5e3f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.132130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80a39fb-bf83-4d58-819c-ba5a6b5f5e3f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.132576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80a39fb-bf83-4d58-819c-ba5a6b5f5e3f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.137705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9358f6f1-c4fd-40b9-be67-68da94c600a4 req-95ff74b8-e743-4bff-be60-f18f9d371001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dead3a0-55e1-4aa5-91e9-5a4eefe5e192", "tag": "afd82864-3497-4dbf-be5e-465b8fe8ede6"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:36.140139 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:36.140139 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:13:36.149572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9358f6f1-c4fd-40b9-be67-68da94c600a4 req-95ff74b8-e743-4bff-be60-f18f9d371001 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.150913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9358f6f1-c4fd-40b9-be67-68da94c600a4 req-95ff74b8-e743-4bff-be60-f18f9d371001 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.168052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9358f6f1-c4fd-40b9-be67-68da94c600a4 req-95ff74b8-e743-4bff-be60-f18f9d371001 service nova] Creating event network-changed:afd82864-3497-4dbf-be5e-465b8fe8ede6 for instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 on nch1-master-1 Dec 18 21:13:36.174621 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9358f6f1-c4fd-40b9-be67-68da94c600a4 req-95ff74b8-e743-4bff-be60-f18f9d371001 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041852 Dec 18 21:13:36.175934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3104/6263] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:36.193513 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f80a39fb-bf83-4d58-819c-ba5a6b5f5e3f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.083073 Dec 18 21:13:36.199830 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3160/6264] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:36 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:36.244269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:36.245294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:36.256087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.259584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.260753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.261253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.415220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-aefc75ca-b58c-4596-93cc-f396d5baced2 req-185f6536-e001-46b2-8930-6ef7f172bb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95123f6f-b540-4847-b6c1-d89287d69e5c", "name": "network-vif-plugged", "status": "completed", "tag": "c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:36.416837 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:36.416837 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:36.437421 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-aefc75ca-b58c-4596-93cc-f396d5baced2 req-185f6536-e001-46b2-8930-6ef7f172bb67 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.438481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-aefc75ca-b58c-4596-93cc-f396d5baced2 req-185f6536-e001-46b2-8930-6ef7f172bb67 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.468518 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-aefc75ca-b58c-4596-93cc-f396d5baced2 req-185f6536-e001-46b2-8930-6ef7f172bb67 service nova] Creating event network-vif-plugged:c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b for instance 95123f6f-b540-4847-b6c1-d89287d69e5c on nch2-master-1 Dec 18 21:13:36.494500 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-aefc75ca-b58c-4596-93cc-f396d5baced2 req-185f6536-e001-46b2-8930-6ef7f172bb67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080636 Dec 18 21:13:36.496948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3161/6265] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:36.634002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:36.651765 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9378bac0-f9dc-4aaa-ba7f-e3d47d7a6a51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1693 microversion: 2.1 time: 0.411644 Dec 18 21:13:36.652975 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3105/6266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:36 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1693 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:36.669475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c5ec534b-8e20-4646-a2da-ae1e265331d3 req-e69735ad-c411-49a4-ac95-eff7b61b6a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:36.671112 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:36.671112 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:36.688163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c5ec534b-8e20-4646-a2da-ae1e265331d3 req-e69735ad-c411-49a4-ac95-eff7b61b6a89 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.689173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c5ec534b-8e20-4646-a2da-ae1e265331d3 req-e69735ad-c411-49a4-ac95-eff7b61b6a89 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.705278 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c5ec534b-8e20-4646-a2da-ae1e265331d3 req-e69735ad-c411-49a4-ac95-eff7b61b6a89 service nova] Creating event network-changed:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch2-master-1 Dec 18 21:13:36.720899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa44562a-f250-4bdf-8afc-f7b3f0011f1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:36.723319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa44562a-f250-4bdf-8afc-f7b3f0011f1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:36.726288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-c5ec534b-8e20-4646-a2da-ae1e265331d3 req-e69735ad-c411-49a4-ac95-eff7b61b6a89 service nova] Instance d5bd7afd-a4da-4163-b4ac-245be65e705b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:13:36.737671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa44562a-f250-4bdf-8afc-f7b3f0011f1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.737671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa44562a-f250-4bdf-8afc-f7b3f0011f1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.737671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa44562a-f250-4bdf-8afc-f7b3f0011f1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.738162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa44562a-f250-4bdf-8afc-f7b3f0011f1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.750225 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c5ec534b-8e20-4646-a2da-ae1e265331d3 req-e69735ad-c411-49a4-ac95-eff7b61b6a89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085470 Dec 18 21:13:36.751997 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3162/6267] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:36.898237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:36.901712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:36.922153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa44562a-f250-4bdf-8afc-f7b3f0011f1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 14 microversion: 2.20 time: 0.203531 Dec 18 21:13:36.926792 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3106/6268] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:36 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:36.927024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.927128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:36.929943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:36.931024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.190488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:37.203460 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b59f5dbf-8a5a-46e4-9b39-f0154b2a81a5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1264 microversion: 2.1 time: 0.322906 Dec 18 21:13:37.205994 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3163/6269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:36 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1264 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:37.218504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a2bcebfa-a052-47a2-8753-6ed42f8a42f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:37.226063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a2bcebfa-a052-47a2-8753-6ed42f8a42f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:37.241606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2bcebfa-a052-47a2-8753-6ed42f8a42f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.242609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2bcebfa-a052-47a2-8753-6ed42f8a42f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.244101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2bcebfa-a052-47a2-8753-6ed42f8a42f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.244881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2bcebfa-a052-47a2-8753-6ed42f8a42f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.291762 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a2bcebfa-a052-47a2-8753-6ed42f8a42f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.087475 Dec 18 21:13:37.294994 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3107/6270] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:37 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:13:37.669613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:37.670387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:37.677832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.678690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.679745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.682666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.865300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:37.873649 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3dd2c31-cf72-4212-b3a0-c4b5338a0033 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1690 microversion: 2.1 time: 0.207644 Dec 18 21:13:37.874674 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3164/6271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:37 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:37.890853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3a628c65-1f46-4759-b4a0-52b590ddeef6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:37.892513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3a628c65-1f46-4759-b4a0-52b590ddeef6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:37.900576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a628c65-1f46-4759-b4a0-52b590ddeef6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.901042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a628c65-1f46-4759-b4a0-52b590ddeef6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.902032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a628c65-1f46-4759-b4a0-52b590ddeef6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.902656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a628c65-1f46-4759-b4a0-52b590ddeef6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.933837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8fd9fc82-7099-4b11-9b7e-61c39602fccb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:37.935329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8fd9fc82-7099-4b11-9b7e-61c39602fccb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:37.943157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fd9fc82-7099-4b11-9b7e-61c39602fccb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.943967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fd9fc82-7099-4b11-9b7e-61c39602fccb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.945499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fd9fc82-7099-4b11-9b7e-61c39602fccb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:37.946106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fd9fc82-7099-4b11-9b7e-61c39602fccb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:37.999305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8fd9fc82-7099-4b11-9b7e-61c39602fccb tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 8154 microversion: 2.20 time: 0.068857 Dec 18 21:13:37.999834 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3165/6272] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:37 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 8154 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:13:38.042175 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3a628c65-1f46-4759-b4a0-52b590ddeef6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action" status: 202 len: 0 microversion: 2.1 time: 0.155473 Dec 18 21:13:38.045869 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3108/6273] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:37 2021] POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:13:38.051376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:38.053194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:38.060505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.061031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.061956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.062446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.244914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:38.255317 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-387af7c2-2bfb-483d-ae06-b51e0ce3719f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1689 microversion: 2.1 time: 0.207803 Dec 18 21:13:38.265622 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3166/6274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:38 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:38.304242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7daf8d75-a77a-401a-8e1b-06c20a05d8e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:38.305807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7daf8d75-a77a-401a-8e1b-06c20a05d8e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:38.315731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7daf8d75-a77a-401a-8e1b-06c20a05d8e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.317322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7daf8d75-a77a-401a-8e1b-06c20a05d8e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.320107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7daf8d75-a77a-401a-8e1b-06c20a05d8e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.321993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7daf8d75-a77a-401a-8e1b-06c20a05d8e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.380895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7daf8d75-a77a-401a-8e1b-06c20a05d8e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.081531 Dec 18 21:13:38.382805 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3167/6275] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:38 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:38.543507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:38.544233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:38.551815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.552282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.554761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.555458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.768410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:38.779657 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dca4d85a-c45d-411a-9b35-f798a9b9ffc7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1452 microversion: 2.1 time: 0.562187 Dec 18 21:13:38.795081 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3109/6276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:38 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1452 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:38.800440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:38.801152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:38.816802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.817676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.818710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:38.819533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:38.996568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:39.009984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-304b7fb2-a5f6-450b-80fd-3c97179451ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:39.011278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-304b7fb2-a5f6-450b-80fd-3c97179451ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:39.016156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e16bf250-a8e1-4d5f-bb94-90a0d182a04a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1452 microversion: 2.1 time: 0.208063 Dec 18 21:13:39.033790 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3168/6277] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:38 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1452 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:13:39.034479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-304b7fb2-a5f6-450b-80fd-3c97179451ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:39.035838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-304b7fb2-a5f6-450b-80fd-3c97179451ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:39.037114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-304b7fb2-a5f6-450b-80fd-3c97179451ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:39.044284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-304b7fb2-a5f6-450b-80fd-3c97179451ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:39.106019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-304b7fb2-a5f6-450b-80fd-3c97179451ab tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 16347 microversion: 2.20 time: 0.099739 Dec 18 21:13:39.107902 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3110/6278] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:39 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 16347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:39.273850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:39.274675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:39.281766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:39.282354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:39.283241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:39.283755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:39.393724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93869a82-949c-4949-a7d6-775f4352afc8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:39.394916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93869a82-949c-4949-a7d6-775f4352afc8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:39.402857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93869a82-949c-4949-a7d6-775f4352afc8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:39.403412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93869a82-949c-4949-a7d6-775f4352afc8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:39.404260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93869a82-949c-4949-a7d6-775f4352afc8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:39.404727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93869a82-949c-4949-a7d6-775f4352afc8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:39.443667 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93869a82-949c-4949-a7d6-775f4352afc8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.054222 Dec 18 21:13:39.444607 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3111/6279] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:39 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:13:39.602441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:39.610421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bec58c65-7710-4ea4-8dc6-520db47e3199 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1689 microversion: 2.1 time: 0.341134 Dec 18 21:13:39.611346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3169/6280] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:39 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1689 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:40.118399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70076e53-e18f-4056-b8c9-eb678c8833d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:40.119412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70076e53-e18f-4056-b8c9-eb678c8833d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:40.128801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70076e53-e18f-4056-b8c9-eb678c8833d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:40.128801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70076e53-e18f-4056-b8c9-eb678c8833d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:40.128801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70076e53-e18f-4056-b8c9-eb678c8833d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:40.128801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70076e53-e18f-4056-b8c9-eb678c8833d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:40.173518 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70076e53-e18f-4056-b8c9-eb678c8833d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 16347 microversion: 2.20 time: 0.058822 Dec 18 21:13:40.177491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3112/6281] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:40 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 16347 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:40.439832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1d815a0b-5f0d-46ce-a7f4-ade457de3bbc req-2d96b508-a423-46ab-b6c4-9626f1a63ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "name": "network-vif-plugged", "status": "completed", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:40.442411 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:40.442411 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:40.455978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b3ee53e-03ba-40a7-929c-fc2e7437bb2e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:40.457446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b3ee53e-03ba-40a7-929c-fc2e7437bb2e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:40.472362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1d815a0b-5f0d-46ce-a7f4-ade457de3bbc req-2d96b508-a423-46ab-b6c4-9626f1a63ec6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:40.473193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1d815a0b-5f0d-46ce-a7f4-ade457de3bbc req-2d96b508-a423-46ab-b6c4-9626f1a63ec6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:40.489121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3ee53e-03ba-40a7-929c-fc2e7437bb2e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:40.489619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3ee53e-03ba-40a7-929c-fc2e7437bb2e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:40.490490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3ee53e-03ba-40a7-929c-fc2e7437bb2e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:40.491509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3ee53e-03ba-40a7-929c-fc2e7437bb2e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:40.505497 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1d815a0b-5f0d-46ce-a7f4-ade457de3bbc req-2d96b508-a423-46ab-b6c4-9626f1a63ec6 service nova] Creating event network-vif-plugged:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch2-master-1 Dec 18 21:13:40.528707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-1d815a0b-5f0d-46ce-a7f4-ade457de3bbc req-2d96b508-a423-46ab-b6c4-9626f1a63ec6 service nova] Instance d5bd7afd-a4da-4163-b4ac-245be65e705b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:13:40.548057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1d815a0b-5f0d-46ce-a7f4-ade457de3bbc req-2d96b508-a423-46ab-b6c4-9626f1a63ec6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115243 Dec 18 21:13:40.549398 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3170/6282] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:40.577642 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b3ee53e-03ba-40a7-929c-fc2e7437bb2e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.126450 Dec 18 21:13:40.578985 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3113/6283] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:40 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:40.629119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:40.629894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:40.638169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:40.638739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:40.639889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:40.640432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:40.909092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:40.917927 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d8d5f06f-798c-4362-8823-6cd020528453 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1689 microversion: 2.1 time: 0.293493 Dec 18 21:13:40.918631 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3171/6284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:40 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1689 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:41.187402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-982acd84-ed14-4dab-8021-d92abdf46912 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:41.188560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-982acd84-ed14-4dab-8021-d92abdf46912 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:41.197815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-982acd84-ed14-4dab-8021-d92abdf46912 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.206850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-982acd84-ed14-4dab-8021-d92abdf46912 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.208853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-982acd84-ed14-4dab-8021-d92abdf46912 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.209339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-982acd84-ed14-4dab-8021-d92abdf46912 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.259445 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-982acd84-ed14-4dab-8021-d92abdf46912 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 16347 microversion: 2.20 time: 0.076092 Dec 18 21:13:41.260384 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3114/6285] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:41 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 16347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:41.511531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cfcc355d-1f6c-4809-af14-3586886a0b89 req-d2192914-5bd6-4e11-98f3-735ddb0c760b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95123f6f-b540-4847-b6c1-d89287d69e5c", "tag": "c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:41.514164 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:41.514164 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:41.523494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cfcc355d-1f6c-4809-af14-3586886a0b89 req-d2192914-5bd6-4e11-98f3-735ddb0c760b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.523941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cfcc355d-1f6c-4809-af14-3586886a0b89 req-d2192914-5bd6-4e11-98f3-735ddb0c760b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.535839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cfcc355d-1f6c-4809-af14-3586886a0b89 req-d2192914-5bd6-4e11-98f3-735ddb0c760b service nova] Creating event network-changed:c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b for instance 95123f6f-b540-4847-b6c1-d89287d69e5c on nch2-master-1 Dec 18 21:13:41.541901 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cfcc355d-1f6c-4809-af14-3586886a0b89 req-d2192914-5bd6-4e11-98f3-735ddb0c760b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034359 Dec 18 21:13:41.542666 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3172/6286] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:41.589867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19236139-e9f5-442b-ab4c-c737c31c4805 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:41.592003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19236139-e9f5-442b-ab4c-c737c31c4805 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:41.613797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19236139-e9f5-442b-ab4c-c737c31c4805 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.617750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19236139-e9f5-442b-ab4c-c737c31c4805 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.618686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19236139-e9f5-442b-ab4c-c737c31c4805 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.619133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19236139-e9f5-442b-ab4c-c737c31c4805 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.679497 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19236139-e9f5-442b-ab4c-c737c31c4805 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.093418 Dec 18 21:13:41.680487 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3173/6287] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:41 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:41.730814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] Calling method '.version_select at 0x7f714c4ab310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:41.731773 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:41.731773 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:13:41.733710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.734463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.749371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.749766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.761236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.761943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.769857 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-756715be-14f5-4c0a-b331-0ba8e66275ff tempest-PortsAdminExtendedAttrsTestJSON-203775796 tempest-PortsAdminExtendedAttrsTestJSON-203775796-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.234794 Dec 18 21:13:41.771665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3115/6288] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 21:13:41 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:41.937493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:41.939041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:41.948599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.949387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:41.950562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:41.951357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:42.218492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:42.230735 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99f90cd6-dcc7-4bd1-8a38-ac52059d9322 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1689 microversion: 2.1 time: 0.298467 Dec 18 21:13:42.231529 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3174/6289] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:41 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1689 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:42.273087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59fdfd43-5f02-41ce-807c-aec729cedb6b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:42.274050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-59fdfd43-5f02-41ce-807c-aec729cedb6b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:42.283109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59fdfd43-5f02-41ce-807c-aec729cedb6b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:42.284109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59fdfd43-5f02-41ce-807c-aec729cedb6b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:42.285269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59fdfd43-5f02-41ce-807c-aec729cedb6b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:42.285956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-59fdfd43-5f02-41ce-807c-aec729cedb6b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:42.297111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4e1e90c4-fe6e-4b36-94ed-5ac93df7fa70 req-3198a0a9-412b-4844-8783-337e1594695c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "name": "network-vif-unplugged", "status": "completed", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:42.299734 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:42.299734 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:42.329758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4e1e90c4-fe6e-4b36-94ed-5ac93df7fa70 req-3198a0a9-412b-4844-8783-337e1594695c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:42.334140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4e1e90c4-fe6e-4b36-94ed-5ac93df7fa70 req-3198a0a9-412b-4844-8783-337e1594695c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:42.339939 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59fdfd43-5f02-41ce-807c-aec729cedb6b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 16347 microversion: 2.20 time: 0.071713 Dec 18 21:13:42.344377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3116/6290] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:42 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 16347 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:42.355306 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4e1e90c4-fe6e-4b36-94ed-5ac93df7fa70 req-3198a0a9-412b-4844-8783-337e1594695c service nova] Creating event network-vif-unplugged:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:13:42.378619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-4e1e90c4-fe6e-4b36-94ed-5ac93df7fa70 req-3198a0a9-412b-4844-8783-337e1594695c service nova] Instance d5bd7afd-a4da-4163-b4ac-245be65e705b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:13:42.402572 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4e1e90c4-fe6e-4b36-94ed-5ac93df7fa70 req-3198a0a9-412b-4844-8783-337e1594695c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117029 Dec 18 21:13:42.403864 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3175/6291] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:13:42.692864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a03bd32-1110-441f-9c6b-3719da386811 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:42.700952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a03bd32-1110-441f-9c6b-3719da386811 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:42.711067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a03bd32-1110-441f-9c6b-3719da386811 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:42.712007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a03bd32-1110-441f-9c6b-3719da386811 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:42.713105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a03bd32-1110-441f-9c6b-3719da386811 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:42.713845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a03bd32-1110-441f-9c6b-3719da386811 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:42.776257 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a03bd32-1110-441f-9c6b-3719da386811 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.089700 Dec 18 21:13:42.777260 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3117/6292] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:42 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:43.255935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:43.257316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:43.264846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:43.265301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:43.266100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:43.266701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:43.353999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a53c23c7-11ee-47d9-a71e-987456f0a7b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:43.355310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a53c23c7-11ee-47d9-a71e-987456f0a7b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:43.363330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a53c23c7-11ee-47d9-a71e-987456f0a7b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:43.363798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a53c23c7-11ee-47d9-a71e-987456f0a7b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:43.364623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a53c23c7-11ee-47d9-a71e-987456f0a7b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:43.365098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a53c23c7-11ee-47d9-a71e-987456f0a7b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:43.410605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:43.420328 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3eca9b33-359c-4956-a51f-d6710369d3ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1689 microversion: 2.1 time: 0.176260 Dec 18 21:13:43.420909 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3176/6293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:43 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:43.430551 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a53c23c7-11ee-47d9-a71e-987456f0a7b3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.076669 Dec 18 21:13:43.430551 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3118/6294] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:43 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:13:43.788894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a91c92a-6a45-4050-8cd3-ca20b12f5bce tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:43.789873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a91c92a-6a45-4050-8cd3-ca20b12f5bce tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:43.797136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a91c92a-6a45-4050-8cd3-ca20b12f5bce tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:43.797614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a91c92a-6a45-4050-8cd3-ca20b12f5bce tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:43.798539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a91c92a-6a45-4050-8cd3-ca20b12f5bce tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:43.799001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a91c92a-6a45-4050-8cd3-ca20b12f5bce tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:43.841024 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a91c92a-6a45-4050-8cd3-ca20b12f5bce tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.056844 Dec 18 21:13:43.841795 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3119/6295] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:43 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:44.436981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-243852a5-b9e0-4de5-b971-4043866513dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:44.438957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-243852a5-b9e0-4de5-b971-4043866513dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:44.444335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:44.445058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:44.445832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-243852a5-b9e0-4de5-b971-4043866513dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:44.446322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-243852a5-b9e0-4de5-b971-4043866513dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:44.447325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-243852a5-b9e0-4de5-b971-4043866513dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:44.447777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-243852a5-b9e0-4de5-b971-4043866513dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:44.452422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:44.452892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:44.453694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:44.454142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:44.488074 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-243852a5-b9e0-4de5-b971-4043866513dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.054611 Dec 18 21:13:44.488767 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3177/6296] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:44 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:44.505611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-eea33613-1425-4887-9ba3-a1371532be7f req-693c7730-29e2-4d1a-aa30-876da1b8c040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:44.505611 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:44.505611 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:44.513445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-eea33613-1425-4887-9ba3-a1371532be7f req-693c7730-29e2-4d1a-aa30-876da1b8c040 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:44.513901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-eea33613-1425-4887-9ba3-a1371532be7f req-693c7730-29e2-4d1a-aa30-876da1b8c040 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:44.527130 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-eea33613-1425-4887-9ba3-a1371532be7f req-693c7730-29e2-4d1a-aa30-876da1b8c040 service nova] Creating event network-changed:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:13:44.532989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-eea33613-1425-4887-9ba3-a1371532be7f req-693c7730-29e2-4d1a-aa30-876da1b8c040 service nova] Instance d5bd7afd-a4da-4163-b4ac-245be65e705b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:13:44.544238 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-eea33613-1425-4887-9ba3-a1371532be7f req-693c7730-29e2-4d1a-aa30-876da1b8c040 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053212 Dec 18 21:13:44.545616 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3178/6297] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:44.608479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:44.617031 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d14a5b09-eb78-4d24-a2c6-8cf2355c3b9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1689 microversion: 2.1 time: 0.177469 Dec 18 21:13:44.617754 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3120/6298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:44 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:44.853420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e44078f6-5f91-402a-b3b5-ae7db2d62692 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:44.854466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e44078f6-5f91-402a-b3b5-ae7db2d62692 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:44.860551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e44078f6-5f91-402a-b3b5-ae7db2d62692 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:44.860939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e44078f6-5f91-402a-b3b5-ae7db2d62692 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:44.861727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e44078f6-5f91-402a-b3b5-ae7db2d62692 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:44.862159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e44078f6-5f91-402a-b3b5-ae7db2d62692 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:44.899657 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e44078f6-5f91-402a-b3b5-ae7db2d62692 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.051104 Dec 18 21:13:44.900584 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3179/6299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:44 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:13:45.501173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ccdf917-a68b-4110-8cb2-7cf62cb1c30c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:45.503067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ccdf917-a68b-4110-8cb2-7cf62cb1c30c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:45.513122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccdf917-a68b-4110-8cb2-7cf62cb1c30c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:45.514046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccdf917-a68b-4110-8cb2-7cf62cb1c30c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:45.515153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccdf917-a68b-4110-8cb2-7cf62cb1c30c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:45.516664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ccdf917-a68b-4110-8cb2-7cf62cb1c30c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:45.580502 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ccdf917-a68b-4110-8cb2-7cf62cb1c30c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.082910 Dec 18 21:13:45.583998 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3121/6300] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:45 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:45.641372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:13:45.643394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:45.655219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:45.656078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:45.656934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:45.657383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:45.910699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-80a0f62c-a469-437d-a6f1-f1dd6009a654 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:45.911741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-80a0f62c-a469-437d-a6f1-f1dd6009a654 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:45.918448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:13:45.918787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80a0f62c-a469-437d-a6f1-f1dd6009a654 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:45.919250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80a0f62c-a469-437d-a6f1-f1dd6009a654 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:45.920056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80a0f62c-a469-437d-a6f1-f1dd6009a654 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:45.920508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80a0f62c-a469-437d-a6f1-f1dd6009a654 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:45.927303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fb511e3-d65d-40a9-9ff7-2dbfd469bf33 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1682 microversion: 2.1 time: 0.294596 Dec 18 21:13:45.928595 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3180/6301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:45 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1682 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:45.963864 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-80a0f62c-a469-437d-a6f1-f1dd6009a654 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 14 microversion: 2.1 time: 0.057056 Dec 18 21:13:45.964519 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3122/6302] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:45 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:13:46.596631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a7b4aa2-9163-401a-a79c-767bce2ce8f4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:46.598120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a7b4aa2-9163-401a-a79c-767bce2ce8f4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:46.605995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7b4aa2-9163-401a-a79c-767bce2ce8f4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:46.606769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7b4aa2-9163-401a-a79c-767bce2ce8f4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:46.607762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7b4aa2-9163-401a-a79c-767bce2ce8f4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:46.608370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1a7b4aa2-9163-401a-a79c-767bce2ce8f4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:46.651126 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a7b4aa2-9163-401a-a79c-767bce2ce8f4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.060792 Dec 18 21:13:46.652112 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3181/6303] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:46 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:13:46.974504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b3e7001-9d70-44db-99a4-bb789b0f7d2f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:46.976174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b3e7001-9d70-44db-99a4-bb789b0f7d2f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:46.983749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b3e7001-9d70-44db-99a4-bb789b0f7d2f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:46.984220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b3e7001-9d70-44db-99a4-bb789b0f7d2f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:46.985033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b3e7001-9d70-44db-99a4-bb789b0f7d2f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:46.985498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b3e7001-9d70-44db-99a4-bb789b0f7d2f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:47.044966 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b3e7001-9d70-44db-99a4-bb789b0f7d2f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 8202 microversion: 2.1 time: 0.074434 Dec 18 21:13:47.045726 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3123/6304] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:46 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 8202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:13:47.667745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2800d85-4166-4234-9f27-1ac25ef2e82d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:47.668761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2800d85-4166-4234-9f27-1ac25ef2e82d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:47.676119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2800d85-4166-4234-9f27-1ac25ef2e82d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:47.676572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2800d85-4166-4234-9f27-1ac25ef2e82d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:47.677358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2800d85-4166-4234-9f27-1ac25ef2e82d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:47.677799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2800d85-4166-4234-9f27-1ac25ef2e82d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:47.718328 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2800d85-4166-4234-9f27-1ac25ef2e82d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.058514 Dec 18 21:13:47.719029 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3182/6305] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:47 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:13:48.057425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf1b4255-a576-484b-ad41-190b579d9994 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:48.058409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf1b4255-a576-484b-ad41-190b579d9994 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:48.065722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1b4255-a576-484b-ad41-190b579d9994 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:48.066200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1b4255-a576-484b-ad41-190b579d9994 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:48.067297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1b4255-a576-484b-ad41-190b579d9994 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:48.067764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf1b4255-a576-484b-ad41-190b579d9994 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:48.117988 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf1b4255-a576-484b-ad41-190b579d9994 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 16389 microversion: 2.1 time: 0.065320 Dec 18 21:13:48.122285 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3124/6306] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:48 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 16389 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:48.428098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ff1e1863-1586-4881-b72d-a5187117497c req-fb558d4f-4ac3-4e1b-8bf6-8977bfc9e0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "name": "network-vif-plugged", "status": "completed", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:48.429638 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:48.429638 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:13:48.439118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ff1e1863-1586-4881-b72d-a5187117497c req-fb558d4f-4ac3-4e1b-8bf6-8977bfc9e0c8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:48.439576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ff1e1863-1586-4881-b72d-a5187117497c req-fb558d4f-4ac3-4e1b-8bf6-8977bfc9e0c8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:48.459478 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ff1e1863-1586-4881-b72d-a5187117497c req-fb558d4f-4ac3-4e1b-8bf6-8977bfc9e0c8 service nova] Creating event network-vif-plugged:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:13:48.462528 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ff1e1863-1586-4881-b72d-a5187117497c req-fb558d4f-4ac3-4e1b-8bf6-8977bfc9e0c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038657 Dec 18 21:13:48.463303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3183/6307] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:13:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:13:48.731654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0da03cb4-475d-47bf-9548-8b8502418305 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:48.732691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0da03cb4-475d-47bf-9548-8b8502418305 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:48.739542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0da03cb4-475d-47bf-9548-8b8502418305 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:48.740014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0da03cb4-475d-47bf-9548-8b8502418305 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:48.740833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0da03cb4-475d-47bf-9548-8b8502418305 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:48.741291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0da03cb4-475d-47bf-9548-8b8502418305 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:48.782005 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0da03cb4-475d-47bf-9548-8b8502418305 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.054285 Dec 18 21:13:48.782861 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3125/6308] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:48 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:49.130671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-10e7443c-afc2-4fe1-b78f-58f4f715559f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:49.131600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-10e7443c-afc2-4fe1-b78f-58f4f715559f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:49.138610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10e7443c-afc2-4fe1-b78f-58f4f715559f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:49.139138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10e7443c-afc2-4fe1-b78f-58f4f715559f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:49.140001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10e7443c-afc2-4fe1-b78f-58f4f715559f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:49.140509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10e7443c-afc2-4fe1-b78f-58f4f715559f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:49.179945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-10e7443c-afc2-4fe1-b78f-58f4f715559f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 16389 microversion: 2.1 time: 0.053552 Dec 18 21:13:49.184303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3184/6309] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:49 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 16389 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:49.794239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40850af1-0d2d-4a55-b1c4-a9e7289fb83b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:49.795198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40850af1-0d2d-4a55-b1c4-a9e7289fb83b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:49.804336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40850af1-0d2d-4a55-b1c4-a9e7289fb83b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:49.804798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40850af1-0d2d-4a55-b1c4-a9e7289fb83b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:49.805743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40850af1-0d2d-4a55-b1c4-a9e7289fb83b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:49.806243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40850af1-0d2d-4a55-b1c4-a9e7289fb83b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:49.852539 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40850af1-0d2d-4a55-b1c4-a9e7289fb83b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.062300 Dec 18 21:13:49.854529 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3126/6310] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:49 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:50.192487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6273c08e-b890-422e-b182-ff417edece6a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:50.193601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6273c08e-b890-422e-b182-ff417edece6a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:50.202010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6273c08e-b890-422e-b182-ff417edece6a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:50.202593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6273c08e-b890-422e-b182-ff417edece6a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:50.203401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6273c08e-b890-422e-b182-ff417edece6a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:50.203833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6273c08e-b890-422e-b182-ff417edece6a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:50.254896 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6273c08e-b890-422e-b182-ff417edece6a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 16389 microversion: 2.1 time: 0.066504 Dec 18 21:13:50.255890 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3185/6311] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:50 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 16389 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:50.867513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f06950cb-9158-49b5-a3a4-21e422451724 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:50.868581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f06950cb-9158-49b5-a3a4-21e422451724 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:50.876216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f06950cb-9158-49b5-a3a4-21e422451724 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:50.876683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f06950cb-9158-49b5-a3a4-21e422451724 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:50.877528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f06950cb-9158-49b5-a3a4-21e422451724 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:50.878048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f06950cb-9158-49b5-a3a4-21e422451724 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:50.921878 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f06950cb-9158-49b5-a3a4-21e422451724 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.059213 Dec 18 21:13:50.922578 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3127/6312] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:50 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:51.267614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-947660fc-aded-403a-bbe4-4c46d55d31d0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:51.268567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-947660fc-aded-403a-bbe4-4c46d55d31d0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:51.277087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-947660fc-aded-403a-bbe4-4c46d55d31d0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:51.277530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-947660fc-aded-403a-bbe4-4c46d55d31d0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:51.278332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-947660fc-aded-403a-bbe4-4c46d55d31d0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:51.278772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-947660fc-aded-403a-bbe4-4c46d55d31d0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:51.318732 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-947660fc-aded-403a-bbe4-4c46d55d31d0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 16389 microversion: 2.1 time: 0.055205 Dec 18 21:13:51.319769 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3186/6313] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:51 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 16389 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:51.934112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7f07ae9-bfbb-4b10-9f29-3ae5cc357a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:51.935223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7f07ae9-bfbb-4b10-9f29-3ae5cc357a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:51.942789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7f07ae9-bfbb-4b10-9f29-3ae5cc357a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:51.943253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7f07ae9-bfbb-4b10-9f29-3ae5cc357a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:51.944041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7f07ae9-bfbb-4b10-9f29-3ae5cc357a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:51.945102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7f07ae9-bfbb-4b10-9f29-3ae5cc357a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:51.984526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7f07ae9-bfbb-4b10-9f29-3ae5cc357a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.054313 Dec 18 21:13:51.988183 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3128/6314] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:51 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:52.331059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4f28448-a57f-4aba-8461-86d36465985c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:52.331997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f4f28448-a57f-4aba-8461-86d36465985c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:52.339436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4f28448-a57f-4aba-8461-86d36465985c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:52.339883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4f28448-a57f-4aba-8461-86d36465985c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:52.340661 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4f28448-a57f-4aba-8461-86d36465985c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:52.341092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4f28448-a57f-4aba-8461-86d36465985c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:52.379827 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4f28448-a57f-4aba-8461-86d36465985c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 16389 microversion: 2.1 time: 0.052977 Dec 18 21:13:52.381297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3187/6315] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:52 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 16389 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:52.997308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-37a14f58-9064-4976-b3f7-b4e401d7c0de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:52.998369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-37a14f58-9064-4976-b3f7-b4e401d7c0de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:53.005958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37a14f58-9064-4976-b3f7-b4e401d7c0de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:53.006462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37a14f58-9064-4976-b3f7-b4e401d7c0de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:53.007831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37a14f58-9064-4976-b3f7-b4e401d7c0de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:53.008484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-37a14f58-9064-4976-b3f7-b4e401d7c0de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:53.051623 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-37a14f58-9064-4976-b3f7-b4e401d7c0de tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.058475 Dec 18 21:13:53.056043 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3129/6316] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:52 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:53.392990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0bd506fc-0183-4257-afc5-d40785757a5e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:53.394823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bd506fc-0183-4257-afc5-d40785757a5e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:53.403215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd506fc-0183-4257-afc5-d40785757a5e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:53.403762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd506fc-0183-4257-afc5-d40785757a5e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:53.404826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd506fc-0183-4257-afc5-d40785757a5e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:53.405506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bd506fc-0183-4257-afc5-d40785757a5e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:53.477239 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0bd506fc-0183-4257-afc5-d40785757a5e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.088836 Dec 18 21:13:53.478303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3188/6317] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:53 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:54.063966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e4ba8ee-8674-4625-b9cf-e14fb2578867 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:54.064994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e4ba8ee-8674-4625-b9cf-e14fb2578867 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:54.073780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8ee-8674-4625-b9cf-e14fb2578867 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:54.074245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8ee-8674-4625-b9cf-e14fb2578867 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:54.075147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8ee-8674-4625-b9cf-e14fb2578867 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:54.075579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8ee-8674-4625-b9cf-e14fb2578867 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:54.123169 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e4ba8ee-8674-4625-b9cf-e14fb2578867 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.063204 Dec 18 21:13:54.124169 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3130/6318] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:54 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:54.489697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5709a51-ba76-49d8-80d0-8ec69c946013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:54.490745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5709a51-ba76-49d8-80d0-8ec69c946013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:54.501285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5709a51-ba76-49d8-80d0-8ec69c946013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:54.501747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5709a51-ba76-49d8-80d0-8ec69c946013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:54.502775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5709a51-ba76-49d8-80d0-8ec69c946013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:54.503597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5709a51-ba76-49d8-80d0-8ec69c946013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:54.574585 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5709a51-ba76-49d8-80d0-8ec69c946013 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.088731 Dec 18 21:13:54.575615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3189/6319] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:54 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:55.135583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29d2fa8d-5e78-4358-af11-43351790b3ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:55.136590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29d2fa8d-5e78-4358-af11-43351790b3ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:55.144284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29d2fa8d-5e78-4358-af11-43351790b3ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:55.144672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29d2fa8d-5e78-4358-af11-43351790b3ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:55.145687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29d2fa8d-5e78-4358-af11-43351790b3ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:55.146349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29d2fa8d-5e78-4358-af11-43351790b3ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:55.188181 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-29d2fa8d-5e78-4358-af11-43351790b3ca tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.056586 Dec 18 21:13:55.189371 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3131/6320] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:55 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:55.587019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4ef6e15-b0e8-45bc-8b67-be195a6cac58 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:55.588684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f4ef6e15-b0e8-45bc-8b67-be195a6cac58 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:55.597259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4ef6e15-b0e8-45bc-8b67-be195a6cac58 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:55.597939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4ef6e15-b0e8-45bc-8b67-be195a6cac58 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:55.598959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4ef6e15-b0e8-45bc-8b67-be195a6cac58 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:55.599585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4ef6e15-b0e8-45bc-8b67-be195a6cac58 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:55.652058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4ef6e15-b0e8-45bc-8b67-be195a6cac58 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.068950 Dec 18 21:13:55.652778 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3190/6321] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:55 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:56.203567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cecd121c-9d7e-4e84-b847-e6ded9d75fc9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:56.204642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cecd121c-9d7e-4e84-b847-e6ded9d75fc9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:56.214388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cecd121c-9d7e-4e84-b847-e6ded9d75fc9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:56.214853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cecd121c-9d7e-4e84-b847-e6ded9d75fc9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:56.215862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cecd121c-9d7e-4e84-b847-e6ded9d75fc9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:56.216317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cecd121c-9d7e-4e84-b847-e6ded9d75fc9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:56.269872 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cecd121c-9d7e-4e84-b847-e6ded9d75fc9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 24515 microversion: 2.20 time: 0.070898 Dec 18 21:13:56.275008 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3132/6322] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:56 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 24515 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:56.667707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5645ae5f-ea48-4a07-bc5f-6446e1263c49 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:56.669365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5645ae5f-ea48-4a07-bc5f-6446e1263c49 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:56.681618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5645ae5f-ea48-4a07-bc5f-6446e1263c49 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:56.682400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5645ae5f-ea48-4a07-bc5f-6446e1263c49 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:56.685920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5645ae5f-ea48-4a07-bc5f-6446e1263c49 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:56.686633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5645ae5f-ea48-4a07-bc5f-6446e1263c49 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:56.752370 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5645ae5f-ea48-4a07-bc5f-6446e1263c49 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.090525 Dec 18 21:13:56.753047 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3191/6323] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:56 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:57.282302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c66e4e01-d515-4616-b1b8-289b37bbe542 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:57.284226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c66e4e01-d515-4616-b1b8-289b37bbe542 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:57.293718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66e4e01-d515-4616-b1b8-289b37bbe542 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:57.294539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66e4e01-d515-4616-b1b8-289b37bbe542 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:57.295867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66e4e01-d515-4616-b1b8-289b37bbe542 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:57.296497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c66e4e01-d515-4616-b1b8-289b37bbe542 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:57.367421 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c66e4e01-d515-4616-b1b8-289b37bbe542 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.089099 Dec 18 21:13:57.369065 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3133/6324] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:57 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:57.766479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-006a3e46-21b4-4382-99f6-ac479678adb5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:57.768337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-006a3e46-21b4-4382-99f6-ac479678adb5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:57.786029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-006a3e46-21b4-4382-99f6-ac479678adb5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:57.788600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-006a3e46-21b4-4382-99f6-ac479678adb5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:57.790536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-006a3e46-21b4-4382-99f6-ac479678adb5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:57.791256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-006a3e46-21b4-4382-99f6-ac479678adb5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:57.852498 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-006a3e46-21b4-4382-99f6-ac479678adb5 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.091449 Dec 18 21:13:57.853801 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3192/6325] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:57 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:58.385549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-872479dd-564e-4e06-8597-d53db9bd28cd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:58.387431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-872479dd-564e-4e06-8597-d53db9bd28cd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:58.396008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872479dd-564e-4e06-8597-d53db9bd28cd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:58.396929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872479dd-564e-4e06-8597-d53db9bd28cd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:58.398396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872479dd-564e-4e06-8597-d53db9bd28cd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:58.398955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872479dd-564e-4e06-8597-d53db9bd28cd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:58.447230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-872479dd-564e-4e06-8597-d53db9bd28cd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.067750 Dec 18 21:13:58.448102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3134/6326] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:58 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:58.865641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9acf073f-3286-403a-a90a-2f8aa1608957 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:58.867916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9acf073f-3286-403a-a90a-2f8aa1608957 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:58.877716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9acf073f-3286-403a-a90a-2f8aa1608957 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:58.879078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9acf073f-3286-403a-a90a-2f8aa1608957 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:58.881214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9acf073f-3286-403a-a90a-2f8aa1608957 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:58.882232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9acf073f-3286-403a-a90a-2f8aa1608957 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:58.927919 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9acf073f-3286-403a-a90a-2f8aa1608957 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.066908 Dec 18 21:13:58.929228 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3193/6327] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:58 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:13:59.459957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6b1b4ef4-f700-4e95-b7ab-eeae06e40dd7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:59.460969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6b1b4ef4-f700-4e95-b7ab-eeae06e40dd7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:59.468233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1b4ef4-f700-4e95-b7ab-eeae06e40dd7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:59.468691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1b4ef4-f700-4e95-b7ab-eeae06e40dd7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:59.469482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1b4ef4-f700-4e95-b7ab-eeae06e40dd7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:59.469932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6b1b4ef4-f700-4e95-b7ab-eeae06e40dd7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:59.511422 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6b1b4ef4-f700-4e95-b7ab-eeae06e40dd7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.055386 Dec 18 21:13:59.516172 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3135/6328] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:13:59 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:13:59.940659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af4126e6-fee4-4903-bcff-4ad49676ecaf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:13:59.941927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af4126e6-fee4-4903-bcff-4ad49676ecaf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:13:59.949295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af4126e6-fee4-4903-bcff-4ad49676ecaf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:59.949755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af4126e6-fee4-4903-bcff-4ad49676ecaf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:59.950593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af4126e6-fee4-4903-bcff-4ad49676ecaf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:13:59.951039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af4126e6-fee4-4903-bcff-4ad49676ecaf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:13:59.991678 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af4126e6-fee4-4903-bcff-4ad49676ecaf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.054298 Dec 18 21:13:59.995390 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3194/6329] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:13:59 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:00.524585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a0ec41a-08c4-487c-81f0-cf75fe408216 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:00.525746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7a0ec41a-08c4-487c-81f0-cf75fe408216 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:00.532699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a0ec41a-08c4-487c-81f0-cf75fe408216 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:00.533288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a0ec41a-08c4-487c-81f0-cf75fe408216 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:00.534104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a0ec41a-08c4-487c-81f0-cf75fe408216 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:00.534593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a0ec41a-08c4-487c-81f0-cf75fe408216 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:00.575072 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a0ec41a-08c4-487c-81f0-cf75fe408216 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.055252 Dec 18 21:14:00.576081 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3136/6330] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:00 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:01.002796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa95fb91-cf65-4065-9a4a-3e45cf1a758e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:01.004426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa95fb91-cf65-4065-9a4a-3e45cf1a758e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:01.014080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa95fb91-cf65-4065-9a4a-3e45cf1a758e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:01.014570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa95fb91-cf65-4065-9a4a-3e45cf1a758e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:01.016021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa95fb91-cf65-4065-9a4a-3e45cf1a758e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:01.016554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa95fb91-cf65-4065-9a4a-3e45cf1a758e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:01.064274 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa95fb91-cf65-4065-9a4a-3e45cf1a758e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.065339 Dec 18 21:14:01.065232 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3195/6331] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:00 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:01.587698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dcf5c7fe-3814-4c1a-a865-e173a77d6d97 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:01.589417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dcf5c7fe-3814-4c1a-a865-e173a77d6d97 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:01.597443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcf5c7fe-3814-4c1a-a865-e173a77d6d97 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:01.598178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcf5c7fe-3814-4c1a-a865-e173a77d6d97 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:01.599234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcf5c7fe-3814-4c1a-a865-e173a77d6d97 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:01.599695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcf5c7fe-3814-4c1a-a865-e173a77d6d97 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:01.644860 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dcf5c7fe-3814-4c1a-a865-e173a77d6d97 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.061035 Dec 18 21:14:01.645951 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3137/6332] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:01 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:02.079313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ffdf64b-94aa-4216-8459-3205ea8ccff0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:02.086277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ffdf64b-94aa-4216-8459-3205ea8ccff0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:02.094508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ffdf64b-94aa-4216-8459-3205ea8ccff0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:02.095288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ffdf64b-94aa-4216-8459-3205ea8ccff0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:02.096881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ffdf64b-94aa-4216-8459-3205ea8ccff0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:02.097602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ffdf64b-94aa-4216-8459-3205ea8ccff0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:02.146417 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ffdf64b-94aa-4216-8459-3205ea8ccff0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.072802 Dec 18 21:14:02.148037 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3196/6333] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:02 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:02.659339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9f714c84-de93-4804-8956-a6586d2b4584 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:02.660513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9f714c84-de93-4804-8956-a6586d2b4584 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:02.669811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f714c84-de93-4804-8956-a6586d2b4584 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:02.670395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f714c84-de93-4804-8956-a6586d2b4584 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:02.671358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f714c84-de93-4804-8956-a6586d2b4584 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:02.672061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f714c84-de93-4804-8956-a6586d2b4584 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:02.720803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9f714c84-de93-4804-8956-a6586d2b4584 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.065938 Dec 18 21:14:02.722700 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3138/6334] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:02 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:03.160626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5388bad1-0d38-4f11-8517-a3badf1bb511 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:03.162449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5388bad1-0d38-4f11-8517-a3badf1bb511 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:03.171226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5388bad1-0d38-4f11-8517-a3badf1bb511 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:03.171678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5388bad1-0d38-4f11-8517-a3badf1bb511 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:03.172514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5388bad1-0d38-4f11-8517-a3badf1bb511 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:03.173139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5388bad1-0d38-4f11-8517-a3badf1bb511 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:03.225893 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5388bad1-0d38-4f11-8517-a3badf1bb511 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.070091 Dec 18 21:14:03.226933 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3197/6335] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:03 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:03.735227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ed7c4d4-14cd-456f-9c70-8ef09c6a116b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:03.737112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ed7c4d4-14cd-456f-9c70-8ef09c6a116b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:03.748856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ed7c4d4-14cd-456f-9c70-8ef09c6a116b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:03.749359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ed7c4d4-14cd-456f-9c70-8ef09c6a116b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:03.750527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ed7c4d4-14cd-456f-9c70-8ef09c6a116b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:03.751398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ed7c4d4-14cd-456f-9c70-8ef09c6a116b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:03.803129 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ed7c4d4-14cd-456f-9c70-8ef09c6a116b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.072906 Dec 18 21:14:03.806706 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3139/6336] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:03 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:04.238965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c42009c0-5b68-443e-980e-06c831e4e2ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:04.240702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c42009c0-5b68-443e-980e-06c831e4e2ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:04.250841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42009c0-5b68-443e-980e-06c831e4e2ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:04.251422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42009c0-5b68-443e-980e-06c831e4e2ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:04.252337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42009c0-5b68-443e-980e-06c831e4e2ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:04.252952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c42009c0-5b68-443e-980e-06c831e4e2ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:04.301987 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c42009c0-5b68-443e-980e-06c831e4e2ea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.067084 Dec 18 21:14:04.302983 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3198/6337] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:04 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:04.817198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52405d1a-4265-42e0-9905-3955b06b0a0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:04.823811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52405d1a-4265-42e0-9905-3955b06b0a0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:04.832023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52405d1a-4265-42e0-9905-3955b06b0a0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:04.832784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52405d1a-4265-42e0-9905-3955b06b0a0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:04.834363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52405d1a-4265-42e0-9905-3955b06b0a0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:04.835375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52405d1a-4265-42e0-9905-3955b06b0a0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:04.907402 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52405d1a-4265-42e0-9905-3955b06b0a0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.094944 Dec 18 21:14:04.914132 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3140/6338] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:04 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:05.319830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8fb516e-dd98-454c-b1b4-2a3b96a3ef05 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:05.322547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f8fb516e-dd98-454c-b1b4-2a3b96a3ef05 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:05.334439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8fb516e-dd98-454c-b1b4-2a3b96a3ef05 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:05.335020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8fb516e-dd98-454c-b1b4-2a3b96a3ef05 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:05.336179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8fb516e-dd98-454c-b1b4-2a3b96a3ef05 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:05.337082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8fb516e-dd98-454c-b1b4-2a3b96a3ef05 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:05.393029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8fb516e-dd98-454c-b1b4-2a3b96a3ef05 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 24556 microversion: 2.1 time: 0.083257 Dec 18 21:14:05.394651 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3199/6339] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:05 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 24556 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:05.921050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7c1f25cf-9382-444f-a1e3-155a3711ef72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:05.922803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7c1f25cf-9382-444f-a1e3-155a3711ef72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:05.931013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c1f25cf-9382-444f-a1e3-155a3711ef72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:05.931741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c1f25cf-9382-444f-a1e3-155a3711ef72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:05.932793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c1f25cf-9382-444f-a1e3-155a3711ef72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:05.933427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c1f25cf-9382-444f-a1e3-155a3711ef72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:05.981729 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7c1f25cf-9382-444f-a1e3-155a3711ef72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.064659 Dec 18 21:14:05.982481 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3141/6340] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:05 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:06.407610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c8aba5e-47f3-4038-b0af-ed303e89cf18 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:06.409782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c8aba5e-47f3-4038-b0af-ed303e89cf18 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:06.417823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8aba5e-47f3-4038-b0af-ed303e89cf18 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:06.418398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8aba5e-47f3-4038-b0af-ed303e89cf18 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:06.419396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8aba5e-47f3-4038-b0af-ed303e89cf18 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:06.420228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c8aba5e-47f3-4038-b0af-ed303e89cf18 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:06.486879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c8aba5e-47f3-4038-b0af-ed303e89cf18 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.083416 Dec 18 21:14:06.487742 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3200/6341] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:06 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:06.995193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-03a3e02b-77a9-4c76-bf5d-e6fba8e6f0a8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:06.996455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-03a3e02b-77a9-4c76-bf5d-e6fba8e6f0a8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:07.004355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a3e02b-77a9-4c76-bf5d-e6fba8e6f0a8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:07.004948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a3e02b-77a9-4c76-bf5d-e6fba8e6f0a8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:07.005918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a3e02b-77a9-4c76-bf5d-e6fba8e6f0a8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:07.007242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-03a3e02b-77a9-4c76-bf5d-e6fba8e6f0a8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:07.049036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-03a3e02b-77a9-4c76-bf5d-e6fba8e6f0a8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.058625 Dec 18 21:14:07.053718 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3142/6342] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:06 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:07.500516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-040edefc-5f7b-43ab-953d-96c1c1a0ff5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:07.503449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-040edefc-5f7b-43ab-953d-96c1c1a0ff5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:07.513900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-040edefc-5f7b-43ab-953d-96c1c1a0ff5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:07.514944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-040edefc-5f7b-43ab-953d-96c1c1a0ff5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:07.515737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-040edefc-5f7b-43ab-953d-96c1c1a0ff5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:07.516181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-040edefc-5f7b-43ab-953d-96c1c1a0ff5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:07.564519 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-040edefc-5f7b-43ab-953d-96c1c1a0ff5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.068455 Dec 18 21:14:07.565183 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3201/6343] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:07 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:08.063163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5338f2df-a443-40ec-afb3-9b7da90d2b18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:08.064817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5338f2df-a443-40ec-afb3-9b7da90d2b18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:08.074885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5338f2df-a443-40ec-afb3-9b7da90d2b18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:08.075775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5338f2df-a443-40ec-afb3-9b7da90d2b18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:08.076623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5338f2df-a443-40ec-afb3-9b7da90d2b18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:08.077252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5338f2df-a443-40ec-afb3-9b7da90d2b18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:08.125151 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5338f2df-a443-40ec-afb3-9b7da90d2b18 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.067001 Dec 18 21:14:08.125817 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3143/6344] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:08 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:08.579109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b18e9892-2349-480b-8d6f-4212171ef259 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:08.580291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b18e9892-2349-480b-8d6f-4212171ef259 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:08.590134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18e9892-2349-480b-8d6f-4212171ef259 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:08.590790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18e9892-2349-480b-8d6f-4212171ef259 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:08.591991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18e9892-2349-480b-8d6f-4212171ef259 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:08.592497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18e9892-2349-480b-8d6f-4212171ef259 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:08.644052 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b18e9892-2349-480b-8d6f-4212171ef259 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.070115 Dec 18 21:14:08.645166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3202/6345] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:08 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:09.139558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8baab0c9-8ecf-4e47-b115-75029da0ba2a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:09.140847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8baab0c9-8ecf-4e47-b115-75029da0ba2a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:09.149534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8baab0c9-8ecf-4e47-b115-75029da0ba2a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:09.150013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8baab0c9-8ecf-4e47-b115-75029da0ba2a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:09.151039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8baab0c9-8ecf-4e47-b115-75029da0ba2a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:09.151634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8baab0c9-8ecf-4e47-b115-75029da0ba2a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:09.199289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8baab0c9-8ecf-4e47-b115-75029da0ba2a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.064231 Dec 18 21:14:09.200498 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3144/6346] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:09 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:09.659172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0b8dab94-0f65-4945-81ce-e8bd8a7fcd8a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:09.660147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0b8dab94-0f65-4945-81ce-e8bd8a7fcd8a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:09.668509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8dab94-0f65-4945-81ce-e8bd8a7fcd8a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:09.668990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8dab94-0f65-4945-81ce-e8bd8a7fcd8a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:09.669855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8dab94-0f65-4945-81ce-e8bd8a7fcd8a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:09.670316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8dab94-0f65-4945-81ce-e8bd8a7fcd8a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:09.714318 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0b8dab94-0f65-4945-81ce-e8bd8a7fcd8a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.060519 Dec 18 21:14:09.718414 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3203/6347] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:09 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:10.215591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8bcd8c4-3b16-4327-9052-af889028782b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:10.216705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8bcd8c4-3b16-4327-9052-af889028782b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:10.224122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8bcd8c4-3b16-4327-9052-af889028782b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:10.225578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8bcd8c4-3b16-4327-9052-af889028782b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:10.226633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8bcd8c4-3b16-4327-9052-af889028782b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:10.227257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8bcd8c4-3b16-4327-9052-af889028782b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:10.273612 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8bcd8c4-3b16-4327-9052-af889028782b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.065247 Dec 18 21:14:10.274755 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3145/6348] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:10 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:10.727064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-04e12046-8605-4ca4-9b53-7eb8538cb6d2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:10.728239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-04e12046-8605-4ca4-9b53-7eb8538cb6d2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:10.741410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04e12046-8605-4ca4-9b53-7eb8538cb6d2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:10.742004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04e12046-8605-4ca4-9b53-7eb8538cb6d2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:10.742963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04e12046-8605-4ca4-9b53-7eb8538cb6d2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:10.743507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04e12046-8605-4ca4-9b53-7eb8538cb6d2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:10.787010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-04e12046-8605-4ca4-9b53-7eb8538cb6d2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.064325 Dec 18 21:14:10.788509 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3204/6349] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:10 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:11.285452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cceace4e-d048-4e99-a810-e89ab81b8cc7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:11.286705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cceace4e-d048-4e99-a810-e89ab81b8cc7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:11.294375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cceace4e-d048-4e99-a810-e89ab81b8cc7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:11.294843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cceace4e-d048-4e99-a810-e89ab81b8cc7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:11.295639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cceace4e-d048-4e99-a810-e89ab81b8cc7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:11.296092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cceace4e-d048-4e99-a810-e89ab81b8cc7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:11.335327 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cceace4e-d048-4e99-a810-e89ab81b8cc7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.053226 Dec 18 21:14:11.336290 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3146/6350] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:11 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:11.800653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f51bcc51-9449-4443-8bb6-a694b602d3b8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:11.801663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f51bcc51-9449-4443-8bb6-a694b602d3b8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:11.809678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f51bcc51-9449-4443-8bb6-a694b602d3b8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:11.810132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f51bcc51-9449-4443-8bb6-a694b602d3b8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:11.810952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f51bcc51-9449-4443-8bb6-a694b602d3b8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:11.811395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f51bcc51-9449-4443-8bb6-a694b602d3b8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:11.852996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f51bcc51-9449-4443-8bb6-a694b602d3b8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.056598 Dec 18 21:14:11.854118 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3205/6351] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:11 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:12.348036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3c23870-2c0c-4fb7-84c1-dc30373335d6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:12.349052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f3c23870-2c0c-4fb7-84c1-dc30373335d6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:12.357334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3c23870-2c0c-4fb7-84c1-dc30373335d6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:12.357798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3c23870-2c0c-4fb7-84c1-dc30373335d6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:12.358727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3c23870-2c0c-4fb7-84c1-dc30373335d6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:12.359165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3c23870-2c0c-4fb7-84c1-dc30373335d6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:12.400220 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3c23870-2c0c-4fb7-84c1-dc30373335d6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.056317 Dec 18 21:14:12.400917 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3147/6352] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:12 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:12.866241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b533623a-8809-4eae-a576-1d1ac40dabea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:12.867276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b533623a-8809-4eae-a576-1d1ac40dabea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:12.874562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b533623a-8809-4eae-a576-1d1ac40dabea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:12.875019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b533623a-8809-4eae-a576-1d1ac40dabea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:12.875822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b533623a-8809-4eae-a576-1d1ac40dabea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:12.876507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b533623a-8809-4eae-a576-1d1ac40dabea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:12.919341 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b533623a-8809-4eae-a576-1d1ac40dabea tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.057544 Dec 18 21:14:12.920001 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3206/6353] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:12 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:13.412137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d330044-567a-45d6-a3f8-6cdb2d6904b1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:13.414036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d330044-567a-45d6-a3f8-6cdb2d6904b1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:13.421267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d330044-567a-45d6-a3f8-6cdb2d6904b1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:13.421742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d330044-567a-45d6-a3f8-6cdb2d6904b1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:13.422587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d330044-567a-45d6-a3f8-6cdb2d6904b1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:13.423046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d330044-567a-45d6-a3f8-6cdb2d6904b1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:13.463876 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d330044-567a-45d6-a3f8-6cdb2d6904b1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.055767 Dec 18 21:14:13.468102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3148/6354] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:13 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:13.931372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9dd3988c-923a-44b8-999f-447d5d6a9dd3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:13.932377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9dd3988c-923a-44b8-999f-447d5d6a9dd3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:13.942040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd3988c-923a-44b8-999f-447d5d6a9dd3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:13.942602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd3988c-923a-44b8-999f-447d5d6a9dd3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:13.943487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd3988c-923a-44b8-999f-447d5d6a9dd3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:13.944003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9dd3988c-923a-44b8-999f-447d5d6a9dd3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:13.986420 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9dd3988c-923a-44b8-999f-447d5d6a9dd3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.058915 Dec 18 21:14:13.987133 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3207/6355] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:13 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:14.144717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b6fcbb19-3728-4f9e-b1b9-c7389bf3d635 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:14.145737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b6fcbb19-3728-4f9e-b1b9-c7389bf3d635 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:14.153557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6fcbb19-3728-4f9e-b1b9-c7389bf3d635 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:14.154029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6fcbb19-3728-4f9e-b1b9-c7389bf3d635 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:14.154865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6fcbb19-3728-4f9e-b1b9-c7389bf3d635 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:14.155323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b6fcbb19-3728-4f9e-b1b9-c7389bf3d635 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:14.212453 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b6fcbb19-3728-4f9e-b1b9-c7389bf3d635 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action" status: 200 len: 63156 microversion: 2.1 time: 0.072129 Dec 18 21:14:14.214897 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3149/6356] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:14 2021] POST /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b/action => generated 63156 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:14.479051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-621f8e9f-2e1a-4936-95f0-aa8842e49a45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:14.480268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-621f8e9f-2e1a-4936-95f0-aa8842e49a45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:14.487946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621f8e9f-2e1a-4936-95f0-aa8842e49a45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:14.488654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621f8e9f-2e1a-4936-95f0-aa8842e49a45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:14.489579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621f8e9f-2e1a-4936-95f0-aa8842e49a45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:14.490025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-621f8e9f-2e1a-4936-95f0-aa8842e49a45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:14.542803 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-621f8e9f-2e1a-4936-95f0-aa8842e49a45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.067851 Dec 18 21:14:14.543972 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3208/6357] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:14 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:14.999615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff9c12c4-8037-4dd9-922a-e9ce95ead904 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:15.001246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff9c12c4-8037-4dd9-922a-e9ce95ead904 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:15.009645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff9c12c4-8037-4dd9-922a-e9ce95ead904 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:15.010283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff9c12c4-8037-4dd9-922a-e9ce95ead904 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:15.011302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff9c12c4-8037-4dd9-922a-e9ce95ead904 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:15.011975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff9c12c4-8037-4dd9-922a-e9ce95ead904 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:15.061484 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff9c12c4-8037-4dd9-922a-e9ce95ead904 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.066850 Dec 18 21:14:15.062444 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3150/6358] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:14 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:15.556796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-371a9378-72e6-4420-9449-48b672839cec tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:15.557862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-371a9378-72e6-4420-9449-48b672839cec tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:15.565687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-371a9378-72e6-4420-9449-48b672839cec tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:15.566148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-371a9378-72e6-4420-9449-48b672839cec tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:15.567246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-371a9378-72e6-4420-9449-48b672839cec tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:15.567690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-371a9378-72e6-4420-9449-48b672839cec tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:15.608570 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-371a9378-72e6-4420-9449-48b672839cec tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.056331 Dec 18 21:14:15.609648 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3209/6359] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:15 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:16.073798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d73e2dfb-9c46-4043-adda-9e3ff8325e54 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:16.074957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d73e2dfb-9c46-4043-adda-9e3ff8325e54 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:16.082412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d73e2dfb-9c46-4043-adda-9e3ff8325e54 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:16.083010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d73e2dfb-9c46-4043-adda-9e3ff8325e54 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:16.083766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d73e2dfb-9c46-4043-adda-9e3ff8325e54 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:16.084736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d73e2dfb-9c46-4043-adda-9e3ff8325e54 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:16.131935 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d73e2dfb-9c46-4043-adda-9e3ff8325e54 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.062098 Dec 18 21:14:16.132843 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3151/6360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:16 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:16.622547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6053aa71-83b6-4826-90a7-fc06c335f751 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:16.623597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6053aa71-83b6-4826-90a7-fc06c335f751 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:16.632544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6053aa71-83b6-4826-90a7-fc06c335f751 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:16.632994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6053aa71-83b6-4826-90a7-fc06c335f751 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:16.633787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6053aa71-83b6-4826-90a7-fc06c335f751 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:16.634219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6053aa71-83b6-4826-90a7-fc06c335f751 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:16.675061 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6053aa71-83b6-4826-90a7-fc06c335f751 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.058336 Dec 18 21:14:16.675941 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3210/6361] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:16 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:17.144583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71615585-7cfd-4941-b405-165cdaba48e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:17.145615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71615585-7cfd-4941-b405-165cdaba48e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:17.153551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71615585-7cfd-4941-b405-165cdaba48e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:17.154026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71615585-7cfd-4941-b405-165cdaba48e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:17.154863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71615585-7cfd-4941-b405-165cdaba48e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:17.155323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71615585-7cfd-4941-b405-165cdaba48e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:17.196096 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71615585-7cfd-4941-b405-165cdaba48e0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.055626 Dec 18 21:14:17.200081 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3152/6362] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:17 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:17.688130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fd9a6605-38cc-4ed7-a1cf-7377c2443521 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:17.690088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fd9a6605-38cc-4ed7-a1cf-7377c2443521 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:17.698532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd9a6605-38cc-4ed7-a1cf-7377c2443521 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:17.699297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd9a6605-38cc-4ed7-a1cf-7377c2443521 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:17.700189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd9a6605-38cc-4ed7-a1cf-7377c2443521 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:17.700839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd9a6605-38cc-4ed7-a1cf-7377c2443521 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:17.745952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fd9a6605-38cc-4ed7-a1cf-7377c2443521 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.061917 Dec 18 21:14:17.746662 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3211/6363] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:17 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:18.452883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-195cc0d0-81bf-4548-93ad-4e607316b2bc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:18.453921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-195cc0d0-81bf-4548-93ad-4e607316b2bc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:18.461566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-195cc0d0-81bf-4548-93ad-4e607316b2bc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:18.462033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-195cc0d0-81bf-4548-93ad-4e607316b2bc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:18.462868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-195cc0d0-81bf-4548-93ad-4e607316b2bc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:18.463322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-195cc0d0-81bf-4548-93ad-4e607316b2bc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:18.508036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-195cc0d0-81bf-4548-93ad-4e607316b2bc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.303184 Dec 18 21:14:18.508664 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3153/6364] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:18 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:18.758877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-566faad7-24f6-41b9-bf57-a7e515188eaa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:18.759897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-566faad7-24f6-41b9-bf57-a7e515188eaa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:18.767722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-566faad7-24f6-41b9-bf57-a7e515188eaa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:18.768096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-566faad7-24f6-41b9-bf57-a7e515188eaa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:18.769313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-566faad7-24f6-41b9-bf57-a7e515188eaa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:18.769750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-566faad7-24f6-41b9-bf57-a7e515188eaa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:18.812895 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-566faad7-24f6-41b9-bf57-a7e515188eaa tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.059052 Dec 18 21:14:18.813696 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3212/6365] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:18 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:19.522402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f41b53ae-0e33-46d0-9f8d-c066ab83ea44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:19.523559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f41b53ae-0e33-46d0-9f8d-c066ab83ea44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:19.531433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f41b53ae-0e33-46d0-9f8d-c066ab83ea44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:19.532229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f41b53ae-0e33-46d0-9f8d-c066ab83ea44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:19.533284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f41b53ae-0e33-46d0-9f8d-c066ab83ea44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:19.533994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f41b53ae-0e33-46d0-9f8d-c066ab83ea44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:19.584230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f41b53ae-0e33-46d0-9f8d-c066ab83ea44 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.065917 Dec 18 21:14:19.589374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3154/6366] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:19 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:19.828901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af1e7fbc-e43a-4362-b17c-86d14b9f6910 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:19.830767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af1e7fbc-e43a-4362-b17c-86d14b9f6910 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:19.841617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af1e7fbc-e43a-4362-b17c-86d14b9f6910 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:19.841965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af1e7fbc-e43a-4362-b17c-86d14b9f6910 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:19.842847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af1e7fbc-e43a-4362-b17c-86d14b9f6910 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:19.845608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af1e7fbc-e43a-4362-b17c-86d14b9f6910 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:19.903567 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af1e7fbc-e43a-4362-b17c-86d14b9f6910 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.081681 Dec 18 21:14:19.904471 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3213/6367] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:19 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:20.596613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e18e044-ce9e-4ba3-8e03-aa15919298e3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:20.597806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e18e044-ce9e-4ba3-8e03-aa15919298e3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:20.605817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e18e044-ce9e-4ba3-8e03-aa15919298e3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:20.606305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e18e044-ce9e-4ba3-8e03-aa15919298e3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:20.607133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e18e044-ce9e-4ba3-8e03-aa15919298e3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:20.607588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e18e044-ce9e-4ba3-8e03-aa15919298e3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:20.627156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da870c50-beb3-4059-a5de-850378d069e2 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:20.628636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da870c50-beb3-4059-a5de-850378d069e2 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:20.643151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da870c50-beb3-4059-a5de-850378d069e2 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:20.643872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da870c50-beb3-4059-a5de-850378d069e2 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:20.644736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da870c50-beb3-4059-a5de-850378d069e2 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:20.645285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da870c50-beb3-4059-a5de-850378d069e2 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:20.664872 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e18e044-ce9e-4ba3-8e03-aa15919298e3 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.072209 Dec 18 21:14:20.665994 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3155/6368] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:20 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:20.795059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da870c50-beb3-4059-a5de-850378d069e2 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1833 microversion: 2.1 time: 0.172052 Dec 18 21:14:20.796236 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3214/6369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:20 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1833 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:20.920113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f52a9de0-273c-4af9-b6bc-e0cec10187f9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:20.921190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f52a9de0-273c-4af9-b6bc-e0cec10187f9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:20.932020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a9de0-273c-4af9-b6bc-e0cec10187f9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:20.932487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a9de0-273c-4af9-b6bc-e0cec10187f9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:20.933794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a9de0-273c-4af9-b6bc-e0cec10187f9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:20.934278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f52a9de0-273c-4af9-b6bc-e0cec10187f9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:20.980655 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f52a9de0-273c-4af9-b6bc-e0cec10187f9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.068386 Dec 18 21:14:20.982424 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3156/6370] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:20 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:21.676246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2620858-b41a-4b80-9c34-4891fac2f8a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:21.677263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2620858-b41a-4b80-9c34-4891fac2f8a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:21.687043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2620858-b41a-4b80-9c34-4891fac2f8a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:21.687799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2620858-b41a-4b80-9c34-4891fac2f8a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:21.689015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2620858-b41a-4b80-9c34-4891fac2f8a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:21.689655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2620858-b41a-4b80-9c34-4891fac2f8a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:21.744584 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2620858-b41a-4b80-9c34-4891fac2f8a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.071563 Dec 18 21:14:21.745461 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3215/6371] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:21 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:21.993365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb517daf-6a12-4087-be4f-3b564168adb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:21.994684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eb517daf-6a12-4087-be4f-3b564168adb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:22.011588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb517daf-6a12-4087-be4f-3b564168adb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.012483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb517daf-6a12-4087-be4f-3b564168adb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.013363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb517daf-6a12-4087-be4f-3b564168adb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.013891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb517daf-6a12-4087-be4f-3b564168adb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.069790 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb517daf-6a12-4087-be4f-3b564168adb8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.079397 Dec 18 21:14:22.071186 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3157/6372] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:21 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:22.209140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:22.210079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:22.216279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a7255f08-ca90-409c-b6da-282d1b068f2e req-633123c0-6e3d-4052-9a1f-39acd1479bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:22.217788 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:14:22.217788 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:14:22.223057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.223760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.224811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.225417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.226370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a7255f08-ca90-409c-b6da-282d1b068f2e req-633123c0-6e3d-4052-9a1f-39acd1479bee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.227123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a7255f08-ca90-409c-b6da-282d1b068f2e req-633123c0-6e3d-4052-9a1f-39acd1479bee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.243979 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a7255f08-ca90-409c-b6da-282d1b068f2e req-633123c0-6e3d-4052-9a1f-39acd1479bee service nova] Creating event network-changed:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:14:22.249779 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a7255f08-ca90-409c-b6da-282d1b068f2e req-633123c0-6e3d-4052-9a1f-39acd1479bee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037418 Dec 18 21:14:22.250684 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3158/6373] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:14:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:14:22.270925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:14:22.372300 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e1e2062-08f7-4dbe-a5c1-1354f3b115cc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 204 len: 0 microversion: 2.1 time: 0.167721 Dec 18 21:14:22.376320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3216/6374] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:14:22 2021] DELETE /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:14:22.387264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:22.387985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:22.399544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.400012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.400868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.401325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.691402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:22.700954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d58a9bab-d976-440b-8b44-1ed2db39081b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1688 microversion: 2.1 time: 0.320092 Dec 18 21:14:22.706424 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3159/6375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:22 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1688 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:22.757946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82021f06-f319-4e8e-bab6-db94be50b525 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:22.759390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82021f06-f319-4e8e-bab6-db94be50b525 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:22.780651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82021f06-f319-4e8e-bab6-db94be50b525 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.781402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82021f06-f319-4e8e-bab6-db94be50b525 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.785086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82021f06-f319-4e8e-bab6-db94be50b525 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:22.785907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82021f06-f319-4e8e-bab6-db94be50b525 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:22.853405 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82021f06-f319-4e8e-bab6-db94be50b525 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.099361 Dec 18 21:14:22.857171 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3217/6376] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:22 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:23.083811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fce5ce05-664a-43ec-8eae-9ee8719ada1c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:23.085486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fce5ce05-664a-43ec-8eae-9ee8719ada1c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:23.093642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fce5ce05-664a-43ec-8eae-9ee8719ada1c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:23.094116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fce5ce05-664a-43ec-8eae-9ee8719ada1c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:23.094953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fce5ce05-664a-43ec-8eae-9ee8719ada1c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:23.095408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fce5ce05-664a-43ec-8eae-9ee8719ada1c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:23.137367 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fce5ce05-664a-43ec-8eae-9ee8719ada1c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.057880 Dec 18 21:14:23.140957 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3160/6377] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:23 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:23.723572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:23.724277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:23.732971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:23.733431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:23.734229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:23.734880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:23.868757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4f652bd-655b-44e5-8b07-bbafdc70b6a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:23.869799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4f652bd-655b-44e5-8b07-bbafdc70b6a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:23.876675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f652bd-655b-44e5-8b07-bbafdc70b6a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:23.877149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f652bd-655b-44e5-8b07-bbafdc70b6a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:23.877961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f652bd-655b-44e5-8b07-bbafdc70b6a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:23.878467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f652bd-655b-44e5-8b07-bbafdc70b6a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:23.923602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:23.925078 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4f652bd-655b-44e5-8b07-bbafdc70b6a2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.060169 Dec 18 21:14:23.930538 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3161/6378] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:23 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:23.937996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-908852c9-02f8-4fd2-a9a4-0ac51cc666ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 200 len: 1569 microversion: 2.1 time: 0.219527 Dec 18 21:14:23.938635 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3218/6379] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:23 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:24.282906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1087d832-ccf6-4c0e-8887-8e9f07194a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:24.286358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1087d832-ccf6-4c0e-8887-8e9f07194a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:24.294667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1087d832-ccf6-4c0e-8887-8e9f07194a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:24.295370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1087d832-ccf6-4c0e-8887-8e9f07194a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:24.296481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1087d832-ccf6-4c0e-8887-8e9f07194a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:24.297874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1087d832-ccf6-4c0e-8887-8e9f07194a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:24.354798 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1087d832-ccf6-4c0e-8887-8e9f07194a40 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.206740 Dec 18 21:14:24.355720 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3162/6380] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:24 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:24.389094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-abc47bd3-193d-4126-b5ce-800fb922f745 req-625c6871-a23e-43b0-a48c-82ad9ff0370a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd7afd-a4da-4163-b4ac-245be65e705b", "name": "network-vif-deleted", "tag": "d142be73-0afd-4754-abd6-52096e5b45d3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:24.391048 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:14:24.391048 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:14:24.400928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-abc47bd3-193d-4126-b5ce-800fb922f745 req-625c6871-a23e-43b0-a48c-82ad9ff0370a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:24.401484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-abc47bd3-193d-4126-b5ce-800fb922f745 req-625c6871-a23e-43b0-a48c-82ad9ff0370a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:24.413581 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-abc47bd3-193d-4126-b5ce-800fb922f745 req-625c6871-a23e-43b0-a48c-82ad9ff0370a service nova] Creating event network-vif-deleted:d142be73-0afd-4754-abd6-52096e5b45d3 for instance d5bd7afd-a4da-4163-b4ac-245be65e705b on nch1-master-1 Dec 18 21:14:24.421514 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-abc47bd3-193d-4126-b5ce-800fb922f745 req-625c6871-a23e-43b0-a48c-82ad9ff0370a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036478 Dec 18 21:14:24.422525 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3219/6381] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:14:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:14:24.938919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a9e43979-ae5f-4cdf-a20c-9347ef6091bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:24.939967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a9e43979-ae5f-4cdf-a20c-9347ef6091bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:24.949142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9e43979-ae5f-4cdf-a20c-9347ef6091bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:24.949579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9e43979-ae5f-4cdf-a20c-9347ef6091bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:24.950575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9e43979-ae5f-4cdf-a20c-9347ef6091bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:24.951348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a9e43979-ae5f-4cdf-a20c-9347ef6091bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:24.957406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:24.958736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: d5bd7afd-a4da-4163-b4ac-245be65e705b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:24.965029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:24.965483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:24.966517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:24.966985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:24.983959 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] HTTP exception thrown: Instance d5bd7afd-a4da-4163-b4ac-245be65e705b could not be found. Dec 18 21:14:24.984582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Returning 404 to user: Instance d5bd7afd-a4da-4163-b4ac-245be65e705b could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:14:24.985542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f0f0b5c-d464-49ce-a63f-fcc58e94febc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b" status: 404 len: 111 microversion: 2.1 time: 0.033178 Dec 18 21:14:24.986103 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3220/6382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:24 2021] GET /compute/v2.1/servers/d5bd7afd-a4da-4163-b4ac-245be65e705b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:14:24.997491 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a9e43979-ae5f-4cdf-a20c-9347ef6091bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.062656 Dec 18 21:14:25.001462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3163/6383] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:24 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:25.366655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a693746-fa1c-4896-a079-8280aac86e95 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:25.367569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6a693746-fa1c-4896-a079-8280aac86e95 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:25.373651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a693746-fa1c-4896-a079-8280aac86e95 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:25.374105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a693746-fa1c-4896-a079-8280aac86e95 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:25.375048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a693746-fa1c-4896-a079-8280aac86e95 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:25.375483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a693746-fa1c-4896-a079-8280aac86e95 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:25.421283 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6a693746-fa1c-4896-a079-8280aac86e95 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.057849 Dec 18 21:14:25.422796 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3221/6384] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:25 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:26.010005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7383e9a2-dd32-4e76-bb5f-cbeb3f802abe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:26.011060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7383e9a2-dd32-4e76-bb5f-cbeb3f802abe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:26.018564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7383e9a2-dd32-4e76-bb5f-cbeb3f802abe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:26.019031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7383e9a2-dd32-4e76-bb5f-cbeb3f802abe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:26.019854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7383e9a2-dd32-4e76-bb5f-cbeb3f802abe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:26.020312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7383e9a2-dd32-4e76-bb5f-cbeb3f802abe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:26.087290 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7383e9a2-dd32-4e76-bb5f-cbeb3f802abe tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.080895 Dec 18 21:14:26.089207 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3164/6385] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:26 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:26.438954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4dcd686e-5ebd-44d5-93ea-d7f91f5d91a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:26.440572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4dcd686e-5ebd-44d5-93ea-d7f91f5d91a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:26.450076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcd686e-5ebd-44d5-93ea-d7f91f5d91a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:26.450687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcd686e-5ebd-44d5-93ea-d7f91f5d91a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:26.451687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcd686e-5ebd-44d5-93ea-d7f91f5d91a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:26.452148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dcd686e-5ebd-44d5-93ea-d7f91f5d91a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:26.501527 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4dcd686e-5ebd-44d5-93ea-d7f91f5d91a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.068439 Dec 18 21:14:26.502840 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3222/6386] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:26 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:27.102909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b5904b8-a253-411e-bd2b-0ee093037408 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:27.104973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b5904b8-a253-411e-bd2b-0ee093037408 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:27.116207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5904b8-a253-411e-bd2b-0ee093037408 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:27.117058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5904b8-a253-411e-bd2b-0ee093037408 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:27.118644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5904b8-a253-411e-bd2b-0ee093037408 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:27.119465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b5904b8-a253-411e-bd2b-0ee093037408 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:27.208283 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b5904b8-a253-411e-bd2b-0ee093037408 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.112171 Dec 18 21:14:27.209999 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3165/6387] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:27 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:27.521088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c019786b-a669-490a-ba0e-926f8bb1aa45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:27.522783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c019786b-a669-490a-ba0e-926f8bb1aa45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:27.535091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c019786b-a669-490a-ba0e-926f8bb1aa45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:27.535874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c019786b-a669-490a-ba0e-926f8bb1aa45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:27.536849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c019786b-a669-490a-ba0e-926f8bb1aa45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:27.539607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c019786b-a669-490a-ba0e-926f8bb1aa45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:27.616348 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c019786b-a669-490a-ba0e-926f8bb1aa45 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.106641 Dec 18 21:14:27.617430 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3223/6388] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:27 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:28.220632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad339390-b995-4126-9eee-5c22701f88e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:28.221690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad339390-b995-4126-9eee-5c22701f88e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:28.230049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad339390-b995-4126-9eee-5c22701f88e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:28.230986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad339390-b995-4126-9eee-5c22701f88e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:28.231803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad339390-b995-4126-9eee-5c22701f88e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:28.232426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad339390-b995-4126-9eee-5c22701f88e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:28.282605 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad339390-b995-4126-9eee-5c22701f88e9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.065895 Dec 18 21:14:28.284314 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3166/6389] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:28 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:28.629488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d68cb19-83a6-4b8d-bcb0-19fda2e3365c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:28.630724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9d68cb19-83a6-4b8d-bcb0-19fda2e3365c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:28.645049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d68cb19-83a6-4b8d-bcb0-19fda2e3365c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:28.655217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d68cb19-83a6-4b8d-bcb0-19fda2e3365c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:28.658179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d68cb19-83a6-4b8d-bcb0-19fda2e3365c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:28.658558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d68cb19-83a6-4b8d-bcb0-19fda2e3365c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:28.745243 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d68cb19-83a6-4b8d-bcb0-19fda2e3365c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.119642 Dec 18 21:14:28.745943 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3224/6390] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:28 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:28.936178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6b9ec23-928e-4253-b93b-e53c2c90cbbd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '.version_select at 0x7f714fe57280>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:28.974016 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6b9ec23-928e-4253-b93b-e53c2c90cbbd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1629853471" status: 202 len: 0 microversion: 2.1 time: 0.041477 Dec 18 21:14:28.975841 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3167/6391] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Dec 18 21:14:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1629853471 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:29.028552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-950f091d-007b-44d1-bf9c-a8c7c4de262e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: .version_select at 0x7f714e4b9280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1417272746"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:29.058909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-950f091d-007b-44d1-bf9c-a8c7c4de262e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:14:29.067060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-950f091d-007b-44d1-bf9c-a8c7c4de262e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:14:29.294763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6885b8c4-695c-41e2-9b40-629da4466142 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:29.296942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6885b8c4-695c-41e2-9b40-629da4466142 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:29.305998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6885b8c4-695c-41e2-9b40-629da4466142 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:29.306793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6885b8c4-695c-41e2-9b40-629da4466142 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:29.307905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6885b8c4-695c-41e2-9b40-629da4466142 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:29.308541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6885b8c4-695c-41e2-9b40-629da4466142 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:29.367069 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6885b8c4-695c-41e2-9b40-629da4466142 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.075981 Dec 18 21:14:29.372612 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3168/6392] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:29 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:29.379797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-950f091d-007b-44d1-bf9c-a8c7c4de262e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:14:29.385745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-950f091d-007b-44d1-bf9c-a8c7c4de262e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:14:29.400966 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-950f091d-007b-44d1-bf9c-a8c7c4de262e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.395904 Dec 18 21:14:29.401968 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3225/6393] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:14:29 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:14:29.758795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-400ff59a-46de-4db8-b27e-faa8ef5cf32e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:29.759989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-400ff59a-46de-4db8-b27e-faa8ef5cf32e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:29.767677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-400ff59a-46de-4db8-b27e-faa8ef5cf32e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:29.768228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-400ff59a-46de-4db8-b27e-faa8ef5cf32e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:29.769122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-400ff59a-46de-4db8-b27e-faa8ef5cf32e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:29.769655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-400ff59a-46de-4db8-b27e-faa8ef5cf32e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:29.814472 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-400ff59a-46de-4db8-b27e-faa8ef5cf32e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.060712 Dec 18 21:14:29.815427 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3169/6394] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:29 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:30.380335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fb990b87-734c-45e2-8e32-a87309283cfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:30.381433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fb990b87-734c-45e2-8e32-a87309283cfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:30.388361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb990b87-734c-45e2-8e32-a87309283cfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:30.388889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb990b87-734c-45e2-8e32-a87309283cfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:30.389725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb990b87-734c-45e2-8e32-a87309283cfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:30.390335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb990b87-734c-45e2-8e32-a87309283cfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:30.451237 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fb990b87-734c-45e2-8e32-a87309283cfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.074431 Dec 18 21:14:30.452728 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3226/6395] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:30 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:30.829819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21c47772-e2cf-4149-bb20-55b523edd139 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:30.831646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-21c47772-e2cf-4149-bb20-55b523edd139 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:30.839844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21c47772-e2cf-4149-bb20-55b523edd139 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:30.840633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21c47772-e2cf-4149-bb20-55b523edd139 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:30.841636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21c47772-e2cf-4149-bb20-55b523edd139 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:30.843042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21c47772-e2cf-4149-bb20-55b523edd139 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:30.895800 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21c47772-e2cf-4149-bb20-55b523edd139 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.070019 Dec 18 21:14:30.901916 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3170/6396] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:30 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:31.466486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ae25e73-e3da-423c-8c70-557bcd5e3f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:31.467680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ae25e73-e3da-423c-8c70-557bcd5e3f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:31.478833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ae25e73-e3da-423c-8c70-557bcd5e3f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:31.479287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ae25e73-e3da-423c-8c70-557bcd5e3f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:31.480088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ae25e73-e3da-423c-8c70-557bcd5e3f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:31.480693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ae25e73-e3da-423c-8c70-557bcd5e3f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:31.532075 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ae25e73-e3da-423c-8c70-557bcd5e3f1b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.072162 Dec 18 21:14:31.532741 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3227/6397] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:31 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:31.911688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-30ad80e3-577e-4f3c-9fb4-cd4242228111 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:31.912842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-30ad80e3-577e-4f3c-9fb4-cd4242228111 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:31.922410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30ad80e3-577e-4f3c-9fb4-cd4242228111 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:31.923115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30ad80e3-577e-4f3c-9fb4-cd4242228111 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:31.924192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30ad80e3-577e-4f3c-9fb4-cd4242228111 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:31.924628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-30ad80e3-577e-4f3c-9fb4-cd4242228111 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:32.007828 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-30ad80e3-577e-4f3c-9fb4-cd4242228111 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.100754 Dec 18 21:14:32.008531 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3171/6398] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:31 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:32.549142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ee6b4a4-ad17-4d71-8758-abc39d5ee933 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:32.549917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ee6b4a4-ad17-4d71-8758-abc39d5ee933 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:32.557789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee6b4a4-ad17-4d71-8758-abc39d5ee933 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:32.558244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee6b4a4-ad17-4d71-8758-abc39d5ee933 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:32.559076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee6b4a4-ad17-4d71-8758-abc39d5ee933 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:32.559517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ee6b4a4-ad17-4d71-8758-abc39d5ee933 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:32.632632 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ee6b4a4-ad17-4d71-8758-abc39d5ee933 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.091754 Dec 18 21:14:32.637644 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3228/6399] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:32 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:33.020891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-40570693-f343-4ea8-bb11-8438949d323e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:33.022113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-40570693-f343-4ea8-bb11-8438949d323e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:33.032707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40570693-f343-4ea8-bb11-8438949d323e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:33.034056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40570693-f343-4ea8-bb11-8438949d323e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:33.035849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40570693-f343-4ea8-bb11-8438949d323e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:33.037215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-40570693-f343-4ea8-bb11-8438949d323e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:33.085167 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-40570693-f343-4ea8-bb11-8438949d323e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.068330 Dec 18 21:14:33.085939 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3172/6400] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:33 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:33.656536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-215e4c04-616b-4c86-8eb6-1973b010739b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:33.658286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-215e4c04-616b-4c86-8eb6-1973b010739b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:33.672303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-215e4c04-616b-4c86-8eb6-1973b010739b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:33.672813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-215e4c04-616b-4c86-8eb6-1973b010739b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:33.674559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-215e4c04-616b-4c86-8eb6-1973b010739b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:33.675070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-215e4c04-616b-4c86-8eb6-1973b010739b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:33.745740 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-215e4c04-616b-4c86-8eb6-1973b010739b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.096860 Dec 18 21:14:33.747134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3229/6401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:33 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:34.098400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a04a5d0-38c6-4e40-9706-91896968da6d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:34.100405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a04a5d0-38c6-4e40-9706-91896968da6d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:34.111228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a04a5d0-38c6-4e40-9706-91896968da6d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:34.111685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a04a5d0-38c6-4e40-9706-91896968da6d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:34.112705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a04a5d0-38c6-4e40-9706-91896968da6d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:34.113426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a04a5d0-38c6-4e40-9706-91896968da6d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:34.160523 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a04a5d0-38c6-4e40-9706-91896968da6d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.066049 Dec 18 21:14:34.161208 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3173/6402] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:34 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:34.760560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e9adada6-0ac5-40ca-acf9-e58b4e2af151 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:34.762595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e9adada6-0ac5-40ca-acf9-e58b4e2af151 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:34.772136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9adada6-0ac5-40ca-acf9-e58b4e2af151 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:34.772588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9adada6-0ac5-40ca-acf9-e58b4e2af151 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:34.773671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9adada6-0ac5-40ca-acf9-e58b4e2af151 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:34.774408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9adada6-0ac5-40ca-acf9-e58b4e2af151 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:34.831494 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e9adada6-0ac5-40ca-acf9-e58b4e2af151 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.075314 Dec 18 21:14:34.832842 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3230/6403] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:34 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:35.186921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ac4c330-bb8d-4614-b4f7-fdc3acbf1433 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:35.189693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3ac4c330-bb8d-4614-b4f7-fdc3acbf1433 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:35.199067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ac4c330-bb8d-4614-b4f7-fdc3acbf1433 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:35.199891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ac4c330-bb8d-4614-b4f7-fdc3acbf1433 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:35.200968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ac4c330-bb8d-4614-b4f7-fdc3acbf1433 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:35.201411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ac4c330-bb8d-4614-b4f7-fdc3acbf1433 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:35.253050 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3ac4c330-bb8d-4614-b4f7-fdc3acbf1433 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.082626 Dec 18 21:14:35.254277 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3174/6404] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:35 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:35.846497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-325db57e-3406-4b99-bd9d-54af5fd1a246 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:35.848247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-325db57e-3406-4b99-bd9d-54af5fd1a246 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:35.856279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-325db57e-3406-4b99-bd9d-54af5fd1a246 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:35.857012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-325db57e-3406-4b99-bd9d-54af5fd1a246 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:35.858072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-325db57e-3406-4b99-bd9d-54af5fd1a246 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:35.870953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-325db57e-3406-4b99-bd9d-54af5fd1a246 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:35.933426 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-325db57e-3406-4b99-bd9d-54af5fd1a246 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.090970 Dec 18 21:14:35.935062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3231/6405] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:35 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:36.265759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d54274ce-be6b-42a8-9060-d7f03bd53a85 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:36.266875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d54274ce-be6b-42a8-9060-d7f03bd53a85 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:36.280185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d54274ce-be6b-42a8-9060-d7f03bd53a85 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:36.280702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d54274ce-be6b-42a8-9060-d7f03bd53a85 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:36.281527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d54274ce-be6b-42a8-9060-d7f03bd53a85 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:36.281978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d54274ce-be6b-42a8-9060-d7f03bd53a85 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:36.355158 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d54274ce-be6b-42a8-9060-d7f03bd53a85 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.092819 Dec 18 21:14:36.356889 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3175/6406] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:36 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:36.950943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1954086a-06f4-41f3-8c93-cb662d41a90a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:36.952612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1954086a-06f4-41f3-8c93-cb662d41a90a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:36.969574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1954086a-06f4-41f3-8c93-cb662d41a90a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:36.975603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1954086a-06f4-41f3-8c93-cb662d41a90a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:36.978104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1954086a-06f4-41f3-8c93-cb662d41a90a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:36.979365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1954086a-06f4-41f3-8c93-cb662d41a90a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:37.076746 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1954086a-06f4-41f3-8c93-cb662d41a90a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.133667 Dec 18 21:14:37.078397 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3232/6407] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:36 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:37.376599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ecdbf594-45e8-4cb8-8275-fb79ca4ca77f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:37.383866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ecdbf594-45e8-4cb8-8275-fb79ca4ca77f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:37.404278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecdbf594-45e8-4cb8-8275-fb79ca4ca77f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:37.405071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecdbf594-45e8-4cb8-8275-fb79ca4ca77f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:37.406228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecdbf594-45e8-4cb8-8275-fb79ca4ca77f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:37.407315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ecdbf594-45e8-4cb8-8275-fb79ca4ca77f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:37.493607 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ecdbf594-45e8-4cb8-8275-fb79ca4ca77f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.128662 Dec 18 21:14:37.498078 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3176/6408] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:37 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:38.093136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-584ce1c7-f006-4755-8c45-1e221e349fb8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:38.094462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-584ce1c7-f006-4755-8c45-1e221e349fb8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:38.109715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-584ce1c7-f006-4755-8c45-1e221e349fb8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:38.110176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-584ce1c7-f006-4755-8c45-1e221e349fb8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:38.112216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-584ce1c7-f006-4755-8c45-1e221e349fb8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:38.112694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-584ce1c7-f006-4755-8c45-1e221e349fb8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:38.189002 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-584ce1c7-f006-4755-8c45-1e221e349fb8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.101460 Dec 18 21:14:38.190937 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3233/6409] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:38 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:38.307540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-603913918", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "fb5f496f-e8cb-4f55-bfa1-40a816271a86"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1417272746", "security_groups": [{"name": "tempest-secgroup-smoke-1420784252"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:38.508330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7bf9fdfc-b938-4bb6-af49-8d7fd254003c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:38.513323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7bf9fdfc-b938-4bb6-af49-8d7fd254003c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:38.524839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bf9fdfc-b938-4bb6-af49-8d7fd254003c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:38.524839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bf9fdfc-b938-4bb6-af49-8d7fd254003c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:38.524839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bf9fdfc-b938-4bb6-af49-8d7fd254003c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:38.525674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7bf9fdfc-b938-4bb6-af49-8d7fd254003c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:38.561916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] validate_networks() for [('fb5f496f-e8cb-4f55-bfa1-40a816271a86', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:14:38.638630 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7bf9fdfc-b938-4bb6-af49-8d7fd254003c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.136161 Dec 18 21:14:38.639339 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3234/6410] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:38 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:39.204434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31471365-7129-4184-a227-fe63028d6c1c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:39.206572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31471365-7129-4184-a227-fe63028d6c1c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:39.226972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31471365-7129-4184-a227-fe63028d6c1c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:39.229816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31471365-7129-4184-a227-fe63028d6c1c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:39.232626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31471365-7129-4184-a227-fe63028d6c1c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:39.234610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31471365-7129-4184-a227-fe63028d6c1c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:39.364405 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31471365-7129-4184-a227-fe63028d6c1c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.165687 Dec 18 21:14:39.365369 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3235/6411] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:39 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:39.468361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:14:39.469109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:14:39.470635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:14:39.471373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:14:39.472665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:14:39.516909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:39.519153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:39.521619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:39.522844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:39.564999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:14:39.581502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:14:39.624187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:14:39.630871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:14:39.652282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-36bc0b4b-7bac-45d2-9567-52923a07b02c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:39.663687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-36bc0b4b-7bac-45d2-9567-52923a07b02c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:39.700077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bc0b4b-7bac-45d2-9567-52923a07b02c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:39.700452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bc0b4b-7bac-45d2-9567-52923a07b02c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:39.701301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bc0b4b-7bac-45d2-9567-52923a07b02c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:39.707911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36bc0b4b-7bac-45d2-9567-52923a07b02c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:39.784801 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e467c60-aa9a-41b6-a14c-20936d38bbf7 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.482365 Dec 18 21:14:39.789598 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3177/6412] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:14:38 2021] POST /compute/v2.1/servers => generated 406 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:14:39.812718 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-36bc0b4b-7bac-45d2-9567-52923a07b02c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.164354 Dec 18 21:14:39.813010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9eb3e231-0a3b-4e91-a393-76fa07b4d57f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:39.814076 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3236/6413] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:39 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:39.815552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9eb3e231-0a3b-4e91-a393-76fa07b4d57f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:39.903774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9eb3e231-0a3b-4e91-a393-76fa07b4d57f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:39.920228 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9eb3e231-0a3b-4e91-a393-76fa07b4d57f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1266 microversion: 2.1 time: 0.123640 Dec 18 21:14:39.921568 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3178/6414] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:39 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:40.381115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80082e11-1141-432f-9431-d881930b5851 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:40.381939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80082e11-1141-432f-9431-d881930b5851 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:40.393787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80082e11-1141-432f-9431-d881930b5851 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:40.395197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80082e11-1141-432f-9431-d881930b5851 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:40.396648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80082e11-1141-432f-9431-d881930b5851 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:40.397088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80082e11-1141-432f-9431-d881930b5851 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:40.462635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80082e11-1141-432f-9431-d881930b5851 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.087284 Dec 18 21:14:40.464839 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3237/6415] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:40 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:40.827248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5e03097-1ba1-4d51-931c-962956898bb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:40.828275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e5e03097-1ba1-4d51-931c-962956898bb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:40.840239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5e03097-1ba1-4d51-931c-962956898bb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:40.840730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5e03097-1ba1-4d51-931c-962956898bb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:40.841574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5e03097-1ba1-4d51-931c-962956898bb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:40.842353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5e03097-1ba1-4d51-931c-962956898bb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:40.900182 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e5e03097-1ba1-4d51-931c-962956898bb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.078249 Dec 18 21:14:40.900820 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3179/6416] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:40 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:40.940934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:40.942426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:40.962148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:40.963163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:40.964179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:40.964710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:41.144814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:41.158009 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11f7c44a-df84-4c8c-8563-4a558198bb26 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1318 microversion: 2.1 time: 0.221804 Dec 18 21:14:41.159047 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3238/6417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:40 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:41.481006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fef90d27-5907-4655-b090-f5635da64e38 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:41.482682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fef90d27-5907-4655-b090-f5635da64e38 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:41.500565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fef90d27-5907-4655-b090-f5635da64e38 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:41.501377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fef90d27-5907-4655-b090-f5635da64e38 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:41.502762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fef90d27-5907-4655-b090-f5635da64e38 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:41.503679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fef90d27-5907-4655-b090-f5635da64e38 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:41.605089 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fef90d27-5907-4655-b090-f5635da64e38 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.131817 Dec 18 21:14:41.606453 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3180/6418] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:41 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:41.914549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e5193eb-eef6-4397-b101-2839ed6dec0b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:41.916433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e5193eb-eef6-4397-b101-2839ed6dec0b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:41.923837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e5193eb-eef6-4397-b101-2839ed6dec0b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:41.924483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e5193eb-eef6-4397-b101-2839ed6dec0b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:41.925631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e5193eb-eef6-4397-b101-2839ed6dec0b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:41.926358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e5193eb-eef6-4397-b101-2839ed6dec0b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:41.985877 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e5193eb-eef6-4397-b101-2839ed6dec0b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.076433 Dec 18 21:14:41.987215 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3239/6419] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:41 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:42.179376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:42.180170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:42.195248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:42.199913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:42.201619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:42.202214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:42.557427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:42.569717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c9079bcf-b7b0-4bfe-8f51-b5d20eb586ce tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1392 microversion: 2.1 time: 0.394649 Dec 18 21:14:42.570420 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3181/6420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:42 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1392 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:42.620904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d204cce-62fa-41d1-bc06-3cbe7e20bab7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:42.627944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d204cce-62fa-41d1-bc06-3cbe7e20bab7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:42.656153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d204cce-62fa-41d1-bc06-3cbe7e20bab7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:42.656759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d204cce-62fa-41d1-bc06-3cbe7e20bab7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:42.658354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d204cce-62fa-41d1-bc06-3cbe7e20bab7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:42.658964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d204cce-62fa-41d1-bc06-3cbe7e20bab7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:42.756827 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d204cce-62fa-41d1-bc06-3cbe7e20bab7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.140039 Dec 18 21:14:42.768666 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3240/6421] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:42 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:42.999046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3d6791a-e145-48b1-83b0-5d92670ee473 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:43.000213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f3d6791a-e145-48b1-83b0-5d92670ee473 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:43.014525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d6791a-e145-48b1-83b0-5d92670ee473 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:43.015539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d6791a-e145-48b1-83b0-5d92670ee473 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:43.021390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d6791a-e145-48b1-83b0-5d92670ee473 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:43.022495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3d6791a-e145-48b1-83b0-5d92670ee473 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:43.116910 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3d6791a-e145-48b1-83b0-5d92670ee473 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.121886 Dec 18 21:14:43.123233 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3182/6422] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:42 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:43.630616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-538e3efd-7d91-4ff1-9034-1e4ba6b75d2f req-3461fed8-6cd7-4cc5-ba9c-9d03f58f3e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:43.632813 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:14:43.632813 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:14:43.647984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-538e3efd-7d91-4ff1-9034-1e4ba6b75d2f req-3461fed8-6cd7-4cc5-ba9c-9d03f58f3e13 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:43.648725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-538e3efd-7d91-4ff1-9034-1e4ba6b75d2f req-3461fed8-6cd7-4cc5-ba9c-9d03f58f3e13 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:43.665205 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-538e3efd-7d91-4ff1-9034-1e4ba6b75d2f req-3461fed8-6cd7-4cc5-ba9c-9d03f58f3e13 service nova] Creating event network-changed:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch1-master-1 Dec 18 21:14:43.670411 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-538e3efd-7d91-4ff1-9034-1e4ba6b75d2f req-3461fed8-6cd7-4cc5-ba9c-9d03f58f3e13 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043807 Dec 18 21:14:43.671648 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3183/6423] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:14:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:14:43.759241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:43.761335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:43.775104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:43.775551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:43.776358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:43.777295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-708d9d1a-d690-4d77-a333-3529e512939a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:43.778745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-708d9d1a-d690-4d77-a333-3529e512939a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:43.779565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:43.786368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-708d9d1a-d690-4d77-a333-3529e512939a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:43.787158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-708d9d1a-d690-4d77-a333-3529e512939a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:43.788699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-708d9d1a-d690-4d77-a333-3529e512939a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:43.789355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-708d9d1a-d690-4d77-a333-3529e512939a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:43.877555 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-708d9d1a-d690-4d77-a333-3529e512939a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.106320 Dec 18 21:14:43.878701 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3184/6424] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:43 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:44.142718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:44.153995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5cdd8790-41f5-4f01-9c62-97b8ca7e2e80 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:44.160184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5cdd8790-41f5-4f01-9c62-97b8ca7e2e80 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:44.164561 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2faecb87-5855-4703-9cdf-d20d1b455d5f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1392 microversion: 2.1 time: 0.579814 Dec 18 21:14:44.166083 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3241/6425] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:43 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1392 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:44.180729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdd8790-41f5-4f01-9c62-97b8ca7e2e80 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:44.181891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdd8790-41f5-4f01-9c62-97b8ca7e2e80 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:44.183293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdd8790-41f5-4f01-9c62-97b8ca7e2e80 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:44.184116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5cdd8790-41f5-4f01-9c62-97b8ca7e2e80 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:44.230548 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5cdd8790-41f5-4f01-9c62-97b8ca7e2e80 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.097867 Dec 18 21:14:44.231907 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3185/6426] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:44 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:44.891124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9a75f94c-1a0c-4c2c-8abd-93fc030ea3e4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:44.892247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9a75f94c-1a0c-4c2c-8abd-93fc030ea3e4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:44.908023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a75f94c-1a0c-4c2c-8abd-93fc030ea3e4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:44.908862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a75f94c-1a0c-4c2c-8abd-93fc030ea3e4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:44.910895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a75f94c-1a0c-4c2c-8abd-93fc030ea3e4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:44.912403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9a75f94c-1a0c-4c2c-8abd-93fc030ea3e4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:44.980210 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9a75f94c-1a0c-4c2c-8abd-93fc030ea3e4 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.091859 Dec 18 21:14:44.981858 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3242/6427] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:44 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:45.185458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:45.186202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:45.195141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:45.195892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:45.196713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:45.197687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:45.243808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ed032b2f-bba2-478b-9f20-6fbc2f245c7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:45.244817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ed032b2f-bba2-478b-9f20-6fbc2f245c7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:45.254193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed032b2f-bba2-478b-9f20-6fbc2f245c7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:45.254998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed032b2f-bba2-478b-9f20-6fbc2f245c7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:45.255981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed032b2f-bba2-478b-9f20-6fbc2f245c7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:45.256591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ed032b2f-bba2-478b-9f20-6fbc2f245c7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:45.306858 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ed032b2f-bba2-478b-9f20-6fbc2f245c7b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.067063 Dec 18 21:14:45.307568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3243/6428] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:45 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:45.381993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:45.391900 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5e82537-483b-4c3e-bb54-4f2acd9f3ac3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1392 microversion: 2.1 time: 0.210428 Dec 18 21:14:45.399230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3186/6429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:45 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:45.993435 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c155c1a-1d3b-4d96-b081-09968b7b6716 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:45.995270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c155c1a-1d3b-4d96-b081-09968b7b6716 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:46.003571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c155c1a-1d3b-4d96-b081-09968b7b6716 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:46.004309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c155c1a-1d3b-4d96-b081-09968b7b6716 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:46.005518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c155c1a-1d3b-4d96-b081-09968b7b6716 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:46.006174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c155c1a-1d3b-4d96-b081-09968b7b6716 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:46.089466 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c155c1a-1d3b-4d96-b081-09968b7b6716 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.100087 Dec 18 21:14:46.090569 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3244/6430] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:45 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:46.321847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8feff103-932e-46fd-b98b-cd6dacae8e0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:46.322837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8feff103-932e-46fd-b98b-cd6dacae8e0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:46.331028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8feff103-932e-46fd-b98b-cd6dacae8e0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:46.331983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8feff103-932e-46fd-b98b-cd6dacae8e0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:46.333953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8feff103-932e-46fd-b98b-cd6dacae8e0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:46.334347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8feff103-932e-46fd-b98b-cd6dacae8e0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:46.387236 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8feff103-932e-46fd-b98b-cd6dacae8e0d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.070452 Dec 18 21:14:46.389354 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3187/6431] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:46 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:46.412012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:46.412764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:46.421499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:46.421967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:46.423040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:46.423749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:46.651721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:46.660754 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ca281ccc-5c1f-4dc5-88e6-4acdf7ecf675 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1392 microversion: 2.1 time: 0.254210 Dec 18 21:14:46.662357 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3245/6432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:46 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:47.102204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93d255bc-fcb4-4589-a3f0-7cf3112ed31b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:47.103336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93d255bc-fcb4-4589-a3f0-7cf3112ed31b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:47.110773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d255bc-fcb4-4589-a3f0-7cf3112ed31b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:47.111601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d255bc-fcb4-4589-a3f0-7cf3112ed31b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:47.112743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d255bc-fcb4-4589-a3f0-7cf3112ed31b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:47.113267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d255bc-fcb4-4589-a3f0-7cf3112ed31b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:47.158201 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93d255bc-fcb4-4589-a3f0-7cf3112ed31b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.060017 Dec 18 21:14:47.162374 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3188/6433] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:47 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:47.405095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a6414de4-be80-45b8-af72-377077d8084d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:47.410620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a6414de4-be80-45b8-af72-377077d8084d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:47.423707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6414de4-be80-45b8-af72-377077d8084d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:47.426211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6414de4-be80-45b8-af72-377077d8084d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:47.427718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6414de4-be80-45b8-af72-377077d8084d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:47.428168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6414de4-be80-45b8-af72-377077d8084d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:47.487262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a6414de4-be80-45b8-af72-377077d8084d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.090071 Dec 18 21:14:47.488559 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3246/6434] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:47 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:47.681220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:47.682038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:47.690045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:47.690859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:47.692117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:47.693331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:47.856633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:47.864963 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7fdaa9f-ff7c-47ab-aa2a-d38945d20fb2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1392 microversion: 2.1 time: 0.188395 Dec 18 21:14:47.865536 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3189/6435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:47 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:48.171467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-29c7f5f2-81d6-48ae-8742-aa8747263b72 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:48.172483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-29c7f5f2-81d6-48ae-8742-aa8747263b72 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:48.184804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c7f5f2-81d6-48ae-8742-aa8747263b72 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:48.185292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c7f5f2-81d6-48ae-8742-aa8747263b72 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:48.186100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c7f5f2-81d6-48ae-8742-aa8747263b72 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:48.186621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-29c7f5f2-81d6-48ae-8742-aa8747263b72 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:48.241013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-29c7f5f2-81d6-48ae-8742-aa8747263b72 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.073742 Dec 18 21:14:48.242156 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3247/6436] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:48 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:48.501608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2aecece3-fe50-4a33-96f5-0f3017749324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:48.502974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2aecece3-fe50-4a33-96f5-0f3017749324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:48.510711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2aecece3-fe50-4a33-96f5-0f3017749324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:48.511471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2aecece3-fe50-4a33-96f5-0f3017749324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:48.512301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2aecece3-fe50-4a33-96f5-0f3017749324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:48.512743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2aecece3-fe50-4a33-96f5-0f3017749324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:48.571858 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2aecece3-fe50-4a33-96f5-0f3017749324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.074178 Dec 18 21:14:48.574679 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3190/6437] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:48 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:48.884127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:48.886165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:48.900582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:48.902320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:48.903334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:48.904021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:49.039049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f8ec32a7-79d0-4faa-a59f-8e8668c41cbc req-c0f0e6ea-bbb0-49e1-98fc-123882db0c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "name": "network-vif-plugged", "status": "completed", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:49.041616 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:14:49.041616 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:14:49.050862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f8ec32a7-79d0-4faa-a59f-8e8668c41cbc req-c0f0e6ea-bbb0-49e1-98fc-123882db0c84 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:49.051337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f8ec32a7-79d0-4faa-a59f-8e8668c41cbc req-c0f0e6ea-bbb0-49e1-98fc-123882db0c84 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:49.065092 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f8ec32a7-79d0-4faa-a59f-8e8668c41cbc req-c0f0e6ea-bbb0-49e1-98fc-123882db0c84 service nova] Creating event network-vif-plugged:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch1-master-1 Dec 18 21:14:49.072136 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f8ec32a7-79d0-4faa-a59f-8e8668c41cbc req-c0f0e6ea-bbb0-49e1-98fc-123882db0c84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Dec 18 21:14:49.073853 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3191/6438] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:14:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:14:49.186605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:49.204165 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d8213e6-9215-4dc4-b8ef-25326b2467b2 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1392 microversion: 2.1 time: 0.326145 Dec 18 21:14:49.216423 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3248/6439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:48 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1392 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:49.255410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d43bc830-98bc-4eca-a937-2ebaa1df486c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:49.257424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d43bc830-98bc-4eca-a937-2ebaa1df486c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:49.265488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d43bc830-98bc-4eca-a937-2ebaa1df486c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:49.266218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d43bc830-98bc-4eca-a937-2ebaa1df486c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:49.267249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d43bc830-98bc-4eca-a937-2ebaa1df486c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:49.267867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d43bc830-98bc-4eca-a937-2ebaa1df486c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:49.491092 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d43bc830-98bc-4eca-a937-2ebaa1df486c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.240973 Dec 18 21:14:49.491760 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3192/6440] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:49 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:49.583800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-02da7c3c-8b46-443b-9fd4-387d75d0c755 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:49.584939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-02da7c3c-8b46-443b-9fd4-387d75d0c755 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:49.591835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02da7c3c-8b46-443b-9fd4-387d75d0c755 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:49.592418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02da7c3c-8b46-443b-9fd4-387d75d0c755 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:49.593210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02da7c3c-8b46-443b-9fd4-387d75d0c755 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:49.593681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-02da7c3c-8b46-443b-9fd4-387d75d0c755 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:49.643679 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-02da7c3c-8b46-443b-9fd4-387d75d0c755 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.064033 Dec 18 21:14:49.647850 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3249/6441] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:49 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:50.223985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:50.225016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:50.235261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:50.235953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:50.236865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:50.237315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:50.504075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c82bc046-f57f-4626-87b0-bbe90d3c8478 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:50.506564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c82bc046-f57f-4626-87b0-bbe90d3c8478 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:50.519737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82bc046-f57f-4626-87b0-bbe90d3c8478 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:50.520543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82bc046-f57f-4626-87b0-bbe90d3c8478 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:50.521533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82bc046-f57f-4626-87b0-bbe90d3c8478 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:50.522149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c82bc046-f57f-4626-87b0-bbe90d3c8478 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:50.572940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:50.583478 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c82bc046-f57f-4626-87b0-bbe90d3c8478 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.083669 Dec 18 21:14:50.584153 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3250/6442] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:50 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:50.585096 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5de4c058-904a-400f-88ac-d3124ddfc31b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1392 microversion: 2.1 time: 0.365111 Dec 18 21:14:50.592218 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3193/6443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:50 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1392 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:50.656841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2f1f95e8-c641-4455-a717-90231842abf8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:50.658311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2f1f95e8-c641-4455-a717-90231842abf8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:50.669129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f1f95e8-c641-4455-a717-90231842abf8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:50.669686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f1f95e8-c641-4455-a717-90231842abf8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:50.670609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f1f95e8-c641-4455-a717-90231842abf8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:50.671282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2f1f95e8-c641-4455-a717-90231842abf8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:50.720762 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2f1f95e8-c641-4455-a717-90231842abf8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.068213 Dec 18 21:14:50.722123 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3251/6444] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:50 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:51.595456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d50d46fa-8b9d-42b8-99ad-986a329b0d85 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:51.597113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d50d46fa-8b9d-42b8-99ad-986a329b0d85 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:51.604187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:51.604893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:51.608008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d50d46fa-8b9d-42b8-99ad-986a329b0d85 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.608724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d50d46fa-8b9d-42b8-99ad-986a329b0d85 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:51.609758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d50d46fa-8b9d-42b8-99ad-986a329b0d85 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.611088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d50d46fa-8b9d-42b8-99ad-986a329b0d85 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:51.617558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.618029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:51.618874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.619697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:51.666097 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d50d46fa-8b9d-42b8-99ad-986a329b0d85 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.074257 Dec 18 21:14:51.667034 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3194/6445] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:51 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:51.733519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaf240b8-8c93-4378-994b-f0d3a94d17c0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:51.734591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaf240b8-8c93-4378-994b-f0d3a94d17c0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:51.742399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaf240b8-8c93-4378-994b-f0d3a94d17c0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.742864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaf240b8-8c93-4378-994b-f0d3a94d17c0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:51.743669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaf240b8-8c93-4378-994b-f0d3a94d17c0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.744118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaf240b8-8c93-4378-994b-f0d3a94d17c0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:51.784747 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaf240b8-8c93-4378-994b-f0d3a94d17c0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.055272 Dec 18 21:14:51.786584 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3195/6446] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:51 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:51.920363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:51.928825 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1ac568e7-353c-41c5-9607-e6215c637097 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1562 microversion: 2.1 time: 0.330549 Dec 18 21:14:51.929688 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3252/6447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:51 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1562 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:51.950898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:51.952287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:51.960899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.961370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:51.962208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:51.962697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:52.235638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:52.243181 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26936c87-e611-4086-8edf-736052fce70b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1562 microversion: 2.1 time: 0.297855 Dec 18 21:14:52.243855 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3196/6448] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:51 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1562 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:14:52.678887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-020104a6-31a5-46c0-aaca-fcd6d4e43b5f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:52.682427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-020104a6-31a5-46c0-aaca-fcd6d4e43b5f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:52.701730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-020104a6-31a5-46c0-aaca-fcd6d4e43b5f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:52.703721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-020104a6-31a5-46c0-aaca-fcd6d4e43b5f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:52.704513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-020104a6-31a5-46c0-aaca-fcd6d4e43b5f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:52.704969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-020104a6-31a5-46c0-aaca-fcd6d4e43b5f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:52.775183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-020104a6-31a5-46c0-aaca-fcd6d4e43b5f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.101088 Dec 18 21:14:52.776164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3253/6449] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:52 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:52.801504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-01e76b6c-e675-4f2d-8dfe-0b27aec449ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:52.803912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-01e76b6c-e675-4f2d-8dfe-0b27aec449ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:52.819237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01e76b6c-e675-4f2d-8dfe-0b27aec449ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:52.819785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01e76b6c-e675-4f2d-8dfe-0b27aec449ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:52.820760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01e76b6c-e675-4f2d-8dfe-0b27aec449ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:52.821498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-01e76b6c-e675-4f2d-8dfe-0b27aec449ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:52.884979 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-01e76b6c-e675-4f2d-8dfe-0b27aec449ee tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.090912 Dec 18 21:14:52.889739 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3197/6450] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:52 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:53.786826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81c8d52b-cc52-4829-a9dc-b988cc07b0db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:53.788425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81c8d52b-cc52-4829-a9dc-b988cc07b0db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:53.795803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81c8d52b-cc52-4829-a9dc-b988cc07b0db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:53.796633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81c8d52b-cc52-4829-a9dc-b988cc07b0db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:53.797738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81c8d52b-cc52-4829-a9dc-b988cc07b0db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:53.798423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81c8d52b-cc52-4829-a9dc-b988cc07b0db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:53.841112 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81c8d52b-cc52-4829-a9dc-b988cc07b0db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.058055 Dec 18 21:14:53.842552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3254/6451] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:53 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:53.898893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed98ea4e-5215-4107-b8e3-4edc55d498bf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:53.900243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed98ea4e-5215-4107-b8e3-4edc55d498bf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:53.908061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed98ea4e-5215-4107-b8e3-4edc55d498bf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:53.908526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed98ea4e-5215-4107-b8e3-4edc55d498bf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:53.909685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed98ea4e-5215-4107-b8e3-4edc55d498bf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:53.910147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed98ea4e-5215-4107-b8e3-4edc55d498bf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:53.958906 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed98ea4e-5215-4107-b8e3-4edc55d498bf tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.064529 Dec 18 21:14:53.959673 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3198/6452] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:53 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:54.641475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:14:54.642487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:54.655348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:54.656075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:54.656980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:54.657515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:54.659697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-42551784-6cb6-497d-a877-ec3dba7cbe76 req-2a35fd3f-bfc0-4786-8b34-6740cb1eb2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:54.662101 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:14:54.662101 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:14:54.692744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-42551784-6cb6-497d-a877-ec3dba7cbe76 req-2a35fd3f-bfc0-4786-8b34-6740cb1eb2ad service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:54.693433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-42551784-6cb6-497d-a877-ec3dba7cbe76 req-2a35fd3f-bfc0-4786-8b34-6740cb1eb2ad service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:54.710767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-42551784-6cb6-497d-a877-ec3dba7cbe76 req-2a35fd3f-bfc0-4786-8b34-6740cb1eb2ad service nova] Creating event network-changed:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch1-master-1 Dec 18 21:14:54.726774 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-42551784-6cb6-497d-a877-ec3dba7cbe76 req-2a35fd3f-bfc0-4786-8b34-6740cb1eb2ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071809 Dec 18 21:14:54.737525 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3199/6453] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:14:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:14:54.854727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f458595d-f016-40fb-ac58-126ed28e9af8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:54.855738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f458595d-f016-40fb-ac58-126ed28e9af8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:54.865072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f458595d-f016-40fb-ac58-126ed28e9af8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:54.865820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f458595d-f016-40fb-ac58-126ed28e9af8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:54.867251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f458595d-f016-40fb-ac58-126ed28e9af8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:54.867939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f458595d-f016-40fb-ac58-126ed28e9af8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:54.931669 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f458595d-f016-40fb-ac58-126ed28e9af8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.081113 Dec 18 21:14:54.932742 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3200/6454] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:54 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:14:54.971743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-570982ff-98a6-4fb0-b042-e6510ccb50e7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:54.974038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-570982ff-98a6-4fb0-b042-e6510ccb50e7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:54.981383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570982ff-98a6-4fb0-b042-e6510ccb50e7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:54.982641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570982ff-98a6-4fb0-b042-e6510ccb50e7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:54.983696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570982ff-98a6-4fb0-b042-e6510ccb50e7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:54.984491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570982ff-98a6-4fb0-b042-e6510ccb50e7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:55.037646 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-570982ff-98a6-4fb0-b042-e6510ccb50e7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.068272 Dec 18 21:14:55.039138 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3201/6455] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:54 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:55.114345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:14:55.125815 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0218551b-c5a7-45b4-8d19-faa11f15fb6d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1562 microversion: 2.1 time: 0.488596 Dec 18 21:14:55.137836 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3255/6456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:14:54 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1562 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:14:55.955916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-997f271c-22d3-45e7-9894-2863f8df2657 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:55.957022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-997f271c-22d3-45e7-9894-2863f8df2657 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:55.966997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997f271c-22d3-45e7-9894-2863f8df2657 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:55.976695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997f271c-22d3-45e7-9894-2863f8df2657 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:55.980399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997f271c-22d3-45e7-9894-2863f8df2657 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:55.981404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-997f271c-22d3-45e7-9894-2863f8df2657 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:56.049862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f59108f3-b427-4a06-87c1-58b68ad03a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:56.050824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f59108f3-b427-4a06-87c1-58b68ad03a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:56.052740 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-997f271c-22d3-45e7-9894-2863f8df2657 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.111322 Dec 18 21:14:56.058633 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3202/6457] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:55 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:56.062534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f59108f3-b427-4a06-87c1-58b68ad03a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:56.063342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f59108f3-b427-4a06-87c1-58b68ad03a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:56.064828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f59108f3-b427-4a06-87c1-58b68ad03a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:56.065280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f59108f3-b427-4a06-87c1-58b68ad03a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:56.127688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f59108f3-b427-4a06-87c1-58b68ad03a0c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.080658 Dec 18 21:14:56.129443 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3256/6458] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:56 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:57.079009 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74fc8a64-415a-4395-a0a9-7e65c4f974bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:57.080715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74fc8a64-415a-4395-a0a9-7e65c4f974bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:57.090182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74fc8a64-415a-4395-a0a9-7e65c4f974bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:57.091192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74fc8a64-415a-4395-a0a9-7e65c4f974bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:57.092150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74fc8a64-415a-4395-a0a9-7e65c4f974bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:57.092612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74fc8a64-415a-4395-a0a9-7e65c4f974bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:57.143302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b760150-edd7-4379-bd36-af1120506ad2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:57.144533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b760150-edd7-4379-bd36-af1120506ad2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:57.153234 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74fc8a64-415a-4395-a0a9-7e65c4f974bf tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.083366 Dec 18 21:14:57.154235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b760150-edd7-4379-bd36-af1120506ad2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:57.155179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b760150-edd7-4379-bd36-af1120506ad2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:57.156099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b760150-edd7-4379-bd36-af1120506ad2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:57.157381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b760150-edd7-4379-bd36-af1120506ad2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:57.159011 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3203/6459] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:57 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:57.205743 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b760150-edd7-4379-bd36-af1120506ad2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.067929 Dec 18 21:14:57.211190 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3257/6460] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:57 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:14:58.171598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f405ddac-65c1-4968-97c1-c26390dbb972 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:58.173282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f405ddac-65c1-4968-97c1-c26390dbb972 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:58.183771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f405ddac-65c1-4968-97c1-c26390dbb972 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:58.185438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f405ddac-65c1-4968-97c1-c26390dbb972 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:58.188473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f405ddac-65c1-4968-97c1-c26390dbb972 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:58.189437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f405ddac-65c1-4968-97c1-c26390dbb972 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:58.220335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1721d5ae-62fb-406d-9dfe-f48dd0500908 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:58.222585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1721d5ae-62fb-406d-9dfe-f48dd0500908 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:58.230565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1721d5ae-62fb-406d-9dfe-f48dd0500908 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:58.231573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1721d5ae-62fb-406d-9dfe-f48dd0500908 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:58.233106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1721d5ae-62fb-406d-9dfe-f48dd0500908 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:58.235478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1721d5ae-62fb-406d-9dfe-f48dd0500908 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:58.263384 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f405ddac-65c1-4968-97c1-c26390dbb972 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.100392 Dec 18 21:14:58.267528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3204/6461] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:58 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:58.292064 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1721d5ae-62fb-406d-9dfe-f48dd0500908 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.076184 Dec 18 21:14:58.292795 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3258/6462] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:58 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:14:59.118299 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:14:59.119139 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:14:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:14:59.277383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4276e2d7-ac7e-4280-abae-fdb26e2e84db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:59.279019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4276e2d7-ac7e-4280-abae-fdb26e2e84db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:59.296594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4276e2d7-ac7e-4280-abae-fdb26e2e84db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:59.297269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4276e2d7-ac7e-4280-abae-fdb26e2e84db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:59.298535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4276e2d7-ac7e-4280-abae-fdb26e2e84db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:59.299325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4276e2d7-ac7e-4280-abae-fdb26e2e84db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:59.305604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-861403d1-36f2-4c45-a9dd-a0d062b8a41b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:14:59.306811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-861403d1-36f2-4c45-a9dd-a0d062b8a41b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:14:59.318188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-861403d1-36f2-4c45-a9dd-a0d062b8a41b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:59.318620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-861403d1-36f2-4c45-a9dd-a0d062b8a41b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:59.319528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-861403d1-36f2-4c45-a9dd-a0d062b8a41b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:14:59.319974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-861403d1-36f2-4c45-a9dd-a0d062b8a41b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:14:59.357441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4276e2d7-ac7e-4280-abae-fdb26e2e84db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.084518 Dec 18 21:14:59.362276 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3205/6463] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:14:59 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:14:59.375736 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-861403d1-36f2-4c45-a9dd-a0d062b8a41b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.074993 Dec 18 21:14:59.376683 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3259/6464] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:14:59 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:00.375448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-657d4aec-5511-4ea2-8027-ea9c92c2ae2a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:00.376480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-657d4aec-5511-4ea2-8027-ea9c92c2ae2a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:00.383915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657d4aec-5511-4ea2-8027-ea9c92c2ae2a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:00.384374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657d4aec-5511-4ea2-8027-ea9c92c2ae2a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:00.385186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657d4aec-5511-4ea2-8027-ea9c92c2ae2a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:00.385646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657d4aec-5511-4ea2-8027-ea9c92c2ae2a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:00.388956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-285c87f3-36a1-4dd7-ae71-bf19df77e46c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:00.390928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-285c87f3-36a1-4dd7-ae71-bf19df77e46c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:00.397598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285c87f3-36a1-4dd7-ae71-bf19df77e46c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:00.398314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285c87f3-36a1-4dd7-ae71-bf19df77e46c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:00.399340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285c87f3-36a1-4dd7-ae71-bf19df77e46c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:00.399782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285c87f3-36a1-4dd7-ae71-bf19df77e46c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:00.454891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-285c87f3-36a1-4dd7-ae71-bf19df77e46c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.069555 Dec 18 21:15:00.455734 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3260/6465] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:15:00 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:15:00.468614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-657d4aec-5511-4ea2-8027-ea9c92c2ae2a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.095834 Dec 18 21:15:00.472195 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3206/6466] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:00 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:01.467533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b67fd147-a56d-408a-8ccb-a5005c13942b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:01.469310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b67fd147-a56d-408a-8ccb-a5005c13942b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:01.483009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b67fd147-a56d-408a-8ccb-a5005c13942b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:01.484350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b4facec-85fe-40db-b046-eb16f7dae7f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:01.484861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b67fd147-a56d-408a-8ccb-a5005c13942b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:01.485375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b67fd147-a56d-408a-8ccb-a5005c13942b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:01.485918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b67fd147-a56d-408a-8ccb-a5005c13942b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:01.486569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b4facec-85fe-40db-b046-eb16f7dae7f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:01.495572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4facec-85fe-40db-b046-eb16f7dae7f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:01.496337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4facec-85fe-40db-b046-eb16f7dae7f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:01.497567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4facec-85fe-40db-b046-eb16f7dae7f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:01.498198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b4facec-85fe-40db-b046-eb16f7dae7f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:01.542433 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b4facec-85fe-40db-b046-eb16f7dae7f9 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.062675 Dec 18 21:15:01.550477 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3207/6467] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:01 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:01.552034 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b67fd147-a56d-408a-8ccb-a5005c13942b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.087817 Dec 18 21:15:01.552694 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3261/6468] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:15:01 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:02.555356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-856e15d5-7527-4a7e-b89d-80cf4f7baf24 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:02.557133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-856e15d5-7527-4a7e-b89d-80cf4f7baf24 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:02.564721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fbc1727b-b2db-43fd-8e59-505d854bcd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:02.566890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fbc1727b-b2db-43fd-8e59-505d854bcd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:02.581000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856e15d5-7527-4a7e-b89d-80cf4f7baf24 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:02.581937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc1727b-b2db-43fd-8e59-505d854bcd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:02.583499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856e15d5-7527-4a7e-b89d-80cf4f7baf24 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:02.584474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc1727b-b2db-43fd-8e59-505d854bcd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:02.585227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc1727b-b2db-43fd-8e59-505d854bcd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:02.586276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856e15d5-7527-4a7e-b89d-80cf4f7baf24 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:02.586895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbc1727b-b2db-43fd-8e59-505d854bcd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:02.590070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856e15d5-7527-4a7e-b89d-80cf4f7baf24 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:02.665152 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fbc1727b-b2db-43fd-8e59-505d854bcd61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.104609 Dec 18 21:15:02.665859 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3262/6469] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:15:02 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:02.672221 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-856e15d5-7527-4a7e-b89d-80cf4f7baf24 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.121755 Dec 18 21:15:02.673481 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3208/6470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:02 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:03.678601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5d4f395d-eeaf-4ce3-9e4d-99d6e57b0e28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:03.680193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5d4f395d-eeaf-4ce3-9e4d-99d6e57b0e28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:03.685260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa6b423e-e6ca-4247-bd3f-7e5466e4417e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:03.686275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa6b423e-e6ca-4247-bd3f-7e5466e4417e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:03.688830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d4f395d-eeaf-4ce3-9e4d-99d6e57b0e28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:03.689491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d4f395d-eeaf-4ce3-9e4d-99d6e57b0e28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:03.690502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d4f395d-eeaf-4ce3-9e4d-99d6e57b0e28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:03.690945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5d4f395d-eeaf-4ce3-9e4d-99d6e57b0e28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:03.695004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6b423e-e6ca-4247-bd3f-7e5466e4417e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:03.695472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6b423e-e6ca-4247-bd3f-7e5466e4417e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:03.702072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6b423e-e6ca-4247-bd3f-7e5466e4417e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:03.702789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa6b423e-e6ca-4247-bd3f-7e5466e4417e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:03.742839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5d4f395d-eeaf-4ce3-9e4d-99d6e57b0e28 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 32588 microversion: 2.20 time: 0.068219 Dec 18 21:15:03.744445 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3263/6471] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:15:03 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 32588 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:03.761826 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa6b423e-e6ca-4247-bd3f-7e5466e4417e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.080752 Dec 18 21:15:03.765805 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3209/6472] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:03 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:15:04.755857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dd94d056-4c00-4582-90de-6f3502f855d3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:04.757651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dd94d056-4c00-4582-90de-6f3502f855d3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:04.768988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd94d056-4c00-4582-90de-6f3502f855d3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:04.769609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd94d056-4c00-4582-90de-6f3502f855d3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:04.776598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a981f291-2c85-4538-a0ad-4f2e1fb52182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:04.778347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a981f291-2c85-4538-a0ad-4f2e1fb52182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:04.780707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd94d056-4c00-4582-90de-6f3502f855d3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:04.781562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dd94d056-4c00-4582-90de-6f3502f855d3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:04.787696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a981f291-2c85-4538-a0ad-4f2e1fb52182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:04.788259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a981f291-2c85-4538-a0ad-4f2e1fb52182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:04.789321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a981f291-2c85-4538-a0ad-4f2e1fb52182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:04.789962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a981f291-2c85-4538-a0ad-4f2e1fb52182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:04.854630 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dd94d056-4c00-4582-90de-6f3502f855d3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 200 len: 40737 microversion: 2.20 time: 0.103657 Dec 18 21:15:04.856712 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3264/6473] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:15:04 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 40737 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:04.866377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a981f291-2c85-4538-a0ad-4f2e1fb52182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.094429 Dec 18 21:15:04.870966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-80986c70-c19e-4d9e-9b80-6d5948dd21c2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:04.871420 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3210/6474] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:04 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:04.872247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-80986c70-c19e-4d9e-9b80-6d5948dd21c2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:04.880474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80986c70-c19e-4d9e-9b80-6d5948dd21c2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:04.881203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80986c70-c19e-4d9e-9b80-6d5948dd21c2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:04.882014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80986c70-c19e-4d9e-9b80-6d5948dd21c2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:04.882819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-80986c70-c19e-4d9e-9b80-6d5948dd21c2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:04.910902 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-80986c70-c19e-4d9e-9b80-6d5948dd21c2 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/ips" status: 200 len: 150 microversion: 2.20 time: 0.047271 Dec 18 21:15:04.911823 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3265/6475] 10.222.0.13 () {60 vars in 1288 bytes} [Sat Dec 18 21:15:04 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:05.880652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e97990f-c8de-4509-9176-1fdc9054459d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:05.881685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e97990f-c8de-4509-9176-1fdc9054459d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:05.889499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e97990f-c8de-4509-9176-1fdc9054459d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:05.890219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e97990f-c8de-4509-9176-1fdc9054459d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:05.891288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e97990f-c8de-4509-9176-1fdc9054459d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:05.891918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e97990f-c8de-4509-9176-1fdc9054459d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:05.945954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e97990f-c8de-4509-9176-1fdc9054459d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.071194 Dec 18 21:15:05.947369 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3211/6476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:05 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:06.959172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccfacc0a-6b63-4ceb-84f0-98101261babc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:06.960017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccfacc0a-6b63-4ceb-84f0-98101261babc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:06.966406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccfacc0a-6b63-4ceb-84f0-98101261babc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:06.966873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccfacc0a-6b63-4ceb-84f0-98101261babc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:06.967666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccfacc0a-6b63-4ceb-84f0-98101261babc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:06.968111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccfacc0a-6b63-4ceb-84f0-98101261babc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:07.004215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:07.005221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:07.012990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:07.013468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:07.014281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:07.014769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:07.025750 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccfacc0a-6b63-4ceb-84f0-98101261babc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.070556 Dec 18 21:15:07.026604 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3266/6477] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:06 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:07.039813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lazy-loading 'flavor' on Instance uuid 7d25881b-6ed3-4a4a-a67f-6deccf75b680 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:15:07.309268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-646a0c51-999f-4627-9e23-390d6658ae3a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 202 len: 0 microversion: 2.20 time: 0.309276 Dec 18 21:15:07.310399 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3212/6478] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:15:06 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:15:07.321171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:07.322565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:07.330015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:07.330015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:07.330524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:07.331151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:07.472114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:07.480642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:07.482203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:07.483430 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d30b5d9b-1157-4180-b3d6-ca7652e68107 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.168538 Dec 18 21:15:07.484022 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3267/6479] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:07 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:08.041976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-403c0c37-1a59-4caf-9d41-c3216413dbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:08.044747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-403c0c37-1a59-4caf-9d41-c3216413dbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:08.051296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-403c0c37-1a59-4caf-9d41-c3216413dbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:08.052126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-403c0c37-1a59-4caf-9d41-c3216413dbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:08.053208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-403c0c37-1a59-4caf-9d41-c3216413dbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:08.053799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-403c0c37-1a59-4caf-9d41-c3216413dbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:08.097278 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-403c0c37-1a59-4caf-9d41-c3216413dbfb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.060980 Dec 18 21:15:08.100805 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3213/6480] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:08 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:08.501868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:08.502509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:08.509863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:08.510377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:08.511206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:08.511650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:08.663170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:08.671246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:08.672853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:08.674027 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6c44198-10b9-4643-baca-4a18b8ef7272 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.175921 Dec 18 21:15:08.674650 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3268/6481] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:08 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:09.109040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-454508a5-a64c-43d5-ba8f-dcca375817db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:09.110080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-454508a5-a64c-43d5-ba8f-dcca375817db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:09.118040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454508a5-a64c-43d5-ba8f-dcca375817db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:09.118536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454508a5-a64c-43d5-ba8f-dcca375817db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:09.119348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454508a5-a64c-43d5-ba8f-dcca375817db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:09.119807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-454508a5-a64c-43d5-ba8f-dcca375817db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:09.159956 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-454508a5-a64c-43d5-ba8f-dcca375817db tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.054961 Dec 18 21:15:09.161451 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3214/6482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:09 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:09.692640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:09.693451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:09.700309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:09.700856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:09.701551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:09.702011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:09.848497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:09.856492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:09.858040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:09.859261 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3795fd6c-2f93-4250-93fb-eca5a855d92b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.171069 Dec 18 21:15:09.859924 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3269/6483] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:09 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:10.173373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e18b28f0-90fc-4651-811c-a9c10f3ee007 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:10.174578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e18b28f0-90fc-4651-811c-a9c10f3ee007 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:10.183387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18b28f0-90fc-4651-811c-a9c10f3ee007 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:10.183853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18b28f0-90fc-4651-811c-a9c10f3ee007 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:10.184660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18b28f0-90fc-4651-811c-a9c10f3ee007 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:10.185117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e18b28f0-90fc-4651-811c-a9c10f3ee007 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:10.229605 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e18b28f0-90fc-4651-811c-a9c10f3ee007 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.060822 Dec 18 21:15:10.230289 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3215/6484] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:10 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:10.877616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:10.878219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:10.884821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:10.885272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:10.886052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:10.886514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:11.035446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:11.043224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:11.044718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:11.045868 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5e88d8ee-2b03-474f-90fc-eaf0661f7a8e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.171989 Dec 18 21:15:11.046672 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3270/6485] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:10 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:11.242002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d0ccd68-0af4-4d20-8dbd-1f146bd19ba6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:11.243056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d0ccd68-0af4-4d20-8dbd-1f146bd19ba6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:11.250223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ccd68-0af4-4d20-8dbd-1f146bd19ba6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:11.250732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ccd68-0af4-4d20-8dbd-1f146bd19ba6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:11.251562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ccd68-0af4-4d20-8dbd-1f146bd19ba6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:11.252014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d0ccd68-0af4-4d20-8dbd-1f146bd19ba6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:11.296861 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d0ccd68-0af4-4d20-8dbd-1f146bd19ba6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.058973 Dec 18 21:15:11.297733 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3216/6486] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:11 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:15:12.063366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:12.064209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:12.071242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:12.071691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:12.072529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:12.073122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:12.210821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:12.218715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:12.220324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:12.221495 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-622275d6-34a4-4f31-a013-a5423a9cdbb4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.161840 Dec 18 21:15:12.222058 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3271/6487] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:12 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:12.309174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2a8cee3-d803-48c0-9032-bb5d6b3592cc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:12.310088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2a8cee3-d803-48c0-9032-bb5d6b3592cc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:12.317680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a8cee3-d803-48c0-9032-bb5d6b3592cc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:12.318152 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a8cee3-d803-48c0-9032-bb5d6b3592cc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:12.318987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a8cee3-d803-48c0-9032-bb5d6b3592cc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:12.319506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2a8cee3-d803-48c0-9032-bb5d6b3592cc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:12.359597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2a8cee3-d803-48c0-9032-bb5d6b3592cc tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.054402 Dec 18 21:15:12.364434 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3217/6488] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:12 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:13.240657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:13.241262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:13.248311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:13.248767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:13.249556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:13.249999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:13.373129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9857c5a9-38f8-485f-b662-946d6602737f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:13.374934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9857c5a9-38f8-485f-b662-946d6602737f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:13.384424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9857c5a9-38f8-485f-b662-946d6602737f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:13.384939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9857c5a9-38f8-485f-b662-946d6602737f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:13.385765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9857c5a9-38f8-485f-b662-946d6602737f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:13.386494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9857c5a9-38f8-485f-b662-946d6602737f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:13.395593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:13.404201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:13.405768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:13.406981 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7930a98c-26fa-4ad3-ad09-727699a42507 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.170784 Dec 18 21:15:13.417265 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3272/6489] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:13 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:13.428869 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9857c5a9-38f8-485f-b662-946d6602737f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.060257 Dec 18 21:15:13.429529 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3218/6490] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:13 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:15:14.424230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:14.424870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:14.432174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:14.432633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:14.433427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:14.433873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:14.441685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b88287ec-4479-4671-a447-3cc714fab772 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:14.443984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b88287ec-4479-4671-a447-3cc714fab772 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:14.452975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b88287ec-4479-4671-a447-3cc714fab772 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:14.453585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b88287ec-4479-4671-a447-3cc714fab772 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:14.454452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b88287ec-4479-4671-a447-3cc714fab772 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:14.455100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b88287ec-4479-4671-a447-3cc714fab772 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:14.501679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b88287ec-4479-4671-a447-3cc714fab772 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.063109 Dec 18 21:15:14.502521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3219/6491] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:14 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:15:14.576898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:14.585895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:14.587744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:14.589091 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7c2c9a3-5a63-4c78-be03-1cc69c0b1a8c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.168382 Dec 18 21:15:14.589924 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3273/6492] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:14 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:15.514929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86f34874-1880-4b32-b255-e22545d89dab tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:15.515939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86f34874-1880-4b32-b255-e22545d89dab tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:15.523900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86f34874-1880-4b32-b255-e22545d89dab tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:15.524359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86f34874-1880-4b32-b255-e22545d89dab tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:15.525146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86f34874-1880-4b32-b255-e22545d89dab tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:15.525594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86f34874-1880-4b32-b255-e22545d89dab tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:15.565395 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86f34874-1880-4b32-b255-e22545d89dab tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 32635 microversion: 2.1 time: 0.054348 Dec 18 21:15:15.566299 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3220/6493] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:15 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 32635 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:15.607928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:15.608539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:15.615478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:15.615936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:15.616721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:15.617162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:15.754547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:15.764011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:15.765943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:15.767294 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89869698-5b80-4deb-9327-c7d0768817f3 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.163827 Dec 18 21:15:15.768000 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3274/6494] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:15 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:16.577435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9163f163-02c6-43e5-8069-6d2c6443b31a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:16.578496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9163f163-02c6-43e5-8069-6d2c6443b31a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:16.586324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9163f163-02c6-43e5-8069-6d2c6443b31a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:16.586789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9163f163-02c6-43e5-8069-6d2c6443b31a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:16.587590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9163f163-02c6-43e5-8069-6d2c6443b31a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:16.588043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9163f163-02c6-43e5-8069-6d2c6443b31a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:16.647594 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9163f163-02c6-43e5-8069-6d2c6443b31a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action" status: 200 len: 40775 microversion: 2.1 time: 0.073993 Dec 18 21:15:16.648903 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3221/6495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:16 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/action => generated 40775 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:16.658633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b68b9348-fd44-4e15-b7f4-828cf76e39f2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:16.659190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b68b9348-fd44-4e15-b7f4-828cf76e39f2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:16.666854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68b9348-fd44-4e15-b7f4-828cf76e39f2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:16.667315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68b9348-fd44-4e15-b7f4-828cf76e39f2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:16.668112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68b9348-fd44-4e15-b7f4-828cf76e39f2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:16.668745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b68b9348-fd44-4e15-b7f4-828cf76e39f2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:16.704256 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b68b9348-fd44-4e15-b7f4-828cf76e39f2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/ips" status: 200 len: 145 microversion: 2.1 time: 0.049229 Dec 18 21:15:16.704879 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3275/6496] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:15:16 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:16.787448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:16.788439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:16.797827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:16.798316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:16.799319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:16.799772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:16.945872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:16.970752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:16.973757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:16.975544 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f86148a2-0194-41f5-9b82-13a152bf195f tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.192964 Dec 18 21:15:16.990287 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3222/6497] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:16 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:17.993820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:17.994385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:18.001179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:18.001630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:18.002448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:18.002891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:18.081343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-09e6de78-44a3-49d5-8c6e-fc333653c44a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2805e9a-f450-4ca2-921c-1bba86b6b1e1"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:18.082646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-09e6de78-44a3-49d5-8c6e-fc333653c44a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:18.091675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09e6de78-44a3-49d5-8c6e-fc333653c44a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:18.092182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09e6de78-44a3-49d5-8c6e-fc333653c44a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:18.092990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09e6de78-44a3-49d5-8c6e-fc333653c44a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:18.093442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-09e6de78-44a3-49d5-8c6e-fc333653c44a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:18.147137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:18.155396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:18.156918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:18.158186 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ebc29f2e-043e-4bdf-a373-1dc5acc52790 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1741 microversion: 2.20 time: 0.168312 Dec 18 21:15:18.158789 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3276/6498] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:17 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:18.343719 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-09e6de78-44a3-49d5-8c6e-fc333653c44a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267465 Dec 18 21:15:18.344343 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3223/6499] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:15:18 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:18.432564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec29f63e-3120-48a2-bd3c-3253034841ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:18.433622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec29f63e-3120-48a2-bd3c-3253034841ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:18.439861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec29f63e-3120-48a2-bd3c-3253034841ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:18.440315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec29f63e-3120-48a2-bd3c-3253034841ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:18.441109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec29f63e-3120-48a2-bd3c-3253034841ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:18.441801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec29f63e-3120-48a2-bd3c-3253034841ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:18.798980 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec29f63e-3120-48a2-bd3c-3253034841ee tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action" status: 200 len: 24572 microversion: 2.1 time: 0.369357 Dec 18 21:15:18.801136 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3277/6500] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:18 2021] POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action => generated 24572 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:19.177735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:19.178525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:19.185683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:19.186154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:19.187058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:19.187518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:19.353338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:19.362330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:19.365039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:19.366488 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44578b15-ebf0-4b36-b5f1-d8ade950aa61 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1741 microversion: 2.20 time: 0.193301 Dec 18 21:15:19.367234 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3224/6501] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:19 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:20.385756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:20.386685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:20.394571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:20.395359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:20.396597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:20.397162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:20.577881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:20.588618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:20.590401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:20.591978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aef3b8ac-36d7-4e07-ad92-576b6b905ddc tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.210403 Dec 18 21:15:20.592591 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3278/6502] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:20 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:20.825652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b0f74ad7-5f72-4ce2-9ee4-a0ee0d8ac06c req-e8064a8e-a033-4cee-91e8-a04916f82e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "name": "network-vif-plugged", "status": "completed", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:20.827236 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:20.827236 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:20.844147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b0f74ad7-5f72-4ce2-9ee4-a0ee0d8ac06c req-e8064a8e-a033-4cee-91e8-a04916f82e39 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:20.844590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b0f74ad7-5f72-4ce2-9ee4-a0ee0d8ac06c req-e8064a8e-a033-4cee-91e8-a04916f82e39 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:20.862616 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b0f74ad7-5f72-4ce2-9ee4-a0ee0d8ac06c req-e8064a8e-a033-4cee-91e8-a04916f82e39 service nova] Creating event network-vif-plugged:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch2-master-1 Dec 18 21:15:20.881550 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b0f74ad7-5f72-4ce2-9ee4-a0ee0d8ac06c req-e8064a8e-a033-4cee-91e8-a04916f82e39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059957 Dec 18 21:15:20.882180 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3225/6503] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:20.954005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-460684782", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:21.012754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:15:21.322874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:15:21.324416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:15:21.324949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:15:21.325882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:15:21.326590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:15:21.335933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.336758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.337771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.338411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.356774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Getting quotas for project c3ff294c24f54faf9ba1592e4dd3ebaa. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:15:21.361869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Getting quotas for user 480f527dbe434218a49acb6095d4d66f and project c3ff294c24f54faf9ba1592e4dd3ebaa. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:15:21.374773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:15:21.377129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:15:21.423898 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e4174e99-401b-471a-855d-0d4afbdbaad9 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478692 Dec 18 21:15:21.425800 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3279/6504] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:15:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:15:21.437266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c35359b-174d-48d8-a72d-905d8063de6a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:21.437974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c35359b-174d-48d8-a72d-905d8063de6a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:21.508247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0c35359b-174d-48d8-a72d-905d8063de6a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:21.516959 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c35359b-174d-48d8-a72d-905d8063de6a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1213 microversion: 2.1 time: 0.084151 Dec 18 21:15:21.522453 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3226/6505] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:21 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:21.613709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:21.615018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:21.632530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.632990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.633788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.634228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.703769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0231e728-a20a-4f53-9f19-36492afa52a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:21.705649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0231e728-a20a-4f53-9f19-36492afa52a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:21.714284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0231e728-a20a-4f53-9f19-36492afa52a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.715761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0231e728-a20a-4f53-9f19-36492afa52a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.719109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0231e728-a20a-4f53-9f19-36492afa52a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.719763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0231e728-a20a-4f53-9f19-36492afa52a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.774617 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0231e728-a20a-4f53-9f19-36492afa52a0 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074502 Dec 18 21:15:21.775810 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3227/6506] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:15:21 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:21.787255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ee2704c-19df-4e91-b987-974889b521d7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:21.787964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ee2704c-19df-4e91-b987-974889b521d7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:21.795603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ee2704c-19df-4e91-b987-974889b521d7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.796384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ee2704c-19df-4e91-b987-974889b521d7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.797384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ee2704c-19df-4e91-b987-974889b521d7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:21.798017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ee2704c-19df-4e91-b987-974889b521d7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:21.844469 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ee2704c-19df-4e91-b987-974889b521d7 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/a2805e9a-f450-4ca2-921c-1bba86b6b1e1" status: 200 len: 194 microversion: 2.1 time: 0.060814 Dec 18 21:15:21.845448 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3228/6507] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Dec 18 21:15:21 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/a2805e9a-f450-4ca2-921c-1bba86b6b1e1 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:21.859629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:21.869259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:21.875320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:21.876616 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85b947c5-ea27-4a90-8fb8-20aa0f4145f1 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.269125 Dec 18 21:15:21.877573 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3280/6508] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:21 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:22.534431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:22.535166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:22.543912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:22.544405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:22.545272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:22.545974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:22.631908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:22.641726 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c172896-e2c8-4245-98a1-69f9cdd751db tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1265 microversion: 2.1 time: 0.110654 Dec 18 21:15:22.643408 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3229/6509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:22 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:22.895453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:22.896044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:22.902854 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:22.903555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:22.904512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:22.905120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:23.078625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:23.089147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:23.091149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:23.092675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-157fa2b6-51ac-4b23-a551-6ad4d9b94b74 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.201096 Dec 18 21:15:23.093729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3281/6510] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:22 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:23.310840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af8c204d-46ca-4574-ab8b-8b4fa27a645d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3f4d09b-7e17-403a-90d2-33cb5c4f21dd"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:23.313113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af8c204d-46ca-4574-ab8b-8b4fa27a645d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:23.329133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af8c204d-46ca-4574-ab8b-8b4fa27a645d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:23.329638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af8c204d-46ca-4574-ab8b-8b4fa27a645d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:23.330580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af8c204d-46ca-4574-ab8b-8b4fa27a645d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:23.331222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af8c204d-46ca-4574-ab8b-8b4fa27a645d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:23.640688 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af8c204d-46ca-4574-ab8b-8b4fa27a645d tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334141 Dec 18 21:15:23.643307 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3230/6511] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:15:23 2021] POST /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:23.660753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:23.662039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:23.673839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:23.674352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:23.678380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:23.679154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:23.761693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:23.772058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-68474f61-4b47-4a3a-94e0-102a1ef1f43d tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1271 microversion: 2.1 time: 0.115417 Dec 18 21:15:23.773004 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3282/6512] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:23 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:24.113275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:24.114770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:24.127465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:24.127950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:24.128791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:24.129253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:24.347017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:24.356127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:24.358280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:24.359891 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-31f90354-c5c8-4ccb-81a1-97fef9843c73 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.250906 Dec 18 21:15:24.361166 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3231/6513] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:24 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:24.799950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:24.802945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:24.822221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:24.823042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:24.831977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:24.833467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:25.073874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:25.085949 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bd6a60b3-0f43-4819-8926-bccc27543cdf tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1313 microversion: 2.1 time: 0.299676 Dec 18 21:15:25.088007 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3283/6514] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:24 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:25.173939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-26da4329-2a52-43bf-a706-95d0a7b88dd8 req-4bb4320e-9b5c-4528-b67d-5064c533c0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc58871a-b684-483d-8cba-4fdbc8ec6a2b", "tag": "5a74dcaa-dd1f-4048-bff3-72d877c828fd"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:25.175554 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:25.175554 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:25.194037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-26da4329-2a52-43bf-a706-95d0a7b88dd8 req-4bb4320e-9b5c-4528-b67d-5064c533c0a6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:25.194983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-26da4329-2a52-43bf-a706-95d0a7b88dd8 req-4bb4320e-9b5c-4528-b67d-5064c533c0a6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:25.212146 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-26da4329-2a52-43bf-a706-95d0a7b88dd8 req-4bb4320e-9b5c-4528-b67d-5064c533c0a6 service nova] Creating event network-changed:5a74dcaa-dd1f-4048-bff3-72d877c828fd for instance cc58871a-b684-483d-8cba-4fdbc8ec6a2b on nch2-master-1 Dec 18 21:15:25.217579 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-26da4329-2a52-43bf-a706-95d0a7b88dd8 req-4bb4320e-9b5c-4528-b67d-5064c533c0a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049070 Dec 18 21:15:25.218810 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3232/6515] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:25.380951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:25.381579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:25.392867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:25.394338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:25.396113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:25.397080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:25.599028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:25.608088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:25.610301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:25.611952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d9200d5-b60b-4c3b-99f0-865c0818a723 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.236110 Dec 18 21:15:25.613670 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3284/6516] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:25 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:26.106861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:26.108287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:26.116313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:26.117404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:26.118585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:26.119491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:26.319119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:26.328380 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-043185fe-f21d-4d06-b0cf-6662c3694ede tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1313 microversion: 2.1 time: 0.226822 Dec 18 21:15:26.329929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3233/6517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:26 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:26.632623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:26.633207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:26.639963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:26.640582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:26.641478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:26.642026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:26.817084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:26.825400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:26.830934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:26.832473 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f80f93e2-9999-49f0-86b8-e5184d9c94dd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.204541 Dec 18 21:15:26.833204 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3285/6518] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:26 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:27.019205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-428ae6c8-f706-49f8-94e2-d3a0e93d281e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:27.020183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-428ae6c8-f706-49f8-94e2-d3a0e93d281e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:27.027211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-428ae6c8-f706-49f8-94e2-d3a0e93d281e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.027704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-428ae6c8-f706-49f8-94e2-d3a0e93d281e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.028475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-428ae6c8-f706-49f8-94e2-d3a0e93d281e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.028920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-428ae6c8-f706-49f8-94e2-d3a0e93d281e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.061452 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-428ae6c8-f706-49f8-94e2-d3a0e93d281e tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046016 Dec 18 21:15:27.062372 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3234/6519] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:15:27 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:27.224138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0498048e-039b-450b-8641-d25dea5f8f17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:27.224634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0498048e-039b-450b-8641-d25dea5f8f17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:27.235121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498048e-039b-450b-8641-d25dea5f8f17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.235582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498048e-039b-450b-8641-d25dea5f8f17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.236394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498048e-039b-450b-8641-d25dea5f8f17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.236839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0498048e-039b-450b-8641-d25dea5f8f17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.273492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0498048e-039b-450b-8641-d25dea5f8f17 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/a2805e9a-f450-4ca2-921c-1bba86b6b1e1" status: 200 len: 194 microversion: 2.1 time: 0.053827 Dec 18 21:15:27.278590 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3286/6520] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Dec 18 21:15:27 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/a2805e9a-f450-4ca2-921c-1bba86b6b1e1 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:27.283780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:27.284525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:27.294661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.295647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.296718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.300396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.346369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:27.347159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:27.364706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.365267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.366310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.366821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.406092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lazy-loading 'services' on Instance uuid 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:15:27.498625 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-207f0400-bb29-4423-a644-ce008dfd1e9c tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/a2805e9a-f450-4ca2-921c-1bba86b6b1e1" status: 202 len: 0 microversion: 2.1 time: 0.218262 Dec 18 21:15:27.500365 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3235/6521] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:15:27 2021] DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/a2805e9a-f450-4ca2-921c-1bba86b6b1e1 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:15:27.575155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:27.585449 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2235dd93-3f1a-407e-b113-c4a609104979 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1313 microversion: 2.1 time: 0.242947 Dec 18 21:15:27.593671 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3287/6522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:27 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:27.852067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:27.852979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:27.859606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.860187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:27.861225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:27.861741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:28.007520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:28.019082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:28.020801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:28.022115 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2575b8fa-c4d5-4c09-a188-c6c4298c1ea6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.174967 Dec 18 21:15:28.022715 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3236/6523] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:27 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:28.603793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:28.604381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:28.623803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:28.624391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:28.625149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:28.630562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:28.641383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87d906ad-2b6a-4934-942b-e9d0644b2bf2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:28.647021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-87d906ad-2b6a-4934-942b-e9d0644b2bf2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:28.654244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d906ad-2b6a-4934-942b-e9d0644b2bf2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:28.655025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d906ad-2b6a-4934-942b-e9d0644b2bf2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:28.655840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d906ad-2b6a-4934-942b-e9d0644b2bf2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:28.656642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d906ad-2b6a-4934-942b-e9d0644b2bf2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:28.719950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87d906ad-2b6a-4934-942b-e9d0644b2bf2 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/e3f4d09b-7e17-403a-90d2-33cb5c4f21dd" status: 200 len: 194 microversion: 2.1 time: 0.082653 Dec 18 21:15:28.732545 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3237/6524] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Dec 18 21:15:28 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/e3f4d09b-7e17-403a-90d2-33cb5c4f21dd => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:28.750533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:28.751417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:28.767629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:28.768108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:28.768943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:28.769399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:28.834265 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:28.845768 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-602da985-84a0-4a46-9db5-059652f458b2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1313 microversion: 2.1 time: 0.247323 Dec 18 21:15:28.856993 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3288/6525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:28 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:28.894973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lazy-loading 'services' on Instance uuid 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:15:28.985168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72076bd2-eb1e-4f5a-8af7-fdf8e73b1a5b tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/e3f4d09b-7e17-403a-90d2-33cb5c4f21dd" status: 202 len: 0 microversion: 2.1 time: 0.249320 Dec 18 21:15:28.985774 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3238/6526] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:15:28 2021] DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments/e3f4d09b-7e17-403a-90d2-33cb5c4f21dd => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:29.042058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:29.042704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:29.049522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:29.050140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:29.051779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:29.052222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:29.226447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:29.239766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:29.241405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:29.242727 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18d1a82c-be0e-4242-ac18-73fbf8dba324 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.205164 Dec 18 21:15:29.243369 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3289/6527] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:29 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:29.865228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:29.865939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:29.876086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:29.876554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:29.877364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:29.879623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:29.954278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:29.955798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:29.966055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:29.967120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:29.968201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:29.969021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.075279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:30.085838 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0b4d608-91e6-4548-88e1-0dbee2cc8824 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1313 microversion: 2.1 time: 0.225546 Dec 18 21:15:30.096279 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3239/6528] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:29 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:30.200547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:30.212541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-989181c0-dede-443b-b958-0275fbccf5de tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:30.214575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-989181c0-dede-443b-b958-0275fbccf5de tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.221119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-989181c0-dede-443b-b958-0275fbccf5de tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.224033 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a8a520e6-5790-4c0c-9f66-662ef6b09a17 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1681 microversion: 2.1 time: 0.273874 Dec 18 21:15:30.224918 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3290/6529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:29 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:30.225285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-989181c0-dede-443b-b958-0275fbccf5de tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.226286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-989181c0-dede-443b-b958-0275fbccf5de tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.226728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-989181c0-dede-443b-b958-0275fbccf5de tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.261381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:30.261983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.268564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.269079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.269879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.270462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.293084 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-989181c0-dede-443b-b958-0275fbccf5de tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084442 Dec 18 21:15:30.296343 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3240/6530] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:15:30 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:15:30.390538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57f2ea9a-1e09-403c-8b98-1ba2555c2a9a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:30.391649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57f2ea9a-1e09-403c-8b98-1ba2555c2a9a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.407160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57f2ea9a-1e09-403c-8b98-1ba2555c2a9a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.407782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57f2ea9a-1e09-403c-8b98-1ba2555c2a9a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.408891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57f2ea9a-1e09-403c-8b98-1ba2555c2a9a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.409462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57f2ea9a-1e09-403c-8b98-1ba2555c2a9a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.435820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:30.446920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:30.448571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:30.450044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-406b7d8e-d67c-4ad7-85d5-4070be0437a9 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1736 microversion: 2.20 time: 0.192513 Dec 18 21:15:30.451526 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3291/6531] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:30 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:30.469405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3fe5c906-5895-463f-a704-6b5dd3b2c6fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:30.470625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3fe5c906-5895-463f-a704-6b5dd3b2c6fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.470793 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57f2ea9a-1e09-403c-8b98-1ba2555c2a9a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action" status: 200 len: 32652 microversion: 2.1 time: 0.085170 Dec 18 21:15:30.471296 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3241/6532] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:30 2021] POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action => generated 32652 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:15:30.483189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fe5c906-5895-463f-a704-6b5dd3b2c6fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.483643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fe5c906-5895-463f-a704-6b5dd3b2c6fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.484549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fe5c906-5895-463f-a704-6b5dd3b2c6fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.484988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3fe5c906-5895-463f-a704-6b5dd3b2c6fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.516926 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3fe5c906-5895-463f-a704-6b5dd3b2c6fb tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051690 Dec 18 21:15:30.517499 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3292/6533] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:15:30 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:15:30.575215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:30.575904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.583524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.584000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.584814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.585272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.612845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:15:30.639828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4503d1d2-3077-4746-b547-356c41c5ff91 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:30.640472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4503d1d2-3077-4746-b547-356c41c5ff91 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.646997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4503d1d2-3077-4746-b547-356c41c5ff91 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.647460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4503d1d2-3077-4746-b547-356c41c5ff91 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.648250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4503d1d2-3077-4746-b547-356c41c5ff91 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.648692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4503d1d2-3077-4746-b547-356c41c5ff91 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.694179 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82e9d008-774c-4212-8598-123642ef8182 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 204 len: 0 microversion: 2.1 time: 0.122764 Dec 18 21:15:30.701120 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3242/6534] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:15:30 2021] DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:15:30.712167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:30.712910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.719329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.719856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.720603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.721050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.836709 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4503d1d2-3077-4746-b547-356c41c5ff91 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1832 microversion: 2.1 time: 0.201397 Dec 18 21:15:30.837525 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3293/6535] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:30 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1832 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:30.853514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:30.854691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:30.861149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.861329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.862101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.862496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.887468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lazy-loading 'flavor' on Instance uuid f191cfff-6882-46e8-be0b-12fbfec0ec1f {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:15:30.897155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:30.900623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Going to try to live migrate instance to another host {{(pid=140732) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 18 21:15:30.905644 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35ea45ee-f28d-43b6-b66c-404f67afe071 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1672 microversion: 2.1 time: 0.198017 Dec 18 21:15:30.906381 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3243/6536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:30 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:30.911077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-54764938-5bf6-415c-92a8-e8a97b564b7a req-bc88bb55-372c-450f-b5b1-aafeb44f16fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc58871a-b684-483d-8cba-4fdbc8ec6a2b", "name": "network-vif-plugged", "status": "completed", "tag": "5a74dcaa-dd1f-4048-bff3-72d877c828fd"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:30.912890 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:30.912890 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:30.919867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-54764938-5bf6-415c-92a8-e8a97b564b7a req-bc88bb55-372c-450f-b5b1-aafeb44f16fa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:30.920552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-54764938-5bf6-415c-92a8-e8a97b564b7a req-bc88bb55-372c-450f-b5b1-aafeb44f16fa service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:30.941219 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-54764938-5bf6-415c-92a8-e8a97b564b7a req-bc88bb55-372c-450f-b5b1-aafeb44f16fa service nova] Creating event network-vif-plugged:5a74dcaa-dd1f-4048-bff3-72d877c828fd for instance cc58871a-b684-483d-8cba-4fdbc8ec6a2b on nch2-master-1 Dec 18 21:15:30.947372 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-54764938-5bf6-415c-92a8-e8a97b564b7a req-bc88bb55-372c-450f-b5b1-aafeb44f16fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039796 Dec 18 21:15:30.948361 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3244/6537] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:31.103212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:31.103933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:31.111005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:31.111472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:31.112306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:31.112783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:31.252020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:31.259494 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e8dae8ac-3b76-446d-a744-7d47878c9061 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1313 microversion: 2.1 time: 0.160339 Dec 18 21:15:31.260091 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3245/6538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:31 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:31.468653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:31.469319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:31.475771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:31.476238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:31.477093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:31.477548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:31.624701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:31.633954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:31.635518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:31.636789 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43c38a86-7ea2-46a0-9dfd-80e848bcb7d8 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1718 microversion: 2.20 time: 0.171848 Dec 18 21:15:31.638647 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3246/6539] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:31 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:31.923320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:31.923974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:31.930949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:31.931424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:31.932235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:31.932699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.179071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:32.187215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce5f57ec-6745-4618-969a-d5be6e5dda35 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1672 microversion: 2.1 time: 0.267590 Dec 18 21:15:32.187804 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3247/6540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:31 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1672 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:32.276132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:32.276850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:32.283397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.283866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.284672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.285129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.399264 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-516549b0-a080-4f23-952c-d5edaf044735 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action" status: 202 len: 0 microversion: 2.1 time: 1.549575 Dec 18 21:15:32.403316 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3294/6541] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:30 2021] POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action => generated 0 bytes in 1552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:32.409254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:32.410099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:32.420007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.420462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.421500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.421954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.455213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:32.472124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-009d6345-09e8-47dc-ac72-05306ef4f058 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1463 microversion: 2.1 time: 0.199293 Dec 18 21:15:32.488531 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3248/6542] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:32 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1463 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:32.503105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b40e18b9-3f65-4115-8a9a-145b1907967a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "711fd27e-147d-4084-8318-a72e449932b9", "device": "/dev/sdb"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:32.505234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b40e18b9-3f65-4115-8a9a-145b1907967a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:32.512326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b40e18b9-3f65-4115-8a9a-145b1907967a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.512796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b40e18b9-3f65-4115-8a9a-145b1907967a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.513663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b40e18b9-3f65-4115-8a9a-145b1907967a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.514283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b40e18b9-3f65-4115-8a9a-145b1907967a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.612553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:32.622062 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-74c64abf-474e-4443-8ced-b628225825e3 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.217705 Dec 18 21:15:32.622701 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3295/6543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:32 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:32.663479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:32.664383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:32.679701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.680153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.681057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:32.681400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:32.821119 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b40e18b9-3f65-4115-8a9a-145b1907967a tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "POST /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324181 Dec 18 21:15:32.821934 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3249/6544] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:15:32 2021] POST /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:33.000749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:33.010383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:33.012440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:33.013864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84f29b59-84da-44a4-b760-3163980ef4b7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1718 microversion: 2.20 time: 0.358894 Dec 18 21:15:33.015016 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3296/6545] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:32 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1718 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:33.206893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:33.208157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:33.214795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:33.215264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:33.217011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:33.217011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:33.422115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:33.434527 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce5d3c2d-850c-4793-ae0f-7c5a2bce6736 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1672 microversion: 2.1 time: 0.233271 Dec 18 21:15:33.435644 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3250/6546] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:33 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:33.640739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:33.642021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:33.650443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:33.651283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:33.652610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:33.653285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:33.656805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-197c68ae-9c16-469f-8b9c-904420cc0139 req-a1de9657-c000-41b1-b0e3-c9bad327b17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "name": "network-vif-unplugged", "status": "completed", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:33.659309 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:33.659309 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:33.680130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-197c68ae-9c16-469f-8b9c-904420cc0139 req-a1de9657-c000-41b1-b0e3-c9bad327b17a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:33.680603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-197c68ae-9c16-469f-8b9c-904420cc0139 req-a1de9657-c000-41b1-b0e3-c9bad327b17a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:33.701592 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-197c68ae-9c16-469f-8b9c-904420cc0139 req-a1de9657-c000-41b1-b0e3-c9bad327b17a service nova] Creating event network-vif-unplugged:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch1-master-1 Dec 18 21:15:33.706905 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-197c68ae-9c16-469f-8b9c-904420cc0139 req-a1de9657-c000-41b1-b0e3-c9bad327b17a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056102 Dec 18 21:15:33.708573 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3251/6547] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:33.925532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:33.949045 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1fca4962-83ec-4220-9a3a-d42aba64d663 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.303185 Dec 18 21:15:33.955287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3297/6548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:33 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:33.968568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-0a19f1fc-a016-4a56-a020-f0fb9945135d req-9167d229-49b8-4914-9708-6eb8ce016732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dead3a0-55e1-4aa5-91e9-5a4eefe5e192", "name": "network-vif-deleted", "tag": "afd82864-3497-4dbf-be5e-465b8fe8ede6"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:33.970461 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:33.970461 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:33.999198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0a19f1fc-a016-4a56-a020-f0fb9945135d req-9167d229-49b8-4914-9708-6eb8ce016732 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:33.999871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0a19f1fc-a016-4a56-a020-f0fb9945135d req-9167d229-49b8-4914-9708-6eb8ce016732 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.025598 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-0a19f1fc-a016-4a56-a020-f0fb9945135d req-9167d229-49b8-4914-9708-6eb8ce016732 service nova] Creating event network-vif-deleted:afd82864-3497-4dbf-be5e-465b8fe8ede6 for instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 on nch1-master-1 Dec 18 21:15:34.031582 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-0a19f1fc-a016-4a56-a020-f0fb9945135d req-9167d229-49b8-4914-9708-6eb8ce016732 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075379 Dec 18 21:15:34.032819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:34.033079 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3252/6549] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:34.037583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:34.047150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.048632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.049698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.050650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.282465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:34.292530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:34.294083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:34.295544 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f7ed36f-6093-416e-b9c3-1485f0517833 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1661 microversion: 2.20 time: 0.267267 Dec 18 21:15:34.296709 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3298/6550] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:34 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1661 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:34.315797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-716d83bb-8439-4860-b703-a3369f402a87 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ead49322-abed-4471-af58-9f89b29a5107"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:34.317929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-716d83bb-8439-4860-b703-a3369f402a87 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:34.324645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-716d83bb-8439-4860-b703-a3369f402a87 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.325205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-716d83bb-8439-4860-b703-a3369f402a87 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.326088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-716d83bb-8439-4860-b703-a3369f402a87 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.326637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-716d83bb-8439-4860-b703-a3369f402a87 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.455261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:34.455963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:34.465885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.466393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.467740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.469487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.522617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.523422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.524225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lazy-loading 'fault' on Instance uuid 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:15:34.603974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6bef41b9948099215b02cdca829bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0115052ed7dd4b60b9c729f1daa095c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:34.615290 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-458f6ce3-3e9e-41ff-93e1-9a43663a6778 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 200 len: 1327 microversion: 2.1 time: 0.165572 Dec 18 21:15:34.616222 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3299/6551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:34 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 1327 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:34.739067 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-716d83bb-8439-4860-b703-a3369f402a87 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.428143 Dec 18 21:15:34.740412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3253/6552] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Dec 18 21:15:34 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-volume_attachments => generated 188 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:34.822909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5a886d56-2d87-4de1-bcac-7cb062c48673 req-52b59637-4e0d-4085-abcc-fbf2e6ae1dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "name": "network-vif-plugged", "status": "completed", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:34.825866 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:34.825866 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:15:34.846889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5a886d56-2d87-4de1-bcac-7cb062c48673 req-52b59637-4e0d-4085-abcc-fbf2e6ae1dc0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.847635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5a886d56-2d87-4de1-bcac-7cb062c48673 req-52b59637-4e0d-4085-abcc-fbf2e6ae1dc0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.872634 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5a886d56-2d87-4de1-bcac-7cb062c48673 req-52b59637-4e0d-4085-abcc-fbf2e6ae1dc0 service nova] Creating event network-vif-plugged:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch1-master-1 Dec 18 21:15:34.876854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-161a96de-5e86-4725-bbfc-c3823386d7b4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:34.877650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-161a96de-5e86-4725-bbfc-c3823386d7b4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:34.878207 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5a886d56-2d87-4de1-bcac-7cb062c48673 req-52b59637-4e0d-4085-abcc-fbf2e6ae1dc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062250 Dec 18 21:15:34.880473 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3300/6553] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:34.885278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-161a96de-5e86-4725-bbfc-c3823386d7b4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.886104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-161a96de-5e86-4725-bbfc-c3823386d7b4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.886968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-161a96de-5e86-4725-bbfc-c3823386d7b4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.887413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-161a96de-5e86-4725-bbfc-c3823386d7b4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.972733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:34.973884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:34.980543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.981365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:34.982449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:34.983545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.220967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:35.236284 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f4dc5fc-bc48-44ac-9100-b705ca3f8ae8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.267416 Dec 18 21:15:35.237142 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3301/6554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:34 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:35.265473 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-161a96de-5e86-4725-bbfc-c3823386d7b4 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-volume_attachments/ead49322-abed-4471-af58-9f89b29a5107" status: 202 len: 0 microversion: 2.20 time: 0.391716 Dec 18 21:15:35.266103 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3254/6555] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Dec 18 21:15:34 2021] DELETE /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-volume_attachments/ead49322-abed-4471-af58-9f89b29a5107 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:15:35.340475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f7c94762-47e0-4c56-af32-f6451faf21b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:35.340955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f7c94762-47e0-4c56-af32-f6451faf21b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:35.351997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7c94762-47e0-4c56-af32-f6451faf21b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:35.355323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7c94762-47e0-4c56-af32-f6451faf21b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.356336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7c94762-47e0-4c56-af32-f6451faf21b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:35.356783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f7c94762-47e0-4c56-af32-f6451faf21b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.469347 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f7c94762-47e0-4c56-af32-f6451faf21b6 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action" status: 202 len: 0 microversion: 2.20 time: 0.133260 Dec 18 21:15:35.470359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3302/6556] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Dec 18 21:15:35 2021] POST /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:15:35.479160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:35.483663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:35.501188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:35.501777 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.505740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:35.506236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.633680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:35.634395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:35.642313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:35.642313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.642313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:35.642774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.657145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] HTTP exception thrown: Instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 could not be found. Dec 18 21:15:35.657913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Returning 404 to user: Instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:35.658875 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-310cd202-d2fe-473b-8fb2-7fcb5d9b9ad8 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 404 len: 111 microversion: 2.1 time: 0.029821 Dec 18 21:15:35.659655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3303/6557] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:35 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:15:35.668894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e43ca420-65d3-4bbc-bb61-007fc143362a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '.version_select at 0x7f71614abd30>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:35.696579 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e43ca420-65d3-4bbc-bb61-007fc143362a tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433518357" status: 202 len: 0 microversion: 2.1 time: 0.031844 Dec 18 21:15:35.698599 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3304/6558] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 21:15:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433518357 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:35.713920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:35.728988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-2949976e-1a78-4b56-a15f-9de40c6e6bf1 req-45dcdd61-d9ac-4859-baac-90753c7fe485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:35.730558 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:35.730558 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:15:35.737926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2949976e-1a78-4b56-a15f-9de40c6e6bf1 req-45dcdd61-d9ac-4859-baac-90753c7fe485 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:35.738411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2949976e-1a78-4b56-a15f-9de40c6e6bf1 req-45dcdd61-d9ac-4859-baac-90753c7fe485 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:35.746979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:35.750128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:35.752229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55e28d15-67f6-4f49-bd44-9c9e6bc1c4af tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1669 microversion: 2.20 time: 0.277475 Dec 18 21:15:35.754134 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3255/6559] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:35 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1669 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:35.758345 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-2949976e-1a78-4b56-a15f-9de40c6e6bf1 req-45dcdd61-d9ac-4859-baac-90753c7fe485 service nova] Creating event network-changed:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch1-master-1 Dec 18 21:15:35.769068 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-2949976e-1a78-4b56-a15f-9de40c6e6bf1 req-45dcdd61-d9ac-4859-baac-90753c7fe485 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043108 Dec 18 21:15:35.771655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3305/6560] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:36.255908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:36.256628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:36.264261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:36.264819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:36.266046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:36.266648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:36.774521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:36.775521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:36.790221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:36.796360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:36.797356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:36.802515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:37.009866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:37.023963 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e65181d6-f3f0-40a9-9e23-3819aaf2863a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.771187 Dec 18 21:15:37.025292 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3256/6561] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:36 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:37.031056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e9eb9026-eb7a-4059-86f9-a0e61cdf6e3e req-5d4601e5-e519-483d-accd-be5af49271ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "name": "network-vif-unplugged", "status": "completed", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:37.034204 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:37.034204 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:37.059146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e9eb9026-eb7a-4059-86f9-a0e61cdf6e3e req-5d4601e5-e519-483d-accd-be5af49271ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:37.059977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e9eb9026-eb7a-4059-86f9-a0e61cdf6e3e req-5d4601e5-e519-483d-accd-be5af49271ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:37.079359 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e9eb9026-eb7a-4059-86f9-a0e61cdf6e3e req-5d4601e5-e519-483d-accd-be5af49271ff service nova] Creating event network-vif-unplugged:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch1-master-1 Dec 18 21:15:37.086319 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e9eb9026-eb7a-4059-86f9-a0e61cdf6e3e req-5d4601e5-e519-483d-accd-be5af49271ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059504 Dec 18 21:15:37.087303 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3257/6562] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:37.189325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:37.208637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:37.213262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:37.215150 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-649676d4-8b38-4973-bd60-65d1eae27426 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.446718 Dec 18 21:15:37.216830 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3306/6563] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:36 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:37.857832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d2057623-5e43-408f-905a-cdaed5d3b7f5 req-23e408b7-f882-4367-82c7-fe12963c008a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:37.859709 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:37.859709 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:37.870798 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d2057623-5e43-408f-905a-cdaed5d3b7f5 req-23e408b7-f882-4367-82c7-fe12963c008a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:37.872008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d2057623-5e43-408f-905a-cdaed5d3b7f5 req-23e408b7-f882-4367-82c7-fe12963c008a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:37.889357 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d2057623-5e43-408f-905a-cdaed5d3b7f5 req-23e408b7-f882-4367-82c7-fe12963c008a service nova] Creating event network-changed:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch1-master-1 Dec 18 21:15:37.897833 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d2057623-5e43-408f-905a-cdaed5d3b7f5 req-23e408b7-f882-4367-82c7-fe12963c008a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043875 Dec 18 21:15:37.899231 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3258/6564] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:38.048583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:38.049571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:38.068348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:38.078125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:38.082654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:38.083182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:38.238161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:38.239584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:38.250225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:38.250999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:38.251931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:38.253031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:38.280520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:38.289385 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-352f69b1-4c65-4012-8996-66a660d76e51 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.251310 Dec 18 21:15:38.291870 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3307/6565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:38 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:38.449921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:38.458332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:38.460023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:38.461336 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8dc06ad1-b0a9-47af-a049-0961b9f22225 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.229663 Dec 18 21:15:38.462280 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3259/6566] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:38 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:39.309499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:39.310144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:39.329843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.330229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.331931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.333157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.399723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1803357441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716702626", "security_groups": [{"name": "tempest-secgroup-smoke-1903789239"}], "block_device_mapping_v2": [{"uuid": "41536881-3ff9-4059-a3bb-d571589e7a54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "719d1db8-90bc-4a29-9e67-d552b1d87f10"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:39.564639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:39.575535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] validate_networks() for [('719d1db8-90bc-4a29-9e67-d552b1d87f10', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:15:39.584485 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e7ae3881-4300-46fc-a6c5-f3ceeece1035 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.279791 Dec 18 21:15:39.602284 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3308/6567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:39 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:39.607926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:39.608785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:39.621684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.622507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.623690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.624696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.893681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:39.903218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:39.905084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:39.906555 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-68514b66-a0ff-49ae-be50-f5754be29345 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.302896 Dec 18 21:15:39.907365 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3309/6568] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:39 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:39.918041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:39.918642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:39.925185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.925638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.927001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.927439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.943695 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] HTTP exception thrown: Instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 could not be found. Dec 18 21:15:39.945302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Returning 404 to user: Instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:39.947264 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5454afc9-8137-4fe5-8786-536125f91ec6 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 404 len: 111 microversion: 2.1 time: 0.038254 Dec 18 21:15:39.948100 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3310/6569] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:15:39 2021] DELETE /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:39.957103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:39.957991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:39.966394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.967164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.968174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:39.968782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:39.986812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] HTTP exception thrown: Instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 could not be found. Dec 18 21:15:39.987745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Returning 404 to user: Instance 2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:39.989531 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e2110fb9-4431-4687-9f6c-99aa38cbc27f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192" status: 404 len: 111 microversion: 2.1 time: 0.036185 Dec 18 21:15:39.993812 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3311/6570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:39 2021] GET /compute/v2.1/servers/2dead3a0-55e1-4aa5-91e9-5a4eefe5e192 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:40.220914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:15:40.221486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:15:40.221970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:15:40.222415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:15:40.223389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:15:40.232293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:40.233163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:40.234664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:40.235261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:40.261284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:15:40.267970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Getting quotas for user d32598482c834073b8fe24c84cb57d2f and project de79cd87d023436a80d3cc5428586e21. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:15:40.332344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:15:40.334951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41536881-3ff9-4059-a3bb-d571589e7a54',volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:15:40.489081 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d5132f0-9b0d-4d5f-9ea2-98fb9b552403 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.094619 Dec 18 21:15:40.490088 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3260/6571] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:15:39 2021] POST /compute/v2.1/servers => generated 406 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:15:40.499388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0697e6c7-7543-497b-8eb0-3c26b47a4335 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:40.500234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0697e6c7-7543-497b-8eb0-3c26b47a4335 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:40.596655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0697e6c7-7543-497b-8eb0-3c26b47a4335 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:40.610756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:40.611704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:40.618637 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0697e6c7-7543-497b-8eb0-3c26b47a4335 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1094 microversion: 2.1 time: 0.120629 Dec 18 21:15:40.619259 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3312/6572] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:40 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:40.623714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:40.624188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:40.625345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:40.632723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:40.885263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:40.894075 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e6d74f9d-e04d-42d5-aa62-b2f27c8e7c9b tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.287856 Dec 18 21:15:40.896411 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3261/6573] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:40 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:40.926001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:40.927350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:40.934317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:40.934784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:40.935913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:40.936768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.141672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:41.149818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:41.151402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:41.152588 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49698dc8-ebea-4a0b-bc2a-c1aa7c7dab92 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.231474 Dec 18 21:15:41.153127 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3313/6574] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:40 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:41.165060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:41.165578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:41.171541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.172011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.172935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.173395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.187124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] HTTP exception thrown: Instance befd31cf-08d3-4d80-a3e6-101af7256703 could not be found. Dec 18 21:15:41.187731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Returning 404 to user: Instance befd31cf-08d3-4d80-a3e6-101af7256703 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:41.188626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc60ced7-c640-4f06-8b28-261fc47c052f tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "DELETE /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 404 len: 111 microversion: 2.1 time: 0.027165 Dec 18 21:15:41.189178 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3262/6575] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:15:41 2021] DELETE /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:15:41.197193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:41.197810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] [instance: befd31cf-08d3-4d80-a3e6-101af7256703] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:41.203788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.204239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.205022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.205469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.218834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] HTTP exception thrown: Instance befd31cf-08d3-4d80-a3e6-101af7256703 could not be found. Dec 18 21:15:41.219431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] Returning 404 to user: Instance befd31cf-08d3-4d80-a3e6-101af7256703 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:41.220262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32b4793c-1231-433e-9462-042635559237 tempest-AttachVolumeTestJSON-466975463 tempest-AttachVolumeTestJSON-466975463-project] 10.222.0.13 "GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703" status: 404 len: 111 microversion: 2.1 time: 0.026801 Dec 18 21:15:41.220978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3314/6576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:41 2021] GET /compute/v2.1/servers/befd31cf-08d3-4d80-a3e6-101af7256703 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:41.644560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:41.646512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:41.661282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.662890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.664065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.668748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.784359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:41.792735 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-90fdb268-fed9-40a1-84c5-e5f181a6f76b tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.160403 Dec 18 21:15:41.794271 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3263/6577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:41 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:41.916269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:41.917756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:41.927023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.928007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:41.929211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:41.929915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:42.173592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:42.174710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:42.183260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:42.184043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:42.185282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:42.186768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:42.203965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:42.214461 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0127adb7-fbfe-4372-aa20-0393ff5be488 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.305766 Dec 18 21:15:42.215292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3315/6578] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:41 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:42.417926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:42.433301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:42.434940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:42.436217 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54a2721f-d49e-4ecd-88bb-cafdda192626 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.267358 Dec 18 21:15:42.436893 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3264/6579] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:42 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:42.778962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:42.779764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:42.787126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:42.788042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:42.789387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:42.790042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:42.810188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:42.810924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:42.819756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:42.820644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:42.839314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:42.839794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:42.927417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lazy-loading 'services' on Instance uuid cc58871a-b684-483d-8cba-4fdbc8ec6a2b {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:15:42.950678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:42.959446 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7e938cb-37d0-4062-8369-056208fe95d2 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.152842 Dec 18 21:15:42.960033 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3265/6580] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:42 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:43.033711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-852e3772-8032-47ff-b6fc-6efe271f75b7 req-321109fc-7455-48dd-8f82-1656bfe0028b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "name": "network-vif-unplugged", "status": "completed", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:43.036662 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:43.036662 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:43.053123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-852e3772-8032-47ff-b6fc-6efe271f75b7 req-321109fc-7455-48dd-8f82-1656bfe0028b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:43.053605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-852e3772-8032-47ff-b6fc-6efe271f75b7 req-321109fc-7455-48dd-8f82-1656bfe0028b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:43.058926 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4b7fdc30-4fc2-437e-aa19-761faac10e74 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b/os-volume_attachments/711fd27e-147d-4084-8318-a72e449932b9" status: 202 len: 0 microversion: 2.1 time: 0.283939 Dec 18 21:15:43.061976 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3316/6581] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:15:42 2021] DELETE /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b/os-volume_attachments/711fd27e-147d-4084-8318-a72e449932b9 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:15:43.085630 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-852e3772-8032-47ff-b6fc-6efe271f75b7 req-321109fc-7455-48dd-8f82-1656bfe0028b service nova] Creating event network-vif-unplugged:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch1-master-1 Dec 18 21:15:43.109291 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-852e3772-8032-47ff-b6fc-6efe271f75b7 req-321109fc-7455-48dd-8f82-1656bfe0028b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080771 Dec 18 21:15:43.110588 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3266/6582] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:43.234781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:43.235822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:43.246792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:43.248627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:43.250655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:43.253331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:43.448587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:43.457081 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-efcefd26-d3f6-4107-9e54-1860d961450e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.227309 Dec 18 21:15:43.460978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:43.461698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:43.467759 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3317/6583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:43 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:43.476553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:43.477608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:43.479472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:43.480240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:43.649081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:43.657028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:43.658700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:43.659926 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-707b3cf1-358d-4921-8cbe-0acc4c8ffaa0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.208554 Dec 18 21:15:43.660659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3267/6584] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:43 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:43.976500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:43.977791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:43.987760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:43.989038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:43.990041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:43.990683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.050455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:44.058817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5aa4407-f209-4772-84c8-fb3010055351 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.086402 Dec 18 21:15:44.059409 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3318/6585] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:43 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:44.292671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:44.293286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:44.318672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.321509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.322612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.324179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.373894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:15:44.475905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:44.476928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:44.480127 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7c4110f-c666-493b-887e-c0ab04e4c04f tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 204 len: 0 microversion: 2.1 time: 0.190851 Dec 18 21:15:44.484244 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3268/6586] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:15:44 2021] DELETE /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:15:44.491891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.493037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.494091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.494803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.497053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:44.497849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:44.506377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.506850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.507733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.508133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.902214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:44.928939 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67ce33a4-24fa-4945-bff8-91937ef7b1b8 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1469 microversion: 2.1 time: 0.438600 Dec 18 21:15:44.931133 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3269/6587] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:44 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1469 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:44.950578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:44.979246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:44.987861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.988522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:44.989408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:44.992365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:45.005956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:45.014973 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc58027c-cd15-4684-a1eb-463b7683c3a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.544320 Dec 18 21:15:45.020748 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3319/6588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:44 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:45.076255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:45.077032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:45.086726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:45.087659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:45.089696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:45.092094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:45.205300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:45.216811 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bfafba10-41f5-46a4-b94a-751916b959b7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.143523 Dec 18 21:15:45.226095 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3320/6589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:45 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:45.343302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:45.351402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:45.352930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:45.354105 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-633435c2-862a-46d8-a9b4-be5811aca38a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.410156 Dec 18 21:15:45.354797 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3270/6590] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:44 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:45.952181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:45.952181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:45.959584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:45.960197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:45.961094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:45.961630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.036886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:46.037504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:46.046264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:46.048190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.049247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:46.052993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.228594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:46.248719 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d01a1642-f1eb-40ed-9315-3461618668cc tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1469 microversion: 2.1 time: 0.303668 Dec 18 21:15:46.249898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3321/6591] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:45 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:46.268567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:46.270273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:46.276929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:46.277658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.278744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:46.279372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.311411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:46.320955 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-16dffdca-d29f-4175-81a5-7f62181b080f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.287862 Dec 18 21:15:46.323092 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3271/6592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:46 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:46.366757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:46.373414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:46.375053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:46.378450 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-54b7db7d-d5df-48ba-8faa-67d578abbac8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.122523 Dec 18 21:15:46.381222 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3322/6593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:46 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:46.385420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:46.386715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.388007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:46.389218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.551605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:46.561444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:46.563600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:46.565089 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-086d0e96-4cee-4c68-823c-86baaae11b8b tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.196105 Dec 18 21:15:46.566023 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3272/6594] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:46 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:46.963327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-2a17f393-248a-4d46-a8a0-afbb3701844f req-e6f9d189-8dd5-4c3a-b979-a1d83116ad4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc58871a-b684-483d-8cba-4fdbc8ec6a2b", "name": "network-vif-deleted", "tag": "5a74dcaa-dd1f-4048-bff3-72d877c828fd"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:46.965668 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:46.965668 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:15:46.974093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2a17f393-248a-4d46-a8a0-afbb3701844f req-e6f9d189-8dd5-4c3a-b979-a1d83116ad4d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:46.975031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-2a17f393-248a-4d46-a8a0-afbb3701844f req-e6f9d189-8dd5-4c3a-b979-a1d83116ad4d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:46.989256 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-2a17f393-248a-4d46-a8a0-afbb3701844f req-e6f9d189-8dd5-4c3a-b979-a1d83116ad4d service nova] Creating event network-vif-deleted:5a74dcaa-dd1f-4048-bff3-72d877c828fd for instance cc58871a-b684-483d-8cba-4fdbc8ec6a2b on nch2-master-1 Dec 18 21:15:46.995414 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-2a17f393-248a-4d46-a8a0-afbb3701844f req-e6f9d189-8dd5-4c3a-b979-a1d83116ad4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Dec 18 21:15:46.996346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3323/6595] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:47.267038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:47.267663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:47.277952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.278457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.279268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.279719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.313420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.313947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.314467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lazy-loading 'fault' on Instance uuid cc58871a-b684-483d-8cba-4fdbc8ec6a2b {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:15:47.351230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:47.352072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:47.361250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480f527dbe434218a49acb6095d4d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:47.362241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.362759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.364131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.364567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.369298 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-73830d12-504a-4e35-b21d-310d101ef3e2 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 200 len: 1303 microversion: 2.1 time: 0.105976 Dec 18 21:15:47.369941 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3273/6596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:47 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:47.398628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:47.400115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:47.408409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.408881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.409696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.410187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.533913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:47.554096 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5def42c3-de0e-49ce-baa0-4b6c4aa14cc6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.160205 Dec 18 21:15:47.557792 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3274/6597] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:47 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:47.578721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:47.584809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:47.587996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:47.597073 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0065cb28-9a0d-4e5e-a5b8-2168a33f34fa tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.251288 Dec 18 21:15:47.626799 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3324/6598] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:47 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:47.630921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.631696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.632568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:47.633185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:47.838860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:47.854835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:47.857560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:47.859486 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5de1aef8-73be-4362-a41d-c8148d95badd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.278594 Dec 18 21:15:47.860758 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3275/6599] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:47 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:15:48.293576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a113db31-1100-4878-8795-d37a218f0a98 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Action: 'create', calling method: .version_select at 0x7f714e36b430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-84950342", "metadata": {"Type": "work"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:48.388306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:48.389224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] [instance: cc58871a-b684-483d-8cba-4fdbc8ec6a2b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:48.396638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.397103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:48.398811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.399959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:48.419155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] HTTP exception thrown: Instance cc58871a-b684-483d-8cba-4fdbc8ec6a2b could not be found. Dec 18 21:15:48.420256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] Returning 404 to user: Instance cc58871a-b684-483d-8cba-4fdbc8ec6a2b could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:48.421969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab7131db-7e7a-426c-af41-efa06c463c44 tempest-VolumesBackupsTest-1696781328 tempest-VolumesBackupsTest-1696781328-project] 10.222.0.13 "GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b" status: 404 len: 111 microversion: 2.1 time: 0.037353 Dec 18 21:15:48.422775 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3276/6600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:48 2021] GET /compute/v2.1/servers/cc58871a-b684-483d-8cba-4fdbc8ec6a2b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:15:48.572309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:48.572946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:48.585853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.586355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:48.587175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.587631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:48.693438 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a113db31-1100-4878-8795-d37a218f0a98 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.535114 Dec 18 21:15:48.695096 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3325/6601] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:15:48 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 538 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 18 21:15:48.708034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:48.710664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:48.721198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:48.723189 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a855b5c1-caaf-4b05-a011-8d4ade0c0613 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.154699 Dec 18 21:15:48.726232 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3277/6602] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:48 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:48.737806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ecfb330b-f416-4193-84dd-c24b6e39fb6d tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Calling method '.version_select at 0x7f714fd82790>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:48.741556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.742130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:48.742940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.743390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:48.852848 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ecfb330b-f416-4193-84dd-c24b6e39fb6d tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7" status: 200 len: 344 microversion: 2.1 time: 0.124326 Dec 18 21:15:48.853412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3278/6603] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:15:48 2021] GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7 => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:48.880464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:48.882783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:48.892388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.895658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:48.897066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:48.897813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:49.059273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:49.069219 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e34dcddf-6f6f-4b12-a3f1-447fdad0d666 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.365538 Dec 18 21:15:49.074395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3326/6604] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:48 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:49.152292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:49.162107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:49.163834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:49.165200 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-670a9ad1-366b-4000-b293-ee03c10cae3c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.290733 Dec 18 21:15:49.165758 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3279/6605] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:48 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:49.742700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:49.743455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:49.750433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:49.751181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:49.752357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:49.753151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:49.813411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:49.821202 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6777490-a87a-497e-a1d4-c17ae141befc tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1144 microversion: 2.1 time: 0.082517 Dec 18 21:15:49.821771 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3327/6606] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:49 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:49.864949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8762b090-4b0a-4700-9f34-5cdbbf9f92e5 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Calling method '.version_select at 0x7f714f627ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:49.931009 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8762b090-4b0a-4700-9f34-5cdbbf9f92e5 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7" status: 200 len: 345 microversion: 2.1 time: 0.069811 Dec 18 21:15:49.931863 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3280/6607] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:15:49 2021] GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:49.942937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fd71594a-1c81-4062-b21c-5e6b98b266ea tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Calling method '.version_select at 0x7f714e309280>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:49.992582 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fd71594a-1c81-4062-b21c-5e6b98b266ea tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7" status: 200 len: 345 microversion: 2.1 time: 0.053795 Dec 18 21:15:49.993548 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3328/6608] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:15:49 2021] GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:50.006767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0ed245fa-802d-4d74-b28e-66be0d468443 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Calling method '.version_select at 0x7f714c494160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:50.087539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:50.088811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:50.091486 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0ed245fa-802d-4d74-b28e-66be0d468443 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7" status: 202 len: 0 microversion: 2.1 time: 0.089720 Dec 18 21:15:50.092197 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3281/6609] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:15:50 2021] DELETE /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:15:50.101743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06f10391-8e9f-4890-b534-a1b59b24e0bb tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Calling method '.version_select at 0x7f714c4ae310>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:50.108711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:50.112384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:50.115636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:50.117391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:50.215213 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06f10391-8e9f-4890-b534-a1b59b24e0bb tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7" status: 200 len: 344 microversion: 2.1 time: 0.118959 Dec 18 21:15:50.215888 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3282/6610] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:15:50 2021] GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:50.220689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:50.221614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:50.241622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:50.244054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:50.247755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:50.248228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:50.471809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:50.498086 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82eb916d-bba2-4063-9492-3fe850c7c727 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.414593 Dec 18 21:15:50.498978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3329/6611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:50 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:50.568307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:50.578574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:50.580464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:50.584095 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7123e28-ce0e-4e1a-9e41-aef8acefeed7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.366029 Dec 18 21:15:50.585149 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3283/6612] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:50 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:50.839173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:50.840910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:50.849997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:50.851686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:50.853277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:50.854070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:50.942106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:50.951679 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-71a1fc7f-4ff7-4782-8b62-06f6a5902d4a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1210 microversion: 2.1 time: 0.116546 Dec 18 21:15:50.952400 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3330/6613] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:50 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:51.227999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-32db70ba-89b4-4cdc-8735-22dd56fff509 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Calling method '.version_select at 0x7f715e3da550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:51.275938 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-32db70ba-89b4-4cdc-8735-22dd56fff509 tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7" status: 200 len: 344 microversion: 2.1 time: 0.051559 Dec 18 21:15:51.279293 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3284/6614] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:15:51 2021] GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:51.516361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:51.517102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:51.523855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:51.524314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:51.525169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:51.525595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:51.603014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:51.604635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:51.614703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:51.615856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:51.617514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:51.618142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:51.816713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:51.826674 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-17f9296f-e446-4abb-abe3-be8c423db9ac tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.312196 Dec 18 21:15:51.828052 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3331/6615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:51 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:51.907705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:51.918465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:51.920083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:51.921353 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4d708ae-d363-4ec6-9d31-6b352c33c86e tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.323177 Dec 18 21:15:51.921936 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3285/6616] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:51 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:51.970629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:51.971632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:51.983182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:51.986164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:51.987305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:51.989249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:52.248374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:52.257671 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b2e086a-7635-4c00-af91-83e4b6d1938f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1278 microversion: 2.1 time: 0.292401 Dec 18 21:15:52.258285 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3332/6617] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:51 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:52.289619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab2dde57-b1ea-4753-b0d8-1299939e0dbb tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Calling method '.version_select at 0x7f71613a1550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:52.318799 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ab2dde57-b1ea-4753-b0d8-1299939e0dbb tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] HTTP exception thrown: Volume 449a875b-1e8f-4b1a-8919-c5108df657c7 could not be found. Dec 18 21:15:52.319421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab2dde57-b1ea-4753-b0d8-1299939e0dbb tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] Returning 404 to user: Volume 449a875b-1e8f-4b1a-8919-c5108df657c7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:52.320276 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab2dde57-b1ea-4753-b0d8-1299939e0dbb tempest-VolumesGetTestJSON-2060073084 tempest-VolumesGetTestJSON-2060073084-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7" status: 404 len: 109 microversion: 2.1 time: 0.035258 Dec 18 21:15:52.320820 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3286/6618] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:15:52 2021] GET /compute/v2.1/os-volumes/449a875b-1e8f-4b1a-8919-c5108df657c7 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:52.849496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:52.850401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:52.863886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:52.864788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:52.867017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:52.867828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:52.943241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:52.943873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:52.961935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:52.962501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:52.964842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:52.965316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:53.088374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:53.102807 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a400edc-48e2-4587-85f5-27116c669aba tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1691 microversion: 2.1 time: 0.259911 Dec 18 21:15:53.114189 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3333/6619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:52 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:53.291188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:53.293939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:53.308895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:53.309767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:53.310917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:53.311118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:53.438578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:53.462220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:53.468110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:53.470441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6100214-f824-458b-bf0b-1bfed79ef027 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.533052 Dec 18 21:15:53.476558 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3287/6620] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:52 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:53.543992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:53.588491 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cafc6376-0126-47a6-bb3f-5e0875035662 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1266 microversion: 2.1 time: 0.301442 Dec 18 21:15:53.605577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-cf1a0ee1-a97d-442e-8b61-cd420bbdfbd9 req-e25c9d7f-9ad5-4d9f-b26d-4a71059126c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc66115-f830-404b-b50a-e0fa7a1b14cc", "tag": "a7cafa90-4ea2-464a-974c-82429732a64d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:53.615482 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3334/6621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:53 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:53.615619 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:53.615619 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:53.643293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cf1a0ee1-a97d-442e-8b61-cd420bbdfbd9 req-e25c9d7f-9ad5-4d9f-b26d-4a71059126c1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:53.646576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cf1a0ee1-a97d-442e-8b61-cd420bbdfbd9 req-e25c9d7f-9ad5-4d9f-b26d-4a71059126c1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:53.679244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-cf1a0ee1-a97d-442e-8b61-cd420bbdfbd9 req-e25c9d7f-9ad5-4d9f-b26d-4a71059126c1 service nova] Creating event network-changed:a7cafa90-4ea2-464a-974c-82429732a64d for instance 9dc66115-f830-404b-b50a-e0fa7a1b14cc on nch1-master-1 Dec 18 21:15:53.688791 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-cf1a0ee1-a97d-442e-8b61-cd420bbdfbd9 req-e25c9d7f-9ad5-4d9f-b26d-4a71059126c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099745 Dec 18 21:15:53.691841 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3288/6622] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:54.127283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:54.129950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:54.171119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.173039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.185566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.187190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.385685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:54.395041 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-318f1e2b-c82c-4f9a-9583-29eeca3aee1a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1681 microversion: 2.1 time: 0.277616 Dec 18 21:15:54.396968 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3335/6623] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:54 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:54.413862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82b188ac-0a89-4689-bb16-bb4fccc302e8 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:54.414935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82b188ac-0a89-4689-bb16-bb4fccc302e8 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:54.422414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b188ac-0a89-4689-bb16-bb4fccc302e8 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.423213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b188ac-0a89-4689-bb16-bb4fccc302e8 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.424291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b188ac-0a89-4689-bb16-bb4fccc302e8 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.425172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82b188ac-0a89-4689-bb16-bb4fccc302e8 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.607015 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82b188ac-0a89-4689-bb16-bb4fccc302e8 tempest-TestNetworkAdvancedServerOps-516260255 tempest-TestNetworkAdvancedServerOps-516260255-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1832 microversion: 2.1 time: 0.197150 Dec 18 21:15:54.609932 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3289/6624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:54 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1832 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:54.629131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:54.629994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:54.637047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.637866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.638890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.639520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.655496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cfe9c768-cf59-4083-bc32-d2e13a736da2 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Action: 'create', calling method: .version_select at 0x7f714e36b1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-37299595", "metadata": {"Type": "work"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:54.656793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cfe9c768-cf59-4083-bc32-d2e13a736da2 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:54.659339 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cfe9c768-cf59-4083-bc32-d2e13a736da2 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.199820 Dec 18 21:15:54.662463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3336/6625] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:15:54 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:15:54.674698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:54.676696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:54.703902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.709554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.710646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.711307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.881098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:54.894599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:54.896348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:54.898533 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fc4c7dfa-4653-4b10-ba5e-d2d6b4e7a876 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.273915 Dec 18 21:15:54.899350 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3290/6626] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:54 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:54.906944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:54.907747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:54.916796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.917104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:54.917507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.918797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:54.919380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:54.928174 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-109a52f4-ce69-45ac-bea9-8f170ba1d7f8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1266 microversion: 2.1 time: 0.264350 Dec 18 21:15:54.929299 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3337/6627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:54 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:54.934119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-184e278e-2d41-4340-86ed-58384b4b87cb tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Action: 'create', calling method: .version_select at 0x7f714e36b310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1733140367", "metadata": {"Type": "work"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:54.936051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-184e278e-2d41-4340-86ed-58384b4b87cb tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:54.937277 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-184e278e-2d41-4340-86ed-58384b4b87cb tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006661 Dec 18 21:15:54.937979 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3338/6628] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:15:54 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:15:54.954326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a541708-415b-445b-9d9f-c64d60760675 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Action: 'create', calling method: .version_select at 0x7f714e503dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-240784825", "metadata": {"Type": "work"}}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:54.955835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a541708-415b-445b-9d9f-c64d60760675 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:54.957289 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6a541708-415b-445b-9d9f-c64d60760675 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009482 Dec 18 21:15:54.960339 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3339/6629] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:15:54 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:15:54.971739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d744886a-0dd4-4aea-a3de-bf0267eef6f6 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Calling method '.version_select at 0x7f714e503280>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:55.008939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d744886a-0dd4-4aea-a3de-bf0267eef6f6 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] HTTP exception thrown: Volume tempest-invalid-751472769 could not be found. Dec 18 21:15:55.009744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d744886a-0dd4-4aea-a3de-bf0267eef6f6 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Returning 404 to user: Volume tempest-invalid-751472769 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:55.010810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d744886a-0dd4-4aea-a3de-bf0267eef6f6 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-751472769" status: 404 len: 98 microversion: 2.1 time: 0.046351 Dec 18 21:15:55.011360 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3340/6630] 10.222.0.13 () {58 vars in 1214 bytes} [Sat Dec 18 21:15:54 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-751472769 => generated 98 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 18 21:15:55.020586 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-77056aa1-cf57-4fd6-b7e0-8e807e870843 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004158 Dec 18 21:15:55.021385 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3341/6631] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Dec 18 21:15:55 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 18 21:15:55.036946 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fb9895c-b922-4f98-ba03-2ae1fb391169 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009523 Dec 18 21:15:55.037573 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3342/6632] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 21:15:55 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 18 21:15:55.047142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b30044ae-dda8-4dee-8737-0a679f2c39ab tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Calling method '.version_select at 0x7f714e5b10d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:55.075913 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-b30044ae-dda8-4dee-8737-0a679f2c39ab tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] HTTP exception thrown: Volume fde68ad1-57c0-401f-ad62-95c29646b0a5 could not be found. Dec 18 21:15:55.076769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b30044ae-dda8-4dee-8737-0a679f2c39ab tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Returning 404 to user: Volume fde68ad1-57c0-401f-ad62-95c29646b0a5 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:55.077623 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b30044ae-dda8-4dee-8737-0a679f2c39ab tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/fde68ad1-57c0-401f-ad62-95c29646b0a5" status: 404 len: 109 microversion: 2.1 time: 0.034757 Dec 18 21:15:55.078177 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3343/6633] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:15:55 2021] DELETE /compute/v2.1/os-volumes/fde68ad1-57c0-401f-ad62-95c29646b0a5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:15:55.090693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:55.098448 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cb014ecb-ea7b-459d-9716-a923d19bcca4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1681 microversion: 2.1 time: 0.197806 Dec 18 21:15:55.099597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17c01f80-1796-4d35-9bbc-d00bcf8bc6b0 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Calling method '.version_select at 0x7f714e36b1f0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:55.100565 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3291/6634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:54 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:55.136444 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-17c01f80-1796-4d35-9bbc-d00bcf8bc6b0 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] HTTP exception thrown: Volume 9c4c933c-273e-43fa-ad05-3752276b8275 could not be found. Dec 18 21:15:55.137052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17c01f80-1796-4d35-9bbc-d00bcf8bc6b0 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] Returning 404 to user: Volume 9c4c933c-273e-43fa-ad05-3752276b8275 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:55.137960 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-17c01f80-1796-4d35-9bbc-d00bcf8bc6b0 tempest-VolumesNegativeTest-2126637063 tempest-VolumesNegativeTest-2126637063-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9c4c933c-273e-43fa-ad05-3752276b8275" status: 404 len: 109 microversion: 2.1 time: 0.054621 Dec 18 21:15:55.138116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f6c794d9-4d06-4d65-8afd-45fcdb8dda03 req-691d0c6b-0d90-4d7e-b15a-e4290f6ea876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "name": "network-vif-plugged", "status": "completed", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:55.138826 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3344/6635] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:15:55 2021] GET /compute/v2.1/os-volumes/9c4c933c-273e-43fa-ad05-3752276b8275 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:55.143987 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:55.143987 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:55.152931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f6c794d9-4d06-4d65-8afd-45fcdb8dda03 req-691d0c6b-0d90-4d7e-b15a-e4290f6ea876 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:55.154170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f6c794d9-4d06-4d65-8afd-45fcdb8dda03 req-691d0c6b-0d90-4d7e-b15a-e4290f6ea876 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:55.169642 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f6c794d9-4d06-4d65-8afd-45fcdb8dda03 req-691d0c6b-0d90-4d7e-b15a-e4290f6ea876 service nova] Creating event network-vif-plugged:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch1-master-1 Dec 18 21:15:55.177269 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f6c794d9-4d06-4d65-8afd-45fcdb8dda03 req-691d0c6b-0d90-4d7e-b15a-e4290f6ea876 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044157 Dec 18 21:15:55.178158 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3292/6636] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:55.246540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b8b04888-58e0-4b39-a71e-11f06f1dc8f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:55.247789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b8b04888-58e0-4b39-a71e-11f06f1dc8f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:55.254895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8b04888-58e0-4b39-a71e-11f06f1dc8f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:55.255355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8b04888-58e0-4b39-a71e-11f06f1dc8f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:55.256191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8b04888-58e0-4b39-a71e-11f06f1dc8f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:55.256633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b8b04888-58e0-4b39-a71e-11f06f1dc8f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:55.313458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b8b04888-58e0-4b39-a71e-11f06f1dc8f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action" status: 200 len: 38643 microversion: 2.1 time: 0.070952 Dec 18 21:15:55.314292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3345/6637] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:15:55 2021] POST /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f/action => generated 38643 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:15:55.923180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:55.924088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:55.933741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:55.935236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:55.936605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:55.937087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:55.948513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:55.949259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:55.971255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:55.972051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:55.973650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:55.976167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:56.478380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:56.489131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:56.492176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:56.502759 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62058169-b266-4922-bb4e-d8c18a2f5d94 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1266 microversion: 2.1 time: 0.560107 Dec 18 21:15:56.506666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:56.510354 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3a7da45b-b1a3-4e83-96c8-6109d825d141 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.593752 Dec 18 21:15:56.512212 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3293/6638] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:55 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:56.537958 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3346/6639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:55 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1266 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:57.416457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:57.416983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:57.427516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:57.428351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:57.429802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:57.430501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:57.430813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7002befa-7917-4311-af96-5076ae60ae47 req-1f988378-c1a7-49c2-ac82-ce90e784b9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:57.432654 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:57.432654 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:15:57.474909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7002befa-7917-4311-af96-5076ae60ae47 req-1f988378-c1a7-49c2-ac82-ce90e784b9f9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:57.483189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:15:57.484413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7002befa-7917-4311-af96-5076ae60ae47 req-1f988378-c1a7-49c2-ac82-ce90e784b9f9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:57.517109 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-7002befa-7917-4311-af96-5076ae60ae47 req-1f988378-c1a7-49c2-ac82-ce90e784b9f9 service nova] Creating event network-changed:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch2-master-1 Dec 18 21:15:57.528911 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7002befa-7917-4311-af96-5076ae60ae47 req-1f988378-c1a7-49c2-ac82-ce90e784b9f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101816 Dec 18 21:15:57.551992 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3347/6640] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:15:57.564940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:57.566744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:57.579977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:57.581730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:57.583293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:57.585284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:57.721055 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-79f74a26-c096-43ab-916f-281155e030a4 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 204 len: 0 microversion: 2.1 time: 0.310101 Dec 18 21:15:57.728469 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3294/6641] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:15:57 2021] DELETE /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:15:57.744044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:57.753398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:57.766696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:57.770835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:57.776760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:57.778155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:58.055608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:58.073064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:58.082413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:58.088372 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9db4f7d8-0b32-465d-8556-d26527426f60 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1727 microversion: 2.20 time: 0.534283 Dec 18 21:15:58.091692 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3348/6642] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:57 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1727 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:58.106438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:58.114787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:58.128223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:58.133935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:58.138080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:58.141392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:58.236355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:58.281318 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-460542fd-723a-4136-b33b-f63be8b82680 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1266 microversion: 2.1 time: 0.551065 Dec 18 21:15:58.282232 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3295/6643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:57 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1266 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:58.700741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:58.711100 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2b98de1d-368f-4c26-b985-691584a4e5bb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 200 len: 1687 microversion: 2.1 time: 0.615635 Dec 18 21:15:58.723187 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3349/6644] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:58 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 1687 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:15:59.109552 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:59.110430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:59.119115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:59.119956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:59.121130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:59.121937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:59.300824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:59.303205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:59.323443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:59.324185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:59.325041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:59.325482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:59.515576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:59.532090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:59.536013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:59.538195 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-54364ed7-62b5-42f6-8bdc-a7191e93ffcd tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1714 microversion: 2.20 time: 0.432887 Dec 18 21:15:59.540510 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3296/6645] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:15:59 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1714 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:15:59.604234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6a971b33-0e40-40cb-a118-fd7f5c015198 req-85f75c7c-74d0-4ae9-9dff-36df15d2bcc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f191cfff-6882-46e8-be0b-12fbfec0ec1f", "name": "network-vif-deleted", "tag": "bca0e7e4-0dfb-4100-aaa8-4c55aa06b336"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:15:59.607263 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:15:59.607263 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:15:59.608582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:15:59.617786 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba981dc8-d3be-4361-938f-631e46d931b5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1266 microversion: 2.1 time: 0.321725 Dec 18 21:15:59.620455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a971b33-0e40-40cb-a118-fd7f5c015198 req-85f75c7c-74d0-4ae9-9dff-36df15d2bcc3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:59.621105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a971b33-0e40-40cb-a118-fd7f5c015198 req-85f75c7c-74d0-4ae9-9dff-36df15d2bcc3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:59.623913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3350/6646] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:59 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:15:59.639124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6a971b33-0e40-40cb-a118-fd7f5c015198 req-85f75c7c-74d0-4ae9-9dff-36df15d2bcc3 service nova] Creating event network-vif-deleted:bca0e7e4-0dfb-4100-aaa8-4c55aa06b336 for instance f191cfff-6882-46e8-be0b-12fbfec0ec1f on nch2-master-1 Dec 18 21:15:59.646837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6a971b33-0e40-40cb-a118-fd7f5c015198 req-85f75c7c-74d0-4ae9-9dff-36df15d2bcc3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059463 Dec 18 21:15:59.649224 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3297/6647] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:15:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:15:59.730223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:15:59.731064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: f191cfff-6882-46e8-be0b-12fbfec0ec1f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:15:59.739895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:59.744234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:59.747929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:15:59.751075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:15:59.782584 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] HTTP exception thrown: Instance f191cfff-6882-46e8-be0b-12fbfec0ec1f could not be found. Dec 18 21:15:59.783673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Returning 404 to user: Instance f191cfff-6882-46e8-be0b-12fbfec0ec1f could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:15:59.784238 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ff5771c9-9131-4684-a254-2161c0dae261 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f" status: 404 len: 111 microversion: 2.1 time: 0.059245 Dec 18 21:15:59.788882 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3351/6648] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:15:59 2021] GET /compute/v2.1/servers/f191cfff-6882-46e8-be0b-12fbfec0ec1f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:16:00.642321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:00.644210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:00.654129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:00.655057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:00.656274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:00.657047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:00.988848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:01.001963 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-584f79d0-81e3-40ed-a90e-0eedfa10ecd4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1266 microversion: 2.1 time: 0.365404 Dec 18 21:16:01.002701 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3298/6649] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:00 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:01.203355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ded7eeb6-694c-4841-a23e-dbe07356b3ed req-de7b7e65-6cf4-4015-a773-c2c946166ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc66115-f830-404b-b50a-e0fa7a1b14cc", "name": "network-vif-plugged", "status": "completed", "tag": "a7cafa90-4ea2-464a-974c-82429732a64d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:01.206008 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:16:01.206008 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:16:01.217469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ded7eeb6-694c-4841-a23e-dbe07356b3ed req-de7b7e65-6cf4-4015-a773-c2c946166ddc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:01.218184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ded7eeb6-694c-4841-a23e-dbe07356b3ed req-de7b7e65-6cf4-4015-a773-c2c946166ddc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:01.234219 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ded7eeb6-694c-4841-a23e-dbe07356b3ed req-de7b7e65-6cf4-4015-a773-c2c946166ddc service nova] Creating event network-vif-plugged:a7cafa90-4ea2-464a-974c-82429732a64d for instance 9dc66115-f830-404b-b50a-e0fa7a1b14cc on nch1-master-1 Dec 18 21:16:01.241496 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ded7eeb6-694c-4841-a23e-dbe07356b3ed req-de7b7e65-6cf4-4015-a773-c2c946166ddc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042082 Dec 18 21:16:01.242164 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3352/6650] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:16:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:02.020859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:02.022173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:02.030976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:02.032556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:02.033832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:02.034921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:02.454744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:02.465751 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bbe57a6c-e0bd-4a6a-9272-175fe136ccba tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1266 microversion: 2.1 time: 0.448667 Dec 18 21:16:02.467102 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3299/6651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:02 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1266 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:03.484859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:03.485656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:03.498761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:03.499538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:03.500588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:03.501264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:03.796944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:03.805547 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25dc83a8-a80b-4119-a0b7-fc70ce0e984a tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1454 microversion: 2.1 time: 0.326086 Dec 18 21:16:03.806122 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3353/6652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:03 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1454 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:03.822021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:03.822599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:03.830473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:03.830960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:03.832299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:03.832753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:04.183515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:04.200427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a535507-a978-4bf1-8e60-9d93002472df tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1454 microversion: 2.1 time: 0.382108 Dec 18 21:16:04.205543 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3300/6653] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:03 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1454 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:04.999045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-546c1d36-e697-409b-9e41-81dd184ee9ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '.version_select at 0x7f714e57d5e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:05.029645 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-546c1d36-e697-409b-9e41-81dd184ee9ef tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1417272746" status: 202 len: 0 microversion: 2.1 time: 0.034755 Dec 18 21:16:05.030323 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3354/6654] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Dec 18 21:16:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1417272746 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:16:05.056934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-25f07f12-e6a0-421a-b3ef-699df8c7b21d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: .version_select at 0x7f714ecd8dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-374927044"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:05.074974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-25f07f12-e6a0-421a-b3ef-699df8c7b21d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:16:05.082471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-25f07f12-e6a0-421a-b3ef-699df8c7b21d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:16:05.233223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-25f07f12-e6a0-421a-b3ef-699df8c7b21d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:16:05.239903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-25f07f12-e6a0-421a-b3ef-699df8c7b21d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:16:05.258110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-25f07f12-e6a0-421a-b3ef-699df8c7b21d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.204810 Dec 18 21:16:05.259252 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3301/6655] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:16:05 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:07.145160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b49e2944-580e-44a7-ae7a-a2ed0bbb9e74 req-f7d2d619-d1c5-47b1-b39a-cf1e40a8cb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc66115-f830-404b-b50a-e0fa7a1b14cc", "tag": "a7cafa90-4ea2-464a-974c-82429732a64d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:07.146978 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:16:07.146978 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:16:07.162500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b49e2944-580e-44a7-ae7a-a2ed0bbb9e74 req-f7d2d619-d1c5-47b1-b39a-cf1e40a8cb68 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:07.163291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b49e2944-580e-44a7-ae7a-a2ed0bbb9e74 req-f7d2d619-d1c5-47b1-b39a-cf1e40a8cb68 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:07.198449 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b49e2944-580e-44a7-ae7a-a2ed0bbb9e74 req-f7d2d619-d1c5-47b1-b39a-cf1e40a8cb68 service nova] Creating event network-changed:a7cafa90-4ea2-464a-974c-82429732a64d for instance 9dc66115-f830-404b-b50a-e0fa7a1b14cc on nch1-master-1 Dec 18 21:16:07.210451 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b49e2944-580e-44a7-ae7a-a2ed0bbb9e74 req-f7d2d619-d1c5-47b1-b39a-cf1e40a8cb68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069801 Dec 18 21:16:07.231149 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3355/6656] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:16:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:15.556122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1182511943", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "328aa90f-1591-4053-86d0-d23c5313a3ad"}], "key_name": "tempest-TestNetworkAdvancedServerOps-374927044", "security_groups": [{"name": "tempest-secgroup-smoke-153542237"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:15.782221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] validate_networks() for [('328aa90f-1591-4053-86d0-d23c5313a3ad', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:16:16.307638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:16:16.308086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:16:16.308582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:16:16.318548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:16:16.319142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:16:16.339617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:16.340252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:16.341226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:16.342720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:16.374231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:16:16.382040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Getting quotas for user f292f8174a7a4de5bf8a848e49f85dbe and project 71c859bfcff54b5c85e6cb248341f37c. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:16:16.401464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:16:16.404613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:16:16.475845 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74395b0e-345f-44c5-81d1-7c20e4d259b9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.927667 Dec 18 21:16:16.476505 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3302/6657] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:16:15 2021] POST /compute/v2.1/servers => generated 405 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:16:16.488166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fa5cd14-6875-43ce-aa08-821502302122 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:16.489242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fa5cd14-6875-43ce-aa08-821502302122 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:16.598441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7fa5cd14-6875-43ce-aa08-821502302122 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:16.606901 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fa5cd14-6875-43ce-aa08-821502302122 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1266 microversion: 2.1 time: 0.123790 Dec 18 21:16:16.610557 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3356/6658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:16 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:17.629529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:17.632370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:17.656329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:17.656803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:17.660119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:17.662979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:17.853299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:17.863811 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55daa52f-4ee3-4738-886a-83d63a83b4cd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1318 microversion: 2.1 time: 0.242774 Dec 18 21:16:17.868993 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3303/6659] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:17 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:18.890134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:18.890793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:18.898673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:18.899372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:18.901027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:18.901897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:19.015065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:19.026049 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52c044de-616f-42bc-9ba6-ff5a7cd2291f tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1324 microversion: 2.1 time: 0.139575 Dec 18 21:16:19.027013 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3357/6660] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:18 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1324 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:20.048545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:20.050707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:20.069660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:20.070975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:20.073209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:20.073692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:20.547591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-25c90a57-f23f-4232-9a78-2f613961305a req-fab8b205-81cd-4645-8686-260e6dc61613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b796a5-4c32-412d-9bc1-b4219233b129", "tag": "eab4ed4b-542e-4493-9473-7dd3c88992e8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:20.549160 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:16:20.549160 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:16:20.557761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-25c90a57-f23f-4232-9a78-2f613961305a req-fab8b205-81cd-4645-8686-260e6dc61613 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:20.558489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-25c90a57-f23f-4232-9a78-2f613961305a req-fab8b205-81cd-4645-8686-260e6dc61613 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:20.575291 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-25c90a57-f23f-4232-9a78-2f613961305a req-fab8b205-81cd-4645-8686-260e6dc61613 service nova] Creating event network-changed:eab4ed4b-542e-4493-9473-7dd3c88992e8 for instance 47b796a5-4c32-412d-9bc1-b4219233b129 on nch2-master-1 Dec 18 21:16:20.586391 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-25c90a57-f23f-4232-9a78-2f613961305a req-fab8b205-81cd-4645-8686-260e6dc61613 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042814 Dec 18 21:16:20.587587 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3358/6661] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:16:21.016349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:21.024992 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6dda2618-d593-4691-9f7a-38f0b9a84521 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1391 microversion: 2.1 time: 0.984189 Dec 18 21:16:21.025994 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3304/6662] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:20 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1391 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:22.045096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:22.046562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:22.053098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:22.053478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:22.054297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:22.054745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:22.400994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:22.414997 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-704127db-26b4-41ed-8b7b-69d6338db091 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1391 microversion: 2.1 time: 0.375887 Dec 18 21:16:22.415602 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3359/6663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:22 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1391 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:23.432292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:23.432943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:23.447981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:23.448306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:23.449121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:23.449771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:23.663070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:23.674163 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ebb3b18-d1fc-4f32-bf52-77a051bc5b8d tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1391 microversion: 2.1 time: 0.245756 Dec 18 21:16:23.675296 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3305/6664] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:23 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:24.692610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:24.694092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:24.701397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:24.702485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:24.703787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:24.704306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:24.873311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:24.888854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b0bbbe6f-2d6b-4f45-9e36-dc6d9bb78b69 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1391 microversion: 2.1 time: 0.200755 Dec 18 21:16:24.890030 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3360/6665] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:24 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:25.223266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-8d18f560-7d89-4d84-96d0-4ac546699897 req-ae184161-6c92-41ee-8d5e-e8f96db112ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b796a5-4c32-412d-9bc1-b4219233b129", "name": "network-vif-plugged", "status": "completed", "tag": "eab4ed4b-542e-4493-9473-7dd3c88992e8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:25.226523 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:16:25.226523 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:16:25.235935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-8d18f560-7d89-4d84-96d0-4ac546699897 req-ae184161-6c92-41ee-8d5e-e8f96db112ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:25.237520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-8d18f560-7d89-4d84-96d0-4ac546699897 req-ae184161-6c92-41ee-8d5e-e8f96db112ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:25.249535 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-8d18f560-7d89-4d84-96d0-4ac546699897 req-ae184161-6c92-41ee-8d5e-e8f96db112ff service nova] Creating event network-vif-plugged:eab4ed4b-542e-4493-9473-7dd3c88992e8 for instance 47b796a5-4c32-412d-9bc1-b4219233b129 on nch2-master-1 Dec 18 21:16:25.254846 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-8d18f560-7d89-4d84-96d0-4ac546699897 req-ae184161-6c92-41ee-8d5e-e8f96db112ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042926 Dec 18 21:16:25.255901 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3306/6666] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:16:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:16:25.907499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:25.908045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:25.915497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:25.915951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:25.916735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:25.917173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:26.106960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:26.114592 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccb1077c-b22a-41d3-9ac6-b60eaa5a74f1 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1391 microversion: 2.1 time: 0.210764 Dec 18 21:16:26.115173 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3361/6667] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:25 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:27.132654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:27.133481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:27.140708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:27.141180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:27.142021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:27.142510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:27.359713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:27.370929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1d3df0fa-670b-44d3-ae44-2bec4a659a70 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1564 microversion: 2.1 time: 0.242237 Dec 18 21:16:27.371523 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3307/6668] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:27 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1564 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:27.387422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:27.388034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:27.394873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:27.395537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:27.396559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:27.397030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:27.687724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:27.706317 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc186cd5-2dff-4c32-9d4b-cab0acf740a5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1564 microversion: 2.1 time: 0.322489 Dec 18 21:16:27.709925 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3362/6669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:27 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1564 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:30.124010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:30.124783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:30.137603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:30.138082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:30.138478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-857a5dfc-e8ed-4019-88b2-4b056e05c329 req-924d408c-40d6-4d86-81aa-25faf8fbd458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b796a5-4c32-412d-9bc1-b4219233b129", "tag": "eab4ed4b-542e-4493-9473-7dd3c88992e8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:30.138935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:30.139560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:30.140676 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:16:30.140676 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:16:30.155154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-857a5dfc-e8ed-4019-88b2-4b056e05c329 req-924d408c-40d6-4d86-81aa-25faf8fbd458 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:30.156264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-857a5dfc-e8ed-4019-88b2-4b056e05c329 req-924d408c-40d6-4d86-81aa-25faf8fbd458 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:30.176458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-857a5dfc-e8ed-4019-88b2-4b056e05c329 req-924d408c-40d6-4d86-81aa-25faf8fbd458 service nova] Creating event network-changed:eab4ed4b-542e-4493-9473-7dd3c88992e8 for instance 47b796a5-4c32-412d-9bc1-b4219233b129 on nch2-master-1 Dec 18 21:16:30.195012 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-857a5dfc-e8ed-4019-88b2-4b056e05c329 req-924d408c-40d6-4d86-81aa-25faf8fbd458 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061423 Dec 18 21:16:30.196067 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3363/6670] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:16:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Dec 18 21:16:30.486397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:30.501588 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b944379f-caee-4b5a-911b-3832d56cccf8 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1564 microversion: 2.1 time: 0.381213 Dec 18 21:16:30.505821 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3308/6671] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:30 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1564 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:31.605755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-54bf776f-9ea8-42d3-ad25-e46df1c30b72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:31.607922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-54bf776f-9ea8-42d3-ad25-e46df1c30b72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:31.618272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54bf776f-9ea8-42d3-ad25-e46df1c30b72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:31.619065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54bf776f-9ea8-42d3-ad25-e46df1c30b72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:31.620130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54bf776f-9ea8-42d3-ad25-e46df1c30b72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:31.620288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-54bf776f-9ea8-42d3-ad25-e46df1c30b72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:31.657642 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-54bf776f-9ea8-42d3-ad25-e46df1c30b72 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064411 Dec 18 21:16:31.658578 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3364/6672] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Dec 18 21:16:31 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:16:31.724080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:31.724586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:31.732219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:31.733706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:31.734647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:31.735111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:31.770685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:16:31.852651 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1970a1ff-aadd-40cc-86ba-352f3f82a458 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 204 len: 0 microversion: 2.20 time: 0.131837 Dec 18 21:16:31.853639 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3309/6673] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:16:31 2021] DELETE /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:16:31.862631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:31.863333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:31.869938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:31.870486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:31.871291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:31.871744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:32.032350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:32.041352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:32.042920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:32.044108 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8335696b-ff01-4782-8bdd-9f4f64ed211d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.186441 Dec 18 21:16:32.045455 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3365/6674] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:16:31 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:16:33.066562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:33.067202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:33.074146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:33.074694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:33.075527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:33.075976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:33.225564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:33.263712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:33.265992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:33.267829 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca949a7f-1639-4c07-a0c9-6c6635412c1d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.206400 Dec 18 21:16:33.268906 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3310/6675] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:16:33 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 21:16:34.290934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:34.292091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:34.302572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:34.303250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:34.304360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:34.305109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:34.579534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:34.590099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:34.591919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdd05da990fb4f7290fb926a258de4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ef041cd6724458b053cde5c1afe4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:34.594093 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-392aeb38-9bca-4afd-bcd8-3786adcc5513 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 200 len: 1720 microversion: 2.20 time: 0.311067 Dec 18 21:16:34.595196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3366/6676] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:16:34 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 1720 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 21:16:34.819535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6052243a-5835-4eee-bb59-58b2c9a75ee1 req-88fce3e5-8ccd-4ce1-b864-c375b6004ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d25881b-6ed3-4a4a-a67f-6deccf75b680", "name": "network-vif-deleted", "tag": "8fc3959f-d4a6-42b7-97eb-c57af1bbe971"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:34.821503 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:16:34.821503 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:16:34.856966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6052243a-5835-4eee-bb59-58b2c9a75ee1 req-88fce3e5-8ccd-4ce1-b864-c375b6004ed6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:34.858616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6052243a-5835-4eee-bb59-58b2c9a75ee1 req-88fce3e5-8ccd-4ce1-b864-c375b6004ed6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:34.885599 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6052243a-5835-4eee-bb59-58b2c9a75ee1 req-88fce3e5-8ccd-4ce1-b864-c375b6004ed6 service nova] Creating event network-vif-deleted:8fc3959f-d4a6-42b7-97eb-c57af1bbe971 for instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 on nch1-master-1 Dec 18 21:16:34.901461 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6052243a-5835-4eee-bb59-58b2c9a75ee1 req-88fce3e5-8ccd-4ce1-b864-c375b6004ed6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084343 Dec 18 21:16:34.902217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3311/6677] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:16:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:35.620735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:35.621797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:35.631290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:35.632053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:35.633309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:35.633931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:35.652027 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] HTTP exception thrown: Instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 could not be found. Dec 18 21:16:35.652701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Returning 404 to user: Instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:35.653597 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-34de5323-46a8-4c37-a399-abf79669c84c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 404 len: 111 microversion: 2.20 time: 0.037286 Dec 18 21:16:35.654203 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3367/6678] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:16:35 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:16:35.665050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5f2c0819-10e6-428c-bc18-3668b4a56ec7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '.version_select at 0x7f714c49fee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:35.687783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5f2c0819-10e6-428c-bc18-3668b4a56ec7 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-820285946" status: 204 len: 0 microversion: 2.20 time: 0.026918 Dec 18 21:16:35.688723 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3312/6679] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Dec 18 21:16:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-820285946 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 21:16:37.662793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:37.663414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:37.675784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:37.678673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:37.679570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:37.680059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:37.726199 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] HTTP exception thrown: Instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 could not be found. Dec 18 21:16:37.726934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Returning 404 to user: Instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:37.727886 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1afb919a-9c9d-47f0-8271-6946a6a1e14d tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 404 len: 111 microversion: 2.20 time: 0.069545 Dec 18 21:16:37.728851 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3368/6680] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:16:37 2021] DELETE /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:16:37.737514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:37.739299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 7d25881b-6ed3-4a4a-a67f-6deccf75b680] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:37.748485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:37.749111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:37.750113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:37.750717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:37.773754 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] HTTP exception thrown: Instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 could not be found. Dec 18 21:16:37.774715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Returning 404 to user: Instance 7d25881b-6ed3-4a4a-a67f-6deccf75b680 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:37.775897 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e5b9bd06-91e6-4b95-8e30-c102fad5c82a tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680" status: 404 len: 111 microversion: 2.20 time: 0.042838 Dec 18 21:16:37.777097 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3313/6681] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:16:37 2021] GET /compute/v2.1/servers/7d25881b-6ed3-4a4a-a67f-6deccf75b680 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:16:38.963865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:38.964951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:38.972076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:38.972650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:38.973528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:38.974074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:38.988522 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] HTTP exception thrown: Instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 could not be found. Dec 18 21:16:38.989480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Returning 404 to user: Instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:38.990503 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bf171b2a-9e69-4b1c-81e0-72050b99f04c tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 404 len: 111 microversion: 2.20 time: 0.030580 Dec 18 21:16:38.991214 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3369/6682] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Dec 18 21:16:38 2021] DELETE /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:16:38.999427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:39.000052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] [instance: 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:39.007324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:39.007837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:39.008615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:39.009066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:39.024772 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] HTTP exception thrown: Instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 could not be found. Dec 18 21:16:39.025811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] Returning 404 to user: Instance 0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:39.027025 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8cf85a3a-c371-41be-9459-3f9d66591bd0 tempest-AttachVolumeShelveTestJSON-764429992 tempest-AttachVolumeShelveTestJSON-764429992-project] 10.222.0.13 "GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9" status: 404 len: 111 microversion: 2.20 time: 0.031519 Dec 18 21:16:39.027747 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3314/6683] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Dec 18 21:16:38 2021] GET /compute/v2.1/servers/0308bf58-e5c0-4eb9-84dc-ad1a6e9a2ea9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 21:16:45.273176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99c447f4-41a8-44db-9f0d-705970c8fe55 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Action: 'create', calling method: .version_select at 0x7f714e37c9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-800121965"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:45.692542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99c447f4-41a8-44db-9f0d-705970c8fe55 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.534867 Dec 18 21:16:45.693358 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3370/6684] 10.222.0.13 () {60 vars in 1154 bytes} [Sat Dec 18 21:16:45 2021] POST /compute/v2.1/os-volumes => generated 337 bytes in 536 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 18 21:16:45.704393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0ae62e44-554f-4d98-a298-0cf7df8709a2 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714c4768b0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:45.846636 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0ae62e44-554f-4d98-a298-0cf7df8709a2 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e" status: 200 len: 337 microversion: 2.1 time: 0.146347 Dec 18 21:16:45.847484 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3315/6685] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:16:45 2021] GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e => generated 337 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:46.859247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eb4f6297-1b34-486e-a34c-bf2a0dc4a434 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714e5c2a60>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:46.916573 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eb4f6297-1b34-486e-a34c-bf2a0dc4a434 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e" status: 200 len: 338 microversion: 2.1 time: 0.062479 Dec 18 21:16:46.917063 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3371/6686] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:16:46 2021] GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e => generated 338 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:46.930033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5cde3c73-6713-4b1d-8a25-2624532e0302 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Action: 'create', calling method: .version_select at 0x7f714fdc3160>, body: {"snapshot": {"volume_id": "aefbe96f-d1ec-4188-99c4-b4da233de88e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1488583054"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:47.076868 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5cde3c73-6713-4b1d-8a25-2624532e0302 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.152683 Dec 18 21:16:47.082872 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3316/6687] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Dec 18 21:16:46 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:47.087820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-119ed1f6-793d-4031-8d38-a53150c1c1af tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f71614ab160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:47.122497 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-119ed1f6-793d-4031-8d38-a53150c1c1af tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20" status: 200 len: 287 microversion: 2.1 time: 0.038227 Dec 18 21:16:47.123272 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3372/6688] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:16:47 2021] GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:47.133241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-357afe3e-7d4c-4b53-a2e4-3ae1127b0edb tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714c4774c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:47.168257 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-357afe3e-7d4c-4b53-a2e4-3ae1127b0edb tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038699 Dec 18 21:16:47.169258 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3317/6689] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Dec 18 21:16:47 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:47.178936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c8b0c06e-ac62-4ad7-b52e-17b429db16d2 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714e5b1550>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:47.209955 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c8b0c06e-ac62-4ad7-b52e-17b429db16d2 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20" status: 200 len: 287 microversion: 2.1 time: 0.034565 Dec 18 21:16:47.210729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3373/6690] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:16:47 2021] GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:48.222357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7788cef4-9b79-4b53-af9a-5f8eb4b31c33 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714c437940>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:48.254794 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7788cef4-9b79-4b53-af9a-5f8eb4b31c33 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20" status: 200 len: 288 microversion: 2.1 time: 0.037650 Dec 18 21:16:48.259568 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3318/6691] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:16:48 2021] GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20 => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:48.265484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19a888c4-b9ea-436f-bac6-75a56e0ae2cc tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714e6310d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:48.321756 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19a888c4-b9ea-436f-bac6-75a56e0ae2cc tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20" status: 202 len: 0 microversion: 2.1 time: 0.059996 Dec 18 21:16:48.322353 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3374/6692] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:16:48 2021] DELETE /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:16:48.330920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13f17b4e-dd21-4ffe-bb7a-8048d9f93629 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714c437a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:48.364455 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13f17b4e-dd21-4ffe-bb7a-8048d9f93629 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20" status: 200 len: 287 microversion: 2.1 time: 0.037788 Dec 18 21:16:48.365100 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3319/6693] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:16:48 2021] GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:49.376124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0b7a516a-bcd3-4cd9-ab92-62c797008475 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714e37cd30>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:49.401394 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0b7a516a-bcd3-4cd9-ab92-62c797008475 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] HTTP exception thrown: Snapshot 15751919-f5ee-47a7-8014-a5e788730d20 could not be found. Dec 18 21:16:49.401993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0b7a516a-bcd3-4cd9-ab92-62c797008475 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Returning 404 to user: Snapshot 15751919-f5ee-47a7-8014-a5e788730d20 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:49.402857 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0b7a516a-bcd3-4cd9-ab92-62c797008475 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20" status: 404 len: 111 microversion: 2.1 time: 0.031466 Dec 18 21:16:49.403408 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3375/6694] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:16:49 2021] GET /compute/v2.1/os-snapshots/15751919-f5ee-47a7-8014-a5e788730d20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:16:49.411987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-59e93975-3181-4e47-b7d2-637de54f5ed5 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714c42c160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:49.471915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-59e93975-3181-4e47-b7d2-637de54f5ed5 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e" status: 202 len: 0 microversion: 2.1 time: 0.064042 Dec 18 21:16:49.473090 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3320/6695] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:16:49 2021] DELETE /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:16:49.483105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7026e61-643b-4544-95ec-c36767416560 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714e5c2160>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:49.534316 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7026e61-643b-4544-95ec-c36767416560 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e" status: 200 len: 337 microversion: 2.1 time: 0.056836 Dec 18 21:16:49.534909 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3376/6696] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:16:49 2021] GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e => generated 337 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:16:50.547741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d8e7eaf1-45c5-4b34-83e2-65f08414c3c3 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714ee3b5e0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:50.578690 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-d8e7eaf1-45c5-4b34-83e2-65f08414c3c3 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] HTTP exception thrown: Volume aefbe96f-d1ec-4188-99c4-b4da233de88e could not be found. Dec 18 21:16:50.578690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d8e7eaf1-45c5-4b34-83e2-65f08414c3c3 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Returning 404 to user: Volume aefbe96f-d1ec-4188-99c4-b4da233de88e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:50.578690 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d8e7eaf1-45c5-4b34-83e2-65f08414c3c3 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e" status: 404 len: 109 microversion: 2.1 time: 0.034011 Dec 18 21:16:50.579055 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3321/6697] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:16:50 2021] GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:16:50.588805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21568864-7efa-49a9-96d3-74ddaac64435 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714e323820>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:50.616793 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-21568864-7efa-49a9-96d3-74ddaac64435 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] HTTP exception thrown: Volume aefbe96f-d1ec-4188-99c4-b4da233de88e could not be found. Dec 18 21:16:50.617442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21568864-7efa-49a9-96d3-74ddaac64435 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Returning 404 to user: Volume aefbe96f-d1ec-4188-99c4-b4da233de88e could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:50.618883 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21568864-7efa-49a9-96d3-74ddaac64435 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e" status: 404 len: 109 microversion: 2.1 time: 0.034612 Dec 18 21:16:50.619441 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3377/6698] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:16:50 2021] DELETE /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:16:50.629469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a40800e-4247-4e3f-8b83-47d0cd10f749 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Calling method '.version_select at 0x7f714c3c4160>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:50.660190 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4a40800e-4247-4e3f-8b83-47d0cd10f749 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] HTTP exception thrown: Volume aefbe96f-d1ec-4188-99c4-b4da233de88e could not be found. Dec 18 21:16:50.660886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a40800e-4247-4e3f-8b83-47d0cd10f749 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] Returning 404 to user: Volume aefbe96f-d1ec-4188-99c4-b4da233de88e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:16:50.661725 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a40800e-4247-4e3f-8b83-47d0cd10f749 tempest-VolumesSnapshotsTestJSON-1206846574 tempest-VolumesSnapshotsTestJSON-1206846574-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e" status: 404 len: 109 microversion: 2.1 time: 0.037739 Dec 18 21:16:50.662307 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3322/6699] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:16:50 2021] GET /compute/v2.1/os-volumes/aefbe96f-d1ec-4188-99c4-b4da233de88e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:16:51.847129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e85f6e2-d3a8-4a71-9aaa-ba8cfac44da6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:51.848100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e85f6e2-d3a8-4a71-9aaa-ba8cfac44da6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:51.857263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e85f6e2-d3a8-4a71-9aaa-ba8cfac44da6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:51.857749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e85f6e2-d3a8-4a71-9aaa-ba8cfac44da6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:51.858573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e85f6e2-d3a8-4a71-9aaa-ba8cfac44da6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:51.859029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e85f6e2-d3a8-4a71-9aaa-ba8cfac44da6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:51.918350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e85f6e2-d3a8-4a71-9aaa-ba8cfac44da6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129/action" status: 200 len: 24533 microversion: 2.1 time: 0.076511 Dec 18 21:16:51.920914 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3378/6700] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:16:51 2021] POST /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129/action => generated 24533 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:16:58.372862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:16:58.374721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:58.380944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:58.381517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:58.382576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:58.383111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:58.476611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:16:58.477052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:16:58.477731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:16:58.478162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:16:58.478935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:16:58.542634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:58.551116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:58.551906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:58.552877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:58.553604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:58.584436 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4410979-1ecb-4ff0-8dc5-d1ec96bc8dfc tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129/action" status: 202 len: 1139 microversion: 2.1 time: 0.217879 Dec 18 21:16:58.587676 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3323/6701] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:16:58 2021] POST /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129/action => generated 1139 bytes in 220 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 18 21:16:58.602020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:58.602866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:58.611556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:58.612090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:58.612973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:58.613483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:58.862654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:16:58.873188 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c49b8f1-1d1e-4591-9bfd-b9ddc6d934fd tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.275959 Dec 18 21:16:58.873808 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3379/6702] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:58 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:16:59.890593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:16:59.892308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:16:59.904730 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:59.905583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:16:59.918557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:16:59.918557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:00.154914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:00.167320 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b90c7fa9-1cd7-4d56-b069-16f25987e585 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.280980 Dec 18 21:17:00.168854 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3324/6703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:16:59 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:01.186053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:01.187738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:01.199884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:01.200342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:01.201148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:01.201684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:01.404331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:01.414365 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8bd9cc94-7026-4f8c-bf83-827d4082851c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.232268 Dec 18 21:17:01.415386 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3380/6704] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:01 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:02.433312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:02.434559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:02.442820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:02.443284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:02.444431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:02.444868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:02.688121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:02.703155 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-67dd25eb-2599-49ab-b56f-eb6d959e6a29 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.273283 Dec 18 21:17:02.703777 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3325/6705] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:02 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:03.721509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:03.723861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:03.733826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:03.736410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:03.738650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:03.739969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:03.977457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:03.997521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2e205a48-2c49-4a41-b1f6-18623bf116d5 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.280549 Dec 18 21:17:03.998610 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3381/6706] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:03 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:05.018132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:05.018929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:05.025961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:05.026593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:05.027528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:05.029555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:05.209353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:05.219288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0ac89312-37c3-4a44-8e3f-6099538e2c22 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.206945 Dec 18 21:17:05.229550 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3326/6707] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:05 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:17:06.237549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:06.238860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:06.251091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:06.259936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:06.265215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:06.265681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:06.665375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:06.675856 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03c8a82b-72cf-43e7-9b60-95010b5cf647 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.442629 Dec 18 21:17:06.689885 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3382/6708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:06 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:07.696010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:07.697231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:07.705247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:07.705953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:07.707049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:07.707781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:08.105227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:08.123835 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9078c896-eb57-49d2-9d72-2d835c8eec0a tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.430857 Dec 18 21:17:08.126201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3327/6709] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:07 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:09.145499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:09.146044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:09.153525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:09.153991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:09.154825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:09.162694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:09.751419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:09.761789 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4279215d-353e-4a96-b2b0-0300cc40718e tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1692 microversion: 2.1 time: 0.621094 Dec 18 21:17:09.787324 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3383/6710] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:09 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1692 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:10.796749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:10.798164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:10.807045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:10.807606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:10.808613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:10.809270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:11.179475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:11.192362 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-23da7d60-1150-45d4-bb9e-ed1b5ae919d6 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1698 microversion: 2.1 time: 0.400831 Dec 18 21:17:11.194449 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3328/6711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:10 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1698 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:12.213734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:12.214526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:12.229876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:12.231318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:12.231691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:12.232139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:12.701179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:12.710985 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ef2db5a1-3050-4be5-adbd-2c3946265420 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1698 microversion: 2.1 time: 0.501570 Dec 18 21:17:12.711711 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3384/6712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:12 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1698 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:13.511882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c2931041-dfa9-4005-b925-a7e82a1cfdf9 req-03d3833c-db40-433e-8830-db3351eb0077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b796a5-4c32-412d-9bc1-b4219233b129", "name": "network-vif-unplugged", "status": "completed", "tag": "eab4ed4b-542e-4493-9473-7dd3c88992e8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:13.514842 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:17:13.514842 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:17:13.535413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c2931041-dfa9-4005-b925-a7e82a1cfdf9 req-03d3833c-db40-433e-8830-db3351eb0077 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:13.535860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c2931041-dfa9-4005-b925-a7e82a1cfdf9 req-03d3833c-db40-433e-8830-db3351eb0077 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:13.562785 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c2931041-dfa9-4005-b925-a7e82a1cfdf9 req-03d3833c-db40-433e-8830-db3351eb0077 service nova] Creating event network-vif-unplugged:eab4ed4b-542e-4493-9473-7dd3c88992e8 for instance 47b796a5-4c32-412d-9bc1-b4219233b129 on nch2-master-1 Dec 18 21:17:13.584634 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c2931041-dfa9-4005-b925-a7e82a1cfdf9 req-03d3833c-db40-433e-8830-db3351eb0077 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077016 Dec 18 21:17:13.585312 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3329/6713] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:17:13 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:17:13.728783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:13.730018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:13.741102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:13.741618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:13.742460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:13.742952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:14.031430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:14.043132 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3ff2b4cd-a468-49eb-a9f0-e55d7465423c tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1683 microversion: 2.1 time: 0.318012 Dec 18 21:17:14.043958 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3385/6714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:13 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1683 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:15.624030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6ea512d2-4cb6-479b-a3ab-ee74fb67ea85 req-23388c3f-5bfe-4353-8a76-45bdb5341b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b796a5-4c32-412d-9bc1-b4219233b129", "name": "network-vif-plugged", "status": "completed", "tag": "eab4ed4b-542e-4493-9473-7dd3c88992e8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:15.626528 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:17:15.626528 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:17:15.644185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6ea512d2-4cb6-479b-a3ab-ee74fb67ea85 req-23388c3f-5bfe-4353-8a76-45bdb5341b64 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:15.645401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6ea512d2-4cb6-479b-a3ab-ee74fb67ea85 req-23388c3f-5bfe-4353-8a76-45bdb5341b64 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:15.662764 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6ea512d2-4cb6-479b-a3ab-ee74fb67ea85 req-23388c3f-5bfe-4353-8a76-45bdb5341b64 service nova] Creating event network-vif-plugged:eab4ed4b-542e-4493-9473-7dd3c88992e8 for instance 47b796a5-4c32-412d-9bc1-b4219233b129 on nch2-master-1 Dec 18 21:17:15.669213 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6ea512d2-4cb6-479b-a3ab-ee74fb67ea85 req-23388c3f-5bfe-4353-8a76-45bdb5341b64 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055847 Dec 18 21:17:15.671876 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3330/6715] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:17:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:17:22.015276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1520895096", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "4a319045-7962-4b86-bd9c-05ab97eb05f9"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:22.075836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] validate_networks() for [('4a319045-7962-4b86-bd9c-05ab97eb05f9', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:17:22.846293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:17:22.847010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:17:22.848209 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:17:22.848807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:17:22.849400 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:17:22.862082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:22.862826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:22.864427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:22.865039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:22.890004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Getting quotas for project c2d14b131ac74307b9aa94aded5f3f5e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:17:22.896436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Getting quotas for user 84883df65dac439a8c1e454b7ad570e2 and project c2d14b131ac74307b9aa94aded5f3f5e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:17:22.912605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:17:22.915284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:17:22.970500 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa22829d-fd10-4c5e-8622-640fefcd7192 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960160 Dec 18 21:17:22.971607 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3386/6716] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:17:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:17:22.985375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d18ca43-817b-4ad9-85b2-9ee21b4209ee tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:22.986965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d18ca43-817b-4ad9-85b2-9ee21b4209ee tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:23.210731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5d18ca43-817b-4ad9-85b2-9ee21b4209ee tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:23.219380 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d18ca43-817b-4ad9-85b2-9ee21b4209ee tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1219 microversion: 2.1 time: 0.241314 Dec 18 21:17:23.220482 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3331/6717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:22 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:24.237698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:24.238366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:24.247639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:24.250465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:24.251889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:24.253034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:24.353535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:24.363011 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1d6edbc9-a235-4f3c-ac1a-8c753804170e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1277 microversion: 2.1 time: 0.129529 Dec 18 21:17:24.364101 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3387/6718] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:24 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:25.382371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:25.383159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:25.393632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:25.394620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:25.396052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:25.397556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:25.766909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:25.777224 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3102c4ad-981b-44be-b898-276fd669b92f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1319 microversion: 2.1 time: 0.399760 Dec 18 21:17:25.778343 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3332/6719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:25 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:26.396596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-c1dbff66-fdcf-4d15-91f5-b04a6cda1f72 req-74c6d568-7d67-491b-8157-27f5b5a108ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784ec8db-d626-4ada-b1c1-918069ac2e19", "tag": "ceebd3a2-aaaa-42d3-8dc9-cb220c492ef3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:26.399267 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:17:26.399267 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:17:26.411842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c1dbff66-fdcf-4d15-91f5-b04a6cda1f72 req-74c6d568-7d67-491b-8157-27f5b5a108ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:26.412773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-c1dbff66-fdcf-4d15-91f5-b04a6cda1f72 req-74c6d568-7d67-491b-8157-27f5b5a108ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:26.429968 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-c1dbff66-fdcf-4d15-91f5-b04a6cda1f72 req-74c6d568-7d67-491b-8157-27f5b5a108ff service nova] Creating event network-changed:ceebd3a2-aaaa-42d3-8dc9-cb220c492ef3 for instance 784ec8db-d626-4ada-b1c1-918069ac2e19 on nch1-master-1 Dec 18 21:17:26.437832 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-c1dbff66-fdcf-4d15-91f5-b04a6cda1f72 req-74c6d568-7d67-491b-8157-27f5b5a108ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256739 Dec 18 21:17:26.439885 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3388/6720] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:17:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:17:26.793755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:26.795033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:26.802099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:26.802876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:26.803695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:26.804153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:27.156994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:27.164663 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d581edb-6539-4a68-afa8-bc2bb7cb2d62 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1319 microversion: 2.1 time: 0.374774 Dec 18 21:17:27.165479 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3333/6721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:26 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:28.184286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:28.185709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:28.192700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:28.193160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:28.194271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:28.194486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:28.407116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:28.415428 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aeb273cd-7634-4744-b7ae-665d89227477 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1319 microversion: 2.1 time: 0.236112 Dec 18 21:17:28.416119 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3389/6722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:28 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:29.433546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:29.434177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:29.441898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:29.444055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:29.446164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:29.446898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:29.902052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:29.912611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-08bae7a0-d55a-4173-a082-5a9ca9ca6c24 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1319 microversion: 2.1 time: 0.482494 Dec 18 21:17:29.913221 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3334/6723] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:29 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:30.930704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:30.931320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:30.940888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:30.941678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:30.942912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:30.943441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:31.198451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:31.209744 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52dc1406-8baa-428a-8305-39a678de8797 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1319 microversion: 2.1 time: 0.284325 Dec 18 21:17:31.219872 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3390/6724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:30 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:31.601689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3ff718d8-5aa5-416a-833b-2f11ea252267 req-a799652a-208c-4991-aaa4-3e5304273202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784ec8db-d626-4ada-b1c1-918069ac2e19", "name": "network-vif-plugged", "status": "completed", "tag": "ceebd3a2-aaaa-42d3-8dc9-cb220c492ef3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:31.603994 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:17:31.603994 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:17:31.621977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3ff718d8-5aa5-416a-833b-2f11ea252267 req-a799652a-208c-4991-aaa4-3e5304273202 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:31.624283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3ff718d8-5aa5-416a-833b-2f11ea252267 req-a799652a-208c-4991-aaa4-3e5304273202 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:31.657157 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3ff718d8-5aa5-416a-833b-2f11ea252267 req-a799652a-208c-4991-aaa4-3e5304273202 service nova] Creating event network-vif-plugged:ceebd3a2-aaaa-42d3-8dc9-cb220c492ef3 for instance 784ec8db-d626-4ada-b1c1-918069ac2e19 on nch1-master-1 Dec 18 21:17:31.670173 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3ff718d8-5aa5-416a-833b-2f11ea252267 req-a799652a-208c-4991-aaa4-3e5304273202 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070891 Dec 18 21:17:31.670889 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3335/6725] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:17:32.229493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:32.230166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:32.238928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:32.239919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:32.241492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:32.241948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:32.713436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:32.723674 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d289d6d-6538-4ae8-be6f-169fe20f4e83 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1319 microversion: 2.1 time: 0.499057 Dec 18 21:17:32.724646 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3391/6726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:32 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:33.740850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:33.741725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:33.752344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:33.753645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:33.758237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:33.758237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:34.003527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:34.014774 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a6a4398-218a-47fd-ae93-bf9db773284c tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1508 microversion: 2.1 time: 0.277960 Dec 18 21:17:34.015638 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3336/6727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:33 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:35.657100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103", "device": "/dev/sdb"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:35.659605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:35.667206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:35.667665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:35.668786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:35.669395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:35.937863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bf5e0cd6-37f4-42b0-aac1-05e90ba10597 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "POST /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285690 Dec 18 21:17:35.938878 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3392/6728] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:17:35 2021] POST /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:17:38.279414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2983022d-6515-49ed-8d0d-52e7070a2925 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:38.281522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2983022d-6515-49ed-8d0d-52e7070a2925 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:38.289889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2983022d-6515-49ed-8d0d-52e7070a2925 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:38.290656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2983022d-6515-49ed-8d0d-52e7070a2925 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:38.291902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2983022d-6515-49ed-8d0d-52e7070a2925 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:38.292571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2983022d-6515-49ed-8d0d-52e7070a2925 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:38.351710 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2983022d-6515-49ed-8d0d-52e7070a2925 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "POST /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129/action" status: 200 len: 24561 microversion: 2.1 time: 0.076001 Dec 18 21:17:38.367112 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3337/6729] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:17:38 2021] POST /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129/action => generated 24561 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:17:45.967019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:45.967612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:45.975450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f403c150-0762-4e4c-93f9-d7823a859ef0 req-f01ec56b-ce1a-4f56-b252-6b4a6a6c3476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b796a5-4c32-412d-9bc1-b4219233b129", "tag": "eab4ed4b-542e-4493-9473-7dd3c88992e8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:45.976931 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:17:45.976931 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:17:45.987460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f403c150-0762-4e4c-93f9-d7823a859ef0 req-f01ec56b-ce1a-4f56-b252-6b4a6a6c3476 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:45.987999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f403c150-0762-4e4c-93f9-d7823a859ef0 req-f01ec56b-ce1a-4f56-b252-6b4a6a6c3476 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:45.993410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:45.993983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:45.994972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:45.995246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:46.003561 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f403c150-0762-4e4c-93f9-d7823a859ef0 req-f01ec56b-ce1a-4f56-b252-6b4a6a6c3476 service nova] Creating event network-changed:eab4ed4b-542e-4493-9473-7dd3c88992e8 for instance 47b796a5-4c32-412d-9bc1-b4219233b129 on nch2-master-1 Dec 18 21:17:46.017206 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f403c150-0762-4e4c-93f9-d7823a859ef0 req-f01ec56b-ce1a-4f56-b252-6b4a6a6c3476 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045541 Dec 18 21:17:46.019119 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3338/6730] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:17:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:17:46.039367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:17:46.209257 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4bca648-8f8a-4401-bb00-57c4cf8db606 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 204 len: 0 microversion: 2.1 time: 0.246771 Dec 18 21:17:46.210423 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3393/6731] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:17:45 2021] DELETE /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:17:46.220443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:46.221236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:46.242183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:46.242789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:46.243772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:46.244361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:46.571752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:46.598048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c4677675-a2c4-4523-801d-ffa7dd2e7e63 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1689 microversion: 2.1 time: 0.382959 Dec 18 21:17:46.601697 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3339/6732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:46 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1689 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:17:47.619543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:47.621056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:47.630491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:47.631466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:47.632519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:47.633083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:47.910130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f292f8174a7a4de5bf8a848e49f85dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c859bfcff54b5c85e6cb248341f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:17:47.918611 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-181cd651-bcbe-4189-9e0d-b949a3fb4f02 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 200 len: 1570 microversion: 2.1 time: 0.303458 Dec 18 21:17:47.919287 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3394/6733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:47 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 1570 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:17:48.346882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-75a6caa1-8a3b-48d1-b8cc-e4883c017eff req-ae4f758d-bda7-49f4-ac84-bfe561e7674c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b796a5-4c32-412d-9bc1-b4219233b129", "name": "network-vif-deleted", "tag": "eab4ed4b-542e-4493-9473-7dd3c88992e8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:17:48.350164 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:17:48.350164 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:17:48.360507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-75a6caa1-8a3b-48d1-b8cc-e4883c017eff req-ae4f758d-bda7-49f4-ac84-bfe561e7674c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:48.361870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-75a6caa1-8a3b-48d1-b8cc-e4883c017eff req-ae4f758d-bda7-49f4-ac84-bfe561e7674c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:48.391034 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-75a6caa1-8a3b-48d1-b8cc-e4883c017eff req-ae4f758d-bda7-49f4-ac84-bfe561e7674c service nova] Creating event network-vif-deleted:eab4ed4b-542e-4493-9473-7dd3c88992e8 for instance 47b796a5-4c32-412d-9bc1-b4219233b129 on nch2-master-1 Dec 18 21:17:48.400723 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-75a6caa1-8a3b-48d1-b8cc-e4883c017eff req-ae4f758d-bda7-49f4-ac84-bfe561e7674c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060117 Dec 18 21:17:48.402394 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3340/6734] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:17:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:17:48.940605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:48.941563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] [instance: 47b796a5-4c32-412d-9bc1-b4219233b129] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:17:48.948841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:48.949377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:48.950595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:17:48.951327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:17:48.970062 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] HTTP exception thrown: Instance 47b796a5-4c32-412d-9bc1-b4219233b129 could not be found. Dec 18 21:17:48.971121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Returning 404 to user: Instance 47b796a5-4c32-412d-9bc1-b4219233b129 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:17:48.972029 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac9acab5-ce3e-4fc4-8cf8-34171eda01eb tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129" status: 404 len: 111 microversion: 2.1 time: 0.039439 Dec 18 21:17:48.976539 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3395/6735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:17:48 2021] GET /compute/v2.1/servers/47b796a5-4c32-412d-9bc1-b4219233b129 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:17:53.389316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-12d0f4a7-d7b6-41c7-a912-6e4852304bf9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] Calling method '.version_select at 0x7f714c420ca0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:17:53.428332 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-12d0f4a7-d7b6-41c7-a912-6e4852304bf9 tempest-TestNetworkAdvancedServerOps-1650254697 tempest-TestNetworkAdvancedServerOps-1650254697-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-374927044" status: 202 len: 0 microversion: 2.1 time: 0.042568 Dec 18 21:17:53.429480 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3341/6736] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Dec 18 21:17:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-374927044 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:18:11.606167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-508179cf-e5b2-466f-a662-2129d43b3fed req-a55fd1c7-947b-4c2e-b07a-003f5ecb5265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc66115-f830-404b-b50a-e0fa7a1b14cc", "tag": "a7cafa90-4ea2-464a-974c-82429732a64d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:18:11.608923 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:18:11.608923 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:18:11.609710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:11.610749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:11.624556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:11.626928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:11.627754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:11.628207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:11.629232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-508179cf-e5b2-466f-a662-2129d43b3fed req-a55fd1c7-947b-4c2e-b07a-003f5ecb5265 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:11.629996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-508179cf-e5b2-466f-a662-2129d43b3fed req-a55fd1c7-947b-4c2e-b07a-003f5ecb5265 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:11.655745 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-508179cf-e5b2-466f-a662-2129d43b3fed req-a55fd1c7-947b-4c2e-b07a-003f5ecb5265 service nova] Creating event network-changed:a7cafa90-4ea2-464a-974c-82429732a64d for instance 9dc66115-f830-404b-b50a-e0fa7a1b14cc on nch1-master-1 Dec 18 21:18:11.666434 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-508179cf-e5b2-466f-a662-2129d43b3fed req-a55fd1c7-947b-4c2e-b07a-003f5ecb5265 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064142 Dec 18 21:18:11.667636 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3342/6737] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:18:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:18:11.676466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:18:11.807262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9e50c38f-ea93-4640-b575-a6c7970d84e9 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 204 len: 0 microversion: 2.1 time: 0.210291 Dec 18 21:18:11.808497 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3396/6738] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:18:11 2021] DELETE /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:18:11.818795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:11.821330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:11.852655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:11.856129 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:11.858458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:11.861399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:12.428337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:18:12.439842 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-966701c0-b5f9-4c48-9b43-042c480cde36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1578 microversion: 2.1 time: 0.624636 Dec 18 21:18:12.452524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3343/6739] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:11 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1578 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:18:13.460495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:13.462165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:13.471415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:13.472283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:13.473424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:13.474101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:13.646329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:18:13.660136 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-36e51209-483a-4f0d-91cd-cb4690a8e1e6 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1460 microversion: 2.1 time: 0.204029 Dec 18 21:18:13.660823 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3397/6740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:13 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1460 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:18:14.368879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b3303226-3a04-42b8-91be-7fb00650bb6e req-7ab57fea-dd28-4d47-aacd-30856647d11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc66115-f830-404b-b50a-e0fa7a1b14cc", "name": "network-vif-deleted", "tag": "a7cafa90-4ea2-464a-974c-82429732a64d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:18:14.370513 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:18:14.370513 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:18:14.379136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b3303226-3a04-42b8-91be-7fb00650bb6e req-7ab57fea-dd28-4d47-aacd-30856647d11e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:14.379820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b3303226-3a04-42b8-91be-7fb00650bb6e req-7ab57fea-dd28-4d47-aacd-30856647d11e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:14.392489 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b3303226-3a04-42b8-91be-7fb00650bb6e req-7ab57fea-dd28-4d47-aacd-30856647d11e service nova] Creating event network-vif-deleted:a7cafa90-4ea2-464a-974c-82429732a64d for instance 9dc66115-f830-404b-b50a-e0fa7a1b14cc on nch1-master-1 Dec 18 21:18:14.397584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b3303226-3a04-42b8-91be-7fb00650bb6e req-7ab57fea-dd28-4d47-aacd-30856647d11e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032267 Dec 18 21:18:14.398798 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3344/6741] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:18:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:18:14.677095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:14.677713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:14.684556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:14.685018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:14.686408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:14.686857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:14.721494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:14.721946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:14.722486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lazy-loading 'fault' on Instance uuid 9dc66115-f830-404b-b50a-e0fa7a1b14cc {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:18:14.763139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:18:14.770906 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d85d5bb-688f-44ce-beb8-2c62ca69eb36 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 200 len: 1230 microversion: 2.1 time: 0.097596 Dec 18 21:18:14.771669 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3398/6742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:14 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:18:15.789871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:15.790547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 9dc66115-f830-404b-b50a-e0fa7a1b14cc] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:15.796695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:15.797174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:15.798006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:15.798494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:15.812343 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 9dc66115-f830-404b-b50a-e0fa7a1b14cc could not be found. Dec 18 21:18:15.813037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 9dc66115-f830-404b-b50a-e0fa7a1b14cc could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:18:15.813891 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44c13eb5-ffb4-485c-99b6-180701709a2f tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc" status: 404 len: 111 microversion: 2.1 time: 0.029181 Dec 18 21:18:15.814473 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3345/6743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:15 2021] GET /compute/v2.1/servers/9dc66115-f830-404b-b50a-e0fa7a1b14cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:18:18.405417 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:18:18.405963 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:18:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:18:49.006650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:49.007260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:49.009935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-581828b0-c691-4b3a-8943-cc93fb9fe4d5 req-5c4171b6-13bb-4003-8692-7db64abc32b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95123f6f-b540-4847-b6c1-d89287d69e5c", "tag": "c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:18:49.012781 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:18:49.012781 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:18:49.014124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:49.014615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:49.015551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:49.016236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:49.030938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-581828b0-c691-4b3a-8943-cc93fb9fe4d5 req-5c4171b6-13bb-4003-8692-7db64abc32b3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:49.031404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-581828b0-c691-4b3a-8943-cc93fb9fe4d5 req-5c4171b6-13bb-4003-8692-7db64abc32b3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:49.043794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:18:49.050637 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-581828b0-c691-4b3a-8943-cc93fb9fe4d5 req-5c4171b6-13bb-4003-8692-7db64abc32b3 service nova] Creating event network-changed:c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b for instance 95123f6f-b540-4847-b6c1-d89287d69e5c on nch2-master-1 Dec 18 21:18:49.062669 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-581828b0-c691-4b3a-8943-cc93fb9fe4d5 req-5c4171b6-13bb-4003-8692-7db64abc32b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055764 Dec 18 21:18:49.063458 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3346/6744] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:18:49.142144 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70afdd75-bc17-4c52-8f24-c68069c100a1 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 204 len: 0 microversion: 2.1 time: 0.138892 Dec 18 21:18:49.143047 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3399/6745] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:18:49 2021] DELETE /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:18:49.151525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:49.152483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:49.159507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:49.160222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:49.161631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:49.162345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:49.461071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:18:49.472328 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-80d49582-1e89-41dd-b4d7-49ecb5ca41f7 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1577 microversion: 2.1 time: 0.324882 Dec 18 21:18:49.477203 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3347/6746] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:49 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1577 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:18:50.494011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:50.494749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:50.501863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:50.502376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:50.503344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:50.503787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:50.588178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32598482c834073b8fe24c84cb57d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de79cd87d023436a80d3cc5428586e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:18:50.597389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b58205af-1839-4e05-a93e-ba3b66741af4 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 200 len: 1223 microversion: 2.1 time: 0.108131 Dec 18 21:18:50.598092 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3400/6747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:50 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:18:51.080130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ce2757a5-7a4b-46f4-a7d1-f7c2cd4ca9a9 req-a14989a2-efeb-464b-afb8-662b7381dd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95123f6f-b540-4847-b6c1-d89287d69e5c", "name": "network-vif-deleted", "tag": "c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:18:51.081849 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:18:51.081849 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:18:51.089760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ce2757a5-7a4b-46f4-a7d1-f7c2cd4ca9a9 req-a14989a2-efeb-464b-afb8-662b7381dd27 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:51.090284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ce2757a5-7a4b-46f4-a7d1-f7c2cd4ca9a9 req-a14989a2-efeb-464b-afb8-662b7381dd27 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:51.102674 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ce2757a5-7a4b-46f4-a7d1-f7c2cd4ca9a9 req-a14989a2-efeb-464b-afb8-662b7381dd27 service nova] Creating event network-vif-deleted:c6893cd9-e9ee-46f4-8dbf-2f28c1faa18b for instance 95123f6f-b540-4847-b6c1-d89287d69e5c on nch2-master-1 Dec 18 21:18:51.108508 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ce2757a5-7a4b-46f4-a7d1-f7c2cd4ca9a9 req-a14989a2-efeb-464b-afb8-662b7381dd27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Dec 18 21:18:51.110796 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3348/6748] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:18:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:18:51.614179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:51.614754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 95123f6f-b540-4847-b6c1-d89287d69e5c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:51.621472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:51.622103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:51.622919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:51.623359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:51.638464 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 95123f6f-b540-4847-b6c1-d89287d69e5c could not be found. Dec 18 21:18:51.639125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 95123f6f-b540-4847-b6c1-d89287d69e5c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:18:51.639973 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cee60103-34f2-4782-8c54-16b7e0e6dda8 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c" status: 404 len: 111 microversion: 2.1 time: 0.029555 Dec 18 21:18:51.640540 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3401/6749] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:51 2021] GET /compute/v2.1/servers/95123f6f-b540-4847-b6c1-d89287d69e5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:18:52.140898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:52.141505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:52.147977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:52.148455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:52.149485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:52.150557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:52.170451 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 could not be found. Dec 18 21:18:52.171172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:18:52.172050 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-198d2cbd-5971-4707-bcbd-b4ee2f8fdea5 tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 404 len: 111 microversion: 2.1 time: 0.036654 Dec 18 21:18:52.172599 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3349/6750] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:18:52 2021] DELETE /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:18:52.181725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:52.182444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] [instance: 4677eac8-1f9e-4309-b018-4b60ce5b1eb4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:18:52.189146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:52.189677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:52.191453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:18:52.191964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:18:52.206629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] HTTP exception thrown: Instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 could not be found. Dec 18 21:18:52.207308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Returning 404 to user: Instance 4677eac8-1f9e-4309-b018-4b60ce5b1eb4 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:18:52.208222 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c3f453c-701c-461d-9046-22884892e5ae tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4" status: 404 len: 111 microversion: 2.1 time: 0.031478 Dec 18 21:18:52.209165 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3402/6751] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:18:52 2021] GET /compute/v2.1/servers/4677eac8-1f9e-4309-b018-4b60ce5b1eb4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:18:53.513835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8278fd5c-284a-4d1c-83cc-0f87aa5d9ddf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] Calling method '.version_select at 0x7f714c407e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:18:53.546894 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8278fd5c-284a-4d1c-83cc-0f87aa5d9ddf tempest-TestVolumeBootPattern-1320248540 tempest-TestVolumeBootPattern-1320248540-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-716702626" status: 202 len: 0 microversion: 2.1 time: 0.036672 Dec 18 21:18:53.549814 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3350/6752] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 21:18:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-716702626 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:19:03.421035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5a5531d-8678-4128-a4ad-372230353bb1 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Action: 'create', calling method: .version_select at 0x7f714e5c2ee0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1576573631"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:03.435597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c5a5531d-8678-4128-a4ad-372230353bb1 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:19:03.441850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c5a5531d-8678-4128-a4ad-372230353bb1 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for user 577286e40c5a4bf6a56af13d061f2151 and project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:19:03.867158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c5a5531d-8678-4128-a4ad-372230353bb1 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:19:03.872612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-c5a5531d-8678-4128-a4ad-372230353bb1 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for user 577286e40c5a4bf6a56af13d061f2151 and project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:19:03.887062 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5a5531d-8678-4128-a4ad-372230353bb1 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.646855 Dec 18 21:19:03.887660 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3403/6753] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:19:03 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:09.358173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-705306446", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5e5f9913-d308-40a2-aebf-8996e1d67943"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:09.687987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] validate_networks() for [('5e5f9913-d308-40a2-aebf-8996e1d67943', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:19:10.141049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:19:10.141480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:19:10.141959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:19:10.142414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:19:10.142995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:19:10.152861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:10.153944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:10.155605 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:10.156799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:10.181911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Getting quotas for project 126c6d3b7ace4bd2ae9d84ba23cf9ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:19:10.189047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Getting quotas for user 90e59ad9f3924293afdb08a62848402f and project 126c6d3b7ace4bd2ae9d84ba23cf9ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:19:10.219158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:19:10.221683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:19:10.267278 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7f74efe-abb3-4aed-a948-8ef95bd954d5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912702 Dec 18 21:19:10.272496 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3351/6754] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:19:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:19:10.279044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40dcb4e6-7c05-4d20-901f-3f56ff830b8e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:10.279720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40dcb4e6-7c05-4d20-901f-3f56ff830b8e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:10.323884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1529059756-access_point-535164930", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5adcb8d0-df6b-44e7-a2e9-4a2ea19a4bf6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1576573631", "security_groups": [{"name": "tempest-secgroup_access--128672315"}, {"name": "tempest-secgroup_general--1230180303"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:10.367226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-40dcb4e6-7c05-4d20-901f-3f56ff830b8e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:10.376148 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40dcb4e6-7c05-4d20-901f-3f56ff830b8e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1213 microversion: 2.1 time: 0.102110 Dec 18 21:19:10.379551 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3404/6755] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:10 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:10.534622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] validate_networks() for [('5adcb8d0-df6b-44e7-a2e9-4a2ea19a4bf6', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:19:11.077499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:19:11.078375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:19:11.078898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:19:11.079328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:19:11.079940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:19:11.089872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:11.090612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:11.091731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:11.092404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:11.119991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:19:11.126291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for user 577286e40c5a4bf6a56af13d061f2151 and project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:19:11.142875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:19:11.145987 ncdv-master-1 devstack@n-api.service[140731]: WARNING nova.utils [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1529059756-access_point-535164930 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1529059756-ac Dec 18 21:19:11.146724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:19:11.211698 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92a7b5a3-fe77-4ac5-bf0a-bf5bb1b63bd4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.892551 Dec 18 21:19:11.213412 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3352/6756] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:19:10 2021] POST /compute/v2.1/servers => generated 457 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:19:11.222722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5459d2c5-33a0-4904-bbc2-102492c010fa tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:11.223817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5459d2c5-33a0-4904-bbc2-102492c010fa tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:11.304522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5459d2c5-33a0-4904-bbc2-102492c010fa tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:11.316203 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5459d2c5-33a0-4904-bbc2-102492c010fa tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1294 microversion: 2.1 time: 0.096822 Dec 18 21:19:11.325076 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3405/6757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:11 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:11.393500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:11.394480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:11.405943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:11.406718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:11.408060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:11.408522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:11.488887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:11.498978 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4be7ad66-e0c1-49f0-aa59-2ff8c6b09fc5 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1265 microversion: 2.1 time: 0.109529 Dec 18 21:19:11.501060 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3353/6758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:11 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:12.347381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:12.348641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:12.380575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:12.381039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:12.384431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:12.387768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:12.492503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:12.505538 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2a89af5d-29ed-4922-aef6-781190a2bc4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1346 microversion: 2.1 time: 0.168747 Dec 18 21:19:12.506539 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3406/6759] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:12 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:12.519360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:12.519992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:12.534821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:12.535304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:12.536173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:12.536664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:12.790444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:12.800248 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a6fa17b1-11ec-49f7-931d-8691b5af769f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1313 microversion: 2.1 time: 0.286788 Dec 18 21:19:12.801955 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3354/6760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:12 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:13.523516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:13.524026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:13.531314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:13.531772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:13.532569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:13.533017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:13.600551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:13.607861 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3a2140a-b809-457e-9412-ff145a7c406b tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1352 microversion: 2.1 time: 0.088143 Dec 18 21:19:13.608456 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3407/6761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:13 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:13.818481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:13.819188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:13.828030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:13.828182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8d196563-49af-4973-8987-2e9d489e6f02 req-ddabe406-6765-40f3-9ee9-ef325a71f5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c334c3db-916a-4592-9542-858ac227a676", "tag": "a6a64ff6-c7dd-4740-9569-40e75248a4f9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:13.828846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:13.830087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:13.830842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:13.845913 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:13.845913 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:19:13.858329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8d196563-49af-4973-8987-2e9d489e6f02 req-ddabe406-6765-40f3-9ee9-ef325a71f5d1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:13.859081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8d196563-49af-4973-8987-2e9d489e6f02 req-ddabe406-6765-40f3-9ee9-ef325a71f5d1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:13.880183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8d196563-49af-4973-8987-2e9d489e6f02 req-ddabe406-6765-40f3-9ee9-ef325a71f5d1 service nova] Creating event network-changed:a6a64ff6-c7dd-4740-9569-40e75248a4f9 for instance c334c3db-916a-4592-9542-858ac227a676 on nch2-master-1 Dec 18 21:19:13.894954 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8d196563-49af-4973-8987-2e9d489e6f02 req-ddabe406-6765-40f3-9ee9-ef325a71f5d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071186 Dec 18 21:19:13.896107 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3408/6762] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:13.999264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:14.007524 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-682622e6-d43c-4503-a7d2-a24d00e50f65 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1313 microversion: 2.1 time: 0.193345 Dec 18 21:19:14.008200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3355/6763] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:13 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:14.626763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:14.627752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:14.634113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:14.635233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:14.636286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:14.636736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:14.795003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:14.802806 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07ed3cef-8899-4d04-82c0-5e0afc78ba66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.180927 Dec 18 21:19:14.803861 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3409/6764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:14 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:15.024689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:15.025324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:15.032726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:15.033200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:15.034011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:15.034498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:15.189161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:15.197608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f0475fb-500f-490a-a897-8ce8379c5251 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1313 microversion: 2.1 time: 0.176555 Dec 18 21:19:15.198179 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3356/6765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:15 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:15.820175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:15.820940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:15.828167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:15.828624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:15.829415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:15.829858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:15.919233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-319b2e61-fb0c-4149-9f1f-56528de670da req-cd77bbd8-55aa-45e2-bfea-459011cc1742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c45feb3-d2c8-4747-8358-9b4d3349e35d", "tag": "257da8ba-96d1-45a1-8c0e-37a7a2967f3e"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:15.920823 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:15.920823 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:19:15.928084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-319b2e61-fb0c-4149-9f1f-56528de670da req-cd77bbd8-55aa-45e2-bfea-459011cc1742 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:15.928548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-319b2e61-fb0c-4149-9f1f-56528de670da req-cd77bbd8-55aa-45e2-bfea-459011cc1742 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:15.942425 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-319b2e61-fb0c-4149-9f1f-56528de670da req-cd77bbd8-55aa-45e2-bfea-459011cc1742 service nova] Creating event network-changed:257da8ba-96d1-45a1-8c0e-37a7a2967f3e for instance 5c45feb3-d2c8-4747-8358-9b4d3349e35d on nch1-master-1 Dec 18 21:19:15.949468 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-319b2e61-fb0c-4149-9f1f-56528de670da req-cd77bbd8-55aa-45e2-bfea-459011cc1742 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033856 Dec 18 21:19:15.950608 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3357/6766] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:19:15.977287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:15.985673 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7f1f456-462b-4f57-af56-a775105f52bf tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.169201 Dec 18 21:19:15.986759 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3410/6767] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:15 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:16.215842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:16.216554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:16.223567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:16.225321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:16.226088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:16.226569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:16.366646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:16.374111 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-634e9777-5b1e-4e01-a4e1-296e18d0a3c4 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1313 microversion: 2.1 time: 0.162835 Dec 18 21:19:16.374728 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3358/6768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:16 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:17.002234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:17.002871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:17.009653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:17.010102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:17.011550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:17.011996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:17.148930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:17.156228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d0f7c360-53a1-4d73-bf17-a8139b1794f7 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.157756 Dec 18 21:19:17.156801 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3411/6769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:16 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:17.390603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:17.391226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:17.397872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:17.398371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:17.399173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:17.399630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:17.528979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:17.536472 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4b1437f0-ecfc-48e4-9adb-359de0ea6192 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1313 microversion: 2.1 time: 0.149604 Dec 18 21:19:17.537031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3359/6770] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:17 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:18.063176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-54baba10-ad71-4e42-a22c-298e515bb846 req-ed104359-54e1-4afb-bac3-f81425079eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c334c3db-916a-4592-9542-858ac227a676", "name": "network-vif-plugged", "status": "completed", "tag": "a6a64ff6-c7dd-4740-9569-40e75248a4f9"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:18.064680 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:18.064680 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:19:18.071863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-54baba10-ad71-4e42-a22c-298e515bb846 req-ed104359-54e1-4afb-bac3-f81425079eca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:18.072387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-54baba10-ad71-4e42-a22c-298e515bb846 req-ed104359-54e1-4afb-bac3-f81425079eca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:18.083823 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-54baba10-ad71-4e42-a22c-298e515bb846 req-ed104359-54e1-4afb-bac3-f81425079eca service nova] Creating event network-vif-plugged:a6a64ff6-c7dd-4740-9569-40e75248a4f9 for instance c334c3db-916a-4592-9542-858ac227a676 on nch2-master-1 Dec 18 21:19:18.088830 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-54baba10-ad71-4e42-a22c-298e515bb846 req-ed104359-54e1-4afb-bac3-f81425079eca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151896 Dec 18 21:19:18.090052 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3412/6771] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:18.172800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:18.173514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:18.179387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:18.179899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:18.180698 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:18.181201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:18.321131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:18.328892 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5ceb137-e5df-40e7-9af8-179b40e8c360 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.159853 Dec 18 21:19:18.329453 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3360/6772] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:18 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:18.553574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:18.554293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:18.561303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:18.561752 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:18.562575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:18.563072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:18.574874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:18.575386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:18.581983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:18.582483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:18.583278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:18.584708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:18.668243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lazy-loading 'services' on Instance uuid 784ec8db-d626-4ada-b1c1-918069ac2e19 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:19:18.701418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:18.708885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cdcb24f3-b6f4-4b47-bada-c5a40e7dfcd3 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1313 microversion: 2.1 time: 0.159500 Dec 18 21:19:18.709569 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3413/6773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:18 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:18.735791 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b296ac74-df96-415c-b6bd-7ce5c9fb0ef1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "DELETE /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19/os-volume_attachments/a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103" status: 202 len: 0 microversion: 2.1 time: 0.165219 Dec 18 21:19:18.736309 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3361/6774] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:19:18 2021] DELETE /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19/os-volume_attachments/a6a5227f-3cf0-4d6b-aa2f-ba6a5904e103 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:19:19.345318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:19.345928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:19.352659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:19.353107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:19.353885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:19.354350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:19.506894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:19.515617 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6a6f032e-524d-41a9-baf7-c7f3b0562d66 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.173919 Dec 18 21:19:19.516460 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3414/6775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:19 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:19.726385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:19.727112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:19.733260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:19.733737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:19.734589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:19.735057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:19.846732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:19.847328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:19.854519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:19.854993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:19.856300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:19.856753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:19.870614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:19.877924 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dcbfe090-2436-4286-b45a-2d2271f6e02e tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1497 microversion: 2.1 time: 0.156604 Dec 18 21:19:19.878842 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3362/6776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:19 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:19.902278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:19:19.990199 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-51da7a03-3338-4097-949a-e0657e6c8156 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "DELETE /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 204 len: 0 microversion: 2.1 time: 0.146979 Dec 18 21:19:19.992006 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3415/6777] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:19:19 2021] DELETE /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:19:20.000188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:20.000917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:20.006843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.007381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.008297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.008897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.153768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:20.161042 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-435b74d7-7f31-452f-8a02-47da8c48974e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1514 microversion: 2.1 time: 0.165660 Dec 18 21:19:20.161607 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3363/6778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:19 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:20.254627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:20.255298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:20.261989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.262547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.263813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.263899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.288828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:19:20.364104 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a4a8c183-d052-48a7-919c-52e95bc9b3cb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 204 len: 0 microversion: 2.1 time: 0.113989 Dec 18 21:19:20.364883 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3416/6779] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:19:20 2021] DELETE /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:19:20.373569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:20.374221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:20.380163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.380623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.381528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.381984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.511551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:20.518984 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ee2adbb-9206-4a74-8727-9fb55ab70648 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1503 microversion: 2.1 time: 0.149868 Dec 18 21:19:20.519537 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3364/6780] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:20 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:20.532940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:20.533713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:20.539606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.540056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.540828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:20.541264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:20.680801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:20.688735 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa904c3c-43b6-42ec-8fa3-82ba4dcbebe4 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.159800 Dec 18 21:19:20.689306 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3417/6781] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:20 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:21.178273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:21.178911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:21.185516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:21.185983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:21.186811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:21.187265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:21.316996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:21.324437 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7821289-9976-45a1-9ff1-0382027f9935 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1514 microversion: 2.1 time: 0.149867 Dec 18 21:19:21.325497 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3365/6782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:21 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:21.536625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:21.537256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:21.544911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:21.545371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:21.546154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:21.546952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:21.677412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:21.685802 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b3e3214-4edc-4d75-bfa7-a9a1f0bf3deb tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1503 microversion: 2.1 time: 0.153168 Dec 18 21:19:21.686567 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3418/6783] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:21 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:21.705558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:21.706180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:21.712666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:21.713275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:21.714227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:21.714817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:21.874063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:21.882847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-66b0fad1-9f0c-4abc-b66e-999a485022d3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.180812 Dec 18 21:19:21.883552 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3366/6784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:21 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:21.919807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4c06514e-5b56-4040-b939-69cfabe22c63 req-59e2b6ae-518d-4aa6-ad9f-03e8ca5bad82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c45feb3-d2c8-4747-8358-9b4d3349e35d", "name": "network-vif-plugged", "status": "completed", "tag": "257da8ba-96d1-45a1-8c0e-37a7a2967f3e"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:21.921783 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:21.921783 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:19:21.930547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4c06514e-5b56-4040-b939-69cfabe22c63 req-59e2b6ae-518d-4aa6-ad9f-03e8ca5bad82 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:21.931085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4c06514e-5b56-4040-b939-69cfabe22c63 req-59e2b6ae-518d-4aa6-ad9f-03e8ca5bad82 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:21.946998 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4c06514e-5b56-4040-b939-69cfabe22c63 req-59e2b6ae-518d-4aa6-ad9f-03e8ca5bad82 service nova] Creating event network-vif-plugged:257da8ba-96d1-45a1-8c0e-37a7a2967f3e for instance 5c45feb3-d2c8-4747-8358-9b4d3349e35d on nch1-master-1 Dec 18 21:19:21.952189 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4c06514e-5b56-4040-b939-69cfabe22c63 req-59e2b6ae-518d-4aa6-ad9f-03e8ca5bad82 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036757 Dec 18 21:19:21.952948 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3419/6785] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:19:22.341465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:22.342092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:22.349160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:22.349627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:22.350478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:22.350937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:22.482695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:22.490929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95338999-4db1-4472-8ca2-562bf99710d1 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 200 len: 1514 microversion: 2.1 time: 0.153736 Dec 18 21:19:22.491514 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3367/6786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:22 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:22.706351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:22.707070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:22.716243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7192183e-ebd3-40a3-a5a0-eac7545e4fe9 req-1dec6e7c-0bcd-49f4-94e7-bb84ea1e2614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c334c3db-916a-4592-9542-858ac227a676", "name": "network-vif-deleted", "tag": "a6a64ff6-c7dd-4740-9569-40e75248a4f9"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:22.716243 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:22.716243 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:19:22.721943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7192183e-ebd3-40a3-a5a0-eac7545e4fe9 req-1dec6e7c-0bcd-49f4-94e7-bb84ea1e2614 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:22.722716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7192183e-ebd3-40a3-a5a0-eac7545e4fe9 req-1dec6e7c-0bcd-49f4-94e7-bb84ea1e2614 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:22.724497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:22.724987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:22.726030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:22.726514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:22.735651 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7192183e-ebd3-40a3-a5a0-eac7545e4fe9 req-1dec6e7c-0bcd-49f4-94e7-bb84ea1e2614 service nova] Creating event network-vif-deleted:a6a64ff6-c7dd-4740-9569-40e75248a4f9 for instance c334c3db-916a-4592-9542-858ac227a676 on nch2-master-1 Dec 18 21:19:22.741372 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7192183e-ebd3-40a3-a5a0-eac7545e4fe9 req-1dec6e7c-0bcd-49f4-94e7-bb84ea1e2614 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036018 Dec 18 21:19:22.742606 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3368/6787] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:19:22.824511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:22.839410 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50e32ed5-5654-4391-9614-62bba1365c03 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 200 len: 1461 microversion: 2.1 time: 0.137617 Dec 18 21:19:22.840034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3420/6788] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:22 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 1461 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:22.900114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:22.900956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:22.907801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:22.908457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:22.909272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:22.909818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:23.385173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:23.392850 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f6ee80a8-85da-43e7-b4cc-6ebe227c9f4d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1471 microversion: 2.1 time: 0.496839 Dec 18 21:19:23.393602 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3369/6789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:22 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:23.507768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:23.508380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 784ec8db-d626-4ada-b1c1-918069ac2e19] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:23.514321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:23.514805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:23.515586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:23.516026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:23.529232 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] HTTP exception thrown: Instance 784ec8db-d626-4ada-b1c1-918069ac2e19 could not be found. Dec 18 21:19:23.529813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Returning 404 to user: Instance 784ec8db-d626-4ada-b1c1-918069ac2e19 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:19:23.530664 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-43ac64f2-1407-4d44-84d5-de1a87e5f1a6 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19" status: 404 len: 111 microversion: 2.1 time: 0.026605 Dec 18 21:19:23.531189 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3421/6790] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:23 2021] GET /compute/v2.1/servers/784ec8db-d626-4ada-b1c1-918069ac2e19 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:19:23.855748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:23.857088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: c334c3db-916a-4592-9542-858ac227a676] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:23.863190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:23.863669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:23.864493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:23.864955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:23.878043 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] HTTP exception thrown: Instance c334c3db-916a-4592-9542-858ac227a676 could not be found. Dec 18 21:19:23.878678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Returning 404 to user: Instance c334c3db-916a-4592-9542-858ac227a676 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:19:23.879513 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b4d6dc6-f6ac-40e0-a7d9-eee57496769c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676" status: 404 len: 111 microversion: 2.1 time: 0.027570 Dec 18 21:19:23.880065 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3370/6791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:23 2021] GET /compute/v2.1/servers/c334c3db-916a-4592-9542-858ac227a676 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:19:24.009467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-121475337", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5e5f9913-d308-40a2-aebf-8996e1d67943"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:24.060546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] validate_networks() for [('5e5f9913-d308-40a2-aebf-8996e1d67943', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:19:24.409447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:24.410077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:24.412731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:19:24.413223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:19:24.413760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:19:24.414174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:19:24.414964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:19:24.416910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.417376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.418180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.418709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.423762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.424280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.425166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.425670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.442656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Getting quotas for project 126c6d3b7ace4bd2ae9d84ba23cf9ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:19:24.447756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Getting quotas for user 90e59ad9f3924293afdb08a62848402f and project 126c6d3b7ace4bd2ae9d84ba23cf9ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:19:24.460696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:19:24.463093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:19:24.507200 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d7e2d91-e874-4a72-accb-e1fd044250c2 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501393 Dec 18 21:19:24.508190 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3422/6792] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:19:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:19:24.518662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f04ef32-b64b-44ba-866a-7c1821305170 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:24.519295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f04ef32-b64b-44ba-866a-7c1821305170 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:24.586012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f04ef32-b64b-44ba-866a-7c1821305170 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:24.594075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:24.594429 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f04ef32-b64b-44ba-866a-7c1821305170 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1213 microversion: 2.1 time: 0.079469 Dec 18 21:19:24.595004 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3423/6793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:24 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:24.606416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7863d992-5540-471f-9988-a3a3e50a3ec3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1643 microversion: 2.1 time: 0.200596 Dec 18 21:19:24.606984 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3371/6794] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:24 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1643 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:19:24.622671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:24.623402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:24.631070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.631750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.632475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.633308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.759741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-365326c7-edab-4aea-8b57-2007b0e08f0e req-ae650a48-8a24-4c84-b33d-3c91a1edb24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784ec8db-d626-4ada-b1c1-918069ac2e19", "name": "network-vif-deleted", "tag": "ceebd3a2-aaaa-42d3-8dc9-cb220c492ef3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:24.761356 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:24.761356 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:19:24.771446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-365326c7-edab-4aea-8b57-2007b0e08f0e req-ae650a48-8a24-4c84-b33d-3c91a1edb24a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.772308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-365326c7-edab-4aea-8b57-2007b0e08f0e req-ae650a48-8a24-4c84-b33d-3c91a1edb24a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.786412 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-365326c7-edab-4aea-8b57-2007b0e08f0e req-ae650a48-8a24-4c84-b33d-3c91a1edb24a service nova] Creating event network-vif-deleted:ceebd3a2-aaaa-42d3-8dc9-cb220c492ef3 for instance 784ec8db-d626-4ada-b1c1-918069ac2e19 on nch1-master-1 Dec 18 21:19:24.792851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-365326c7-edab-4aea-8b57-2007b0e08f0e req-ae650a48-8a24-4c84-b33d-3c91a1edb24a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036911 Dec 18 21:19:24.795212 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3372/6795] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:19:24.803102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:24.812276 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c58e3df-8545-4ba4-a57b-70a541ed7f83 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1643 microversion: 2.1 time: 0.193839 Dec 18 21:19:24.813378 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3424/6796] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:24 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1643 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:24.829710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58ffaf08-6aeb-4964-b286-7839c6e77629 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:24.830661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58ffaf08-6aeb-4964-b286-7839c6e77629 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:24.837145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58ffaf08-6aeb-4964-b286-7839c6e77629 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.837743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58ffaf08-6aeb-4964-b286-7839c6e77629 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:24.838709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58ffaf08-6aeb-4964-b286-7839c6e77629 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:24.839276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58ffaf08-6aeb-4964-b286-7839c6e77629 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:25.143797 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58ffaf08-6aeb-4964-b286-7839c6e77629 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1794 microversion: 2.1 time: 0.318540 Dec 18 21:19:25.144714 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3373/6797] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:24 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1794 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:25.612560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:25.613315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:25.620542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:25.621278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:25.622107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:25.622593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:25.691272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:25.698916 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae5455d9-640f-4406-b23b-be12e372e2fd tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1271 microversion: 2.1 time: 0.091112 Dec 18 21:19:25.699494 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3425/6798] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:25 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:19:26.719167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:26.719885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:26.727485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:26.727981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:26.728799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:26.729338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:26.862438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:26.869769 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-14ad969c-1178-4971-a49f-17b96419462d tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.157314 Dec 18 21:19:26.870671 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3374/6799] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:26 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:27.886451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:27.887172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:27.893982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:27.894477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:27.895273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:27.895713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:28.034310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:28.042616 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9704f433-f774-4172-9945-0b7f646d4521 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.159927 Dec 18 21:19:28.043852 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3426/6800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:27 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:28.064967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f2e4c3a8-b643-4922-98b5-3d9dbf46a09f req-54f76c09-2551-4d8a-902e-308cf3678ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c45feb3-d2c8-4747-8358-9b4d3349e35d", "tag": "257da8ba-96d1-45a1-8c0e-37a7a2967f3e"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:28.067068 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:28.067068 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:19:28.075916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f2e4c3a8-b643-4922-98b5-3d9dbf46a09f req-54f76c09-2551-4d8a-902e-308cf3678ed8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:28.076611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f2e4c3a8-b643-4922-98b5-3d9dbf46a09f req-54f76c09-2551-4d8a-902e-308cf3678ed8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:28.091042 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f2e4c3a8-b643-4922-98b5-3d9dbf46a09f req-54f76c09-2551-4d8a-902e-308cf3678ed8 service nova] Creating event network-changed:257da8ba-96d1-45a1-8c0e-37a7a2967f3e for instance 5c45feb3-d2c8-4747-8358-9b4d3349e35d on nch1-master-1 Dec 18 21:19:28.097338 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f2e4c3a8-b643-4922-98b5-3d9dbf46a09f req-54f76c09-2551-4d8a-902e-308cf3678ed8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036219 Dec 18 21:19:28.098559 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3375/6801] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:28.333932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-20743324", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "4a319045-7962-4b86-bd9c-05ab97eb05f9"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:28.406062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] validate_networks() for [('4a319045-7962-4b86-bd9c-05ab97eb05f9', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:19:28.980233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:19:28.981374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:19:28.982105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:19:28.982105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:19:28.982543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:19:28.993158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:28.993764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:28.994951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:28.999147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:29.018859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Getting quotas for project c2d14b131ac74307b9aa94aded5f3f5e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:19:29.023943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Getting quotas for user 84883df65dac439a8c1e454b7ad570e2 and project c2d14b131ac74307b9aa94aded5f3f5e. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:19:29.037128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:19:29.039413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:19:29.064357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:29.065399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:29.074213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:29.075197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:29.076313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:29.076865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:29.086094 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30aff390-efd8-4dec-b2f5-6b167abda283 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756905 Dec 18 21:19:29.086806 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3427/6802] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:19:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:19:29.097237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-822e0470-aadd-4708-9321-c06800eef307 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:29.098084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-822e0470-aadd-4708-9321-c06800eef307 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:29.192531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-822e0470-aadd-4708-9321-c06800eef307 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:29.201833 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-822e0470-aadd-4708-9321-c06800eef307 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1217 microversion: 2.1 time: 0.108190 Dec 18 21:19:29.204467 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3428/6803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:29 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:29.280360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:29.288821 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-64ad0998-9cb0-423e-a256-0f45178fd894 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.229022 Dec 18 21:19:29.298585 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3376/6804] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:29 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:30.120107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ec715517-5492-4163-bf7f-59705de79dd7 req-38408e3d-4745-4a1b-8462-dd66a1b15db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa4399a-9312-45b5-9afd-22ef3108c648", "tag": "97721db6-c0d4-427a-bf3b-29a6939f6da3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:30.121769 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:30.121769 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:19:30.131744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ec715517-5492-4163-bf7f-59705de79dd7 req-38408e3d-4745-4a1b-8462-dd66a1b15db8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:30.132193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ec715517-5492-4163-bf7f-59705de79dd7 req-38408e3d-4745-4a1b-8462-dd66a1b15db8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:30.142527 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ec715517-5492-4163-bf7f-59705de79dd7 req-38408e3d-4745-4a1b-8462-dd66a1b15db8 service nova] Creating event network-changed:97721db6-c0d4-427a-bf3b-29a6939f6da3 for instance cfa4399a-9312-45b5-9afd-22ef3108c648 on nch2-master-1 Dec 18 21:19:30.147804 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ec715517-5492-4163-bf7f-59705de79dd7 req-38408e3d-4745-4a1b-8462-dd66a1b15db8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031431 Dec 18 21:19:30.148570 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3429/6805] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:30.220252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:30.221083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:30.227710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:30.228560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:30.229530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:30.230126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:30.299950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:30.307079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:30.308107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:30.312254 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0691346-5f3c-410e-9240-ef05a960d507 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1275 microversion: 2.1 time: 0.095313 Dec 18 21:19:30.313186 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3377/6806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:30 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:30.316160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:30.316725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:30.317652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:30.318208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:30.555171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:30.562878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ce52394e-b114-41a2-bba8-269d63a5459c tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.259918 Dec 18 21:19:30.563919 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3430/6807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:30 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:19:31.331606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:31.338053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:31.346392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:31.346894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:31.347690 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:31.348348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:31.495664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:31.503691 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2060b91e-6d8a-44ba-937c-4d15098029da tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1317 microversion: 2.1 time: 0.176850 Dec 18 21:19:31.504270 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3378/6808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:31 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:31.580258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:31.580963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:31.587789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:31.588238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:31.589021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:31.589462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:31.738669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:31.748235 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-caac280e-a0e3-4715-8095-a235c3faa772 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.171236 Dec 18 21:19:31.748920 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3431/6809] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:31 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:32.168792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d3267beb-72f4-48d8-8102-ca38309c5fb3 req-a4628dbc-91e3-4630-94b8-eb4819d79cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1395a5ef-f368-42fe-bac4-a24564f6b5a1", "tag": "3a467b03-fb6e-4723-8389-19b8585c616d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:32.171032 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:32.171032 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:19:32.178052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d3267beb-72f4-48d8-8102-ca38309c5fb3 req-a4628dbc-91e3-4630-94b8-eb4819d79cb9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:32.178466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d3267beb-72f4-48d8-8102-ca38309c5fb3 req-a4628dbc-91e3-4630-94b8-eb4819d79cb9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:32.191225 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d3267beb-72f4-48d8-8102-ca38309c5fb3 req-a4628dbc-91e3-4630-94b8-eb4819d79cb9 service nova] Creating event network-changed:3a467b03-fb6e-4723-8389-19b8585c616d for instance 1395a5ef-f368-42fe-bac4-a24564f6b5a1 on nch2-master-1 Dec 18 21:19:32.196080 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d3267beb-72f4-48d8-8102-ca38309c5fb3 req-a4628dbc-91e3-4630-94b8-eb4819d79cb9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031018 Dec 18 21:19:32.196694 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3379/6810] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:32.520496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:32.521197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:32.527156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:32.527616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:32.528406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:32.529466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:32.673431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:32.681421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-12e9a6a7-91f0-4736-a1b6-3f5f3a4affcb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1317 microversion: 2.1 time: 0.164691 Dec 18 21:19:32.682012 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3432/6811] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:32 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:32.768983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:32.769716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:32.775861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:32.776323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:32.777124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:32.777578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:32.905283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:32.912915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-230a24c8-908b-499d-9942-717c77a79784 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.148795 Dec 18 21:19:32.913481 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3380/6812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:32 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:33.698829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:33.699432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:33.706150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:33.706635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:33.707408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:33.707842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:33.840980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:33.848321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6aaebd09-e067-47eb-8fa6-c0be8bdc2d11 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1317 microversion: 2.1 time: 0.153213 Dec 18 21:19:33.848981 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3433/6813] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:33 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:33.928742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:33.929380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:33.936796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:33.937266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:33.938067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:33.938554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:34.003501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b3a1e264-00ec-43a8-95e6-0258f0cb42ad req-712f3513-4064-4f3d-96c5-a6b860c6ae20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa4399a-9312-45b5-9afd-22ef3108c648", "name": "network-vif-plugged", "status": "completed", "tag": "97721db6-c0d4-427a-bf3b-29a6939f6da3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:34.005168 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:34.005168 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:19:34.013326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b3a1e264-00ec-43a8-95e6-0258f0cb42ad req-712f3513-4064-4f3d-96c5-a6b860c6ae20 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:34.014025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b3a1e264-00ec-43a8-95e6-0258f0cb42ad req-712f3513-4064-4f3d-96c5-a6b860c6ae20 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:34.028697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b3a1e264-00ec-43a8-95e6-0258f0cb42ad req-712f3513-4064-4f3d-96c5-a6b860c6ae20 service nova] Creating event network-vif-plugged:97721db6-c0d4-427a-bf3b-29a6939f6da3 for instance cfa4399a-9312-45b5-9afd-22ef3108c648 on nch2-master-1 Dec 18 21:19:34.033949 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b3a1e264-00ec-43a8-95e6-0258f0cb42ad req-712f3513-4064-4f3d-96c5-a6b860c6ae20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034240 Dec 18 21:19:34.034603 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3434/6814] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:19:34.080393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:34.087737 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0689ace-a468-4c94-a4a5-3406f48fe259 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.162714 Dec 18 21:19:34.088297 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3381/6815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:33 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:34.866758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:34.867456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:34.874112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:34.874593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:34.875377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:34.875816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:35.004175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:35.011538 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11cfeaef-348f-4603-a86f-18ab84e45eb0 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1317 microversion: 2.1 time: 0.149708 Dec 18 21:19:35.012116 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3435/6816] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:34 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:35.104613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:35.105492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:35.112402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:35.112973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:35.114004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:35.114660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:35.252922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:35.260485 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-56bb459d-c5be-4177-9939-8156ae9dae1f tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1313 microversion: 2.1 time: 0.159517 Dec 18 21:19:35.260882 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3382/6817] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:35 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:36.029419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:36.030139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:36.037245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.037700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:36.038513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.038954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:36.169871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:36.177295 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4bc36ab6-7d49-4b9b-a6dc-3afa57552663 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1317 microversion: 2.1 time: 0.152216 Dec 18 21:19:36.177881 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3436/6818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:36 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:36.276983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:36.277501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:36.284549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.285015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:36.285816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.286289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:36.417180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:36.424658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff90d553-b8ce-4df1-9179-9310cd8e8922 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1498 microversion: 2.1 time: 0.151599 Dec 18 21:19:36.425235 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3383/6819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:36 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:36.798578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:36.799019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:36.805057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.805543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:36.806365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.806806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:36.832026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:19:36.908235 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-758705c3-05ea-4920-9908-b51f64ccbb43 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 204 len: 0 microversion: 2.1 time: 0.113566 Dec 18 21:19:36.908964 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3437/6820] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:19:36 2021] DELETE /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:19:36.917106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:36.917741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:36.924232 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.924709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:36.925516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:36.925980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:37.052990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:37.061160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-774e87d4-9189-4bb6-89b5-e1b84bad7341 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1504 microversion: 2.1 time: 0.147837 Dec 18 21:19:37.061732 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3384/6821] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:36 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:37.194902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:37.195610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:37.201907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:37.202414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:37.203197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:37.203637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:37.336449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:37.344338 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e60f121-2006-4f00-aa36-9fdd7f2e84fb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1317 microversion: 2.1 time: 0.153816 Dec 18 21:19:37.344927 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3438/6822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:37 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:38.012154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-66e9d173-27f4-4f84-9da0-a281acb52a6c req-8b8486b9-bcbe-4fdd-bbc2-192a85e228d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1395a5ef-f368-42fe-bac4-a24564f6b5a1", "name": "network-vif-plugged", "status": "completed", "tag": "3a467b03-fb6e-4723-8389-19b8585c616d"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:38.014327 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:38.014327 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:19:38.021975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-66e9d173-27f4-4f84-9da0-a281acb52a6c req-8b8486b9-bcbe-4fdd-bbc2-192a85e228d9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:38.022499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-66e9d173-27f4-4f84-9da0-a281acb52a6c req-8b8486b9-bcbe-4fdd-bbc2-192a85e228d9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:38.033978 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-66e9d173-27f4-4f84-9da0-a281acb52a6c req-8b8486b9-bcbe-4fdd-bbc2-192a85e228d9 service nova] Creating event network-vif-plugged:3a467b03-fb6e-4723-8389-19b8585c616d for instance 1395a5ef-f368-42fe-bac4-a24564f6b5a1 on nch2-master-1 Dec 18 21:19:38.039006 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-66e9d173-27f4-4f84-9da0-a281acb52a6c req-8b8486b9-bcbe-4fdd-bbc2-192a85e228d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030489 Dec 18 21:19:38.039847 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3385/6823] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:38.080184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:38.080808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:38.087810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:38.088275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:38.089213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:38.089683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:38.275828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:38.283281 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6bf8347-7b8f-453c-8554-d48fc421384a tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1504 microversion: 2.1 time: 0.208455 Dec 18 21:19:38.283854 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3439/6824] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:38 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:38.362752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:38.363583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:38.371141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:38.371621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:38.373119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:38.373576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:38.597283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:38.604773 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a0a1ef0-6538-4bbe-9020-d096cd6efd6f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1317 microversion: 2.1 time: 0.246898 Dec 18 21:19:38.605344 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3386/6825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:38 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:39.280977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0f55a653-58d2-48ff-944b-40ec97fa8dc0 req-f2b45518-048e-43c3-816a-90aac392fdbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa4399a-9312-45b5-9afd-22ef3108c648", "name": "network-vif-deleted", "tag": "97721db6-c0d4-427a-bf3b-29a6939f6da3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:39.282950 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:19:39.282950 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:19:39.292135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0f55a653-58d2-48ff-944b-40ec97fa8dc0 req-f2b45518-048e-43c3-816a-90aac392fdbb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.292924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0f55a653-58d2-48ff-944b-40ec97fa8dc0 req-f2b45518-048e-43c3-816a-90aac392fdbb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:39.300483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:39.301211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:39.305860 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0f55a653-58d2-48ff-944b-40ec97fa8dc0 req-f2b45518-048e-43c3-816a-90aac392fdbb service nova] Creating event network-vif-deleted:97721db6-c0d4-427a-bf3b-29a6939f6da3 for instance cfa4399a-9312-45b5-9afd-22ef3108c648 on nch2-master-1 Dec 18 21:19:39.308320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.308990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:39.310527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.311063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:39.312699 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0f55a653-58d2-48ff-944b-40ec97fa8dc0 req-f2b45518-048e-43c3-816a-90aac392fdbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101994 Dec 18 21:19:39.313306 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3440/6826] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:19:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:39.344520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.345060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:39.345598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lazy-loading 'fault' on Instance uuid cfa4399a-9312-45b5-9afd-22ef3108c648 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:19:39.386300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e59ad9f3924293afdb08a62848402f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:39.394344 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26900b75-1523-4625-b983-014e3b3e63cc tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 200 len: 1303 microversion: 2.1 time: 0.097757 Dec 18 21:19:39.394907 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3387/6827] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:39 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:19:39.621361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:39.622123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:39.628535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.629319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:39.630534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.630966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:39.936097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:19:39.943909 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c6145fe-8a89-43a5-85fb-cd126e9bc4d3 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1506 microversion: 2.1 time: 0.326738 Dec 18 21:19:39.944489 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3441/6828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:39 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:19:39.960391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "453214a7-66ea-4df2-bb71-f35aa118fee6", "device": "/dev/sdb"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:19:39.961826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:39.968301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.968773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:39.969580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:39.970034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:40.198818 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c957a6c5-55e1-4d59-b1d0-371bc50d47cb tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "POST /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241874 Dec 18 21:19:40.199367 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3388/6829] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:19:39 2021] POST /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:19:40.412239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:19:40.413010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] [instance: cfa4399a-9312-45b5-9afd-22ef3108c648] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:19:40.419808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:40.420273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:40.421068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:19:40.421512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:19:40.435408 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] HTTP exception thrown: Instance cfa4399a-9312-45b5-9afd-22ef3108c648 could not be found. Dec 18 21:19:40.436007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] Returning 404 to user: Instance cfa4399a-9312-45b5-9afd-22ef3108c648 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:19:40.436835 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-20902560-0692-4541-b1bb-511a5fa18914 tempest-VolumesActionsTest-1443685035 tempest-VolumesActionsTest-1443685035-project] 10.222.0.13 "GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648" status: 404 len: 111 microversion: 2.1 time: 0.028450 Dec 18 21:19:40.437386 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3442/6830] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:19:40 2021] GET /compute/v2.1/servers/cfa4399a-9312-45b5-9afd-22ef3108c648 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:20:09.813135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-745212165", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "f79d293b-03ff-4822-bd46-98d5ea3ffe14"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1576573631", "security_groups": []}, "os:scheduler_hints": {"different_host": ["5c45feb3-d2c8-4747-8358-9b4d3349e35d"]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:20:09.896269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] validate_networks() for [('f79d293b-03ff-4822-bd46-98d5ea3ffe14', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:20:10.604411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:20:10.607051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:20:10.609519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:20:10.610194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:20:10.610813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:20:10.633932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:10.636928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:10.637751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:10.638378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:10.684951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:20:10.694561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Getting quotas for user 577286e40c5a4bf6a56af13d061f2151 and project 4fc0be93c7544e6eb79d01c1bf880625. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:20:10.721082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:20:10.724020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:20:10.793516 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d28e701a-90a5-4775-8fa0-cdde1ea22b77 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.985117 Dec 18 21:20:10.794455 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3389/6831] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:20:09 2021] POST /compute/v2.1/servers => generated 361 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:20:10.804780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41e4875a-e304-430c-8c9a-9dd1cba2cb7c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:10.805980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41e4875a-e304-430c-8c9a-9dd1cba2cb7c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:10.878721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-41e4875a-e304-430c-8c9a-9dd1cba2cb7c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:10.885977 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41e4875a-e304-430c-8c9a-9dd1cba2cb7c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1241 microversion: 2.1 time: 0.085351 Dec 18 21:20:10.887441 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3443/6832] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:10 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:11.907236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:11.908063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:11.915892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:11.916719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:11.917936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:11.918679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:12.042321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:12.054641 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc17411b-41e0-441f-a77d-109ad121af0d tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1293 microversion: 2.1 time: 0.154369 Dec 18 21:20:12.055238 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3390/6833] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:11 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:13.074959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:13.076474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:13.088755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:13.089582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:13.091343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:13.092142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:13.260491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:13.268917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6b36aa0e-7dae-4f10-bc33-dad4b78f54af tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.199803 Dec 18 21:20:13.269576 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3444/6834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:13 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:13.642824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7855cc2b-9359-4a06-9976-03ac9ba7cd81 req-2172ad2f-3628-4700-b8eb-8dffbccf938a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84abd9f3-8abd-432f-92bc-cfdb71dadde0", "tag": "2ec96c2b-1b74-4d9f-8233-d41904d985ae"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:20:13.644561 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:20:13.644561 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:20:13.656169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7855cc2b-9359-4a06-9976-03ac9ba7cd81 req-2172ad2f-3628-4700-b8eb-8dffbccf938a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:13.656835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7855cc2b-9359-4a06-9976-03ac9ba7cd81 req-2172ad2f-3628-4700-b8eb-8dffbccf938a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:13.670398 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7855cc2b-9359-4a06-9976-03ac9ba7cd81 req-2172ad2f-3628-4700-b8eb-8dffbccf938a service nova] Creating event network-changed:2ec96c2b-1b74-4d9f-8233-d41904d985ae for instance 84abd9f3-8abd-432f-92bc-cfdb71dadde0 on nch2-master-1 Dec 18 21:20:13.677974 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7855cc2b-9359-4a06-9976-03ac9ba7cd81 req-2172ad2f-3628-4700-b8eb-8dffbccf938a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040988 Dec 18 21:20:13.679788 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3391/6835] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:20:14.285682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:14.286306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:14.292788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:14.293245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:14.294033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:14.294499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:14.409157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:14.416512 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0b8ea78a-cfa3-455d-a12e-f845f1f5ebf9 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.134439 Dec 18 21:20:14.417082 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3445/6836] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:14 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:15.434756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:15.435418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:15.441907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:15.442417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:15.443230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:15.443703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:15.525641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:15.533472 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4b284323-6a35-415f-a898-2b4b03aea919 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.103858 Dec 18 21:20:15.534024 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3392/6837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:15 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:16.550718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:16.551325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:16.563064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:16.563507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:16.564428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:16.564879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:16.647006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:16.654372 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e69bc071-2e1a-44eb-bc73-cf8e676a932c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.107400 Dec 18 21:20:16.654940 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3446/6838] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:16 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:17.670975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:17.671602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:17.678490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:17.678962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:17.679764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:17.680223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:17.774507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:17.781990 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b9541707-18b4-41e5-a0fa-6cb07a9808f3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.114760 Dec 18 21:20:17.782612 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3393/6839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:17 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:18.798681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:18.799292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:18.806563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:18.807020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:18.807823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:18.808267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:18.889837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:18.897092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56d560b3-237e-4583-a860-c75adad88234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.102224 Dec 18 21:20:18.897660 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3447/6840] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:18 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:19.914320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:19.914853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:19.922279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:19.922765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:19.923569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:19.924028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:20.009556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:20.016856 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2b9e949d-488f-47df-9bf7-0f6f9dbb2a3a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.106390 Dec 18 21:20:20.017432 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3394/6841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:19 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:20.213702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-99efe059-57b4-424a-bef7-9c1a4422ad6c req-a6bd736f-4c44-42a3-8e70-15c8c5e9eba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84abd9f3-8abd-432f-92bc-cfdb71dadde0", "name": "network-vif-plugged", "status": "completed", "tag": "2ec96c2b-1b74-4d9f-8233-d41904d985ae"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:20:20.215806 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:20:20.215806 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:20:20.224372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-99efe059-57b4-424a-bef7-9c1a4422ad6c req-a6bd736f-4c44-42a3-8e70-15c8c5e9eba2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:20.224828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-99efe059-57b4-424a-bef7-9c1a4422ad6c req-a6bd736f-4c44-42a3-8e70-15c8c5e9eba2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:20.236712 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-99efe059-57b4-424a-bef7-9c1a4422ad6c req-a6bd736f-4c44-42a3-8e70-15c8c5e9eba2 service nova] Creating event network-vif-plugged:2ec96c2b-1b74-4d9f-8233-d41904d985ae for instance 84abd9f3-8abd-432f-92bc-cfdb71dadde0 on nch2-master-1 Dec 18 21:20:20.242041 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-99efe059-57b4-424a-bef7-9c1a4422ad6c req-a6bd736f-4c44-42a3-8e70-15c8c5e9eba2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032163 Dec 18 21:20:20.242685 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3448/6842] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:20:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:20:21.033404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:21.033972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:21.040818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:21.041294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:21.042100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:21.043079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:21.128592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:21.139285 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-81b9c268-d709-4477-9eb6-181b32b8ecac tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1299 microversion: 2.1 time: 0.108331 Dec 18 21:20:21.139285 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3395/6843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:21 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:22.157102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:22.157804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:22.163949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.164409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.165193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.165635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.247921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:22.255837 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0bb1dff0-090c-47fd-8582-d621b8981910 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1470 microversion: 2.1 time: 0.103226 Dec 18 21:20:22.256413 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3449/6844] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:22 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1470 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:22.272257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:22.272892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:22.279837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.280310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.281134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.281593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.363667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:22.371494 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b259b66-c467-453a-b164-fea6a07fdf4a tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1470 microversion: 2.1 time: 0.102952 Dec 18 21:20:22.372071 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3396/6845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:22 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1470 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:22.387517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c1851eb-d296-4a54-8d55-d7d6fce697ba tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:22.388329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c1851eb-d296-4a54-8d55-d7d6fce697ba tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:22.394091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c1851eb-d296-4a54-8d55-d7d6fce697ba tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.394576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c1851eb-d296-4a54-8d55-d7d6fce697ba tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.395350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c1851eb-d296-4a54-8d55-d7d6fce697ba tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.395805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c1851eb-d296-4a54-8d55-d7d6fce697ba tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.474299 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c1851eb-d296-4a54-8d55-d7d6fce697ba tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1621 microversion: 2.1 time: 0.091066 Dec 18 21:20:22.474879 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3450/6846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:22 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1621 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:20:22.489733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8cfe4c70-a718-4e04-a85f-c041c22bbcd3 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:22.490392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8cfe4c70-a718-4e04-a85f-c041c22bbcd3 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:22.496715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cfe4c70-a718-4e04-a85f-c041c22bbcd3 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.497184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cfe4c70-a718-4e04-a85f-c041c22bbcd3 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.497982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cfe4c70-a718-4e04-a85f-c041c22bbcd3 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:22.498485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8cfe4c70-a718-4e04-a85f-c041c22bbcd3 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:22.631441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8cfe4c70-a718-4e04-a85f-c041c22bbcd3 tempest-TestSecurityGroupsBasicOps-1390929627 tempest-TestSecurityGroupsBasicOps-1390929627-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1912 microversion: 2.1 time: 0.145029 Dec 18 21:20:22.632179 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3397/6847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:22 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1912 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:23.002234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:23.002768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:23.008676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:23.009136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:23.009922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:23.010393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:23.034954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:20:23.109340 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75875c4e-bf83-4042-881a-e13b4249fa29 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "DELETE /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 204 len: 0 microversion: 2.1 time: 0.110565 Dec 18 21:20:23.109939 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3451/6848] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:20:22 2021] DELETE /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:20:23.118709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:23.119451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:23.125345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:23.125810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:23.126631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:23.127085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:23.208893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:23.216955 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0323816f-c4d7-42e3-9389-5506b01f835c tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1476 microversion: 2.1 time: 0.102024 Dec 18 21:20:23.217528 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3398/6849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:23 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1476 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:24.234929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:24.235652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:24.242371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:24.242827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:24.243607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:24.244043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:24.336301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:24.343789 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45a72e4d-1852-4001-b2b4-d4f18e499f20 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 200 len: 1476 microversion: 2.1 time: 0.112914 Dec 18 21:20:24.344363 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3452/6850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:24 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 1476 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:24.853295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2b1c254d-212c-42bc-9e19-33f8020a82ef req-1e1ec292-7a6b-42c4-affb-8b23d949da7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84abd9f3-8abd-432f-92bc-cfdb71dadde0", "name": "network-vif-deleted", "tag": "2ec96c2b-1b74-4d9f-8233-d41904d985ae"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:20:24.855509 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:20:24.855509 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:20:24.866655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2b1c254d-212c-42bc-9e19-33f8020a82ef req-1e1ec292-7a6b-42c4-affb-8b23d949da7e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:24.867704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2b1c254d-212c-42bc-9e19-33f8020a82ef req-1e1ec292-7a6b-42c4-affb-8b23d949da7e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:24.881504 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2b1c254d-212c-42bc-9e19-33f8020a82ef req-1e1ec292-7a6b-42c4-affb-8b23d949da7e service nova] Creating event network-vif-deleted:2ec96c2b-1b74-4d9f-8233-d41904d985ae for instance 84abd9f3-8abd-432f-92bc-cfdb71dadde0 on nch2-master-1 Dec 18 21:20:24.889458 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2b1c254d-212c-42bc-9e19-33f8020a82ef req-1e1ec292-7a6b-42c4-affb-8b23d949da7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041599 Dec 18 21:20:24.890304 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3399/6851] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:20:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:20:25.361014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:25.361619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 84abd9f3-8abd-432f-92bc-cfdb71dadde0] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:25.368352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:25.368800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:25.369576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:25.370007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:25.383027 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] HTTP exception thrown: Instance 84abd9f3-8abd-432f-92bc-cfdb71dadde0 could not be found. Dec 18 21:20:25.383608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Returning 404 to user: Instance 84abd9f3-8abd-432f-92bc-cfdb71dadde0 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:20:25.384455 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f6d42a7c-420d-4fe2-81d8-f5efc7c3d758 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0" status: 404 len: 111 microversion: 2.1 time: 0.027204 Dec 18 21:20:25.385002 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3453/6852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:25 2021] GET /compute/v2.1/servers/84abd9f3-8abd-432f-92bc-cfdb71dadde0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:20:29.365548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:29.366167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:29.366551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-45d5d6e7-4305-4a47-ae56-2906ec5ee77f req-952a2700-1666-4f75-a50c-c4fc54e8191f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c45feb3-d2c8-4747-8358-9b4d3349e35d", "tag": "257da8ba-96d1-45a1-8c0e-37a7a2967f3e"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:20:29.368328 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:20:29.368328 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:20:29.372835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:29.373382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:29.374335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:29.374802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:29.376472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-45d5d6e7-4305-4a47-ae56-2906ec5ee77f req-952a2700-1666-4f75-a50c-c4fc54e8191f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:29.376925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-45d5d6e7-4305-4a47-ae56-2906ec5ee77f req-952a2700-1666-4f75-a50c-c4fc54e8191f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:29.389085 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-45d5d6e7-4305-4a47-ae56-2906ec5ee77f req-952a2700-1666-4f75-a50c-c4fc54e8191f service nova] Creating event network-changed:257da8ba-96d1-45a1-8c0e-37a7a2967f3e for instance 5c45feb3-d2c8-4747-8358-9b4d3349e35d on nch1-master-1 Dec 18 21:20:29.394432 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-45d5d6e7-4305-4a47-ae56-2906ec5ee77f req-952a2700-1666-4f75-a50c-c4fc54e8191f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031764 Dec 18 21:20:29.395649 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3454/6853] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:20:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:20:29.404750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:20:29.495658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bea91ba3-b830-4211-9e05-2a3d708d6580 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 204 len: 0 microversion: 2.1 time: 0.134686 Dec 18 21:20:29.496631 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3400/6854] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:20:29 2021] DELETE /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:20:29.507067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:29.508015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:29.515958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:29.516417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:29.517404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:29.518164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:29.683458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:29.691928 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6602947-bae7-40ba-b857-50fad29b8ca3 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1767 microversion: 2.1 time: 0.190802 Dec 18 21:20:29.692509 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3455/6855] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:29 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1767 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:20:30.709404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:30.710134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:30.717187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:30.717660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:30.718506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:30.718968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:30.858487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:30.865750 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-742a5892-386a-42b2-b155-6114e79d5515 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1649 microversion: 2.1 time: 0.160542 Dec 18 21:20:30.866365 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3401/6856] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:30 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1649 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:31.564430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-a8b4c384-3970-4459-9b97-1af616233b82 req-33fe83ef-082e-4cbe-bf3d-15179f52a9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c45feb3-d2c8-4747-8358-9b4d3349e35d", "name": "network-vif-deleted", "tag": "257da8ba-96d1-45a1-8c0e-37a7a2967f3e"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:20:31.566268 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:20:31.566268 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:20:31.574272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a8b4c384-3970-4459-9b97-1af616233b82 req-33fe83ef-082e-4cbe-bf3d-15179f52a9d3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:31.574730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-a8b4c384-3970-4459-9b97-1af616233b82 req-33fe83ef-082e-4cbe-bf3d-15179f52a9d3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:31.586537 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-a8b4c384-3970-4459-9b97-1af616233b82 req-33fe83ef-082e-4cbe-bf3d-15179f52a9d3 service nova] Creating event network-vif-deleted:257da8ba-96d1-45a1-8c0e-37a7a2967f3e for instance 5c45feb3-d2c8-4747-8358-9b4d3349e35d on nch1-master-1 Dec 18 21:20:31.591832 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-a8b4c384-3970-4459-9b97-1af616233b82 req-33fe83ef-082e-4cbe-bf3d-15179f52a9d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031022 Dec 18 21:20:31.592435 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3456/6857] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:20:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:20:31.882809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:31.883440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:31.890601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:31.891108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:31.891934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:31.892393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:31.925551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:31.926020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:31.926521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lazy-loading 'fault' on Instance uuid 5c45feb3-d2c8-4747-8358-9b4d3349e35d {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:20:31.970173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577286e40c5a4bf6a56af13d061f2151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc0be93c7544e6eb79d01c1bf880625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:20:31.978226 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46e9bab9-4d8a-47e7-8439-3abd96a4c66e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 200 len: 1384 microversion: 2.1 time: 0.099199 Dec 18 21:20:31.978830 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3402/6858] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:31 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 1384 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:20:32.998695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:32.999390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] [instance: 5c45feb3-d2c8-4747-8358-9b4d3349e35d] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:20:33.005510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:33.005965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:33.006790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:20:33.007231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:20:33.020857 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] HTTP exception thrown: Instance 5c45feb3-d2c8-4747-8358-9b4d3349e35d could not be found. Dec 18 21:20:33.021438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Returning 404 to user: Instance 5c45feb3-d2c8-4747-8358-9b4d3349e35d could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:20:33.022276 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-266c111e-15a0-4723-b1b2-12b433f2e234 tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d" status: 404 len: 111 microversion: 2.1 time: 0.029104 Dec 18 21:20:33.022820 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3457/6859] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:20:32 2021] GET /compute/v2.1/servers/5c45feb3-d2c8-4747-8358-9b4d3349e35d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:20:36.113574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-22a73ad9-aed3-41e8-a9e8-f3532332981e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] Calling method '.version_select at 0x7f714c4760d0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:20:36.138852 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-22a73ad9-aed3-41e8-a9e8-f3532332981e tempest-TestSecurityGroupsBasicOps-1529059756 tempest-TestSecurityGroupsBasicOps-1529059756-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1576573631" status: 202 len: 0 microversion: 2.1 time: 0.028988 Dec 18 21:20:36.139638 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3403/6860] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Dec 18 21:20:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1576573631 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:21:17.557779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:21:17.558307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:21:17.564489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:17.564943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:17.565978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:17.566451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:17.643771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lazy-loading 'services' on Instance uuid 1395a5ef-f368-42fe-bac4-a24564f6b5a1 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:21:17.711135 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ba022321-580c-4171-91d0-1ba2d5597420 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1/os-volume_attachments/453214a7-66ea-4df2-bb71-f35aa118fee6" status: 202 len: 0 microversion: 2.1 time: 0.157344 Dec 18 21:21:17.711729 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3458/6861] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:21:17 2021] DELETE /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1/os-volume_attachments/453214a7-66ea-4df2-bb71-f35aa118fee6 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:21:18.825041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:21:18.825562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:21:18.832165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:18.832681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:18.833483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:18.833944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:18.858509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:21:18.929554 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0fee122-a7bf-4acc-9cef-099f63d2549e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 204 len: 0 microversion: 2.1 time: 0.108872 Dec 18 21:21:18.930369 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3404/6862] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:21:18 2021] DELETE /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:21:18.940600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:21:18.941317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:21:18.947744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:18.948206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:18.949051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:18.949492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:19.080270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:21:19.088260 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d415281e-5e91-483c-95ab-8434e37a1f5e tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1512 microversion: 2.1 time: 0.152900 Dec 18 21:21:19.090011 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3459/6863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:21:18 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:21:20.108180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:21:20.108933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:21:20.115640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:20.116108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:20.116905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:20.117358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:20.256994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84883df65dac439a8c1e454b7ad570e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d14b131ac74307b9aa94aded5f3f5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:21:20.264523 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35485fee-2d5d-4fa8-86f5-25b8a61e41a8 tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 200 len: 1512 microversion: 2.1 time: 0.160959 Dec 18 21:21:20.265098 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3405/6864] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:21:20 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:21:20.833896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d653b7a3-5627-4b51-be99-ed760b943e21 req-58543274-1164-4139-95c9-9e18136cbf7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1395a5ef-f368-42fe-bac4-a24564f6b5a1", "name": "network-vif-deleted", "tag": "3a467b03-fb6e-4723-8389-19b8585c616d"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:21:20.835734 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:21:20.835734 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:21:20.844645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d653b7a3-5627-4b51-be99-ed760b943e21 req-58543274-1164-4139-95c9-9e18136cbf7e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:20.845101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d653b7a3-5627-4b51-be99-ed760b943e21 req-58543274-1164-4139-95c9-9e18136cbf7e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:20.856495 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d653b7a3-5627-4b51-be99-ed760b943e21 req-58543274-1164-4139-95c9-9e18136cbf7e service nova] Creating event network-vif-deleted:3a467b03-fb6e-4723-8389-19b8585c616d for instance 1395a5ef-f368-42fe-bac4-a24564f6b5a1 on nch2-master-1 Dec 18 21:21:20.861514 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d653b7a3-5627-4b51-be99-ed760b943e21 req-58543274-1164-4139-95c9-9e18136cbf7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031279 Dec 18 21:21:20.862120 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3460/6865] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:21:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:21:21.282367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:21:21.282992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] [instance: 1395a5ef-f368-42fe-bac4-a24564f6b5a1] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:21:21.289623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:21.290093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:21.290911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:21.291366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:21.304646 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] HTTP exception thrown: Instance 1395a5ef-f368-42fe-bac4-a24564f6b5a1 could not be found. Dec 18 21:21:21.305240 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] Returning 404 to user: Instance 1395a5ef-f368-42fe-bac4-a24564f6b5a1 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:21:21.306090 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e2c3e1e-87d0-408d-a731-3ede4cd91e7f tempest-VolumesSnapshotTestJSON-1921935471 tempest-VolumesSnapshotTestJSON-1921935471-project] 10.222.0.13 "GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1" status: 404 len: 111 microversion: 2.1 time: 0.028429 Dec 18 21:21:21.306640 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3406/6866] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:21:21 2021] GET /compute/v2.1/servers/1395a5ef-f368-42fe-bac4-a24564f6b5a1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:21:38.425779 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:21:38.426404 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:21:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:21:55.621737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6d7f8e0-adf6-4cbb-91fd-c444c9cdaf7b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'create', calling method: .version_select at 0x7f714ef15280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1290761752"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:21:55.641334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e6d7f8e0-adf6-4cbb-91fd-c444c9cdaf7b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:21:55.647037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e6d7f8e0-adf6-4cbb-91fd-c444c9cdaf7b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:21:56.047496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e6d7f8e0-adf6-4cbb-91fd-c444c9cdaf7b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:21:56.052266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e6d7f8e0-adf6-4cbb-91fd-c444c9cdaf7b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:21:56.067133 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6d7f8e0-adf6-4cbb-91fd-c444c9cdaf7b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.451969 Dec 18 21:21:56.067749 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3461/6867] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:21:55 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:21:57.626828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1786663039", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "eb94229c-2472-48e1-ad2e-ee3003c78914"}], "key_name": "tempest-TestNetworkBasicOps-1290761752", "security_groups": [{"name": "tempest-secgroup-smoke-1982015071"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:21:57.908061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] validate_networks() for [('eb94229c-2472-48e1-ad2e-ee3003c78914', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:21:58.279379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:21:58.279825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:21:58.280476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:21:58.280939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:21:58.281371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:21:58.290063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:58.290573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:58.291444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:58.291903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:58.309038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:21:58.314124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:21:58.326789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:21:58.329114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:21:58.374705 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-facd3f28-b231-4529-bc71-d4b07b58608e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751621 Dec 18 21:21:58.375398 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3407/6868] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:21:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:21:58.386460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df61879c-3050-4713-b926-0de11054afdc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:21:58.387184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df61879c-3050-4713-b926-0de11054afdc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:21:58.504981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-df61879c-3050-4713-b926-0de11054afdc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:21:58.514679 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df61879c-3050-4713-b926-0de11054afdc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1249 microversion: 2.1 time: 0.133112 Dec 18 21:21:58.515283 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3462/6869] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:21:58 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1249 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:21:59.533304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:21:59.533964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:21:59.540328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:59.540811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:59.542181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:21:59.542722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:21:59.634527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:21:59.642909 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad27fd1b-ff32-4f80-9b79-640ba27e3234 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1307 microversion: 2.1 time: 0.114473 Dec 18 21:21:59.643816 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3408/6870] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:21:59 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:00.642697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5f5ffb50-d62d-4835-a6cb-c66128e4a3f4 req-a2f2b296-ef8d-4a8b-b9ea-922b0e266fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afbda18-b545-47c4-bfc0-612365afab02", "tag": "5f5f86a7-2190-4a16-8881-387d56f8e8b1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:22:00.646553 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:22:00.646553 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:22:00.661940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:00.663196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:00.681437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:00.682522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:00.683351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:00.683812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:00.695626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5f5ffb50-d62d-4835-a6cb-c66128e4a3f4 req-a2f2b296-ef8d-4a8b-b9ea-922b0e266fba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:00.696081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5f5ffb50-d62d-4835-a6cb-c66128e4a3f4 req-a2f2b296-ef8d-4a8b-b9ea-922b0e266fba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:00.718697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5f5ffb50-d62d-4835-a6cb-c66128e4a3f4 req-a2f2b296-ef8d-4a8b-b9ea-922b0e266fba service nova] Creating event network-changed:5f5f86a7-2190-4a16-8881-387d56f8e8b1 for instance 3afbda18-b545-47c4-bfc0-612365afab02 on nch2-master-1 Dec 18 21:22:00.725158 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5f5ffb50-d62d-4835-a6cb-c66128e4a3f4 req-a2f2b296-ef8d-4a8b-b9ea-922b0e266fba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089473 Dec 18 21:22:00.725778 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3463/6871] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:22:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:22:00.927996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:00.935454 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b1d6f71-7880-4fc1-9c2c-5b490ddfc605 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1375 microversion: 2.1 time: 0.277623 Dec 18 21:22:00.936026 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3409/6872] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:00 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1375 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:01.954359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:01.955149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:01.962120 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:01.962605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:01.963425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:01.963862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:02.095788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:02.104260 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ee4ff983-e514-471c-aa6d-3738d1adb9a4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1375 microversion: 2.1 time: 0.154887 Dec 18 21:22:02.104937 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3464/6873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:01 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:03.121768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:03.122421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:03.129070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:03.129544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:03.130376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:03.130838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:03.265558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:03.272866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4cd5b7b-8d59-46cd-8033-9c53abac4845 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1375 microversion: 2.1 time: 0.155478 Dec 18 21:22:03.273436 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3410/6874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:03 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:04.289039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:04.289781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:04.296780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:04.297235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:04.298018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:04.298497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:04.428045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:04.435855 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d566bfad-16ae-440f-92a7-db38bf70243f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1375 microversion: 2.1 time: 0.150671 Dec 18 21:22:04.436423 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3465/6875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:04 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:05.453825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:05.454488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:05.461731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:05.462204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:05.463067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:05.463524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:05.596076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:05.603416 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a60bf01-7bc6-459d-9bdf-69236f23c509 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1375 microversion: 2.1 time: 0.153705 Dec 18 21:22:05.604476 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3411/6876] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:05 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:06.621139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:06.621978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:06.628825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:06.629289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:06.630088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:06.630560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:06.702132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-def42828-2dcf-4648-baa3-aee70a6fbf6f req-b2d1f00a-8489-4d8d-bb2d-d87714001569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afbda18-b545-47c4-bfc0-612365afab02", "name": "network-vif-plugged", "status": "completed", "tag": "5f5f86a7-2190-4a16-8881-387d56f8e8b1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:22:06.706419 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:22:06.706419 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:22:06.717165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-def42828-2dcf-4648-baa3-aee70a6fbf6f req-b2d1f00a-8489-4d8d-bb2d-d87714001569 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:06.717746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-def42828-2dcf-4648-baa3-aee70a6fbf6f req-b2d1f00a-8489-4d8d-bb2d-d87714001569 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:06.734813 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-def42828-2dcf-4648-baa3-aee70a6fbf6f req-b2d1f00a-8489-4d8d-bb2d-d87714001569 service nova] Creating event network-vif-plugged:5f5f86a7-2190-4a16-8881-387d56f8e8b1 for instance 3afbda18-b545-47c4-bfc0-612365afab02 on nch2-master-1 Dec 18 21:22:06.740271 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-def42828-2dcf-4648-baa3-aee70a6fbf6f req-b2d1f00a-8489-4d8d-bb2d-d87714001569 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044705 Dec 18 21:22:06.741441 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3412/6877] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:22:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:22:06.783539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:06.791396 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e78711c9-3dfb-4a3a-a141-16a9ceb877a7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1375 microversion: 2.1 time: 0.174266 Dec 18 21:22:06.791985 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3466/6878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:06 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:07.809512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:07.810223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:07.816740 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:07.817208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:07.818037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:07.818521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:07.952766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:07.960196 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c8d04c2-a211-4934-ba36-9275fc111ce4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1375 microversion: 2.1 time: 0.155633 Dec 18 21:22:07.960768 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3413/6879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:07 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:08.976735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:08.977349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:08.983953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:08.984408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:08.985191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:08.985632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:09.121128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:09.128503 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f606e8a8-73ed-448d-b908-5dc240e6770c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1548 microversion: 2.1 time: 0.155550 Dec 18 21:22:09.129076 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3467/6880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:08 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:09.144792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:09.145450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:09.152178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:09.152643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:09.153443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:09.153899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:09.287095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:09.294408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ca3eb4e7-e069-42b8-8ee3-e74717de8939 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1548 microversion: 2.1 time: 0.153276 Dec 18 21:22:09.294980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3414/6881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:09 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:11.189608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f0f25b27-155e-457a-93f2-63781863175e req-117d9e9f-4f93-4366-95fa-7e1524f46924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afbda18-b545-47c4-bfc0-612365afab02", "tag": "5f5f86a7-2190-4a16-8881-387d56f8e8b1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:22:11.191423 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:22:11.191423 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:22:11.199025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f0f25b27-155e-457a-93f2-63781863175e req-117d9e9f-4f93-4366-95fa-7e1524f46924 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:11.199478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f0f25b27-155e-457a-93f2-63781863175e req-117d9e9f-4f93-4366-95fa-7e1524f46924 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:11.210686 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f0f25b27-155e-457a-93f2-63781863175e req-117d9e9f-4f93-4366-95fa-7e1524f46924 service nova] Creating event network-changed:5f5f86a7-2190-4a16-8881-387d56f8e8b1 for instance 3afbda18-b545-47c4-bfc0-612365afab02 on nch2-master-1 Dec 18 21:22:11.216263 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f0f25b27-155e-457a-93f2-63781863175e req-117d9e9f-4f93-4366-95fa-7e1524f46924 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030311 Dec 18 21:22:11.217155 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3468/6882] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:22:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:22:32.432474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-289b8503-3ed8-4b9e-a51e-585f79599976 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:22:32.433447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-289b8503-3ed8-4b9e-a51e-585f79599976 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:32.439566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-289b8503-3ed8-4b9e-a51e-585f79599976 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:32.440291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-289b8503-3ed8-4b9e-a51e-585f79599976 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:32.441094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-289b8503-3ed8-4b9e-a51e-585f79599976 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:32.441555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-289b8503-3ed8-4b9e-a51e-585f79599976 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:32.489191 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-289b8503-3ed8-4b9e-a51e-585f79599976 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02/action" status: 200 len: 24564 microversion: 2.1 time: 0.060590 Dec 18 21:22:32.489828 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3415/6883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:22:32 2021] POST /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02/action => generated 24564 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:22:47.297122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6c6550f-49db-44a8-b149-f05a31bd11ce tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'create', calling method: .version_select at 0x7f714ef60dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-338824886"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:22:47.311256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d6c6550f-49db-44a8-b149-f05a31bd11ce tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:22:47.316998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d6c6550f-49db-44a8-b149-f05a31bd11ce tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:22:47.476699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d6c6550f-49db-44a8-b149-f05a31bd11ce tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:22:47.481375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-d6c6550f-49db-44a8-b149-f05a31bd11ce tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:22:47.496831 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6c6550f-49db-44a8-b149-f05a31bd11ce tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.204721 Dec 18 21:22:47.497203 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3469/6884] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:22:47 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:48.508601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-213929944", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "7e12e453-abb3-45e7-8007-59d6087e217c"}], "key_name": "tempest-TestNetworkBasicOps-338824886", "security_groups": [{"name": "tempest-secgroup-smoke-1895345692"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:22:48.622967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] validate_networks() for [('7e12e453-abb3-45e7-8007-59d6087e217c', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:22:49.010326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:22:49.010975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:22:49.012603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:22:49.013180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:22:49.014286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:22:49.029702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:49.030708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:49.032100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:49.032867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:49.054631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:22:49.061039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:22:49.075353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:22:49.079014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:22:49.140917 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c250fb3e-ee3e-4a1f-9435-cf28c13f16c5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.636200 Dec 18 21:22:49.142063 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3416/6885] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:22:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:22:49.153086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-42e916e4-5b28-40a1-bfb8-41f2e4159a1e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:49.154497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-42e916e4-5b28-40a1-bfb8-41f2e4159a1e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:49.214360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42e916e4-5b28-40a1-bfb8-41f2e4159a1e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:49.221203 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-42e916e4-5b28-40a1-bfb8-41f2e4159a1e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1247 microversion: 2.1 time: 0.073050 Dec 18 21:22:49.221925 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3470/6886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:49 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:50.239318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e318611-c85e-4691-a889-a4a0c9c51442 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:50.239892 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e318611-c85e-4691-a889-a4a0c9c51442 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:50.291775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4e318611-c85e-4691-a889-a4a0c9c51442 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:50.299149 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e318611-c85e-4691-a889-a4a0c9c51442 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1247 microversion: 2.1 time: 0.063726 Dec 18 21:22:50.299704 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3417/6887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:50 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1247 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:22:51.317554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21eec795-8d3f-47a7-b87d-bd0542958517 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:51.318288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21eec795-8d3f-47a7-b87d-bd0542958517 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:51.375981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-21eec795-8d3f-47a7-b87d-bd0542958517 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:51.383820 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21eec795-8d3f-47a7-b87d-bd0542958517 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1247 microversion: 2.1 time: 0.070793 Dec 18 21:22:51.385061 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3471/6888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:51 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:52.401404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0777e80-5222-4c45-92ae-85001b2ce26b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:52.402026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0777e80-5222-4c45-92ae-85001b2ce26b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:52.454478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0777e80-5222-4c45-92ae-85001b2ce26b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:52.461465 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0777e80-5222-4c45-92ae-85001b2ce26b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1247 microversion: 2.1 time: 0.064303 Dec 18 21:22:52.462947 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3418/6889] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:52 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:53.478897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:53.479508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:53.486487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:53.486942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:53.487720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:53.488160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:53.546918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:53.553961 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c61971f2-7add-4737-a2d7-c7731f673bd5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1251 microversion: 2.1 time: 0.078780 Dec 18 21:22:53.554567 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3472/6890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:53 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1251 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:54.571582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:54.572864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:54.580872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:54.581340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:54.582143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:54.582620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:54.652146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:54.659675 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-beff741c-432f-4080-8628-cb4d73417910 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1305 microversion: 2.1 time: 0.091955 Dec 18 21:22:54.660297 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3419/6891] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:54 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:55.686433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:55.687055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:55.694990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:55.695627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:55.696619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:55.697288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:55.786722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e7992df7-3bfd-4b31-8743-95c5c0f76943 req-de295280-98a1-4f77-a6d8-083b42bc046c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c14c64-4eb9-42e4-b4e0-0da498b05e25", "tag": "4e38c3d7-714c-454d-a174-eab6093a4357"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:22:55.788588 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:22:55.788588 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:22:55.795589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e7992df7-3bfd-4b31-8743-95c5c0f76943 req-de295280-98a1-4f77-a6d8-083b42bc046c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:55.796056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e7992df7-3bfd-4b31-8743-95c5c0f76943 req-de295280-98a1-4f77-a6d8-083b42bc046c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:55.812414 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e7992df7-3bfd-4b31-8743-95c5c0f76943 req-de295280-98a1-4f77-a6d8-083b42bc046c service nova] Creating event network-changed:4e38c3d7-714c-454d-a174-eab6093a4357 for instance 56c14c64-4eb9-42e4-b4e0-0da498b05e25 on nch1-master-1 Dec 18 21:22:55.823566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e7992df7-3bfd-4b31-8743-95c5c0f76943 req-de295280-98a1-4f77-a6d8-083b42bc046c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145915 Dec 18 21:22:55.824521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3420/6892] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:22:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:22:55.856965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:55.865167 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b5afa026-2571-4016-bd6b-3df240431e82 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1373 microversion: 2.1 time: 0.190162 Dec 18 21:22:55.865769 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3473/6893] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:55 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:56.883267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:56.883976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:56.890155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:56.890652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:56.891446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:56.891897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:57.020672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:57.028541 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d24b38dd-7044-43fd-bc50-18e01cc0d85a tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1373 microversion: 2.1 time: 0.150193 Dec 18 21:22:57.029099 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3421/6894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:56 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:58.045437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:58.045993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:58.052731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:58.053186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:58.053974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:58.054457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:58.185429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:58.193083 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b88a0c96-445a-4a07-a55e-5bba8f365d37 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1373 microversion: 2.1 time: 0.151452 Dec 18 21:22:58.193649 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3474/6895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:58 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:22:59.209832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:22:59.210494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:22:59.217578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:59.218077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:59.219061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:22:59.219546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:22:59.352489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:22:59.359973 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0792542a-5256-40af-910e-c93629180017 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1373 microversion: 2.1 time: 0.153865 Dec 18 21:22:59.360568 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3422/6896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:22:59 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:00.376996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:00.377626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:00.384831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:00.385286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:00.386064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:00.386547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:00.518996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:00.526810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4b54c125-fbb4-4986-b2ca-04265b2e3e40 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1373 microversion: 2.1 time: 0.153504 Dec 18 21:23:00.527376 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3475/6897] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:00 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:00.929317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-265d0c6a-6183-4bd0-9f94-9afcef3bb534 req-571924f5-b77c-4d60-b30c-1893a36df1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c14c64-4eb9-42e4-b4e0-0da498b05e25", "name": "network-vif-plugged", "status": "completed", "tag": "4e38c3d7-714c-454d-a174-eab6093a4357"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:00.930931 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:23:00.930931 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:23:00.938885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-265d0c6a-6183-4bd0-9f94-9afcef3bb534 req-571924f5-b77c-4d60-b30c-1893a36df1d4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:00.939339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-265d0c6a-6183-4bd0-9f94-9afcef3bb534 req-571924f5-b77c-4d60-b30c-1893a36df1d4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:00.951325 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-265d0c6a-6183-4bd0-9f94-9afcef3bb534 req-571924f5-b77c-4d60-b30c-1893a36df1d4 service nova] Creating event network-vif-plugged:4e38c3d7-714c-454d-a174-eab6093a4357 for instance 56c14c64-4eb9-42e4-b4e0-0da498b05e25 on nch1-master-1 Dec 18 21:23:00.956211 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-265d0c6a-6183-4bd0-9f94-9afcef3bb534 req-571924f5-b77c-4d60-b30c-1893a36df1d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030539 Dec 18 21:23:00.956989 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3423/6898] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:23:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:23:01.544584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:01.545189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:01.552009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:01.552465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:01.553256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:01.553699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:01.684404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:01.691911 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c257a68f-80cf-49e4-a206-243513d8ed04 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1373 microversion: 2.1 time: 0.151632 Dec 18 21:23:01.692478 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3476/6899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:01 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:02.709986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:02.710729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:02.717010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:02.717482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:02.718354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:02.718817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:02.851662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:02.859505 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c0efed9e-5f26-4e2f-8dd1-11c61a6292cc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1545 microversion: 2.1 time: 0.154495 Dec 18 21:23:02.860077 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3424/6900] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:02 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:02.875862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:02.876511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:02.883295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:02.883761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:02.884548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:02.884992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:03.020433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:03.028342 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9930e4a-1c16-45a0-ac17-ed3d3fd97ca4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1545 microversion: 2.1 time: 0.156168 Dec 18 21:23:03.028925 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3477/6901] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:02 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:16.802920 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:23:16.803456 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:23:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:23:30.995555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:30.996126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:31.002672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:31.002987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:31.003790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:31.006054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:31.030657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:23:31.111395 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5fd8f750-f2f6-4dd4-88cb-2d1b83f0102f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "DELETE /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 204 len: 0 microversion: 2.1 time: 0.120196 Dec 18 21:23:31.111976 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3425/6902] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:23:30 2021] DELETE /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:23:31.120785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:31.121394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:31.127560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:31.127949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:31.128725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:31.129161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:31.260317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:31.267688 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c83b9b92-fbda-4226-a463-49081f10e9d3 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1551 microversion: 2.1 time: 0.151303 Dec 18 21:23:31.280618 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3478/6903] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:31 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:32.285472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:32.286167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:32.293161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:32.293625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:32.294458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:32.294915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:32.430991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:32.438900 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-657f5b67-56f3-4e39-9ec9-621f3d82f484 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1551 microversion: 2.1 time: 0.157653 Dec 18 21:23:32.439464 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3426/6904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:32 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:33.060775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-dff23fb4-e7bb-4667-9aa5-256b128a76f2 req-00089704-c672-4bd9-af43-799a3c59c009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c14c64-4eb9-42e4-b4e0-0da498b05e25", "name": "network-vif-deleted", "tag": "4e38c3d7-714c-454d-a174-eab6093a4357"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:33.062433 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:23:33.062433 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:23:33.071338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dff23fb4-e7bb-4667-9aa5-256b128a76f2 req-00089704-c672-4bd9-af43-799a3c59c009 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:33.071779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dff23fb4-e7bb-4667-9aa5-256b128a76f2 req-00089704-c672-4bd9-af43-799a3c59c009 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:33.083226 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-dff23fb4-e7bb-4667-9aa5-256b128a76f2 req-00089704-c672-4bd9-af43-799a3c59c009 service nova] Creating event network-vif-deleted:4e38c3d7-714c-454d-a174-eab6093a4357 for instance 56c14c64-4eb9-42e4-b4e0-0da498b05e25 on nch1-master-1 Dec 18 21:23:33.089122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-dff23fb4-e7bb-4667-9aa5-256b128a76f2 req-00089704-c672-4bd9-af43-799a3c59c009 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Dec 18 21:23:33.089723 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3479/6905] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:23:33.456870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:33.457498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:33.465341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:33.465816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:33.466665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:33.467128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:33.505604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:33.506089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:33.506597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lazy-loading 'fault' on Instance uuid 56c14c64-4eb9-42e4-b4e0-0da498b05e25 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:23:33.545932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:33.553272 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4b61b6f1-acfe-40d8-80a5-3824b4c2a08d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 200 len: 1337 microversion: 2.1 time: 0.100250 Dec 18 21:23:33.553896 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3427/6906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:33 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:34.571765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:34.572530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 56c14c64-4eb9-42e4-b4e0-0da498b05e25] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:34.578784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:34.579244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:34.580039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:34.580486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:34.594135 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] HTTP exception thrown: Instance 56c14c64-4eb9-42e4-b4e0-0da498b05e25 could not be found. Dec 18 21:23:34.594754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Returning 404 to user: Instance 56c14c64-4eb9-42e4-b4e0-0da498b05e25 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:23:34.595573 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4cf4f9a0-a9a7-41ea-b420-43a2d806063d tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25" status: 404 len: 111 microversion: 2.1 time: 0.028791 Dec 18 21:23:34.596098 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3480/6907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:34 2021] GET /compute/v2.1/servers/56c14c64-4eb9-42e4-b4e0-0da498b05e25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:23:34.757493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f42b6500-9d23-4694-95fb-b325591a4b57 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '.version_select at 0x7f714f637ee0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:34.784110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f42b6500-9d23-4694-95fb-b325591a4b57 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-338824886" status: 202 len: 0 microversion: 2.1 time: 0.030828 Dec 18 21:23:34.784763 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3428/6908] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:23:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-338824886 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:23:36.435522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:36.441076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-84ce0ae0-f9ae-4dd1-b1bf-11e78b902a7f req-7594db87-033f-43ef-a271-3ad6d7d9c92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afbda18-b545-47c4-bfc0-612365afab02", "tag": "5f5f86a7-2190-4a16-8881-387d56f8e8b1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:36.441581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:36.442897 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:23:36.442897 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:23:36.452031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:36.452632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:36.453450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:36.453890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:36.455079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-84ce0ae0-f9ae-4dd1-b1bf-11e78b902a7f req-7594db87-033f-43ef-a271-3ad6d7d9c92d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:36.456647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-84ce0ae0-f9ae-4dd1-b1bf-11e78b902a7f req-7594db87-033f-43ef-a271-3ad6d7d9c92d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:36.468211 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-84ce0ae0-f9ae-4dd1-b1bf-11e78b902a7f req-7594db87-033f-43ef-a271-3ad6d7d9c92d service nova] Creating event network-changed:5f5f86a7-2190-4a16-8881-387d56f8e8b1 for instance 3afbda18-b545-47c4-bfc0-612365afab02 on nch2-master-1 Dec 18 21:23:36.473430 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-84ce0ae0-f9ae-4dd1-b1bf-11e78b902a7f req-7594db87-033f-43ef-a271-3ad6d7d9c92d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036138 Dec 18 21:23:36.474120 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3429/6909] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:23:36.483647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:23:36.574150 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5184a67c-1c5b-48f0-bc56-207c7f1494b6 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 204 len: 0 microversion: 2.1 time: 0.141968 Dec 18 21:23:36.575709 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3481/6910] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:23:36 2021] DELETE /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:23:36.585244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:36.585978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:36.593092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:36.593561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:36.594439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:36.594889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:36.819148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:36.827467 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5677c6c-b3ca-4be0-a857-1570d93771b4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1672 microversion: 2.1 time: 0.246615 Dec 18 21:23:36.828071 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3430/6911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:36 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:37.845445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:37.846147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:37.852756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:37.853244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:37.854035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:37.854579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:38.073674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:38.081112 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ef0591c-09d7-4024-a127-35b28675ad70 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 200 len: 1554 microversion: 2.1 time: 0.239752 Dec 18 21:23:38.081686 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3482/6912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:37 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:38.490372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b2c3ae14-63c5-49c8-948f-cb2d6b1040ad req-5b224191-f388-453e-b1ce-9c5b28e4c59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afbda18-b545-47c4-bfc0-612365afab02", "name": "network-vif-deleted", "tag": "5f5f86a7-2190-4a16-8881-387d56f8e8b1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:38.491923 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:23:38.491923 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:23:38.500916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b2c3ae14-63c5-49c8-948f-cb2d6b1040ad req-5b224191-f388-453e-b1ce-9c5b28e4c59a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:38.501388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b2c3ae14-63c5-49c8-948f-cb2d6b1040ad req-5b224191-f388-453e-b1ce-9c5b28e4c59a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:38.513977 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b2c3ae14-63c5-49c8-948f-cb2d6b1040ad req-5b224191-f388-453e-b1ce-9c5b28e4c59a service nova] Creating event network-vif-deleted:5f5f86a7-2190-4a16-8881-387d56f8e8b1 for instance 3afbda18-b545-47c4-bfc0-612365afab02 on nch2-master-1 Dec 18 21:23:38.520988 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b2c3ae14-63c5-49c8-948f-cb2d6b1040ad req-5b224191-f388-453e-b1ce-9c5b28e4c59a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035369 Dec 18 21:23:38.521595 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3431/6913] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:23:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:23:39.098838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:39.099444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 3afbda18-b545-47c4-bfc0-612365afab02] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:39.106730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:39.107187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:39.107977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:39.108418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:39.121454 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] HTTP exception thrown: Instance 3afbda18-b545-47c4-bfc0-612365afab02 could not be found. Dec 18 21:23:39.122031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Returning 404 to user: Instance 3afbda18-b545-47c4-bfc0-612365afab02 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:23:39.122871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-08a44315-31d4-48f8-9ee9-bdd64e576a53 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02" status: 404 len: 111 microversion: 2.1 time: 0.027930 Dec 18 21:23:39.123395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3483/6914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:39 2021] GET /compute/v2.1/servers/3afbda18-b545-47c4-bfc0-612365afab02 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:23:39.275729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7a359a6-0e50-452e-8bab-e34189c84acc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '.version_select at 0x7f7161309550>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:39.297604 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7a359a6-0e50-452e-8bab-e34189c84acc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1290761752" status: 202 len: 0 microversion: 2.1 time: 0.025857 Dec 18 21:23:39.298563 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3432/6915] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 21:23:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1290761752 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:23:47.163837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8b6e1a50-2c19-4c7b-bca9-aeb07c163ed2 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'create', calling method: .version_select at 0x7f714eec10d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1646348471"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:47.183621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-8b6e1a50-2c19-4c7b-bca9-aeb07c163ed2 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:23:47.192060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-8b6e1a50-2c19-4c7b-bca9-aeb07c163ed2 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:23:47.268826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-8b6e1a50-2c19-4c7b-bca9-aeb07c163ed2 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:23:47.274017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-8b6e1a50-2c19-4c7b-bca9-aeb07c163ed2 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:23:47.289999 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8b6e1a50-2c19-4c7b-bca9-aeb07c163ed2 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.129987 Dec 18 21:23:47.291006 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3484/6916] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:23:47 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:48.365992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1478141035", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "71a415c2-b348-4d1f-b065-76e558ec8787"}], "key_name": "tempest-TestNetworkBasicOps-1646348471", "security_groups": [{"name": "tempest-secgroup-smoke-888660876"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:48.468848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] validate_networks() for [('71a415c2-b348-4d1f-b065-76e558ec8787', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:23:49.238529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:23:49.238968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:23:49.239462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:23:49.239890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:23:49.240316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:23:49.250062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:49.250568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:49.251409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:49.251863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:49.268408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for project 12ebb2d131744779969f033e54696e15. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:23:49.273856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Getting quotas for user 9373fe72d79041f8afc18454e442e9ea and project 12ebb2d131744779969f033e54696e15. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:23:49.286069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:23:49.288755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:23:49.335419 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a88a0983-2fd6-4d93-9f88-e8259635d4be tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.973994 Dec 18 21:23:49.336245 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3433/6917] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:23:48 2021] POST /compute/v2.1/servers => generated 405 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:23:49.346196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8661def6-41f2-48bb-be1d-510e42745b8e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:49.347566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8661def6-41f2-48bb-be1d-510e42745b8e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:49.404018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8661def6-41f2-48bb-be1d-510e42745b8e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:49.410903 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8661def6-41f2-48bb-be1d-510e42745b8e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1249 microversion: 2.1 time: 0.068437 Dec 18 21:23:49.412903 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3485/6918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:49 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:50.431592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:50.433048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:50.442669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:50.443373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:50.444371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:50.445007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:50.525381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:50.533880 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-87d6382a-dfee-4b17-817a-8723aace765b tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1309 microversion: 2.1 time: 0.108062 Dec 18 21:23:50.534681 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3434/6919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:50 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:51.551148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:51.551768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:51.560082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:51.560619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:51.561427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:51.562459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:51.719444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:51.727958 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22a8e661-18ca-4a57-a68a-3897bd108a7f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1374 microversion: 2.1 time: 0.180650 Dec 18 21:23:51.728882 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3486/6920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:51 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:51.811256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-29712cc5-e09b-4e94-9044-a62fdfbb1f41 req-758a6a42-1d39-4114-985f-6d13cd38f5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feb4fd1-36a8-4d70-9525-e0af4b799b14", "tag": "6807a989-cc57-4963-9412-513434830430"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:51.813970 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:23:51.813970 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:23:51.829493 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-29712cc5-e09b-4e94-9044-a62fdfbb1f41 req-758a6a42-1d39-4114-985f-6d13cd38f5b6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:51.830017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-29712cc5-e09b-4e94-9044-a62fdfbb1f41 req-758a6a42-1d39-4114-985f-6d13cd38f5b6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:51.842782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-29712cc5-e09b-4e94-9044-a62fdfbb1f41 req-758a6a42-1d39-4114-985f-6d13cd38f5b6 service nova] Creating event network-changed:6807a989-cc57-4963-9412-513434830430 for instance 8feb4fd1-36a8-4d70-9525-e0af4b799b14 on nch1-master-1 Dec 18 21:23:51.848608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-29712cc5-e09b-4e94-9044-a62fdfbb1f41 req-758a6a42-1d39-4114-985f-6d13cd38f5b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041430 Dec 18 21:23:51.849066 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3435/6921] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:23:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:23:52.745063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:52.745672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:52.752508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:52.752985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:52.753785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:52.754258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:52.899301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:52.910058 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59cd6a05-0771-4ca9-abe9-d401cde8b145 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1374 microversion: 2.1 time: 0.168279 Dec 18 21:23:52.910670 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3487/6922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:52 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:53.928327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:53.929041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:53.935467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:53.935941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:53.936747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:53.937207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:54.072671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:54.080576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9766ab52-7dff-432c-adfb-7ec3d9629f4f tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1374 microversion: 2.1 time: 0.157224 Dec 18 21:23:54.081140 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3436/6923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:53 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:55.096868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:55.097563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:55.105001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:55.105453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:55.106241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:55.106714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:55.241338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:55.249365 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bf8eb806-64e8-48fb-ae0f-a91f6f45083e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1374 microversion: 2.1 time: 0.156288 Dec 18 21:23:55.249934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3488/6924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:55 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:56.266593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:56.267267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:56.274046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:56.274546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:56.275340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:56.275796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:56.409408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:56.416843 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1cd5dd67-f284-486a-8179-c915bf31dd56 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1374 microversion: 2.1 time: 0.153882 Dec 18 21:23:56.417359 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3437/6925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:56 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:57.188231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-efc6795f-c8ec-460e-a068-91283298bffc req-e0188272-033c-4a68-a342-f6217ba489a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feb4fd1-36a8-4d70-9525-e0af4b799b14", "name": "network-vif-plugged", "status": "completed", "tag": "6807a989-cc57-4963-9412-513434830430"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:23:57.190066 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:23:57.190066 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:23:57.198827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-efc6795f-c8ec-460e-a068-91283298bffc req-e0188272-033c-4a68-a342-f6217ba489a2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:57.199775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-efc6795f-c8ec-460e-a068-91283298bffc req-e0188272-033c-4a68-a342-f6217ba489a2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:57.211890 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-efc6795f-c8ec-460e-a068-91283298bffc req-e0188272-033c-4a68-a342-f6217ba489a2 service nova] Creating event network-vif-plugged:6807a989-cc57-4963-9412-513434830430 for instance 8feb4fd1-36a8-4d70-9525-e0af4b799b14 on nch1-master-1 Dec 18 21:23:57.217654 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-efc6795f-c8ec-460e-a068-91283298bffc req-e0188272-033c-4a68-a342-f6217ba489a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Dec 18 21:23:57.218243 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3489/6926] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:23:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:23:57.434627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:57.435246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:57.441799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:57.442283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:57.443086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:57.443537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:57.573985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:57.581308 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-149a4f2a-d9f6-43d7-b55e-3500c12f7dc5 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1374 microversion: 2.1 time: 0.151207 Dec 18 21:23:57.581904 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3438/6927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:57 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:58.599241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:58.600665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:58.607453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:58.607905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:58.608705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:58.609147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:58.745492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:58.753413 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0e9cade6-d137-4dc4-9f4d-6afb2103fd8c tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1546 microversion: 2.1 time: 0.158612 Dec 18 21:23:58.754011 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3490/6928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:58 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:23:58.769820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:23:58.770484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:23:58.777164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:58.778210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:58.779033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:23:58.779531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:23:58.916879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:23:58.924313 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-104aa570-6641-455c-99dd-2b60b6f59d7e tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1546 microversion: 2.1 time: 0.158116 Dec 18 21:23:58.924905 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3439/6929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:23:58 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:24:00.507371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-43beadc6-c290-4ef2-b0a4-be638b294191 req-432a1f1b-60ba-4383-b686-71a94a5e1fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feb4fd1-36a8-4d70-9525-e0af4b799b14", "tag": "6807a989-cc57-4963-9412-513434830430"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:24:00.509131 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:24:00.509131 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:24:00.518658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-43beadc6-c290-4ef2-b0a4-be638b294191 req-432a1f1b-60ba-4383-b686-71a94a5e1fac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:00.519360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-43beadc6-c290-4ef2-b0a4-be638b294191 req-432a1f1b-60ba-4383-b686-71a94a5e1fac service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:00.531829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-43beadc6-c290-4ef2-b0a4-be638b294191 req-432a1f1b-60ba-4383-b686-71a94a5e1fac service nova] Creating event network-changed:6807a989-cc57-4963-9412-513434830430 for instance 8feb4fd1-36a8-4d70-9525-e0af4b799b14 on nch1-master-1 Dec 18 21:24:00.537194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-43beadc6-c290-4ef2-b0a4-be638b294191 req-432a1f1b-60ba-4383-b686-71a94a5e1fac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033586 Dec 18 21:24:00.538874 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3491/6930] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:24:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:24:26.831492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0638fcb0-6d25-4d95-a1f2-e1e873226bc8 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:24:26.832477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0638fcb0-6d25-4d95-a1f2-e1e873226bc8 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:26.838499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0638fcb0-6d25-4d95-a1f2-e1e873226bc8 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:26.838935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0638fcb0-6d25-4d95-a1f2-e1e873226bc8 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:26.839724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0638fcb0-6d25-4d95-a1f2-e1e873226bc8 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:26.840173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0638fcb0-6d25-4d95-a1f2-e1e873226bc8 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:26.888734 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0638fcb0-6d25-4d95-a1f2-e1e873226bc8 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14/action" status: 200 len: 24572 microversion: 2.1 time: 0.061220 Dec 18 21:24:26.889580 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3440/6931] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:24:26 2021] POST /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14/action => generated 24572 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:24:37.989349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d518313e-10e2-4629-8acd-205ef7efaddc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:24:37.990384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d518313e-10e2-4629-8acd-205ef7efaddc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:37.997364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d518313e-10e2-4629-8acd-205ef7efaddc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:37.997810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d518313e-10e2-4629-8acd-205ef7efaddc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:37.998620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d518313e-10e2-4629-8acd-205ef7efaddc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:37.999057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d518313e-10e2-4629-8acd-205ef7efaddc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:38.056589 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d518313e-10e2-4629-8acd-205ef7efaddc tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "POST /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14/action" status: 200 len: 32645 microversion: 2.1 time: 0.071212 Dec 18 21:24:38.057234 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3492/6932] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:24:37 2021] POST /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14/action => generated 32645 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:24:39.379214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5274078f-104c-4658-ae2b-3c2f5197993b req-14abb017-36e8-44f2-93dc-fe32aec10cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feb4fd1-36a8-4d70-9525-e0af4b799b14", "tag": "6807a989-cc57-4963-9412-513434830430"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:24:39.382422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:24:39.383777 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:24:39.383777 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:24:39.384165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:39.391942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:39.392611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:39.393498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:39.394042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:39.395565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5274078f-104c-4658-ae2b-3c2f5197993b req-14abb017-36e8-44f2-93dc-fe32aec10cfc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:39.396012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5274078f-104c-4658-ae2b-3c2f5197993b req-14abb017-36e8-44f2-93dc-fe32aec10cfc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:39.407738 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5274078f-104c-4658-ae2b-3c2f5197993b req-14abb017-36e8-44f2-93dc-fe32aec10cfc service nova] Creating event network-changed:6807a989-cc57-4963-9412-513434830430 for instance 8feb4fd1-36a8-4d70-9525-e0af4b799b14 on nch1-master-1 Dec 18 21:24:39.412574 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5274078f-104c-4658-ae2b-3c2f5197993b req-14abb017-36e8-44f2-93dc-fe32aec10cfc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037250 Dec 18 21:24:39.413425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3493/6933] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:24:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:24:39.421214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:24:39.511788 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e1ae16c-c680-4978-a87e-6c1fc4f50df7 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 204 len: 0 microversion: 2.1 time: 0.139833 Dec 18 21:24:39.516113 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3441/6934] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:24:39 2021] DELETE /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:24:39.523011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:24:39.523837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:39.531131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:39.531850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:39.532834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:39.533462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:39.680501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:24:39.688472 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-afba47a6-f5f3-4ef4-9fe6-8fc8ee33d679 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1671 microversion: 2.1 time: 0.170907 Dec 18 21:24:39.689324 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3494/6935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:24:39 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:24:40.706482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:24:40.707255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:40.714795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:40.715270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:40.716134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:40.716511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:40.849389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:24:40.857289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-590e85eb-b85b-43ff-9eb5-907d40ad3b33 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1552 microversion: 2.1 time: 0.154943 Dec 18 21:24:40.857849 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3442/6936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:24:40 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:24:41.519378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f00c3b1a-020a-416b-87e0-8d8999c36973 req-5b20a615-0649-447b-84bc-5b40d42f692d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feb4fd1-36a8-4d70-9525-e0af4b799b14", "name": "network-vif-deleted", "tag": "6807a989-cc57-4963-9412-513434830430"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:24:41.520976 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:24:41.520976 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:24:41.529221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f00c3b1a-020a-416b-87e0-8d8999c36973 req-5b20a615-0649-447b-84bc-5b40d42f692d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:41.529729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f00c3b1a-020a-416b-87e0-8d8999c36973 req-5b20a615-0649-447b-84bc-5b40d42f692d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:41.541651 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f00c3b1a-020a-416b-87e0-8d8999c36973 req-5b20a615-0649-447b-84bc-5b40d42f692d service nova] Creating event network-vif-deleted:6807a989-cc57-4963-9412-513434830430 for instance 8feb4fd1-36a8-4d70-9525-e0af4b799b14 on nch1-master-1 Dec 18 21:24:41.547657 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f00c3b1a-020a-416b-87e0-8d8999c36973 req-5b20a615-0649-447b-84bc-5b40d42f692d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031840 Dec 18 21:24:41.548215 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3495/6937] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:24:41.875497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:24:41.876136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:41.883998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:41.884484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:41.885570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:41.886032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:41.925922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:41.926887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:41.927551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lazy-loading 'fault' on Instance uuid 8feb4fd1-36a8-4d70-9525-e0af4b799b14 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:24:41.974333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9373fe72d79041f8afc18454e442e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ebb2d131744779969f033e54696e15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:24:41.982294 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-546b9d5a-bacb-47d2-952a-9ea2723f4429 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 200 len: 1339 microversion: 2.1 time: 0.111188 Dec 18 21:24:41.982987 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3443/6938] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:24:41 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:24:43.000620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:24:43.001297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] [instance: 8feb4fd1-36a8-4d70-9525-e0af4b799b14] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:43.008299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:43.008757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:43.009546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:43.009994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:43.023285 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] HTTP exception thrown: Instance 8feb4fd1-36a8-4d70-9525-e0af4b799b14 could not be found. Dec 18 21:24:43.023916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Returning 404 to user: Instance 8feb4fd1-36a8-4d70-9525-e0af4b799b14 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:24:43.024735 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f188198-f371-4d8d-9e51-f1af92c301d4 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14" status: 404 len: 111 microversion: 2.1 time: 0.028988 Dec 18 21:24:43.025269 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3496/6939] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:24:42 2021] GET /compute/v2.1/servers/8feb4fd1-36a8-4d70-9525-e0af4b799b14 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:24:43.180441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3fac6130-22e0-4081-bf60-66b725e93685 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] Calling method '.version_select at 0x7f715c440b80>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:24:43.200969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3fac6130-22e0-4081-bf60-66b725e93685 tempest-TestNetworkBasicOps-2144304942 tempest-TestNetworkBasicOps-2144304942-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1646348471" status: 202 len: 0 microversion: 2.1 time: 0.023831 Dec 18 21:24:43.201766 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3444/6940] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 21:24:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1646348471 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:24:57.549983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e4d065d6-27a8-467e-a62c-00dd25deeabd tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Action: 'create', calling method: .version_select at 0x7f714ef5f310>, body: {"keypair": {"name": "tempest-TestServerBasicOps-762672056"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:24:57.564056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e4d065d6-27a8-467e-a62c-00dd25deeabd tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for project 294815d868e14c1e891b4b86a397ac8e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:24:57.570084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e4d065d6-27a8-467e-a62c-00dd25deeabd tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for user 57603d680eb644bc9d56f772ce4b5bb4 and project 294815d868e14c1e891b4b86a397ac8e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:24:57.712882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e4d065d6-27a8-467e-a62c-00dd25deeabd tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for project 294815d868e14c1e891b4b86a397ac8e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:24:57.717345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-e4d065d6-27a8-467e-a62c-00dd25deeabd tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for user 57603d680eb644bc9d56f772ce4b5bb4 and project 294815d868e14c1e891b4b86a397ac8e. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:24:57.732056 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e4d065d6-27a8-467e-a62c-00dd25deeabd tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.358150 Dec 18 21:24:57.738083 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3497/6941] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:24:57 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:24:58.773370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-751074251", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-762672056", "security_groups": [{"name": "tempest-secgroup-smoke-2012101670"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f0fa9983-9bc5-4ade-b1b6-4614703d4ecd"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:24:58.879518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] validate_networks() for [('f0fa9983-9bc5-4ade-b1b6-4614703d4ecd', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:24:59.148765 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:24:59.149588 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:24:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:24:59.318290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for project 294815d868e14c1e891b4b86a397ac8e. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:24:59.325144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for user 57603d680eb644bc9d56f772ce4b5bb4 and project 294815d868e14c1e891b4b86a397ac8e. Resources: dict_keys(['metadata_items']) {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:24:59.338509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:24:59.339040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:24:59.339533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:24:59.339998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:24:59.340429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:24:59.349241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:59.349746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:59.350654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:24:59.351117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:24:59.369092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for project 294815d868e14c1e891b4b86a397ac8e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:24:59.375027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Getting quotas for user 57603d680eb644bc9d56f772ce4b5bb4 and project 294815d868e14c1e891b4b86a397ac8e. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:24:59.387517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:24:59.389906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:24:59.438000 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c6a87fa4-a12d-47fe-89e9-91624983d538 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668271 Dec 18 21:24:59.439308 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3445/6942] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:24:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:24:59.450399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48f3b20b-a98a-436c-b4e3-4b5257ce5ba7 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:24:59.451103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48f3b20b-a98a-436c-b4e3-4b5257ce5ba7 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:24:59.532822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48f3b20b-a98a-436c-b4e3-4b5257ce5ba7 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:24:59.541440 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48f3b20b-a98a-436c-b4e3-4b5257ce5ba7 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1301 microversion: 2.1 time: 0.096067 Dec 18 21:24:59.542000 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3498/6943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:24:59 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:00.560322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:00.561058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:00.571333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:00.571796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:00.572816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:00.573274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:00.668981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:00.676934 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4202aebd-72d8-4f9b-a073-4ed890de69b8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1359 microversion: 2.1 time: 0.121987 Dec 18 21:25:00.677642 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3446/6944] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:00 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1359 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:01.695540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:01.696326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:01.708858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:01.709723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:01.712905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:01.713432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:01.974528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:01.984124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bbbc8f05-4056-472d-9d8f-f7f898ac6003 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1427 microversion: 2.1 time: 0.292776 Dec 18 21:25:01.984705 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3499/6945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:01 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1427 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:02.128473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-14f62017-6988-4628-80dd-73da62bffa0b req-a4da4e9d-2d47-4b01-a1ec-390461dc59c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5754d94d-b011-4ee2-b9a0-680bce3ef2e4", "tag": "ec97ef2b-eb9b-42c8-a086-17b838b4112b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:25:02.130559 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:25:02.130559 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:25:02.141156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-14f62017-6988-4628-80dd-73da62bffa0b req-a4da4e9d-2d47-4b01-a1ec-390461dc59c8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:02.141930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-14f62017-6988-4628-80dd-73da62bffa0b req-a4da4e9d-2d47-4b01-a1ec-390461dc59c8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:02.162288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-14f62017-6988-4628-80dd-73da62bffa0b req-a4da4e9d-2d47-4b01-a1ec-390461dc59c8 service nova] Creating event network-changed:ec97ef2b-eb9b-42c8-a086-17b838b4112b for instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 on nch2-master-1 Dec 18 21:25:02.171836 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-14f62017-6988-4628-80dd-73da62bffa0b req-a4da4e9d-2d47-4b01-a1ec-390461dc59c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149613 Dec 18 21:25:02.172775 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3447/6946] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:25:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:25:03.001446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:03.002063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:03.008944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:03.009406 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:03.010197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:03.010670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:03.152045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:03.160154 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66adba30-8356-44c5-add3-6dcb73e7fcac tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1427 microversion: 2.1 time: 0.162490 Dec 18 21:25:03.160724 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3500/6947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:02 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:04.177404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:04.178123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:04.185163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:04.185633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:04.186464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:04.186923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:04.319729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:04.327589 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-549ce4ee-0c5a-4624-8b7b-060fdcdff178 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1427 microversion: 2.1 time: 0.154324 Dec 18 21:25:04.328159 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3448/6948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:04 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1427 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:05.344021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:05.344625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:05.351535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:05.351986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:05.352797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:05.353235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:05.489595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:05.497557 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88cb4846-23c6-473c-b80a-dc6b64542482 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1427 microversion: 2.1 time: 0.157264 Dec 18 21:25:05.498119 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3501/6949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:05 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:06.514458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:06.515096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:06.521922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:06.522442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:06.523244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:06.523700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:06.654769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:06.662018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e95e597-097f-4c7b-acd4-aab681aea97e tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1427 microversion: 2.1 time: 0.151947 Dec 18 21:25:06.662649 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3449/6950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:06 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:07.456374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ce921e6b-d0aa-494b-b5d6-c4cbd0900993 req-e179e464-b507-4109-9bcc-7613283e1405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5754d94d-b011-4ee2-b9a0-680bce3ef2e4", "name": "network-vif-plugged", "status": "completed", "tag": "ec97ef2b-eb9b-42c8-a086-17b838b4112b"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:25:07.457962 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:25:07.457962 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:25:07.465513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ce921e6b-d0aa-494b-b5d6-c4cbd0900993 req-e179e464-b507-4109-9bcc-7613283e1405 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:07.465968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ce921e6b-d0aa-494b-b5d6-c4cbd0900993 req-e179e464-b507-4109-9bcc-7613283e1405 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:07.476549 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ce921e6b-d0aa-494b-b5d6-c4cbd0900993 req-e179e464-b507-4109-9bcc-7613283e1405 service nova] Creating event network-vif-plugged:ec97ef2b-eb9b-42c8-a086-17b838b4112b for instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 on nch2-master-1 Dec 18 21:25:07.482023 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ce921e6b-d0aa-494b-b5d6-c4cbd0900993 req-e179e464-b507-4109-9bcc-7613283e1405 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093738 Dec 18 21:25:07.482640 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3502/6951] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:25:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:25:07.678996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:07.679618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:07.686465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:07.686936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:07.687728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:07.688181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:07.817667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:07.825551 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0cf9155b-455d-4955-87cc-0f388cecb4df tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1427 microversion: 2.1 time: 0.150094 Dec 18 21:25:07.826127 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3450/6952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:07 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:08.843758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:08.844455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:08.850646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:08.851097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:08.851874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:08.852308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:08.988524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:08.996335 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7e214a4f-5f57-42e2-b53f-4cf4051d861a tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1607 microversion: 2.1 time: 0.157022 Dec 18 21:25:08.996917 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3503/6953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:08 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1607 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:09.012601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:09.013226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:09.019914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:09.020451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:09.021239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:09.021692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:09.154757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:09.162299 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e2fd608-a501-4d83-be88-a7b156adf5a2 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1607 microversion: 2.1 time: 0.153998 Dec 18 21:25:09.162878 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3451/6954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:09 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1607 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:09.178304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:09.178915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:09.185411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:09.185859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:09.186666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:09.187099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:09.319480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:25:09.326906 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f0b372a-fd76-4a2b-9d97-5b636833c247 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1607 microversion: 2.1 time: 0.152349 Dec 18 21:25:09.327478 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3504/6955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:25:09 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1607 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:25:10.987742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a6ed017e-a969-43be-93a4-3aa9cd28531a req-17980fb3-1a3c-4165-a001-1dd0f8144c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5754d94d-b011-4ee2-b9a0-680bce3ef2e4", "tag": "ec97ef2b-eb9b-42c8-a086-17b838b4112b"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:25:10.989704 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:25:10.989704 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:25:11.002670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a6ed017e-a969-43be-93a4-3aa9cd28531a req-17980fb3-1a3c-4165-a001-1dd0f8144c0d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:11.003655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a6ed017e-a969-43be-93a4-3aa9cd28531a req-17980fb3-1a3c-4165-a001-1dd0f8144c0d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:11.017837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a6ed017e-a969-43be-93a4-3aa9cd28531a req-17980fb3-1a3c-4165-a001-1dd0f8144c0d service nova] Creating event network-changed:ec97ef2b-eb9b-42c8-a086-17b838b4112b for instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 on nch2-master-1 Dec 18 21:25:11.022948 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a6ed017e-a969-43be-93a4-3aa9cd28531a req-17980fb3-1a3c-4165-a001-1dd0f8144c0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039262 Dec 18 21:25:11.023564 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3452/6956] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:25:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:25:47.252460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-21332a7c-6246-4c85-8d30-cc389b4bc80d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:25:47.253023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-21332a7c-6246-4c85-8d30-cc389b4bc80d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:25:47.259123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21332a7c-6246-4c85-8d30-cc389b4bc80d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:47.259580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21332a7c-6246-4c85-8d30-cc389b4bc80d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:47.260361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21332a7c-6246-4c85-8d30-cc389b4bc80d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:25:47.260801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-21332a7c-6246-4c85-8d30-cc389b4bc80d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:25:47.285431 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-21332a7c-6246-4c85-8d30-cc389b4bc80d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.037107 Dec 18 21:25:47.286028 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3505/6957] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:25:47 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4/os-server-password => generated 116 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:28:16.848375 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:28:16.848907 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:28:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:28:19.190860 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:28:19.191315 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:28:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:29:50.601888 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:29:50.602734 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:29:50.606806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:29:50.607433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:29:50.616774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:50.617248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:50.618053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:50.618548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:50.643299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:29:50.719008 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d9251c52-712a-446a-9d51-c5633bd6c7db tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 204 len: 0 microversion: 2.1 time: 0.118348 Dec 18 21:29:50.720257 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3453/6958] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:29:50 2021] DELETE /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:29:50.726535 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d65e2c3a-bf34-479d-be5a-5182256b434e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 18 21:29:50.727482 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f82efa99-2048-43b1-87fb-668518ca915b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 18 21:29:50.731158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:29:50.731795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:29:50.738567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:50.739020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:50.739810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:50.740247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:50.977322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:29:50.984724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5142726-7b70-4475-bd14-0cb312fdf84f tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1731 microversion: 2.1 time: 0.260130 Dec 18 21:29:50.985295 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3506/6959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:29:50 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:29:52.002608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:29:52.003241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:29:52.029593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:52.030067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:52.030929 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:52.031386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:52.049983 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43562. Dec 18 21:29:52.053890 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43560. Dec 18 21:29:52.344904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57603d680eb644bc9d56f772ce4b5bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294815d868e14c1e891b4b86a397ac8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:29:52.352443 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18ad30f0-bfe4-49fd-b689-c89450036aaa tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 200 len: 1731 microversion: 2.1 time: 0.354182 Dec 18 21:29:52.353019 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3454/6960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:29:51 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 1731 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:29:52.890131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d22e649e-813a-4e59-89a5-d64c5b677e28 req-c816c866-580c-44b8-be2a-6b220f54b2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5754d94d-b011-4ee2-b9a0-680bce3ef2e4", "name": "network-vif-deleted", "tag": "ec97ef2b-eb9b-42c8-a086-17b838b4112b"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:29:52.892400 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:29:52.892400 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:29:52.924830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d22e649e-813a-4e59-89a5-d64c5b677e28 req-c816c866-580c-44b8-be2a-6b220f54b2cc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:52.925303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d22e649e-813a-4e59-89a5-d64c5b677e28 req-c816c866-580c-44b8-be2a-6b220f54b2cc service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:52.930698 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] [d65e2c3a-bf34-479d-be5a-5182256b434e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43568. Dec 18 21:29:52.937749 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] [f82efa99-2048-43b1-87fb-668518ca915b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43570. Dec 18 21:29:52.940638 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d22e649e-813a-4e59-89a5-d64c5b677e28 req-c816c866-580c-44b8-be2a-6b220f54b2cc service nova] Creating event network-vif-deleted:ec97ef2b-eb9b-42c8-a086-17b838b4112b for instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 on nch2-master-1 Dec 18 21:29:52.944391 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [req-d22e649e-813a-4e59-89a5-d64c5b677e28 req-c816c866-580c-44b8-be2a-6b220f54b2cc service nova] [8794ef8f-769f-4ebf-b406-f268af7629fe] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:29:53.371509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:29:53.372771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:29:53.380308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:53.380955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:53.381813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:53.382306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:53.396476 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] HTTP exception thrown: Instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 could not be found. Dec 18 21:29:53.397093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Returning 404 to user: Instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:29:53.397950 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2dc73b02-c957-4f49-ba48-f26a68715ab8 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 404 len: 111 microversion: 2.1 time: 0.031771 Dec 18 21:29:53.398757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3455/6961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:29:53 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:29:53.852545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:29:53.853061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:29:53.859101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:53.859578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:53.860931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:53.861369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:53.875292 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] HTTP exception thrown: Instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 could not be found. Dec 18 21:29:53.876643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Returning 404 to user: Instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:29:53.877502 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-856b2162-a73c-418f-8396-41ae940cbb32 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 404 len: 111 microversion: 2.1 time: 0.028788 Dec 18 21:29:53.878121 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3456/6962] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:29:53 2021] DELETE /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:29:53.887805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:29:53.888443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [instance: 5754d94d-b011-4ee2-b9a0-680bce3ef2e4] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:29:53.894658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:53.895137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:53.896050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:29:53.896514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:29:53.910902 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] HTTP exception thrown: Instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 could not be found. Dec 18 21:29:53.911517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Returning 404 to user: Instance 5754d94d-b011-4ee2-b9a0-680bce3ef2e4 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:29:53.912374 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6a1bf60b-067d-433d-9111-caea3b0c531d tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4" status: 404 len: 111 microversion: 2.1 time: 0.029957 Dec 18 21:29:53.912925 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3457/6963] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:29:53 2021] GET /compute/v2.1/servers/5754d94d-b011-4ee2-b9a0-680bce3ef2e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:29:53.962363 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [req-d22e649e-813a-4e59-89a5-d64c5b677e28 req-c816c866-580c-44b8-be2a-6b220f54b2cc service nova] [8794ef8f-769f-4ebf-b406-f268af7629fe] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43582. Dec 18 21:29:53.965930 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d22e649e-813a-4e59-89a5-d64c5b677e28 req-c816c866-580c-44b8-be2a-6b220f54b2cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.079736 Dec 18 21:29:53.966737 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3507/6964] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:29:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:29:54.074414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c3f9316-b1d7-4e74-ab2e-ab30afcfc663 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] Calling method '.version_select at 0x7f714f637820>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:29:54.077741 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c3f9316-b1d7-4e74-ab2e-ab30afcfc663 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [8dd317d4-e5a6-4383-9f1e-824b7b312d63] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:29:55.093117 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c3f9316-b1d7-4e74-ab2e-ab30afcfc663 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] [8dd317d4-e5a6-4383-9f1e-824b7b312d63] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43586. Dec 18 21:29:55.113104 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c3f9316-b1d7-4e74-ab2e-ab30afcfc663 tempest-TestServerBasicOps-1940841894 tempest-TestServerBasicOps-1940841894-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-762672056" status: 202 len: 0 microversion: 2.1 time: 1.042803 Dec 18 21:29:55.113681 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3458/6965] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:29:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-762672056 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:29:58.448709 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:29:58.449336 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:29:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:30:13.274726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1891946305", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:13.325272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] validate_networks() for None {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:30:13.617535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:30:13.617959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:30:13.618501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:30:13.618914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:30:13.619327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:30:13.628595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:13.629047 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:13.629873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:13.630410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:13.647034 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Getting quotas for project 6f52949ca7754cb0bb38b4fa73ca59e5. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:30:13.652035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Getting quotas for user 38bad590d33c4304b6a7908e1d3b43e3 and project 6f52949ca7754cb0bb38b4fa73ca59e5. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:30:13.663712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:30:13.666121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:30:13.710902 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b14e625a-cbe9-4d71-91f8-4d15946ec786 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553932 Dec 18 21:30:13.711786 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3508/6966] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:30:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:30:13.721564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-37262a62-5e23-41ae-a9b2-e47c2e3719ef tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:13.722197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-37262a62-5e23-41ae-a9b2-e47c2e3719ef tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:13.777208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-37262a62-5e23-41ae-a9b2-e47c2e3719ef tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:13.784115 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-37262a62-5e23-41ae-a9b2-e47c2e3719ef tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1222 microversion: 2.1 time: 0.066169 Dec 18 21:30:13.784717 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3459/6967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:13 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:14.801816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:14.802620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:14.809662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:14.810116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:14.811001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:14.811449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:14.895019 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:14.902662 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e5d68a7d-860a-46af-ac94-88283c01071a tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1280 microversion: 2.1 time: 0.105433 Dec 18 21:30:14.903246 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3509/6968] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:14 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:15.919132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:15.919762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:15.927366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:15.928135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:15.929438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:15.929828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:16.139635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:16.147086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-125cfddd-8428-41b9-a9ad-a1ce1fb24021 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1322 microversion: 2.1 time: 0.231651 Dec 18 21:30:16.147657 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3460/6969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:15 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:16.302055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-dad66dc6-e30c-45a3-96ed-e6a35a2cf53a req-93cd9d69-40cb-4caf-9bbf-1412a76d4f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea3af0c-60de-42ac-8a06-2c9ff43b0879", "tag": "99d6929e-263b-4736-8d4c-2697c2efebc3"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:16.303726 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:16.303726 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:30:16.311083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dad66dc6-e30c-45a3-96ed-e6a35a2cf53a req-93cd9d69-40cb-4caf-9bbf-1412a76d4f7a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:16.311527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-dad66dc6-e30c-45a3-96ed-e6a35a2cf53a req-93cd9d69-40cb-4caf-9bbf-1412a76d4f7a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:16.324602 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-dad66dc6-e30c-45a3-96ed-e6a35a2cf53a req-93cd9d69-40cb-4caf-9bbf-1412a76d4f7a service nova] Creating event network-changed:99d6929e-263b-4736-8d4c-2697c2efebc3 for instance 0ea3af0c-60de-42ac-8a06-2c9ff43b0879 on nch2-master-1 Dec 18 21:30:16.329710 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-dad66dc6-e30c-45a3-96ed-e6a35a2cf53a req-93cd9d69-40cb-4caf-9bbf-1412a76d4f7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114034 Dec 18 21:30:16.331165 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3510/6970] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:30:17.163025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:17.163566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:17.170309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:17.170785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:17.171595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:17.172050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:17.307910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:17.315767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ffae933c-3930-4ef1-9d0d-6f16f923ec48 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1322 microversion: 2.1 time: 0.156047 Dec 18 21:30:17.316340 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3461/6971] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:17 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:18.334975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:18.335692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:18.341887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:18.342376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:18.343165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:18.343611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:18.480899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:18.488212 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f476bec-94f5-447e-9ac3-47a1066ae482 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1322 microversion: 2.1 time: 0.158960 Dec 18 21:30:18.488817 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3511/6972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:18 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:19.505102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:19.505642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:19.512327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:19.512802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:19.513601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:19.514056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:19.648630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:19.655931 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fb2908d-eab4-4c26-989e-fce3567ffcad tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1322 microversion: 2.1 time: 0.155289 Dec 18 21:30:19.656496 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3462/6973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:19 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:20.672437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:20.673043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:20.679797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:20.680251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:20.681059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:20.681500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:20.812456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:20.821503 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab12a8e7-b906-4b21-a998-9692a861f256 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1322 microversion: 2.1 time: 0.152876 Dec 18 21:30:20.822487 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3512/6974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:20 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:20.943405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-8a1ae8ce-6bdd-43a2-9b27-3a4cb3b18ea5 req-1ce4c9e3-2ea2-41fe-924d-bfd3656abb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea3af0c-60de-42ac-8a06-2c9ff43b0879", "name": "network-vif-plugged", "status": "completed", "tag": "99d6929e-263b-4736-8d4c-2697c2efebc3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:20.945011 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:20.945011 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:30:20.952224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-8a1ae8ce-6bdd-43a2-9b27-3a4cb3b18ea5 req-1ce4c9e3-2ea2-41fe-924d-bfd3656abb7d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:20.952694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-8a1ae8ce-6bdd-43a2-9b27-3a4cb3b18ea5 req-1ce4c9e3-2ea2-41fe-924d-bfd3656abb7d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:20.963314 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-8a1ae8ce-6bdd-43a2-9b27-3a4cb3b18ea5 req-1ce4c9e3-2ea2-41fe-924d-bfd3656abb7d service nova] Creating event network-vif-plugged:99d6929e-263b-4736-8d4c-2697c2efebc3 for instance 0ea3af0c-60de-42ac-8a06-2c9ff43b0879 on nch2-master-1 Dec 18 21:30:20.968467 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-8a1ae8ce-6bdd-43a2-9b27-3a4cb3b18ea5 req-1ce4c9e3-2ea2-41fe-924d-bfd3656abb7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098460 Dec 18 21:30:20.969061 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3463/6975] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:30:21.839082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:21.839686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:21.846647 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:21.847108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:21.847897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:21.848340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:21.980747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:21.988845 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4dbcdc44-b4f9-45e9-bd98-d7fe0cf9e9dd tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1322 microversion: 2.1 time: 0.152828 Dec 18 21:30:21.989412 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3513/6976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:21 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:23.007248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:23.007875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:23.014039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.014542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.015341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.015793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.147002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:23.154540 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82a20d28-2bf6-4980-847f-9a7a3c191049 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1472 microversion: 2.1 time: 0.152864 Dec 18 21:30:23.155121 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3464/6977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:23 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1472 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:23.220622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f9f6de0b-5d62-480b-995f-0a3fde7ee8cc tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Calling method '.version_select at 0x7f714eec6b80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:23.286582 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f9f6de0b-5d62-480b-995f-0a3fde7ee8cc tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/13323e42804f45bfa615f57dc06a356a" status: 200 len: 371 microversion: 2.1 time: 0.117618 Dec 18 21:30:23.287500 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3514/6978] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:30:23 2021] GET /compute/v2.1/os-quota-sets/13323e42804f45bfa615f57dc06a356a => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:30:23.298059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3f0c4921-60ab-4149-8d75-f186db2fd3bd tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-931951978", "id": 54116818, "os-flavor-access:is_public": "True"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:23.299668 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:23.299668 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:30:23.321736 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3f0c4921-60ab-4149-8d75-f186db2fd3bd tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.027424 Dec 18 21:30:23.322625 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3465/6979] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:30:23 2021] POST /compute/v2.1/flavors => generated 431 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:30:23.333095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "54116818"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:23.334112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:23.340259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.340734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.341536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.341975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.522326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a79698c2f37433aabb73db7e8a11b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13323e42804f45bfa615f57dc06a356a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:23.528619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-931951978 {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:30:23.529686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.530131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.530981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.531420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.551941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Getting quotas for project 6f52949ca7754cb0bb38b4fa73ca59e5. Resources: {'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:30:23.556711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Getting quotas for user 38bad590d33c4304b6a7908e1d3b43e3 and project 6f52949ca7754cb0bb38b4fa73ca59e5. Resources: {'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:30:23.568133 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.compute.api [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] ram quota exceeded for 13323e42804f45bfa615f57dc06a356a, tried to resize instance. Dec 18 21:30:23.568667 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Dec 18 21:30:23.569259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:30:23.570095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75fb73ba-e507-42ef-aa73-9ef3359f0656 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879/action" status: 403 len: 118 microversion: 2.1 time: 0.240886 Dec 18 21:30:23.570697 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3515/6980] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:30:23 2021] POST /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879/action => generated 118 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:30:23.579398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26885c2e-3034-4cc7-8779-8d782010fdaf tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:23.580150 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:23.580150 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:30:23.596125 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26885c2e-3034-4cc7-8779-8d782010fdaf tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/54116818" status: 202 len: 0 microversion: 2.1 time: 0.020418 Dec 18 21:30:23.596677 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3466/6981] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 21:30:23 2021] DELETE /compute/v2.1/flavors/54116818 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:30:23.604808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48a6efbb-a713-41d6-8754-ce8f97bb177c tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:23.623835 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48a6efbb-a713-41d6-8754-ce8f97bb177c tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022641 Dec 18 21:30:23.624381 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3516/6982] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 21:30:23 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:23.640545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ab63ee80-86b2-4985-b106-725cd657e6da tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Calling method '.version_select at 0x7f714fde44c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:23.710160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ab63ee80-86b2-4985-b106-725cd657e6da tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/13323e42804f45bfa615f57dc06a356a" status: 200 len: 371 microversion: 2.1 time: 0.073186 Dec 18 21:30:23.710760 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3467/6983] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:30:23 2021] GET /compute/v2.1/os-quota-sets/13323e42804f45bfa615f57dc06a356a => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:30:23.720615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9a456b64-349d-401f-880f-cf6678bcdc95 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1329217811", "id": 1538411349, "os-flavor-access:is_public": "True"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:23.722191 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:23.722191 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:30:23.737736 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9a456b64-349d-401f-880f-cf6678bcdc95 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.020711 Dec 18 21:30:23.739038 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3517/6984] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:30:23 2021] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:30:23.749324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1538411349"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:23.750406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:23.756415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.756881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.757704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.758157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.890532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a79698c2f37433aabb73db7e8a11b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13323e42804f45bfa615f57dc06a356a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:23.898635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1329217811 {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:30:23.899737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.900205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.901046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:23.901504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:23.921773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Getting quotas for project 6f52949ca7754cb0bb38b4fa73ca59e5. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:30:23.926598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Getting quotas for user 38bad590d33c4304b6a7908e1d3b43e3 and project 6f52949ca7754cb0bb38b4fa73ca59e5. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:30:23.937954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] cores quota exceeded for 13323e42804f45bfa615f57dc06a356a, tried to resize instance. Dec 18 21:30:23.938553 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Dec 18 21:30:23.939165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:30:23.940019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c595bf1f-3428-4638-9691-062bc491a341 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879/action" status: 403 len: 113 microversion: 2.1 time: 0.194595 Dec 18 21:30:23.940597 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3468/6985] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:30:23 2021] POST /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879/action => generated 113 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:30:23.948866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e7ec1fb7-2c41-4b7f-9e01-feea9ed4edc8 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:23.949658 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:23.949658 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:30:23.966162 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e7ec1fb7-2c41-4b7f-9e01-feea9ed4edc8 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1538411349" status: 202 len: 0 microversion: 2.1 time: 0.021214 Dec 18 21:30:23.966735 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3518/6986] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Dec 18 21:30:23 2021] DELETE /compute/v2.1/flavors/1538411349 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:30:23.974992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7cddfe0-e5e8-4192-9403-5fd97fea3c80 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:23.993109 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7cddfe0-e5e8-4192-9403-5fd97fea3c80 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022320 Dec 18 21:30:23.993650 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3469/6987] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 21:30:23 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:24.009466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:24.009964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:24.016211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:24.016664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:24.017443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:24.017880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:24.042883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:30:24.115584 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d8a4c6e1-491d-4557-a47a-cc7e4376f9c3 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 204 len: 0 microversion: 2.1 time: 0.109520 Dec 18 21:30:24.116425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3519/6988] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:30:24 2021] DELETE /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:30:24.125786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:24.126455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:24.133241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:24.133713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:24.134548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:24.135051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:24.270020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:24.278239 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0db02db0-cf08-4ad2-8427-2224530b6c9b tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1478 microversion: 2.1 time: 0.157759 Dec 18 21:30:24.278839 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3470/6989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:24 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:25.295313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:25.296009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:25.303301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:25.303750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:25.304523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:25.304956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:25.457356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bad590d33c4304b6a7908e1d3b43e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f52949ca7754cb0bb38b4fa73ca59e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:25.464782 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-334cc343-7752-4e45-b568-3318073621bf tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 200 len: 1478 microversion: 2.1 time: 0.173542 Dec 18 21:30:25.465361 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3520/6990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:25 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 1478 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:25.882212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-d0f2bd48-be7e-4852-8763-a26c1d64b1e6 req-b0ad1369-7c4b-4215-b6da-b8324ce76a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea3af0c-60de-42ac-8a06-2c9ff43b0879", "name": "network-vif-deleted", "tag": "99d6929e-263b-4736-8d4c-2697c2efebc3"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:25.885355 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:25.885355 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:30:25.896420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d0f2bd48-be7e-4852-8763-a26c1d64b1e6 req-b0ad1369-7c4b-4215-b6da-b8324ce76a38 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:25.897249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-d0f2bd48-be7e-4852-8763-a26c1d64b1e6 req-b0ad1369-7c4b-4215-b6da-b8324ce76a38 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:25.913089 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-d0f2bd48-be7e-4852-8763-a26c1d64b1e6 req-b0ad1369-7c4b-4215-b6da-b8324ce76a38 service nova] Creating event network-vif-deleted:99d6929e-263b-4736-8d4c-2697c2efebc3 for instance 0ea3af0c-60de-42ac-8a06-2c9ff43b0879 on nch2-master-1 Dec 18 21:30:25.918951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-d0f2bd48-be7e-4852-8763-a26c1d64b1e6 req-b0ad1369-7c4b-4215-b6da-b8324ce76a38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041194 Dec 18 21:30:25.919887 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3471/6991] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:30:26.482982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:26.483515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] [instance: 0ea3af0c-60de-42ac-8a06-2c9ff43b0879] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:26.491596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:26.492163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:26.497482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:26.497482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:26.506871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] HTTP exception thrown: Instance 0ea3af0c-60de-42ac-8a06-2c9ff43b0879 could not be found. Dec 18 21:30:26.507467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] Returning 404 to user: Instance 0ea3af0c-60de-42ac-8a06-2c9ff43b0879 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:30:26.508321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f1342976-17bf-477c-9297-d709eab85758 tempest-ServersAdminNegativeTestJSON-2048861831 tempest-ServersAdminNegativeTestJSON-2048861831-project] 10.222.0.13 "GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879" status: 404 len: 111 microversion: 2.1 time: 0.029567 Dec 18 21:30:26.508866 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3521/6992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:26 2021] GET /compute/v2.1/servers/0ea3af0c-60de-42ac-8a06-2c9ff43b0879 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:30:29.132660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1798571822", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "9dec6022-5b27-424d-9d26-c9268d945b1b"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:29.183527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] validate_networks() for [('9dec6022-5b27-424d-9d26-c9268d945b1b', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:30:29.525976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:30:29.526480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:30:29.526969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:30:29.527388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:30:29.527810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:30:29.536421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:29.536880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:29.537738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:29.538187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:29.554110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Getting quotas for project 68c8fcdf62d4488494c91a4cb55c2456. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:30:29.559127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Getting quotas for user a862e89dfc994d3fbbbdb0a08826d554 and project 68c8fcdf62d4488494c91a4cb55c2456. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:30:29.572404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:30:29.574833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:30:29.620327 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11cd4ff0-c7b6-474b-8d14-38b3f1a40c98 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603997 Dec 18 21:30:29.621004 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3472/6993] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:30:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:30:29.631271 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6b855d02-824d-4b4d-839f-fd98ac5a8e3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:29.631878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6b855d02-824d-4b4d-839f-fd98ac5a8e3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:29.683735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6b855d02-824d-4b4d-839f-fd98ac5a8e3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:29.692805 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6b855d02-824d-4b4d-839f-fd98ac5a8e3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1215 microversion: 2.1 time: 0.065567 Dec 18 21:30:29.693402 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3522/6994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:29 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:30.710214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:30.711033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:30.719436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:30.720144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:30.721483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:30.721953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:30.792564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:30.800522 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2bdf620d-1014-441a-8e33-3caf03110c65 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1273 microversion: 2.1 time: 0.094421 Dec 18 21:30:30.801125 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3473/6995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:30 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:31.746692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-af4bb397-9b15-4c13-81ad-748aceb9e874 req-57e2b0f4-506c-4b52-b3e3-62874bb81ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0821cc85-a213-4d89-9621-383a9ee86938", "tag": "a39e39e5-8e11-44fa-82ec-a039eebef716"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:31.748541 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:31.748541 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:30:31.757434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-af4bb397-9b15-4c13-81ad-748aceb9e874 req-57e2b0f4-506c-4b52-b3e3-62874bb81ff0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:31.757999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-af4bb397-9b15-4c13-81ad-748aceb9e874 req-57e2b0f4-506c-4b52-b3e3-62874bb81ff0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:31.772598 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-af4bb397-9b15-4c13-81ad-748aceb9e874 req-57e2b0f4-506c-4b52-b3e3-62874bb81ff0 service nova] Creating event network-changed:a39e39e5-8e11-44fa-82ec-a039eebef716 for instance 0821cc85-a213-4d89-9621-383a9ee86938 on nch2-master-1 Dec 18 21:30:31.778948 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-af4bb397-9b15-4c13-81ad-748aceb9e874 req-57e2b0f4-506c-4b52-b3e3-62874bb81ff0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036636 Dec 18 21:30:31.779569 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3523/6996] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:30:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:30:31.818218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:31.818894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:31.826124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:31.826649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:31.827501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:31.827960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:32.065984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:32.073584 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-432317bc-45ef-4ba8-b72c-670a078bb149 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1315 microversion: 2.1 time: 0.259658 Dec 18 21:30:32.074358 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3474/6997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:31 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:33.097812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:33.098546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:33.104555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:33.105005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:33.105783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:33.106227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:33.240550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:33.247814 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f87275f5-61fe-475f-8ad6-7175e0b0ff97 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1315 microversion: 2.1 time: 0.154954 Dec 18 21:30:33.248392 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3524/6998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:33 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:34.264702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:34.265333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:34.272675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:34.273146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:34.273941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:34.274436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:34.408437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:34.415762 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21682aa1-5d65-44ea-926d-7eccec252653 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1315 microversion: 2.1 time: 0.154884 Dec 18 21:30:34.416327 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3475/6999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:34 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:30:35.431737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:35.432350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:35.439103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:35.439595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:35.440382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:35.440819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:35.568385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:35.576026 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc49f7f4-dca3-48a8-8dd7-ca059b524cb6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1315 microversion: 2.1 time: 0.148053 Dec 18 21:30:35.576600 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3525/7000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:35 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:36.593298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:36.593922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:36.600702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:36.601168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:36.601962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:36.602448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:36.733765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:36.741852 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e61f780d-bd10-4d40-9d63-99a7faa35a19 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1315 microversion: 2.1 time: 0.152255 Dec 18 21:30:36.742439 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3476/7001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:36 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:36.931728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-b11dcbe0-8939-4310-8c4d-cdfaa2850176 req-16136736-84e8-4480-b439-b68b4da89ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0821cc85-a213-4d89-9621-383a9ee86938", "name": "network-vif-plugged", "status": "completed", "tag": "a39e39e5-8e11-44fa-82ec-a039eebef716"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:36.933312 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:30:36.933312 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:30:36.942235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b11dcbe0-8939-4310-8c4d-cdfaa2850176 req-16136736-84e8-4480-b439-b68b4da89ae3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:36.942737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-b11dcbe0-8939-4310-8c4d-cdfaa2850176 req-16136736-84e8-4480-b439-b68b4da89ae3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:36.954411 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-b11dcbe0-8939-4310-8c4d-cdfaa2850176 req-16136736-84e8-4480-b439-b68b4da89ae3 service nova] Creating event network-vif-plugged:a39e39e5-8e11-44fa-82ec-a039eebef716 for instance 0821cc85-a213-4d89-9621-383a9ee86938 on nch2-master-1 Dec 18 21:30:36.959342 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-b11dcbe0-8939-4310-8c4d-cdfaa2850176 req-16136736-84e8-4480-b439-b68b4da89ae3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031370 Dec 18 21:30:36.959931 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3526/7002] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:30:37.758130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:37.758792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:37.765513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:37.765978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:37.766805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:37.767256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:37.901475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:37.908748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4143619-daa4-4a9c-9f7b-fd6284885454 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1315 microversion: 2.1 time: 0.154334 Dec 18 21:30:37.909328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3477/7003] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:37 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:38.926222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:38.926867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:38.932996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:38.933451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:38.934228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:38.934694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:39.069044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:39.078408 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ceb6baa2-3f2b-49ce-89e0-5e87967b2089 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1502 microversion: 2.1 time: 0.157130 Dec 18 21:30:39.079009 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3527/7004] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:38 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:39.098228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:30:39.099280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:39.105926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:39.106430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:39.107230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:39.107678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:39.133852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:39.139441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Old instance type m1.heat2, new instance type m1.heat {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:30:39.145884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:30:39.146353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:30:39.146835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:30:39.147256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:30:39.147676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:30:39.207837 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2205053-1aeb-4389-843e-e424a4c25d07 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "POST /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938/action" status: 202 len: 0 microversion: 2.1 time: 0.113873 Dec 18 21:30:39.208355 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3478/7005] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:30:39 2021] POST /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:30:39.216372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:39.216989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:39.224377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:39.224377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:39.225114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:39.225548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:39.360337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:39.367793 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-306a1f07-e911-4faf-a29c-f5b172df831d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1511 microversion: 2.1 time: 0.155198 Dec 18 21:30:39.368373 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3528/7006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:39 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:40.385782 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:40.386459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:40.392498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:40.392970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:40.393769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:40.394765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:40.531513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:40.539802 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d60b83cc-b5c6-4821-9491-64ce2b307dbd tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1511 microversion: 2.1 time: 0.158624 Dec 18 21:30:40.540685 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3479/7007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:40 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:41.557390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:41.558004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:41.564859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:41.565317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:41.566129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:41.566602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:41.699456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:41.706856 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fb8cfe29-a103-485a-bb13-3a84910c91f3 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.153275 Dec 18 21:30:41.707433 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3529/7008] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:41 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:42.723993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:42.724624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:42.731383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:42.731889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:42.732699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:42.733157 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:42.860598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:42.868452 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-327fd764-ad9c-404f-9c67-126639ff823a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.148273 Dec 18 21:30:42.869025 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3480/7009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:42 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:43.885215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:43.885826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:43.892847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:43.893332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:43.894780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:43.895233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:44.027761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:44.035200 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-751c5335-c0af-4c39-974b-24cc0d87eef8 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.153719 Dec 18 21:30:44.035779 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3530/7010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:43 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:45.052496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:45.053035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:45.059807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:45.060278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:45.061078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:45.061535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:45.190834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:45.199061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bae27488-60bd-4e80-a10f-c6730acc00a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.150909 Dec 18 21:30:45.199625 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3481/7011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:45 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:46.215970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:46.216575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:46.223289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:46.223736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:46.224511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:46.224950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:46.354642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:46.361871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a4b9354-5867-44d2-a2dc-bb0f7420bb5e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.149657 Dec 18 21:30:46.362468 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3531/7012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:46 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:47.379203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:47.379851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:47.386612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:47.387083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:47.387946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:47.388396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:47.531014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:47.538289 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae41ed4a-5e4e-4868-ba99-a9608a44a394 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.162856 Dec 18 21:30:47.538864 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3482/7013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:47 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:48.555462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:48.556124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:48.562832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:48.563280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:48.564059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:48.564494 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:48.691464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:48.699952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3130e3f5-a999-4973-8812-8a97360c6137 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.148180 Dec 18 21:30:48.700524 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3532/7014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:48 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:49.716808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:49.717438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:49.724703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:49.725174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:49.725975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:49.726470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:49.859511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:49.867520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-afd2583d-e0b3-48d1-9072-233514cdb799 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.154474 Dec 18 21:30:49.868089 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3483/7015] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:49 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:50.884965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:50.885631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:50.892481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:50.892932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:50.893712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:50.894165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:51.021782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:51.031098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-47b16ab2-5ddb-414f-85ae-847968a3554f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.150033 Dec 18 21:30:51.031666 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3533/7016] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:50 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:52.048224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:52.048858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:52.055371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:52.055847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:52.056657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:52.057114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:52.185593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:52.193461 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8273d4f7-e6a5-428c-83b2-04b05c82a756 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.149129 Dec 18 21:30:52.194025 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3484/7017] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:52 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:53.210362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:53.210974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:53.217151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:53.217605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:53.218426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:53.218867 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:53.358675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:53.366559 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2fa21e56-e88b-435e-90b8-c7d27fd1bd57 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.159926 Dec 18 21:30:53.367134 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3534/7018] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:53 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:54.382642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:54.383263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:54.390569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:54.391037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:54.391827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:54.392277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:54.520720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:54.528004 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2d68975a-58ef-4d81-8627-c6e5a5e62713 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.149143 Dec 18 21:30:54.528567 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3485/7019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:54 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:55.544594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:55.545129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:55.552859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:55.553311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:55.554092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:55.554558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:55.685232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:55.693182 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-213bfa78-a064-490e-b2be-501f1a080ab6 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.152466 Dec 18 21:30:55.693757 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3535/7020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:55 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:56.710955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:56.711576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:56.718416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:56.718908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:56.719680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:56.720134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:56.850680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:56.858054 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-064a4b22-4120-4f25-86c8-507d28695a32 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.151553 Dec 18 21:30:56.858667 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3486/7021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:56 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:57.875478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:57.876092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:57.883479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:57.883938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:57.884777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:57.885349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:58.015701 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:58.023750 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-26eaf723-c30d-4e4f-8ae3-f5d27afdc892 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.152098 Dec 18 21:30:58.024331 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3536/7022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:57 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:30:59.040774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:30:59.041307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:30:59.048075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:59.048547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:59.049347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:30:59.049807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:30:59.180104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:30:59.187497 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18a81105-a65e-4f25-9e8f-290ebf1d313f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.150641 Dec 18 21:30:59.188071 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3487/7023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:30:59 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:00.204063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:00.204673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:00.211508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:00.211965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:00.212746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:00.213188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:00.344588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:00.353194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ccad92b-c0ac-4cdf-87ec-aa1c5ade9b96 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.152888 Dec 18 21:31:00.353802 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3537/7024] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:00 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:01.370058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:01.370713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:01.379289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:01.379756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:01.380547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:01.381000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:01.513006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:01.520367 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5967441b-26a2-47fa-9787-374c7f95507d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.154173 Dec 18 21:31:01.520920 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3488/7025] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:01 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:02.537056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:02.537666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:02.544469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:02.544954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:02.545731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:02.546176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:02.677143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:02.684812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-43a07318-9b9a-4168-8a4c-819e99cf6d89 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.151459 Dec 18 21:31:02.685396 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3538/7026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:02 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:03.702191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:03.702842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:03.710029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:03.710530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:03.711333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:03.711786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:03.844302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:03.852300 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0133331d-94c8-43c1-84c4-fad6686b323e tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.154078 Dec 18 21:31:03.852885 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3489/7027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:03 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:04.869525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:04.870127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:04.876847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:04.877295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:04.878072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:04.878541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:05.006543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:05.013758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7955f181-264a-4b01-ab7a-54762063fa0a tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.147910 Dec 18 21:31:05.014348 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3539/7028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:04 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:06.030573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:06.031146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:06.037940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:06.038446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:06.039250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:06.039710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:06.166821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:06.174147 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cde4ebd-33cb-49f5-824b-c4653103c27b tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.147454 Dec 18 21:31:06.174749 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3490/7029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:06 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:07.191511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:07.192116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:07.199144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:07.199606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:07.200432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:07.200884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:07.343569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:07.352913 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-795ee95d-0f6c-41c3-8103-9f10622acf68 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.165212 Dec 18 21:31:07.353491 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3540/7030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:07 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:08.370921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:08.371583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:08.379048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:08.379525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:08.380334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:08.380795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:08.556394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:08.565165 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39176cb1-5731-4bb6-9584-0483b30d3af4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1516 microversion: 2.1 time: 0.197994 Dec 18 21:31:08.565760 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3491/7031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:08 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:09.286208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0d2206b3-4314-4fc4-95b4-c1f670da06bc req-3b1b0cef-827a-4ab5-bb64-ca1cb33703ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0821cc85-a213-4d89-9621-383a9ee86938", "name": "network-vif-unplugged", "status": "completed", "tag": "a39e39e5-8e11-44fa-82ec-a039eebef716"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:09.287810 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:31:09.287810 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:31:09.294831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0d2206b3-4314-4fc4-95b4-c1f670da06bc req-3b1b0cef-827a-4ab5-bb64-ca1cb33703ca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:09.295286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0d2206b3-4314-4fc4-95b4-c1f670da06bc req-3b1b0cef-827a-4ab5-bb64-ca1cb33703ca service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:09.306803 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0d2206b3-4314-4fc4-95b4-c1f670da06bc req-3b1b0cef-827a-4ab5-bb64-ca1cb33703ca service nova] Creating event network-vif-unplugged:a39e39e5-8e11-44fa-82ec-a039eebef716 for instance 0821cc85-a213-4d89-9621-383a9ee86938 on nch1-master-1 Dec 18 21:31:09.312183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-0d2206b3-4314-4fc4-95b4-c1f670da06bc req-3b1b0cef-827a-4ab5-bb64-ca1cb33703ca service nova] Instance 0821cc85-a213-4d89-9621-383a9ee86938 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:31:09.324060 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0d2206b3-4314-4fc4-95b4-c1f670da06bc req-3b1b0cef-827a-4ab5-bb64-ca1cb33703ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112542 Dec 18 21:31:09.324679 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3541/7032] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:31:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:31:09.588476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:09.589312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:09.596434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:09.598627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:09.599572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:09.600107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:09.733744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:09.742499 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f67419b8-5b35-4e86-8b7b-0373338bb80c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1515 microversion: 2.1 time: 0.157598 Dec 18 21:31:09.743174 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3492/7033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:09 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:31:10.761572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:10.762288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:10.768388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:10.768841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:10.770187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:10.770650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:10.905355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:10.912785 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2224986a-ea06-4ecf-8dff-08f1cb17f30d tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1513 microversion: 2.1 time: 0.156078 Dec 18 21:31:10.913361 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3542/7034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:10 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:11.341204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2028cc67-5855-463e-b51f-040c363c11a8 req-c127f37e-200d-468c-9ba2-da9ed2f583db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0821cc85-a213-4d89-9621-383a9ee86938", "tag": "a39e39e5-8e11-44fa-82ec-a039eebef716"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:11.342793 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:31:11.342793 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:31:11.350596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2028cc67-5855-463e-b51f-040c363c11a8 req-c127f37e-200d-468c-9ba2-da9ed2f583db service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:11.351066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2028cc67-5855-463e-b51f-040c363c11a8 req-c127f37e-200d-468c-9ba2-da9ed2f583db service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:11.362306 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2028cc67-5855-463e-b51f-040c363c11a8 req-c127f37e-200d-468c-9ba2-da9ed2f583db service nova] Creating event network-changed:a39e39e5-8e11-44fa-82ec-a039eebef716 for instance 0821cc85-a213-4d89-9621-383a9ee86938 on nch1-master-1 Dec 18 21:31:11.368026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-2028cc67-5855-463e-b51f-040c363c11a8 req-c127f37e-200d-468c-9ba2-da9ed2f583db service nova] Instance 0821cc85-a213-4d89-9621-383a9ee86938 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:31:11.380524 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2028cc67-5855-463e-b51f-040c363c11a8 req-c127f37e-200d-468c-9ba2-da9ed2f583db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042965 Dec 18 21:31:11.381124 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3493/7035] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:31:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:31:11.929794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:11.930437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:11.937149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:11.937631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:11.938436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:11.938885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:12.071838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:12.079422 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9de78589-7544-4cd5-935f-5b95c6eff7e9 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1510 microversion: 2.1 time: 0.153354 Dec 18 21:31:12.079995 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3543/7036] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:11 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:12.096200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:12.096811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:12.103654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:12.104130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:12.104938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:12.105404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:12.130450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:31:12.178278 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.compute.api [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Found an unconfirmed migration during delete, id: 16, status: finished Dec 18 21:31:13.458494 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9b3a1790-ec93-4b3d-a91c-e4f25d596ce7 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 204 len: 0 microversion: 2.1 time: 1.365995 Dec 18 21:31:13.459305 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3494/7037] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:31:12 2021] DELETE /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 0 bytes in 1368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:31:13.467931 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:13.468525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:13.476906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:13.477334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:13.478434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:13.478873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:13.606896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:13.614153 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1dc319a4-88ee-4298-a766-67462f14f3b2 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1502 microversion: 2.1 time: 0.150484 Dec 18 21:31:13.614747 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3544/7038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:13 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:14.632963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:14.633879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:14.644471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:14.644943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:14.645755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:14.646224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:14.781708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a862e89dfc994d3fbbbdb0a08826d554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c8fcdf62d4488494c91a4cb55c2456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:14.791895 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c849b98e-9cc0-4a28-bb81-d431cf13fa3f tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 200 len: 1502 microversion: 2.1 time: 0.164509 Dec 18 21:31:14.792524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3495/7039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:14 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:15.147638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0311483f-a096-4798-a7b4-4d63dd83ba82 req-06d8b21a-64b6-412d-a1d9-7bd1d7557cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0821cc85-a213-4d89-9621-383a9ee86938", "name": "network-vif-plugged", "status": "completed", "tag": "a39e39e5-8e11-44fa-82ec-a039eebef716"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:15.149325 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:31:15.149325 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:31:15.157697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0311483f-a096-4798-a7b4-4d63dd83ba82 req-06d8b21a-64b6-412d-a1d9-7bd1d7557cce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.158413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0311483f-a096-4798-a7b4-4d63dd83ba82 req-06d8b21a-64b6-412d-a1d9-7bd1d7557cce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.172258 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0311483f-a096-4798-a7b4-4d63dd83ba82 req-06d8b21a-64b6-412d-a1d9-7bd1d7557cce service nova] Creating event network-vif-plugged:a39e39e5-8e11-44fa-82ec-a039eebef716 for instance 0821cc85-a213-4d89-9621-383a9ee86938 on nch1-master-1 Dec 18 21:31:15.178168 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0311483f-a096-4798-a7b4-4d63dd83ba82 req-06d8b21a-64b6-412d-a1d9-7bd1d7557cce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035497 Dec 18 21:31:15.178820 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3545/7040] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:31:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:31:15.395601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f42ac1b7-8cbc-4170-b53c-546f5f16b70e req-dca28f62-dd8f-4cbc-a55c-2b2adf86c34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0821cc85-a213-4d89-9621-383a9ee86938", "name": "network-vif-deleted", "tag": "a39e39e5-8e11-44fa-82ec-a039eebef716"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:15.397151 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:31:15.397151 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:31:15.404609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f42ac1b7-8cbc-4170-b53c-546f5f16b70e req-dca28f62-dd8f-4cbc-a55c-2b2adf86c34f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.405066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f42ac1b7-8cbc-4170-b53c-546f5f16b70e req-dca28f62-dd8f-4cbc-a55c-2b2adf86c34f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.416768 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f42ac1b7-8cbc-4170-b53c-546f5f16b70e req-dca28f62-dd8f-4cbc-a55c-2b2adf86c34f service nova] Creating event network-vif-deleted:a39e39e5-8e11-44fa-82ec-a039eebef716 for instance 0821cc85-a213-4d89-9621-383a9ee86938 on nch1-master-1 Dec 18 21:31:15.430282 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f42ac1b7-8cbc-4170-b53c-546f5f16b70e req-dca28f62-dd8f-4cbc-a55c-2b2adf86c34f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Dec 18 21:31:15.430979 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3496/7041] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:31:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:31:15.810684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:15.811490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:15.818734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.819190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.819987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.820428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.833731 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] HTTP exception thrown: Instance 0821cc85-a213-4d89-9621-383a9ee86938 could not be found. Dec 18 21:31:15.834351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Returning 404 to user: Instance 0821cc85-a213-4d89-9621-383a9ee86938 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:31:15.835179 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19bf29b1-ae43-446f-b8a5-6336c95519ab tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 404 len: 111 microversion: 2.1 time: 0.028784 Dec 18 21:31:15.835720 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3546/7042] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:15 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:31:15.851736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:15.852341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:15.858494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.859162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.859997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.860452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.873989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] HTTP exception thrown: Instance 0821cc85-a213-4d89-9621-383a9ee86938 could not be found. Dec 18 21:31:15.874623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Returning 404 to user: Instance 0821cc85-a213-4d89-9621-383a9ee86938 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:31:15.875460 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a379e94-c437-49b7-9654-7878cab94a2c tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 404 len: 111 microversion: 2.1 time: 0.028657 Dec 18 21:31:15.875990 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3497/7043] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:31:15 2021] DELETE /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:31:15.884319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:15.884926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] [instance: 0821cc85-a213-4d89-9621-383a9ee86938] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:15.890786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.891241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.892022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:15.892462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:15.905423 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] HTTP exception thrown: Instance 0821cc85-a213-4d89-9621-383a9ee86938 could not be found. Dec 18 21:31:15.906003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] Returning 404 to user: Instance 0821cc85-a213-4d89-9621-383a9ee86938 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:31:15.906837 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-93e8f1b5-3fe4-42c6-a2ee-e2388b6402a4 tempest-DeleteServersTestJSON-2099028335 tempest-DeleteServersTestJSON-2099028335-project] 10.222.0.13 "GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938" status: 404 len: 111 microversion: 2.1 time: 0.026186 Dec 18 21:31:15.907345 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3547/7044] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:15 2021] GET /compute/v2.1/servers/0821cc85-a213-4d89-9621-383a9ee86938 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:31:18.292719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1123565506", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "87c24db7-4ee0-4903-b73a-79e3ee0776ff"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:18.342999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] validate_networks() for [('87c24db7-4ee0-4903-b73a-79e3ee0776ff', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:31:18.684306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:31:18.684746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:31:18.685264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:31:18.685689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:31:18.686118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:31:18.697126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:18.697595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:18.698743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:18.699180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:18.716149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Getting quotas for project 1fef6da50bfa450ba842674c07090fc1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:31:18.721094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Getting quotas for user 3a774440d2524acfaecf6af8cfba1507 and project 1fef6da50bfa450ba842674c07090fc1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:31:18.734348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:31:18.739147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:31:18.784316 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f5e00058-17f6-4ca8-9ad4-5fbb61ab88e1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607126 Dec 18 21:31:18.785023 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3498/7045] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:31:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:31:18.795741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7c5e873-a1d4-4af3-883e-2fa21e0fce0c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:18.796357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7c5e873-a1d4-4af3-883e-2fa21e0fce0c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:18.857492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a7c5e873-a1d4-4af3-883e-2fa21e0fce0c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:18.866156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7c5e873-a1d4-4af3-883e-2fa21e0fce0c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1218 microversion: 2.1 time: 0.074398 Dec 18 21:31:18.866769 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3548/7046] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:18 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:19.883640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:19.884268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:19.893725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:19.895234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:19.896211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:19.896750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:19.957199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:19.964708 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95167049-4cad-45ac-bb7f-c80f9291bf10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1276 microversion: 2.1 time: 0.084754 Dec 18 21:31:19.965314 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3499/7047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:19 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:20.980967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:20.981499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:20.992134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:20.992587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:20.993377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:20.993798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:21.006563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ef08f4f4-5cdc-41bb-83af-a5cdff95f6fb req-7a4dcc44-986f-4db9-a4b7-b005a9992b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58cc2cfe-f84a-4687-83a2-a1e49526c279", "tag": "488effe1-ce8e-48ae-a0f0-a272d170fc27"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:21.009727 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:31:21.009727 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:31:21.020505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ef08f4f4-5cdc-41bb-83af-a5cdff95f6fb req-7a4dcc44-986f-4db9-a4b7-b005a9992b91 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:21.022189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ef08f4f4-5cdc-41bb-83af-a5cdff95f6fb req-7a4dcc44-986f-4db9-a4b7-b005a9992b91 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:21.035442 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ef08f4f4-5cdc-41bb-83af-a5cdff95f6fb req-7a4dcc44-986f-4db9-a4b7-b005a9992b91 service nova] Creating event network-changed:488effe1-ce8e-48ae-a0f0-a272d170fc27 for instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 on nch1-master-1 Dec 18 21:31:21.043535 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ef08f4f4-5cdc-41bb-83af-a5cdff95f6fb req-7a4dcc44-986f-4db9-a4b7-b005a9992b91 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040936 Dec 18 21:31:21.044152 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3500/7048] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:31:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:31:21.138478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:21.146397 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecdd77be-29b9-456a-b16c-71e571b8b53f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1318 microversion: 2.1 time: 0.169267 Dec 18 21:31:21.146981 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3549/7049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:20 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:22.163548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:22.164261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:22.170792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:22.171253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:22.172043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:22.172497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:22.309077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:22.316360 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04535783-6aed-493b-91ed-2e3d30e14e27 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1318 microversion: 2.1 time: 0.157508 Dec 18 21:31:22.316932 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3501/7050] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:22 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:23.333285 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:23.334554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:23.340802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:23.341257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:23.342038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:23.342514 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:23.467766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:23.475521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ce4fc9a-5856-41fb-bb0f-872d309993ef tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1318 microversion: 2.1 time: 0.146007 Dec 18 21:31:23.476091 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3550/7051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:23 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:24.492251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:24.492868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:24.499630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:24.500097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:24.500883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:24.501329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:24.629348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:24.636614 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b76d8492-ea7f-4888-99c4-6e6a31638cd4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1318 microversion: 2.1 time: 0.148059 Dec 18 21:31:24.637180 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3502/7052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:24 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:25.652753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:25.653356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:25.660686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:25.661134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:25.661908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:25.662374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:26.034738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:26.041945 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d8af6c19-3548-4f4e-84f0-154fd89f5f43 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1318 microversion: 2.1 time: 0.392919 Dec 18 21:31:26.042536 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3551/7053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:25 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:31:27.042140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-361da8d9-09a2-4cc8-8ae0-e7753a482680 req-206b798e-db07-452d-a042-ba6c5d768346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cc2cfe-f84a-4687-83a2-a1e49526c279", "name": "network-vif-plugged", "status": "completed", "tag": "488effe1-ce8e-48ae-a0f0-a272d170fc27"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:27.043740 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:31:27.043740 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:31:27.054573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-361da8d9-09a2-4cc8-8ae0-e7753a482680 req-206b798e-db07-452d-a042-ba6c5d768346 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:27.055446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-361da8d9-09a2-4cc8-8ae0-e7753a482680 req-206b798e-db07-452d-a042-ba6c5d768346 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:27.058201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:27.058892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:27.066018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:27.066875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:27.068293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:27.069160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:27.069386 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-361da8d9-09a2-4cc8-8ae0-e7753a482680 req-206b798e-db07-452d-a042-ba6c5d768346 service nova] Creating event network-vif-plugged:488effe1-ce8e-48ae-a0f0-a272d170fc27 for instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 on nch1-master-1 Dec 18 21:31:27.075544 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-361da8d9-09a2-4cc8-8ae0-e7753a482680 req-206b798e-db07-452d-a042-ba6c5d768346 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037144 Dec 18 21:31:27.076190 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3503/7054] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:31:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:31:27.203857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:27.211753 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b634e98-66f5-4703-bc69-ef821bce4ad4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1318 microversion: 2.1 time: 0.157506 Dec 18 21:31:27.212489 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3552/7055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:27 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:28.230080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:28.230844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:28.237274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:28.238413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:28.239219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:28.239673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:28.373156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:28.380513 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e02f046-9be3-4bc6-a847-077336a9c49e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1318 microversion: 2.1 time: 0.155275 Dec 18 21:31:28.381087 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3504/7056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:28 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:29.396617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:29.397225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:29.403940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.404380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.405161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.405602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.530639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:29.538458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c889cde-a779-47c9-b6af-8ea3bba178b7 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1508 microversion: 2.1 time: 0.145538 Dec 18 21:31:29.539027 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3553/7057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:29 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:29.554747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:29.555365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:29.561971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.562476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.563266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.563717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.692166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:29.699782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ddd3bbaa-ba7b-4b92-a7d2-56f35a9a6fd1 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1508 microversion: 2.1 time: 0.148704 Dec 18 21:31:29.700375 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3505/7058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:29 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:29.715379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39b53c8b-f941-4d61-9ffd-33de70bf21b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:29.716549 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39b53c8b-f941-4d61-9ffd-33de70bf21b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:29.723015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b53c8b-f941-4d61-9ffd-33de70bf21b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.723473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b53c8b-f941-4d61-9ffd-33de70bf21b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.724264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b53c8b-f941-4d61-9ffd-33de70bf21b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.724709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39b53c8b-f941-4d61-9ffd-33de70bf21b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.786102 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39b53c8b-f941-4d61-9ffd-33de70bf21b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "PUT /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1080 microversion: 2.1 time: 0.074294 Dec 18 21:31:29.786694 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3554/7059] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:31:29 2021] PUT /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1080 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:29.800834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:29.801460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:29.807683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.808149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.808945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.809402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.941010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:29.948379 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-78211aca-661a-4d52-a511-16d24c0ff094 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1506 microversion: 2.1 time: 0.151962 Dec 18 21:31:29.949209 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3506/7060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:29 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:29.964438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:29.965044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:29.970864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.971318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:29.972723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:29.973166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:30.103598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:30.110912 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1f3e6193-93e4-4534-8e01-7a519faa23b5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1506 microversion: 2.1 time: 0.150163 Dec 18 21:31:30.111504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3555/7061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:29 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:30.131356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:30.132359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:30.138416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:30.138895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:30.139700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:30.140160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:30.168154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:30.173813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Old instance type m1.heat2, new instance type m1.heat {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:31:30.179940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:31:30.180377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:31:30.180870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:31:30.181297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:31:30.181727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:31:30.241760 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ed9e1629-586f-407e-8c8c-38685389dba8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "POST /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279/action" status: 202 len: 0 microversion: 2.1 time: 0.114803 Dec 18 21:31:30.242394 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3507/7062] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:31:30 2021] POST /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:31:30.250301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:30.250906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:30.257148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:30.257592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:30.258389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:30.258825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:30.398889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:30.410718 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-19b36b58-aaeb-49c4-973b-17b5fbb4b4de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1517 microversion: 2.1 time: 0.163971 Dec 18 21:31:30.411310 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3556/7063] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:30 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:31:31.429149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:31.429781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:31.435817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:31.436280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:31.437107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:31.437561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:31.568896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:31.576690 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1fc787ef-420a-4755-b6d4-cba39dc3a334 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1517 microversion: 2.1 time: 0.152505 Dec 18 21:31:31.577269 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3508/7064] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:31 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:32.593574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:32.594227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:32.601357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:32.601801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:32.602607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:32.603042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:32.736559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:32.744604 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15c29770-35e9-4c57-b647-13197be605af tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.154750 Dec 18 21:31:32.745177 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3557/7065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:32 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:33.761662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:33.762328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:33.769143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:33.769606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:33.770446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:33.770904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:33.906199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:33.913523 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-168722a3-d2e6-41ea-8add-7d37cedd3cfa tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.155620 Dec 18 21:31:33.914095 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3509/7066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:33 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:34.931223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:34.931858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:34.938689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:34.939148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:34.939940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:34.940380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:35.072322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:35.079938 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f553ec02-8840-4cde-9c40-eed94e68b789 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.152753 Dec 18 21:31:35.080502 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3558/7067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:34 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:36.096168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:36.097367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:36.104081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:36.104542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:36.105327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:36.105776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:36.235185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:36.242511 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d3e103e4-1eca-4f82-a5b0-32c965f1c7d6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.150004 Dec 18 21:31:36.243072 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3510/7068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:36 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:37.259449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:37.260081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:37.266922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:37.267367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:37.268141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:37.268575 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:37.398409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:37.405831 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-34577342-c6e2-4aae-a7aa-263aec89d1ca tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.150110 Dec 18 21:31:37.406432 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3559/7069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:37 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:38.422989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:38.423518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:38.430802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:38.431265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:38.432054 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:38.432503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:38.564354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:38.571735 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c1eeb66b-613b-48ca-b9fa-55378366fcbf tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.152590 Dec 18 21:31:38.572301 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3511/7070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:38 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:39.588992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:39.589505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:39.596207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:39.596663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:39.597450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:39.597891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:39.726279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:39.733545 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-547c6755-a6bc-40bb-a9f4-6bd560fe9883 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.148434 Dec 18 21:31:39.734110 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3560/7071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:39 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:40.750941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:40.751573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:40.758829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:40.759292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:40.760081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:40.760530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:40.888072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:40.896146 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2399c671-b1ed-4001-b81a-273497c8469d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.148947 Dec 18 21:31:40.896763 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3512/7072] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:40 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:41.913539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:41.914149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:41.920875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:41.921325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:41.922101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:41.922574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:42.053563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:42.060925 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-825f0e38-e287-4350-9f22-af49edfd4596 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.151886 Dec 18 21:31:42.061524 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3561/7073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:41 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:43.081719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:43.082424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:43.089208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:43.089676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:43.090500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:43.090959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:43.218198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:43.226052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c4b0edb-aeef-475a-b1a9-1419cef4cd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.148209 Dec 18 21:31:43.226654 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3513/7074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:43 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:31:44.243367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:44.243978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:44.250757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:44.251211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:44.251994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:44.252437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:44.385528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:44.392982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0676a2c6-9617-44cc-9c2b-e36bc550a04b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.153359 Dec 18 21:31:44.393560 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3562/7075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:44 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:45.409023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:45.410177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:45.417126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:45.417536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:45.418354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:45.418814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:45.552868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:45.560317 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c4f4119-08d3-414f-8019-517b882f7280 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.155072 Dec 18 21:31:45.560890 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3514/7076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:45 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:46.577234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:46.577832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:46.584462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:46.584911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:46.585685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:46.586122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:46.716509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:46.724646 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-89ab9dce-5a4c-418c-9c25-5b22a39b62f5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.151417 Dec 18 21:31:46.725213 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3563/7077] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:46 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:47.741709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:47.742367 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:47.750102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:47.750614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:47.751412 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:47.751869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:47.885504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:47.892826 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ce542b13-2ca4-4677-b53d-b2e32d913bd5 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.154899 Dec 18 21:31:47.893404 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3515/7078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:47 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:48.908686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:48.909915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:48.916665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:48.917114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:48.917888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:48.918346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:49.048946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:49.056610 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c05ecaa-f49f-4d25-a962-b462addbc680 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.151639 Dec 18 21:31:49.057186 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3564/7079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:48 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:50.073909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:50.074725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:50.082062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:50.082549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:50.083354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:50.083809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:50.222489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:50.230056 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d00b342-e2cd-42bc-b634-1c5c63138561 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.159955 Dec 18 21:31:50.230674 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3516/7080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:50 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:51.247071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:51.247731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:51.254980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:51.255437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:51.256224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:51.256663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:51.386330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:51.394433 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1486a326-48ff-4876-869a-088a246d56e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.150416 Dec 18 21:31:51.395013 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3565/7081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:51 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:52.412071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:52.412681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:52.418863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:52.419333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:52.420121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:52.420573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:52.550565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:52.557834 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d3f005d-5554-4a81-842f-4a93042057b8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.150304 Dec 18 21:31:52.558430 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3517/7082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:52 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:53.574848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:53.575391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:53.581284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:53.581731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:53.582533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:53.582970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:53.711290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:53.718810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-98dcc4cc-8a0a-4034-9bbf-35f869b2d357 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.148220 Dec 18 21:31:53.719386 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3566/7083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:53 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:54.736188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:54.736818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:54.744695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:54.745160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:54.745994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:54.746503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:54.873921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:54.881299 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-44786735-d141-4c5d-869b-4b00b7b75471 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.148879 Dec 18 21:31:54.881872 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3518/7084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:54 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:55.897858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:55.898505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:55.905267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:55.905718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:55.906532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:55.906977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:56.038966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:56.046421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9ef1bc4-4986-4cfd-9cca-6619a6e76602 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.152186 Dec 18 21:31:56.046992 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3567/7085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:55 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:57.063851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:57.064394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:57.071829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:57.072302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:57.073103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:57.073560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:57.199943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:57.207270 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c8e9de5-6da1-4d3c-8d24-4a8a107deb94 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.147259 Dec 18 21:31:57.207832 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3519/7086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:57 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:58.223990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:58.224600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:58.232084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:58.232536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:58.233315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:58.233750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:58.366871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:58.374200 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a1b13ea-b736-4b5f-b7eb-e64e63c7952f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1522 microversion: 2.1 time: 0.154184 Dec 18 21:31:58.375029 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3568/7087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:58 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:59.391830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:31:59.392456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:31:59.400172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:59.400634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:59.401438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:59.401890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:59.658956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:31:59.666370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b4e1b8f-fd56-4958-a81e-d984889bf5f2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1521 microversion: 2.1 time: 0.278358 Dec 18 21:31:59.666953 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3520/7088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:31:59 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:31:59.730112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8257f3d5-cdb1-41c7-8013-b7ce55a77fce req-412d452f-8845-463f-9b42-13c8bca49f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cc2cfe-f84a-4687-83a2-a1e49526c279", "name": "network-vif-unplugged", "status": "completed", "tag": "488effe1-ce8e-48ae-a0f0-a272d170fc27"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:31:59.732235 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:31:59.732235 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:31:59.740016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8257f3d5-cdb1-41c7-8013-b7ce55a77fce req-412d452f-8845-463f-9b42-13c8bca49f4b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:31:59.740471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8257f3d5-cdb1-41c7-8013-b7ce55a77fce req-412d452f-8845-463f-9b42-13c8bca49f4b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:31:59.753425 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8257f3d5-cdb1-41c7-8013-b7ce55a77fce req-412d452f-8845-463f-9b42-13c8bca49f4b service nova] Creating event network-vif-unplugged:488effe1-ce8e-48ae-a0f0-a272d170fc27 for instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 on nch2-master-1 Dec 18 21:31:59.759342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-8257f3d5-cdb1-41c7-8013-b7ce55a77fce req-412d452f-8845-463f-9b42-13c8bca49f4b service nova] Instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:31:59.771470 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8257f3d5-cdb1-41c7-8013-b7ce55a77fce req-412d452f-8845-463f-9b42-13c8bca49f4b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045049 Dec 18 21:31:59.772080 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3569/7089] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:31:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:00.682796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:00.683415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:00.690562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:00.691028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:00.691839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:00.692547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:00.828869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:00.836778 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3ace2623-06aa-4227-b178-3d2266e16155 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1519 microversion: 2.1 time: 0.157686 Dec 18 21:32:00.837352 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3521/7090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:00 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:01.790284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-62b12d10-50cc-4589-a977-fbc9c5f5a001 req-a90f4163-4211-4c47-910f-ce915cee1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58cc2cfe-f84a-4687-83a2-a1e49526c279", "tag": "488effe1-ce8e-48ae-a0f0-a272d170fc27"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:01.791806 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:01.791806 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:32:01.799778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-62b12d10-50cc-4589-a977-fbc9c5f5a001 req-a90f4163-4211-4c47-910f-ce915cee1bf6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:01.800227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-62b12d10-50cc-4589-a977-fbc9c5f5a001 req-a90f4163-4211-4c47-910f-ce915cee1bf6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:01.812415 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-62b12d10-50cc-4589-a977-fbc9c5f5a001 req-a90f4163-4211-4c47-910f-ce915cee1bf6 service nova] Creating event network-changed:488effe1-ce8e-48ae-a0f0-a272d170fc27 for instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 on nch2-master-1 Dec 18 21:32:01.817510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-62b12d10-50cc-4589-a977-fbc9c5f5a001 req-a90f4163-4211-4c47-910f-ce915cee1bf6 service nova] Instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:32:01.828201 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-62b12d10-50cc-4589-a977-fbc9c5f5a001 req-a90f4163-4211-4c47-910f-ce915cee1bf6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041981 Dec 18 21:32:01.828809 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3570/7091] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:01.855144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:01.855806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:01.864405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:01.864970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:01.866101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:01.866667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:02.106683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:02.115626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92e56762-c8e5-4c30-84b0-fd0d31f749b6 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1519 microversion: 2.1 time: 0.265701 Dec 18 21:32:02.125541 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3522/7092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:01 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:03.134953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:03.135646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:03.141640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:03.142085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:03.142903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:03.143338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:03.275560 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:03.283701 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-330c0658-89db-4cd2-ab6e-8208fcb72a3d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1516 microversion: 2.1 time: 0.154718 Dec 18 21:32:03.284357 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3571/7093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:03 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:03.301631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7acb4e0a-91be-4b8b-afeb-8480adee0b09 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:03.302233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7acb4e0a-91be-4b8b-afeb-8480adee0b09 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:03.308989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7acb4e0a-91be-4b8b-afeb-8480adee0b09 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:03.309502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7acb4e0a-91be-4b8b-afeb-8480adee0b09 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:03.310353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7acb4e0a-91be-4b8b-afeb-8480adee0b09 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:03.310816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7acb4e0a-91be-4b8b-afeb-8480adee0b09 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:03.369290 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7acb4e0a-91be-4b8b-afeb-8480adee0b09 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "POST /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279/action" status: 204 len: 0 microversion: 2.1 time: 0.071979 Dec 18 21:32:03.370098 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3523/7094] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:32:03 2021] POST /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:32:03.378040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:03.378755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:03.385041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:03.385804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:03.386845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:03.387442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:03.528842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:03.536854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-53b1ea61-a632-48d2-aa86-e7bce0da9244 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1516 microversion: 2.1 time: 0.162547 Dec 18 21:32:03.537529 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3572/7095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:03 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:32:04.555405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:04.556155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:04.563418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:04.563884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:04.564684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:04.565134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:04.711382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:04.719056 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1477a16-6897-4e8f-9b03-e28ad14cfbc0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1508 microversion: 2.1 time: 0.168648 Dec 18 21:32:04.719645 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3524/7096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:04 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:04.735795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:04.736564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:04.744454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:04.744919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:04.745746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:04.746191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:04.882417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:04.889754 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-94f9fca3-7184-411d-b947-3beec1804794 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1508 microversion: 2.1 time: 0.157904 Dec 18 21:32:04.890346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3573/7097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:04 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:04.905822 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:04.906487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:04.913027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:04.913527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:04.914349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:04.914813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:05.045259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:05.053253 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-94a16e72-0037-4baf-b779-d83bd5f2e531 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 200 len: 1508 microversion: 2.1 time: 0.151173 Dec 18 21:32:05.053814 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3525/7098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:04 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:05.068766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:05.069269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:05.075381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:05.075840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:05.076627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:05.077068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:05.101725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:32:05.173183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13b0d460-23f4-44b4-a62e-845747bafe70 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 204 len: 0 microversion: 2.1 time: 0.107785 Dec 18 21:32:05.173779 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3574/7099] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:32:05 2021] DELETE /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:32:05.229251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1534874141", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "87c24db7-4ee0-4903-b73a-79e3ee0776ff"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:05.286216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] validate_networks() for [('87c24db7-4ee0-4903-b73a-79e3ee0776ff', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:32:05.439873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-823eb936-81ae-4a9e-932d-283b152f9a25 req-505d6d18-34cc-4d3e-8d2e-22f5396febba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cc2cfe-f84a-4687-83a2-a1e49526c279", "name": "network-vif-plugged", "status": "completed", "tag": "488effe1-ce8e-48ae-a0f0-a272d170fc27"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:05.441552 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:05.441552 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:32:05.450532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-823eb936-81ae-4a9e-932d-283b152f9a25 req-505d6d18-34cc-4d3e-8d2e-22f5396febba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:05.451283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-823eb936-81ae-4a9e-932d-283b152f9a25 req-505d6d18-34cc-4d3e-8d2e-22f5396febba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:05.464819 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-823eb936-81ae-4a9e-932d-283b152f9a25 req-505d6d18-34cc-4d3e-8d2e-22f5396febba service nova] Creating event network-vif-plugged:488effe1-ce8e-48ae-a0f0-a272d170fc27 for instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 on nch2-master-1 Dec 18 21:32:05.469887 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-823eb936-81ae-4a9e-932d-283b152f9a25 req-505d6d18-34cc-4d3e-8d2e-22f5396febba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034544 Dec 18 21:32:05.470857 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3575/7100] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:05.648724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:32:05.649203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:32:05.649659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:32:05.650080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:32:05.650553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:32:05.659508 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:05.659974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:05.660855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:05.661313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:05.677654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Getting quotas for project 1fef6da50bfa450ba842674c07090fc1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:32:05.682733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Getting quotas for user 3a774440d2524acfaecf6af8cfba1507 and project 1fef6da50bfa450ba842674c07090fc1. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:32:05.695277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:32:05.697592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:32:05.741989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71ccdffb-f2fb-40b3-b3d0-fe3149e1e7ff tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516529 Dec 18 21:32:05.742694 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3526/7101] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:32:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:32:05.753010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0fbee5bb-92df-4478-88ab-906c4aed35de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:05.753728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0fbee5bb-92df-4478-88ab-906c4aed35de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:05.809811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0fbee5bb-92df-4478-88ab-906c4aed35de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:05.817744 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0fbee5bb-92df-4478-88ab-906c4aed35de tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1218 microversion: 2.1 time: 0.068113 Dec 18 21:32:05.818337 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3576/7102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:05 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:06.836564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:06.838118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:06.844831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:06.845516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:06.846540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:06.846996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:06.939203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:06.951846 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4f2f333d-b802-4521-afed-65ddf5c65534 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1276 microversion: 2.1 time: 0.116848 Dec 18 21:32:06.958603 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3527/7103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:06 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:07.010966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4323d89e-030d-4c65-b4a2-fd8ee4bf4c80 req-c71b6c2d-fb45-4b19-a9ca-6b89fdbc1b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cc2cfe-f84a-4687-83a2-a1e49526c279", "name": "network-vif-deleted", "tag": "488effe1-ce8e-48ae-a0f0-a272d170fc27"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:07.013187 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:07.013187 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:32:07.022563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4323d89e-030d-4c65-b4a2-fd8ee4bf4c80 req-c71b6c2d-fb45-4b19-a9ca-6b89fdbc1b92 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:07.022933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4323d89e-030d-4c65-b4a2-fd8ee4bf4c80 req-c71b6c2d-fb45-4b19-a9ca-6b89fdbc1b92 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:07.036228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4323d89e-030d-4c65-b4a2-fd8ee4bf4c80 req-c71b6c2d-fb45-4b19-a9ca-6b89fdbc1b92 service nova] Creating event network-vif-deleted:488effe1-ce8e-48ae-a0f0-a272d170fc27 for instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 on nch2-master-1 Dec 18 21:32:07.041195 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4323d89e-030d-4c65-b4a2-fd8ee4bf4c80 req-c71b6c2d-fb45-4b19-a9ca-6b89fdbc1b92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034028 Dec 18 21:32:07.041816 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3577/7104] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:07.947537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-54e0a4f4-34f7-4002-9c64-3a758ae59bbe req-dce7ab14-4c11-411c-b47f-299a81b06602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f965a7ab-e6e3-4df1-aa97-948d03ab7c3b", "tag": "088a2c72-a7f6-40fe-8587-35574fd17f26"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:07.950163 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:07.950163 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:32:07.959006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-54e0a4f4-34f7-4002-9c64-3a758ae59bbe req-dce7ab14-4c11-411c-b47f-299a81b06602 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:07.959006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-54e0a4f4-34f7-4002-9c64-3a758ae59bbe req-dce7ab14-4c11-411c-b47f-299a81b06602 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:07.966103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:07.967052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:07.974101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:07.974589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:07.975540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:07.975980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:07.984217 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-54e0a4f4-34f7-4002-9c64-3a758ae59bbe req-dce7ab14-4c11-411c-b47f-299a81b06602 service nova] Creating event network-changed:088a2c72-a7f6-40fe-8587-35574fd17f26 for instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b on nch2-master-1 Dec 18 21:32:07.989863 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-54e0a4f4-34f7-4002-9c64-3a758ae59bbe req-dce7ab14-4c11-411c-b47f-299a81b06602 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045526 Dec 18 21:32:07.990670 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3528/7105] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:32:08.109049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:08.116374 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2903fbe7-f835-4a91-9add-600f3b11b530 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1318 microversion: 2.1 time: 0.154453 Dec 18 21:32:08.117065 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3578/7106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:07 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:32:09.133357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:09.134073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:09.141076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:09.141554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:09.142388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:09.142849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:09.278318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:09.286147 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-993b8220-19ed-4a70-8ca4-a6c374bd3427 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1318 microversion: 2.1 time: 0.156826 Dec 18 21:32:09.287047 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3529/7107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:09 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:10.303370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:10.303981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:10.310890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:10.311395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:10.312272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:10.312746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:10.441146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:10.449078 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa647047-f17a-4a79-bce0-a582c9e9deb9 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1318 microversion: 2.1 time: 0.149978 Dec 18 21:32:10.449896 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3579/7108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:10 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:11.465701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:11.466359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:11.473109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:11.474075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:11.474918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:11.475409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:11.612651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:11.620634 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd3e275c-edb5-45de-b475-3541ea9ffe39 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1318 microversion: 2.1 time: 0.158677 Dec 18 21:32:11.621226 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3530/7109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:11 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:12.636753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:12.637349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:12.644068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:12.644524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:12.645307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:12.645747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:12.774395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:12.781658 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-277c23be-77ae-42a4-9f76-5f73310f7d4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1318 microversion: 2.1 time: 0.148639 Dec 18 21:32:12.782235 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3580/7110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:12 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:13.464137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-05b94528-d480-4c6d-bf7f-9326e4f09e61 req-29318b14-f334-458d-bb0d-c9e9137b41c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965a7ab-e6e3-4df1-aa97-948d03ab7c3b", "name": "network-vif-plugged", "status": "completed", "tag": "088a2c72-a7f6-40fe-8587-35574fd17f26"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:13.465785 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:13.465785 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:32:13.474278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-05b94528-d480-4c6d-bf7f-9326e4f09e61 req-29318b14-f334-458d-bb0d-c9e9137b41c0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:13.474775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-05b94528-d480-4c6d-bf7f-9326e4f09e61 req-29318b14-f334-458d-bb0d-c9e9137b41c0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:13.485826 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-05b94528-d480-4c6d-bf7f-9326e4f09e61 req-29318b14-f334-458d-bb0d-c9e9137b41c0 service nova] Creating event network-vif-plugged:088a2c72-a7f6-40fe-8587-35574fd17f26 for instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b on nch2-master-1 Dec 18 21:32:13.491212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-05b94528-d480-4c6d-bf7f-9326e4f09e61 req-29318b14-f334-458d-bb0d-c9e9137b41c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030914 Dec 18 21:32:13.491966 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3531/7111] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:13.799084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:13.799624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:13.806551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:13.807016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:13.807811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:13.808258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:13.936332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:13.944188 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-465f3d3e-549b-464a-b8be-f410e66afe20 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1318 microversion: 2.1 time: 0.149016 Dec 18 21:32:13.944762 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3581/7112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:13 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:14.962720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:14.963460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:14.969701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:14.970106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:14.970933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:14.971387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:15.359873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:15.372329 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d1fac5fd-ef08-4a56-9002-619d05dc98b4 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1508 microversion: 2.1 time: 0.415026 Dec 18 21:32:15.372930 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3532/7113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:14 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:15.388482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:15.389086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:15.396448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:15.396908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:15.397670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:15.398107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:15.523863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:15.531421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-53c575ba-6002-4f83-aac8-cb41a30a3dab tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1508 microversion: 2.1 time: 0.146515 Dec 18 21:32:15.531938 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3582/7114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:15 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:15.546986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:15.548002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:15.554553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:15.555017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:15.555804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:15.556251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:15.583483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:15.589156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Old instance type m1.heat2, new instance type m1.heat {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:32:15.595168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:32:15.595600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:32:15.596082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:32:15.596500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:32:15.596919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:32:15.656350 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1536efee-a204-4dbf-b6d4-a8978170224f tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "POST /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b/action" status: 202 len: 0 microversion: 2.1 time: 0.113062 Dec 18 21:32:15.656953 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3533/7115] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:32:15 2021] POST /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:32:15.665065 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:15.665672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:15.672090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:15.672546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:15.673328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:15.673767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:15.823495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:15.832821 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78512116-d3c3-4d2f-a38e-e20eba84632d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1515 microversion: 2.1 time: 0.171445 Dec 18 21:32:15.838952 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3583/7116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:15 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:32:16.850274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:16.850913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:16.857074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:16.857546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:16.858377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:16.858835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:16.988256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:16.995792 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04a2ad1e-3a9f-43ee-9631-d267e16f827b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1515 microversion: 2.1 time: 0.150167 Dec 18 21:32:16.996455 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3534/7117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:16 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:18.012532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:18.013092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:18.019815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:18.020343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:18.021126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:18.021567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:18.156547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:18.164355 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cba7cd79-b398-48dd-b392-7a1140721376 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.155647 Dec 18 21:32:18.164928 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3584/7118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:18 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:19.181056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:19.182051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:19.189358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:19.189821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:19.190645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:19.191097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:19.325296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:19.333061 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa3964d0-8314-4ede-9bf1-9910d3c51674 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.155240 Dec 18 21:32:19.333633 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3535/7119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:19 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:20.350801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:20.351410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:20.358139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:20.358626 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:20.359414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:20.359851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:20.485581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:20.492935 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-251a761a-6d76-4c67-a07b-2901ba9fc933 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.146584 Dec 18 21:32:20.493504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3585/7120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:20 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:21.509823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:21.510478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:21.517186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:21.517691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:21.518514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:21.518961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:21.656800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:21.664156 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d1022aae-c38f-44be-83b5-41f16fc5bf96 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.158021 Dec 18 21:32:21.664718 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3536/7121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:21 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:22.680718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:22.681326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:22.688020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:22.688466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:22.689238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:22.689671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:22.817002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:22.825101 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d4ce2074-c76c-475a-993f-78caef14a891 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.147849 Dec 18 21:32:22.826047 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3586/7122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:22 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:23.843312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:23.843961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:23.850521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:23.850992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:23.851797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:23.852278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:23.980488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:23.987790 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f923884e-f98f-4984-abd8-5ee699e3cc10 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.148556 Dec 18 21:32:23.988354 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3537/7123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:23 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:25.004816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:25.005877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:25.011984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:25.012447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:25.013239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:25.013685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:25.144313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:25.152193 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3b7583c-efdd-4684-afa0-43a9497ad74c tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.151510 Dec 18 21:32:25.152774 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3587/7124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:24 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:26.168982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:26.169621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:26.176464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:26.176940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:26.177780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:26.178268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:26.305697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:26.313130 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9f520d3f-fc15-4d51-917f-671a52c00f50 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.147941 Dec 18 21:32:26.313710 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3538/7125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:26 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:27.330177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:27.330810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:27.337518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:27.337974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:27.338780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:27.339221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:27.469789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:27.477628 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e9fe993-5138-40f6-96ee-7b83b4ffb766 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.151386 Dec 18 21:32:27.478365 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3588/7126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:27 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:28.494891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:28.495516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:28.502271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:28.502750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:28.503543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:28.504001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:28.631275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:28.638596 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e29957af-56c2-43b9-8194-80eed2bfac3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.147462 Dec 18 21:32:28.639174 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3539/7127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:28 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:29.655244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:29.655877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:29.662571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:29.663027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:29.663812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:29.664250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:29.795510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:29.803363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-93192a4c-465d-4db3-b3bd-80cb0dd5aa3e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.151829 Dec 18 21:32:29.803928 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3589/7128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:29 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:30.820075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:30.820705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:30.827796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:30.828333 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:30.829082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:30.829540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:30.960401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:30.967735 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8de533b5-3a3c-448c-8519-7f895b010994 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.151382 Dec 18 21:32:30.968248 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3540/7129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:30 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:31.984465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:31.985007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:31.992345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:31.992797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:31.993581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:31.994022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:32.122921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:32.130230 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9eae96c6-8322-4916-b6c7-6ede5636edfd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.149565 Dec 18 21:32:32.130829 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3590/7130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:31 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:33.147686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:33.148308 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:33.155048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:33.155511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:33.156300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:33.156753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:33.295319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:33.302911 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-504e1cd8-bece-4362-82ab-e51f1b8e6751 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.159620 Dec 18 21:32:33.303514 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3541/7131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:33 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:34.320245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:34.320889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:34.327919 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:34.328396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:34.329163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:34.329608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:34.467623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:34.475007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8580e0ec-5f01-4d53-b32e-1c0733172c7a tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.159126 Dec 18 21:32:34.475584 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3591/7132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:34 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:35.492114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:35.492642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:35.499323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:35.499789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:35.500579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:35.501029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:35.637136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:35.644493 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c685927b-1805-4264-9897-4e65d3c8dd44 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.156269 Dec 18 21:32:35.645061 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3542/7133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:35 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:36.660719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:36.661324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:36.668607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:36.669059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:36.669841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:36.670304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:36.797946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:36.805293 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0eeb3fc4-688d-43c3-92f4-c2ba365c1624 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.148334 Dec 18 21:32:36.805852 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3592/7134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:36 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:37.821806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:37.822465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:37.829564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:37.830033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:37.830860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:37.831322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:37.962165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:37.970042 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18d61c7b-a383-47fb-a7c3-33629937ba9b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.151862 Dec 18 21:32:37.970584 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3543/7135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:37 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:38.987413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:38.987949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:38.995183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:38.995642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:38.996423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:38.996866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:39.127610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:39.135565 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-359e65fa-ee65-4af3-9103-12e8f04783bd tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.151962 Dec 18 21:32:39.136133 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3593/7136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:38 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:40.152772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:40.153409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:40.160170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:40.160638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:40.161439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:40.161896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:40.288202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:40.295590 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5f201661-82da-4653-a0cc-ba0c935f0477 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.146580 Dec 18 21:32:40.296155 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3544/7137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:40 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:41.312818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:41.313458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:41.320176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:41.320629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:41.321407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:41.321846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:41.455370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:41.463391 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b6abf74-129e-4e5b-8523-f1b39509b8e2 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.154360 Dec 18 21:32:41.463951 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3594/7138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:41 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:42.480413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:42.481100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:42.487719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:42.488179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:42.488969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:42.489419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:42.617927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:42.625363 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c2671cb3-7360-42ae-95ee-5a65b5ae887e tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.148682 Dec 18 21:32:42.625933 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3545/7139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:42 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:43.642043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:43.642684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:43.649434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:43.649896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:43.650712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:43.651158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:43.783980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:43.791890 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f436d4c1-5b7a-41f7-a883-8775584e4909 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1520 microversion: 2.1 time: 0.153664 Dec 18 21:32:43.792467 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3595/7140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:43 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:44.602119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-228729ba-14bd-46ad-914a-99236736fe3f req-7fb57661-cf9f-4a7d-9f11-734274aa4e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965a7ab-e6e3-4df1-aa97-948d03ab7c3b", "name": "network-vif-unplugged", "status": "completed", "tag": "088a2c72-a7f6-40fe-8587-35574fd17f26"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:44.603694 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:44.603694 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:32:44.612060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-228729ba-14bd-46ad-914a-99236736fe3f req-7fb57661-cf9f-4a7d-9f11-734274aa4e1c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:44.612526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-228729ba-14bd-46ad-914a-99236736fe3f req-7fb57661-cf9f-4a7d-9f11-734274aa4e1c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:44.624107 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-228729ba-14bd-46ad-914a-99236736fe3f req-7fb57661-cf9f-4a7d-9f11-734274aa4e1c service nova] Creating event network-vif-unplugged:088a2c72-a7f6-40fe-8587-35574fd17f26 for instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b on nch1-master-1 Dec 18 21:32:44.629420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-228729ba-14bd-46ad-914a-99236736fe3f req-7fb57661-cf9f-4a7d-9f11-734274aa4e1c service nova] Instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:32:44.640742 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-228729ba-14bd-46ad-914a-99236736fe3f req-7fb57661-cf9f-4a7d-9f11-734274aa4e1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042603 Dec 18 21:32:44.641352 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3546/7141] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:32:44.809112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:44.809720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:44.816330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:44.816781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:44.817597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:44.818551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:44.959531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:44.966975 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e0e218a-d22b-4bb0-941a-b69e7286f687 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1519 microversion: 2.1 time: 0.161664 Dec 18 21:32:44.967554 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3596/7142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:44 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:45.985652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:45.986340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:45.993473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:45.993945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:45.994810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:45.995273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:46.129116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:46.136445 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c8f3489c-9280-4511-8538-500d68e86989 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1517 microversion: 2.1 time: 0.155944 Dec 18 21:32:46.137021 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3547/7143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:45 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:46.658510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-acf08cd3-2386-47e6-9b79-45da1d06c3b4 req-fdc96f1b-2043-4075-a918-1434e9ec8323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f965a7ab-e6e3-4df1-aa97-948d03ab7c3b", "tag": "088a2c72-a7f6-40fe-8587-35574fd17f26"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:46.660019 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:46.660019 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:32:46.668248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-acf08cd3-2386-47e6-9b79-45da1d06c3b4 req-fdc96f1b-2043-4075-a918-1434e9ec8323 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:46.668699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-acf08cd3-2386-47e6-9b79-45da1d06c3b4 req-fdc96f1b-2043-4075-a918-1434e9ec8323 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:46.683305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-acf08cd3-2386-47e6-9b79-45da1d06c3b4 req-fdc96f1b-2043-4075-a918-1434e9ec8323 service nova] Creating event network-changed:088a2c72-a7f6-40fe-8587-35574fd17f26 for instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b on nch1-master-1 Dec 18 21:32:46.688684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-acf08cd3-2386-47e6-9b79-45da1d06c3b4 req-fdc96f1b-2043-4075-a918-1434e9ec8323 service nova] Instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:32:46.700800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-acf08cd3-2386-47e6-9b79-45da1d06c3b4 req-fdc96f1b-2043-4075-a918-1434e9ec8323 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045796 Dec 18 21:32:46.701408 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3597/7144] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:47.152930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:47.153551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:47.160318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:47.160785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:47.162205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:47.162682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:47.303953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:47.311969 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7373f7b3-7fc6-4164-a815-dc44d8a59941 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1517 microversion: 2.1 time: 0.162655 Dec 18 21:32:47.312542 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3548/7145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:47 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:48.330449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:48.331177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:48.337258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:48.337712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:48.338523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:48.338966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:48.467420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:48.475352 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b452584a-aeef-42ac-94bb-3f1f1740e4bc tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1514 microversion: 2.1 time: 0.150123 Dec 18 21:32:48.475921 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3598/7146] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:48 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:48.491624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2e65220a-73f4-46b8-91d9-69c448fa3894 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:48.492169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2e65220a-73f4-46b8-91d9-69c448fa3894 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:48.498769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e65220a-73f4-46b8-91d9-69c448fa3894 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:48.499234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e65220a-73f4-46b8-91d9-69c448fa3894 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:48.500023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e65220a-73f4-46b8-91d9-69c448fa3894 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:48.500481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2e65220a-73f4-46b8-91d9-69c448fa3894 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:48.558368 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2e65220a-73f4-46b8-91d9-69c448fa3894 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "POST /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b/action" status: 204 len: 0 microversion: 2.1 time: 0.070699 Dec 18 21:32:48.559004 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3549/7147] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:32:48 2021] POST /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:32:48.567683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:48.568299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:48.575725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:48.576192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:48.577217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:48.578439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:48.719797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:48.727917 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-495b6679-9ff5-4aef-8ec6-e520ddc80214 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1514 microversion: 2.1 time: 0.164615 Dec 18 21:32:48.728492 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3599/7148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:48 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:49.438187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-78213b61-8af9-4e31-93d7-7369d35bcc41 req-76e6f690-f976-4c06-8e88-38fe0ea28a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965a7ab-e6e3-4df1-aa97-948d03ab7c3b", "name": "network-vif-plugged", "status": "completed", "tag": "088a2c72-a7f6-40fe-8587-35574fd17f26"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:49.439706 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:49.439706 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:32:49.448113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-78213b61-8af9-4e31-93d7-7369d35bcc41 req-76e6f690-f976-4c06-8e88-38fe0ea28a3e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:49.448586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-78213b61-8af9-4e31-93d7-7369d35bcc41 req-76e6f690-f976-4c06-8e88-38fe0ea28a3e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:49.460485 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-78213b61-8af9-4e31-93d7-7369d35bcc41 req-76e6f690-f976-4c06-8e88-38fe0ea28a3e service nova] Creating event network-vif-plugged:088a2c72-a7f6-40fe-8587-35574fd17f26 for instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b on nch1-master-1 Dec 18 21:32:49.465759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-78213b61-8af9-4e31-93d7-7369d35bcc41 req-76e6f690-f976-4c06-8e88-38fe0ea28a3e service nova] Instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:32:49.476353 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-78213b61-8af9-4e31-93d7-7369d35bcc41 req-76e6f690-f976-4c06-8e88-38fe0ea28a3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042157 Dec 18 21:32:49.476967 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3550/7149] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:49.745270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:49.745904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:49.752864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:49.753341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:49.754154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:49.754631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:49.889559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:49.896894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f84b713e-796b-4d4f-9bb5-a2bc48653fd0 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1506 microversion: 2.1 time: 0.155365 Dec 18 21:32:49.897466 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3600/7150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:49 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:49.914950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:49.915660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:49.921882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:49.922378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:49.923173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:49.923622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.053687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:50.061219 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-739a23d7-c5bd-4380-8629-1460bf0eac4d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1506 microversion: 2.1 time: 0.152088 Dec 18 21:32:50.061837 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3551/7151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:49 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:50.076888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:50.077496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:50.083796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.084246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.085018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.085462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.216203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:50.223466 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5481fe0e-6e1e-4088-ac50-2019a1ee6830 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1506 microversion: 2.1 time: 0.150523 Dec 18 21:32:50.224649 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3601/7152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:50 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:50.239405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:50.239875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:50.249000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.249706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.251127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.251825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.281062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:32:50.354626 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bddc95a2-a802-4094-863e-d3505df243ec tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 204 len: 0 microversion: 2.1 time: 0.118425 Dec 18 21:32:50.355253 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3552/7153] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:32:50 2021] DELETE /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:32:50.371432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:50.371924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:50.377934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.378745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.379551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.380492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.405238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:32:50.447007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.compute.api [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Instance is already in deleting state, ignoring this request Dec 18 21:32:50.447811 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c660cc01-e5ce-485f-adf6-854211ee402b tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 204 len: 0 microversion: 2.1 time: 0.080186 Dec 18 21:32:50.448368 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3602/7154] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:32:50 2021] DELETE /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 21:32:50.457199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:50.457943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:50.464451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.464928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.465734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:50.466198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:50.604478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:50.611840 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bb29bf56-5c78-4602-8fbb-faf14854f277 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1512 microversion: 2.1 time: 0.158775 Dec 18 21:32:50.612411 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3553/7155] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:50 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:51.627716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:51.628321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:51.634984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:51.635442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:51.636218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:51.636650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:51.772710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a774440d2524acfaecf6af8cfba1507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fef6da50bfa450ba842674c07090fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:32:51.780391 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72fb16f9-b38d-45dd-b073-f54225723d8d tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 200 len: 1512 microversion: 2.1 time: 0.156363 Dec 18 21:32:51.780971 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3603/7156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:51 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:32:52.220837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1b095496-6732-4504-8f76-3a234d546a49 req-efee0b74-e8f0-4931-9d45-fdfaffdab47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965a7ab-e6e3-4df1-aa97-948d03ab7c3b", "name": "network-vif-deleted", "tag": "088a2c72-a7f6-40fe-8587-35574fd17f26"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:52.222444 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:32:52.222444 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:32:52.229973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1b095496-6732-4504-8f76-3a234d546a49 req-efee0b74-e8f0-4931-9d45-fdfaffdab47f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:52.230468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1b095496-6732-4504-8f76-3a234d546a49 req-efee0b74-e8f0-4931-9d45-fdfaffdab47f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:52.242627 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1b095496-6732-4504-8f76-3a234d546a49 req-efee0b74-e8f0-4931-9d45-fdfaffdab47f service nova] Creating event network-vif-deleted:088a2c72-a7f6-40fe-8587-35574fd17f26 for instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b on nch1-master-1 Dec 18 21:32:52.247830 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1b095496-6732-4504-8f76-3a234d546a49 req-efee0b74-e8f0-4931-9d45-fdfaffdab47f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031065 Dec 18 21:32:52.248532 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3554/7157] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:32:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:32:52.798898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:52.799492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: f965a7ab-e6e3-4df1-aa97-948d03ab7c3b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:52.806829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:52.807282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:52.808068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:52.808508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:52.821390 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] HTTP exception thrown: Instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b could not be found. Dec 18 21:32:52.821970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Returning 404 to user: Instance f965a7ab-e6e3-4df1-aa97-948d03ab7c3b could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:32:52.822812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e056ddb4-067f-47af-a43f-e15aafb5b9d8 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b" status: 404 len: 111 microversion: 2.1 time: 0.028525 Dec 18 21:32:52.823343 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3604/7158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:52 2021] GET /compute/v2.1/servers/f965a7ab-e6e3-4df1-aa97-948d03ab7c3b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:32:52.831999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:52.832593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:52.838737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:52.839205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:52.839997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:52.840476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:52.853699 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] HTTP exception thrown: Instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 could not be found. Dec 18 21:32:52.854387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Returning 404 to user: Instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:32:52.855220 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b03dbd3-f231-4f80-8d5e-e864d12f6247 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 404 len: 111 microversion: 2.1 time: 0.027303 Dec 18 21:32:52.855737 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3555/7159] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:32:52 2021] DELETE /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:32:52.863381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:32:52.864013 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] [instance: 58cc2cfe-f84a-4687-83a2-a1e49526c279] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:32:52.870690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:52.871143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:52.871914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:32:52.872352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:32:52.898110 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] HTTP exception thrown: Instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 could not be found. Dec 18 21:32:52.899149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] Returning 404 to user: Instance 58cc2cfe-f84a-4687-83a2-a1e49526c279 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:32:52.900094 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-372330c9-5364-416c-9c3b-0aaa8d3b7483 tempest-ServerDiskConfigTestJSON-1917752987 tempest-ServerDiskConfigTestJSON-1917752987-project] 10.222.0.13 "GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279" status: 404 len: 111 microversion: 2.1 time: 0.040241 Dec 18 21:32:52.900644 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3605/7160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:32:52 2021] GET /compute/v2.1/servers/58cc2cfe-f84a-4687-83a2-a1e49526c279 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:32:58.605292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-43d9db34-599f-4901-82d8-1bd435a385f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'create', calling method: .version_select at 0x7f714fd82e50>, body: {"keypair": {"name": "tempest-keypair-1744532994"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:32:58.619571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43d9db34-599f-4901-82d8-1bd435a385f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:32:58.625506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43d9db34-599f-4901-82d8-1bd435a385f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:32:58.758071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43d9db34-599f-4901-82d8-1bd435a385f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:32:58.762312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-43d9db34-599f-4901-82d8-1bd435a385f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:32:58.784885 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-43d9db34-599f-4901-82d8-1bd435a385f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.294022 Dec 18 21:32:58.785544 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3556/7161] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:32:58 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:00.351962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-19550839", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d5d526c-ff3b-4870-a375-d43b4ba66efb"}], "security_groups": [{"name": "tempest-securitygroup--784507149"}], "key_name": "tempest-keypair-1744532994", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:00.455383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] validate_networks() for [('0d5d526c-ff3b-4870-a375-d43b4ba66efb', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:33:00.838691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:33:00.839121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:33:00.839595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:33:00.840028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:33:00.840447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:33:00.849179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:00.850233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:00.851087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:00.851524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:00.869005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:33:00.874026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:33:00.886589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:33:00.888966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:33:00.936283 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [0e6a3d8c-bec6-4f3d-88c2-121f370c116c] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:33:01.956508 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [0e6a3d8c-bec6-4f3d-88c2-121f370c116c] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44446. Dec 18 21:33:01.972410 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df343f83-a0d6-47d0-aaa2-0b836bc2c66f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.616084 Dec 18 21:33:01.973289 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3606/7162] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:33:00 2021] POST /compute/v2.1/servers => generated 408 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 21:33:01.991941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a0cb77b-a735-47ab-b4d4-28d4939612ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:01.993342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0a0cb77b-a735-47ab-b4d4-28d4939612ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:02.056800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a0cb77b-a735-47ab-b4d4-28d4939612ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:02.064176 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a0cb77b-a735-47ab-b4d4-28d4939612ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1237 microversion: 2.1 time: 0.084208 Dec 18 21:33:02.064941 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3557/7163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:01 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:03.082206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:03.083758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:03.093414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:03.094213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:03.095491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:03.096185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:03.163321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:03.170973 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a750be25-9b4b-4ebf-8aa0-7c922ff1ac97 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1295 microversion: 2.1 time: 0.093436 Dec 18 21:33:03.171574 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3607/7164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:03 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:04.188415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:04.189392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:04.199102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:04.199580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:04.200399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:04.201112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:04.333168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1a080c7b-a360-4711-9bcf-45b39cee6392 req-dfa19e72-9c0e-4b02-a0fa-719ff5f68068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6d28b1-a536-490d-91f9-aedfd7bc4ba7", "tag": "12e24094-1435-477a-82aa-fb6329af98bf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:04.334852 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:33:04.334852 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:33:04.344205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1a080c7b-a360-4711-9bcf-45b39cee6392 req-dfa19e72-9c0e-4b02-a0fa-719ff5f68068 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:04.344580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1a080c7b-a360-4711-9bcf-45b39cee6392 req-dfa19e72-9c0e-4b02-a0fa-719ff5f68068 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:04.364219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:04.369776 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1a080c7b-a360-4711-9bcf-45b39cee6392 req-dfa19e72-9c0e-4b02-a0fa-719ff5f68068 service nova] Creating event network-changed:12e24094-1435-477a-82aa-fb6329af98bf for instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 on nch1-master-1 Dec 18 21:33:04.375072 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1a080c7b-a360-4711-9bcf-45b39cee6392 req-dfa19e72-9c0e-4b02-a0fa-719ff5f68068 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045467 Dec 18 21:33:04.376290 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3608/7165] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:33:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:33:04.376417 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7be06f8c-b311-44ca-a707-85266a884bad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1362 microversion: 2.1 time: 0.192269 Dec 18 21:33:04.385793 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3558/7166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:04 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:05.394378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:05.395085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:05.401824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:05.402305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:05.403100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:05.403546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:05.531654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:05.539004 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9924caa4-31bf-43be-9a0c-89f61ec7c2f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1362 microversion: 2.1 time: 0.149720 Dec 18 21:33:05.539575 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3609/7167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:05 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:06.555639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:06.556293 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:06.563047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:06.563510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:06.564307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:06.564762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:06.701757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:06.709732 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d7c292a-d755-4b1a-a99e-c6ae461706ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1362 microversion: 2.1 time: 0.157781 Dec 18 21:33:06.710322 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3559/7168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:06 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:07.725983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:07.726615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:07.733452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:07.733904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:07.734713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:07.735150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:07.866761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:07.874039 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-32557139-8a22-44ad-b185-e157b03cbd89 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1362 microversion: 2.1 time: 0.152239 Dec 18 21:33:07.874648 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3610/7169] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:07 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:08.890950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:08.891579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:08.898549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:08.899022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:08.899833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:08.900294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:09.033591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:09.044557 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-626916d7-9029-468f-9d57-a40d0348f598 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1362 microversion: 2.1 time: 0.157020 Dec 18 21:33:09.045397 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3560/7170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:08 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:33:09.517578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ca1d4c80-eabf-4dd3-9f52-2fb9320fbc31 req-f8ff5a68-6750-4d8a-aa34-21d706513fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6d28b1-a536-490d-91f9-aedfd7bc4ba7", "name": "network-vif-plugged", "status": "completed", "tag": "12e24094-1435-477a-82aa-fb6329af98bf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:09.519166 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:33:09.519166 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:33:09.527873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ca1d4c80-eabf-4dd3-9f52-2fb9320fbc31 req-f8ff5a68-6750-4d8a-aa34-21d706513fba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:09.528397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ca1d4c80-eabf-4dd3-9f52-2fb9320fbc31 req-f8ff5a68-6750-4d8a-aa34-21d706513fba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:09.541394 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ca1d4c80-eabf-4dd3-9f52-2fb9320fbc31 req-f8ff5a68-6750-4d8a-aa34-21d706513fba service nova] Creating event network-vif-plugged:12e24094-1435-477a-82aa-fb6329af98bf for instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 on nch1-master-1 Dec 18 21:33:09.546306 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ca1d4c80-eabf-4dd3-9f52-2fb9320fbc31 req-f8ff5a68-6750-4d8a-aa34-21d706513fba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032449 Dec 18 21:33:09.546917 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3611/7171] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:33:10.062364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:10.062998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:10.070351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:10.070823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:10.071621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:10.072079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:10.201441 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:10.209711 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-21b58796-6d41-4307-87cf-4b6e468c5921 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1362 microversion: 2.1 time: 0.150466 Dec 18 21:33:10.210312 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3561/7172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:10 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:11.227287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:11.227960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:11.234130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:11.234614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:11.235401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:11.235840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:11.370141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:33:11.377811 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fd6456a0-d69f-46e0-b836-3754de60d433 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1548 microversion: 2.1 time: 0.155658 Dec 18 21:33:11.378422 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3612/7173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:33:11 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:11.393679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35f86fbe-99c6-4383-a251-4816cc6df234 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:33:11.394194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35f86fbe-99c6-4383-a251-4816cc6df234 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:11.400982 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f86fbe-99c6-4383-a251-4816cc6df234 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:11.401455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f86fbe-99c6-4383-a251-4816cc6df234 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:11.402268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f86fbe-99c6-4383-a251-4816cc6df234 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:11.402741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35f86fbe-99c6-4383-a251-4816cc6df234 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:11.481044 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35f86fbe-99c6-4383-a251-4816cc6df234 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091114 Dec 18 21:33:11.481649 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3562/7174] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:33:11 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:33:12.425722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-95076aec-6742-403d-b247-12cc46dedab2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:12.426714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-95076aec-6742-403d-b247-12cc46dedab2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:12.428569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-cd945132-48c9-4077-b803-7b9fc530898a req-2ab73d6a-971a-4a01-a940-f89e4a456193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6d28b1-a536-490d-91f9-aedfd7bc4ba7", "tag": "12e24094-1435-477a-82aa-fb6329af98bf"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:12.430313 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:33:12.430313 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:33:12.433627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95076aec-6742-403d-b247-12cc46dedab2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:12.434086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95076aec-6742-403d-b247-12cc46dedab2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:12.435155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95076aec-6742-403d-b247-12cc46dedab2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:12.435677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-95076aec-6742-403d-b247-12cc46dedab2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:12.437891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cd945132-48c9-4077-b803-7b9fc530898a req-2ab73d6a-971a-4a01-a940-f89e4a456193 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:12.438601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-cd945132-48c9-4077-b803-7b9fc530898a req-2ab73d6a-971a-4a01-a940-f89e4a456193 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:12.451377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-cd945132-48c9-4077-b803-7b9fc530898a req-2ab73d6a-971a-4a01-a940-f89e4a456193 service nova] Creating event network-changed:12e24094-1435-477a-82aa-fb6329af98bf for instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 on nch1-master-1 Dec 18 21:33:12.457023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-cd945132-48c9-4077-b803-7b9fc530898a req-2ab73d6a-971a-4a01-a940-f89e4a456193 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033002 Dec 18 21:33:12.457869 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3563/7175] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:33:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:33:12.481306 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-95076aec-6742-403d-b247-12cc46dedab2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.059525 Dec 18 21:33:12.482045 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3613/7176] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:12 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:13.493710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8303f604-2d15-4640-9a90-2577db43f0db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:13.494933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8303f604-2d15-4640-9a90-2577db43f0db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:13.501430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8303f604-2d15-4640-9a90-2577db43f0db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:13.501904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8303f604-2d15-4640-9a90-2577db43f0db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:13.502767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8303f604-2d15-4640-9a90-2577db43f0db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:13.503228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8303f604-2d15-4640-9a90-2577db43f0db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:13.541967 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8303f604-2d15-4640-9a90-2577db43f0db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.053108 Dec 18 21:33:13.542652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3564/7177] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:13 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:14.553880 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9411f27-c0c1-41d7-95b5-8eaf4c8acae5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:14.554942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9411f27-c0c1-41d7-95b5-8eaf4c8acae5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:14.562264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9411f27-c0c1-41d7-95b5-8eaf4c8acae5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:14.562717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9411f27-c0c1-41d7-95b5-8eaf4c8acae5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:14.563490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9411f27-c0c1-41d7-95b5-8eaf4c8acae5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:14.563927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9411f27-c0c1-41d7-95b5-8eaf4c8acae5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:14.601249 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9411f27-c0c1-41d7-95b5-8eaf4c8acae5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.051954 Dec 18 21:33:14.601882 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3614/7178] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:14 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:15.612537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5d5328f6-7b33-43b9-81f2-d1ff824f421f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:15.613562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5d5328f6-7b33-43b9-81f2-d1ff824f421f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:15.621564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d5328f6-7b33-43b9-81f2-d1ff824f421f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:15.622037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d5328f6-7b33-43b9-81f2-d1ff824f421f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:15.622886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d5328f6-7b33-43b9-81f2-d1ff824f421f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:15.623348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5d5328f6-7b33-43b9-81f2-d1ff824f421f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:15.664377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5d5328f6-7b33-43b9-81f2-d1ff824f421f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.055845 Dec 18 21:33:15.665144 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3565/7179] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:15 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:16.675820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-11a20b6e-a756-479a-b203-0c62a74da691 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:16.676821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-11a20b6e-a756-479a-b203-0c62a74da691 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:16.684053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11a20b6e-a756-479a-b203-0c62a74da691 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:16.684498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11a20b6e-a756-479a-b203-0c62a74da691 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:16.685276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11a20b6e-a756-479a-b203-0c62a74da691 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:16.685718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-11a20b6e-a756-479a-b203-0c62a74da691 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:16.724363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-11a20b6e-a756-479a-b203-0c62a74da691 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.052492 Dec 18 21:33:16.724979 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3615/7180] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:16 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:17.735703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c9679e8-34a6-4f46-b5bd-eeb8204d4541 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:17.736725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8c9679e8-34a6-4f46-b5bd-eeb8204d4541 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:17.744701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c9679e8-34a6-4f46-b5bd-eeb8204d4541 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:17.745171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c9679e8-34a6-4f46-b5bd-eeb8204d4541 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:17.745980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c9679e8-34a6-4f46-b5bd-eeb8204d4541 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:17.746473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c9679e8-34a6-4f46-b5bd-eeb8204d4541 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:17.782926 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8c9679e8-34a6-4f46-b5bd-eeb8204d4541 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.051219 Dec 18 21:33:17.786426 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3566/7181] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:17 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:18.467482 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:33:18.467942 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:33:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:33:18.794607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50ae308a-77ad-4639-9e35-7c62d8aeb460 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:18.795609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50ae308a-77ad-4639-9e35-7c62d8aeb460 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:18.803413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50ae308a-77ad-4639-9e35-7c62d8aeb460 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:18.803864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50ae308a-77ad-4639-9e35-7c62d8aeb460 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:18.804643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50ae308a-77ad-4639-9e35-7c62d8aeb460 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:18.805082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50ae308a-77ad-4639-9e35-7c62d8aeb460 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:18.841968 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50ae308a-77ad-4639-9e35-7c62d8aeb460 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.051359 Dec 18 21:33:18.842624 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3616/7182] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:18 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:19.852968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-732501e2-cf6c-4f66-ab9b-b78bccf902fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:19.853986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-732501e2-cf6c-4f66-ab9b-b78bccf902fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:19.861347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-732501e2-cf6c-4f66-ab9b-b78bccf902fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:19.861816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-732501e2-cf6c-4f66-ab9b-b78bccf902fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:19.862659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-732501e2-cf6c-4f66-ab9b-b78bccf902fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:19.863112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-732501e2-cf6c-4f66-ab9b-b78bccf902fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:19.900163 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-732501e2-cf6c-4f66-ab9b-b78bccf902fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.051228 Dec 18 21:33:19.900929 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3567/7183] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:19 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:20.910955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8fe3d4c5-c0ff-4cc1-8ad6-1696865dddb5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:20.912572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8fe3d4c5-c0ff-4cc1-8ad6-1696865dddb5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:20.920391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4c5-c0ff-4cc1-8ad6-1696865dddb5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:20.920983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4c5-c0ff-4cc1-8ad6-1696865dddb5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:20.921815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4c5-c0ff-4cc1-8ad6-1696865dddb5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:20.922468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4c5-c0ff-4cc1-8ad6-1696865dddb5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:20.959881 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8fe3d4c5-c0ff-4cc1-8ad6-1696865dddb5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.052873 Dec 18 21:33:20.960654 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3617/7184] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:20 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:21.971639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97ff42ac-adda-49dd-af5b-1ae9575f8378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:21.972549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97ff42ac-adda-49dd-af5b-1ae9575f8378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:21.980360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97ff42ac-adda-49dd-af5b-1ae9575f8378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:21.980819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97ff42ac-adda-49dd-af5b-1ae9575f8378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:21.981625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97ff42ac-adda-49dd-af5b-1ae9575f8378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:21.982075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97ff42ac-adda-49dd-af5b-1ae9575f8378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:22.022978 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97ff42ac-adda-49dd-af5b-1ae9575f8378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.055380 Dec 18 21:33:22.023607 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3568/7185] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:21 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:33:23.033936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62b73962-a49d-47c1-b05c-73d6a41066d9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:23.034969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62b73962-a49d-47c1-b05c-73d6a41066d9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:23.041988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62b73962-a49d-47c1-b05c-73d6a41066d9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:23.042466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62b73962-a49d-47c1-b05c-73d6a41066d9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:23.043242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62b73962-a49d-47c1-b05c-73d6a41066d9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:23.043684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62b73962-a49d-47c1-b05c-73d6a41066d9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:23.087618 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62b73962-a49d-47c1-b05c-73d6a41066d9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 14 microversion: 2.1 time: 0.057785 Dec 18 21:33:23.090670 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3618/7186] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:23 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:33:24.099076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fca4dba6-974c-4d5e-9ec3-1e39bb67d6d6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:24.100743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fca4dba6-974c-4d5e-9ec3-1e39bb67d6d6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:24.107753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca4dba6-974c-4d5e-9ec3-1e39bb67d6d6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:24.108223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca4dba6-974c-4d5e-9ec3-1e39bb67d6d6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:24.109104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca4dba6-974c-4d5e-9ec3-1e39bb67d6d6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:24.109485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fca4dba6-974c-4d5e-9ec3-1e39bb67d6d6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:24.159876 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fca4dba6-974c-4d5e-9ec3-1e39bb67d6d6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 8205 microversion: 2.1 time: 0.064971 Dec 18 21:33:24.160491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3569/7187] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:24 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 8205 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:33:25.171445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ee57574f-7a56-4dad-aa67-9cac4662d248 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:25.172467 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ee57574f-7a56-4dad-aa67-9cac4662d248 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:25.180737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee57574f-7a56-4dad-aa67-9cac4662d248 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:25.181205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee57574f-7a56-4dad-aa67-9cac4662d248 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:25.181998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee57574f-7a56-4dad-aa67-9cac4662d248 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:25.182477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee57574f-7a56-4dad-aa67-9cac4662d248 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:25.233858 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ee57574f-7a56-4dad-aa67-9cac4662d248 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 16397 microversion: 2.1 time: 0.066377 Dec 18 21:33:25.234525 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3619/7188] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:25 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 16397 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:26.245763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c1daaad6-32d6-4842-bcc8-b61cc1c85951 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:26.246811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c1daaad6-32d6-4842-bcc8-b61cc1c85951 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:26.254194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1daaad6-32d6-4842-bcc8-b61cc1c85951 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:26.254688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1daaad6-32d6-4842-bcc8-b61cc1c85951 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:26.256080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1daaad6-32d6-4842-bcc8-b61cc1c85951 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:26.256539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1daaad6-32d6-4842-bcc8-b61cc1c85951 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:26.298462 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c1daaad6-32d6-4842-bcc8-b61cc1c85951 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 16397 microversion: 2.1 time: 0.056703 Dec 18 21:33:26.299083 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3570/7189] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:26 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 16397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:27.309917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4c590435-68e2-4c44-bc2c-b7f3ad1133f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:27.310960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4c590435-68e2-4c44-bc2c-b7f3ad1133f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:27.318809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c590435-68e2-4c44-bc2c-b7f3ad1133f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:27.319266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c590435-68e2-4c44-bc2c-b7f3ad1133f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:27.320046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c590435-68e2-4c44-bc2c-b7f3ad1133f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:27.320488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4c590435-68e2-4c44-bc2c-b7f3ad1133f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:27.359363 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4c590435-68e2-4c44-bc2c-b7f3ad1133f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 16397 microversion: 2.1 time: 0.053407 Dec 18 21:33:27.359978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3620/7190] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:27 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 16397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:33:28.371190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-019bc834-0fd4-496c-be7f-559f732e0b65 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:28.372209 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-019bc834-0fd4-496c-be7f-559f732e0b65 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:28.379578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019bc834-0fd4-496c-be7f-559f732e0b65 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:28.380044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019bc834-0fd4-496c-be7f-559f732e0b65 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:28.380836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019bc834-0fd4-496c-be7f-559f732e0b65 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:28.381291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-019bc834-0fd4-496c-be7f-559f732e0b65 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:28.427833 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-019bc834-0fd4-496c-be7f-559f732e0b65 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 16397 microversion: 2.1 time: 0.060679 Dec 18 21:33:28.428468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3571/7191] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:28 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 16397 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:29.439584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8da2c3aa-1726-4be5-9b85-b99272468b58 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:29.440596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8da2c3aa-1726-4be5-9b85-b99272468b58 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:29.447959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8da2c3aa-1726-4be5-9b85-b99272468b58 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:29.448413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8da2c3aa-1726-4be5-9b85-b99272468b58 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:29.449204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8da2c3aa-1726-4be5-9b85-b99272468b58 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:29.449643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8da2c3aa-1726-4be5-9b85-b99272468b58 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:29.488693 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8da2c3aa-1726-4be5-9b85-b99272468b58 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 16397 microversion: 2.1 time: 0.053131 Dec 18 21:33:29.489571 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3621/7192] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:29 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 16397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:30.500983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8afa0041-e831-4e98-8343-cb778781d144 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:30.502026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8afa0041-e831-4e98-8343-cb778781d144 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:30.509901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8afa0041-e831-4e98-8343-cb778781d144 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:30.510400 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8afa0041-e831-4e98-8343-cb778781d144 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:30.511204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8afa0041-e831-4e98-8343-cb778781d144 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:30.511660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8afa0041-e831-4e98-8343-cb778781d144 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:30.563073 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8afa0041-e831-4e98-8343-cb778781d144 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.066005 Dec 18 21:33:30.563935 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3572/7193] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:30 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:31.575061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ce9cc842-7960-4359-883e-d766b2066a7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:31.575981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ce9cc842-7960-4359-883e-d766b2066a7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:31.583988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce9cc842-7960-4359-883e-d766b2066a7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:31.584438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce9cc842-7960-4359-883e-d766b2066a7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:31.585214 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce9cc842-7960-4359-883e-d766b2066a7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:31.585649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce9cc842-7960-4359-883e-d766b2066a7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:31.631828 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ce9cc842-7960-4359-883e-d766b2066a7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.060846 Dec 18 21:33:31.632712 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3622/7194] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:31 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:32.643821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8da8e4d1-4e5c-4d88-891e-09decec6cf85 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:32.644878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8da8e4d1-4e5c-4d88-891e-09decec6cf85 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:32.652316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8da8e4d1-4e5c-4d88-891e-09decec6cf85 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:32.652795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8da8e4d1-4e5c-4d88-891e-09decec6cf85 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:32.653606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8da8e4d1-4e5c-4d88-891e-09decec6cf85 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:32.654069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8da8e4d1-4e5c-4d88-891e-09decec6cf85 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:32.695411 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8da8e4d1-4e5c-4d88-891e-09decec6cf85 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.055507 Dec 18 21:33:32.696122 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3573/7195] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:32 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:33.707873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec436b3c-a90c-4ce2-92db-006f9c959795 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:33.708881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec436b3c-a90c-4ce2-92db-006f9c959795 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:33.716308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec436b3c-a90c-4ce2-92db-006f9c959795 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:33.716763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec436b3c-a90c-4ce2-92db-006f9c959795 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:33.717562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec436b3c-a90c-4ce2-92db-006f9c959795 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:33.718003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec436b3c-a90c-4ce2-92db-006f9c959795 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:33.759867 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec436b3c-a90c-4ce2-92db-006f9c959795 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.056059 Dec 18 21:33:33.760522 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3623/7196] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:33 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:33:34.772473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7f0ff4ca-f51a-428f-8df0-09fd20a443a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:34.773503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7f0ff4ca-f51a-428f-8df0-09fd20a443a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:34.780898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f0ff4ca-f51a-428f-8df0-09fd20a443a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:34.781369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f0ff4ca-f51a-428f-8df0-09fd20a443a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:34.782175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f0ff4ca-f51a-428f-8df0-09fd20a443a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:34.782671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f0ff4ca-f51a-428f-8df0-09fd20a443a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:34.821236 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7f0ff4ca-f51a-428f-8df0-09fd20a443a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.053478 Dec 18 21:33:34.821867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3574/7197] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:34 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:35.832708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49a83542-e944-4bbf-bca6-1e84b10de1ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:35.833705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-49a83542-e944-4bbf-bca6-1e84b10de1ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:35.840973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49a83542-e944-4bbf-bca6-1e84b10de1ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:35.841419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49a83542-e944-4bbf-bca6-1e84b10de1ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:35.842197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49a83542-e944-4bbf-bca6-1e84b10de1ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:35.842658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49a83542-e944-4bbf-bca6-1e84b10de1ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:35.882427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49a83542-e944-4bbf-bca6-1e84b10de1ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.053721 Dec 18 21:33:35.883054 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3624/7198] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:35 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:36.894167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-780fc2a6-6f25-40ee-b691-e6e7ee749cf2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:36.895204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-780fc2a6-6f25-40ee-b691-e6e7ee749cf2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:36.902538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780fc2a6-6f25-40ee-b691-e6e7ee749cf2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:36.903001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780fc2a6-6f25-40ee-b691-e6e7ee749cf2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:36.903817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780fc2a6-6f25-40ee-b691-e6e7ee749cf2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:36.904269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-780fc2a6-6f25-40ee-b691-e6e7ee749cf2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:36.949696 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-780fc2a6-6f25-40ee-b691-e6e7ee749cf2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.055902 Dec 18 21:33:36.951551 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3575/7199] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:36 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:37.962025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3318f830-e0c9-48be-af5b-8e676c48dc48 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:37.963648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3318f830-e0c9-48be-af5b-8e676c48dc48 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:37.971050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3318f830-e0c9-48be-af5b-8e676c48dc48 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:37.971444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3318f830-e0c9-48be-af5b-8e676c48dc48 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:37.972231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3318f830-e0c9-48be-af5b-8e676c48dc48 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:37.972695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3318f830-e0c9-48be-af5b-8e676c48dc48 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:38.013378 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3318f830-e0c9-48be-af5b-8e676c48dc48 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.055428 Dec 18 21:33:38.014018 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3625/7200] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:37 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:39.025913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-987fadbc-2e3e-4efe-8a2e-bb1d2ad1b995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:39.026885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-987fadbc-2e3e-4efe-8a2e-bb1d2ad1b995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:39.034106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-987fadbc-2e3e-4efe-8a2e-bb1d2ad1b995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:39.034591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-987fadbc-2e3e-4efe-8a2e-bb1d2ad1b995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:39.035384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-987fadbc-2e3e-4efe-8a2e-bb1d2ad1b995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:39.035834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-987fadbc-2e3e-4efe-8a2e-bb1d2ad1b995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:39.074714 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-987fadbc-2e3e-4efe-8a2e-bb1d2ad1b995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.053313 Dec 18 21:33:39.075324 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3576/7201] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:39 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:40.086973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5646c35-4fe7-4a23-9647-30c644518797 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:40.087914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5646c35-4fe7-4a23-9647-30c644518797 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:40.095223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5646c35-4fe7-4a23-9647-30c644518797 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:40.095710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5646c35-4fe7-4a23-9647-30c644518797 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:40.096495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5646c35-4fe7-4a23-9647-30c644518797 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:40.096935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5646c35-4fe7-4a23-9647-30c644518797 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:40.139194 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5646c35-4fe7-4a23-9647-30c644518797 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.056393 Dec 18 21:33:40.139814 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3626/7202] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:40 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:41.151097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3a096ca-4f88-4096-9aa5-eb3701583e47 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:41.152104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3a096ca-4f88-4096-9aa5-eb3701583e47 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:41.159393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3a096ca-4f88-4096-9aa5-eb3701583e47 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:41.159857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3a096ca-4f88-4096-9aa5-eb3701583e47 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:41.160648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3a096ca-4f88-4096-9aa5-eb3701583e47 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:41.161101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3a096ca-4f88-4096-9aa5-eb3701583e47 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:41.202917 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3a096ca-4f88-4096-9aa5-eb3701583e47 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.055791 Dec 18 21:33:41.203559 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3577/7203] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:41 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:42.215821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ab1fcb5f-1dff-40c1-89f9-a69b5cd1d552 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:42.216832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ab1fcb5f-1dff-40c1-89f9-a69b5cd1d552 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:42.224139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1fcb5f-1dff-40c1-89f9-a69b5cd1d552 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:42.224593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1fcb5f-1dff-40c1-89f9-a69b5cd1d552 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:42.225376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1fcb5f-1dff-40c1-89f9-a69b5cd1d552 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:42.225818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ab1fcb5f-1dff-40c1-89f9-a69b5cd1d552 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:42.267814 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ab1fcb5f-1dff-40c1-89f9-a69b5cd1d552 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.055939 Dec 18 21:33:42.268664 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3627/7204] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:42 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:43.280210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c1a42c8f-a329-40d5-aa8c-74adc24eeeb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:43.281218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c1a42c8f-a329-40d5-aa8c-74adc24eeeb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:43.288721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1a42c8f-a329-40d5-aa8c-74adc24eeeb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:43.289223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1a42c8f-a329-40d5-aa8c-74adc24eeeb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:43.290059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1a42c8f-a329-40d5-aa8c-74adc24eeeb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:43.290543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1a42c8f-a329-40d5-aa8c-74adc24eeeb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:43.330534 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c1a42c8f-a329-40d5-aa8c-74adc24eeeb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 24564 microversion: 2.1 time: 0.054548 Dec 18 21:33:43.331201 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3578/7205] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:43 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 24564 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:33:44.343003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85dc80c5-e43e-4117-9fc3-f7f16e05f03b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:44.344023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-85dc80c5-e43e-4117-9fc3-f7f16e05f03b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:44.351485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85dc80c5-e43e-4117-9fc3-f7f16e05f03b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:44.351943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85dc80c5-e43e-4117-9fc3-f7f16e05f03b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:44.352734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85dc80c5-e43e-4117-9fc3-f7f16e05f03b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:44.353185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85dc80c5-e43e-4117-9fc3-f7f16e05f03b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:44.393303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85dc80c5-e43e-4117-9fc3-f7f16e05f03b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.054318 Dec 18 21:33:44.393962 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3628/7206] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:44 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:45.405562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b1ca1189-4e9d-4eb0-ada2-c10f22ca0ba3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:45.406601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b1ca1189-4e9d-4eb0-ada2-c10f22ca0ba3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:45.414450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ca1189-4e9d-4eb0-ada2-c10f22ca0ba3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:45.414913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ca1189-4e9d-4eb0-ada2-c10f22ca0ba3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:45.415707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ca1189-4e9d-4eb0-ada2-c10f22ca0ba3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:45.416156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b1ca1189-4e9d-4eb0-ada2-c10f22ca0ba3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:45.475217 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b1ca1189-4e9d-4eb0-ada2-c10f22ca0ba3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.073510 Dec 18 21:33:45.475784 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3579/7207] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:45 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:46.487768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c1d5621-1364-44fa-8e34-a14cfa0d20bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:46.488771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c1d5621-1364-44fa-8e34-a14cfa0d20bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:46.496605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c1d5621-1364-44fa-8e34-a14cfa0d20bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:46.497059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c1d5621-1364-44fa-8e34-a14cfa0d20bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:46.497843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c1d5621-1364-44fa-8e34-a14cfa0d20bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:46.498301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c1d5621-1364-44fa-8e34-a14cfa0d20bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:46.541015 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c1d5621-1364-44fa-8e34-a14cfa0d20bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.057211 Dec 18 21:33:46.541653 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3629/7208] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:46 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:47.555107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5ce47330-855f-4466-8e29-71417c64c509 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:47.555720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5ce47330-855f-4466-8e29-71417c64c509 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:47.563902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ce47330-855f-4466-8e29-71417c64c509 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:47.564563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ce47330-855f-4466-8e29-71417c64c509 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:47.565371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ce47330-855f-4466-8e29-71417c64c509 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:47.565820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5ce47330-855f-4466-8e29-71417c64c509 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:47.607027 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5ce47330-855f-4466-8e29-71417c64c509 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.057763 Dec 18 21:33:47.607860 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3580/7209] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:47 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:48.619268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d872043-29e2-4339-ab76-7b2e23a25acf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:48.620296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2d872043-29e2-4339-ab76-7b2e23a25acf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:48.627596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d872043-29e2-4339-ab76-7b2e23a25acf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:48.628056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d872043-29e2-4339-ab76-7b2e23a25acf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:48.628841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d872043-29e2-4339-ab76-7b2e23a25acf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:48.629286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d872043-29e2-4339-ab76-7b2e23a25acf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:48.669074 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d872043-29e2-4339-ab76-7b2e23a25acf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.053846 Dec 18 21:33:48.669700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3630/7210] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:48 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:49.681963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-826eedef-697e-4479-992f-b4d3f956ce29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:49.683005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-826eedef-697e-4479-992f-b4d3f956ce29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:49.690242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-826eedef-697e-4479-992f-b4d3f956ce29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:49.690733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-826eedef-697e-4479-992f-b4d3f956ce29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:49.691533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-826eedef-697e-4479-992f-b4d3f956ce29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:49.691983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-826eedef-697e-4479-992f-b4d3f956ce29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:49.733488 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-826eedef-697e-4479-992f-b4d3f956ce29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.056267 Dec 18 21:33:49.734414 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3581/7211] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:49 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:50.746594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4d7458a5-2120-48eb-937b-41a5d1b65ea2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:50.747591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4d7458a5-2120-48eb-937b-41a5d1b65ea2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:50.755411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d7458a5-2120-48eb-937b-41a5d1b65ea2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:50.755858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d7458a5-2120-48eb-937b-41a5d1b65ea2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:50.756631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d7458a5-2120-48eb-937b-41a5d1b65ea2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:50.757064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4d7458a5-2120-48eb-937b-41a5d1b65ea2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:50.805938 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4d7458a5-2120-48eb-937b-41a5d1b65ea2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.063830 Dec 18 21:33:50.806645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3631/7212] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:50 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:51.818147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b8d4bdd2-bd83-4dc8-b948-0018243cdac5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:51.819181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b8d4bdd2-bd83-4dc8-b948-0018243cdac5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:51.827515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8d4bdd2-bd83-4dc8-b948-0018243cdac5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:51.827980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8d4bdd2-bd83-4dc8-b948-0018243cdac5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:51.828772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8d4bdd2-bd83-4dc8-b948-0018243cdac5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:51.829223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8d4bdd2-bd83-4dc8-b948-0018243cdac5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:51.877944 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b8d4bdd2-bd83-4dc8-b948-0018243cdac5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.063738 Dec 18 21:33:51.878636 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3582/7213] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:51 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:52.891621 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3d48448c-13eb-4fb6-b114-aed06bf26b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:52.893358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3d48448c-13eb-4fb6-b114-aed06bf26b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:52.903489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d48448c-13eb-4fb6-b114-aed06bf26b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:52.904132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d48448c-13eb-4fb6-b114-aed06bf26b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:52.905462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d48448c-13eb-4fb6-b114-aed06bf26b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:52.906197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3d48448c-13eb-4fb6-b114-aed06bf26b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:52.956240 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3d48448c-13eb-4fb6-b114-aed06bf26b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.069921 Dec 18 21:33:52.956884 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3632/7214] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:52 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:53.968720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ac8b3c0-87c4-44f2-947c-07765d0b55de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:53.969659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2ac8b3c0-87c4-44f2-947c-07765d0b55de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:53.976874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ac8b3c0-87c4-44f2-947c-07765d0b55de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:53.977350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ac8b3c0-87c4-44f2-947c-07765d0b55de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:53.978159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ac8b3c0-87c4-44f2-947c-07765d0b55de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:53.978645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ac8b3c0-87c4-44f2-947c-07765d0b55de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:54.028456 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ac8b3c0-87c4-44f2-947c-07765d0b55de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.063911 Dec 18 21:33:54.029095 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3583/7215] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:53 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:55.040704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ec9c797a-2ac3-42a9-a3c9-3929c2bff069 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:55.041618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ec9c797a-2ac3-42a9-a3c9-3929c2bff069 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:55.048833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec9c797a-2ac3-42a9-a3c9-3929c2bff069 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:55.049284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec9c797a-2ac3-42a9-a3c9-3929c2bff069 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:55.050061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec9c797a-2ac3-42a9-a3c9-3929c2bff069 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:55.050528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ec9c797a-2ac3-42a9-a3c9-3929c2bff069 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:55.095153 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ec9c797a-2ac3-42a9-a3c9-3929c2bff069 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058436 Dec 18 21:33:55.095776 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3633/7216] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:55 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:56.107951 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a751aef9-2776-4574-892e-5c4a015e9a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:56.108971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a751aef9-2776-4574-892e-5c4a015e9a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:56.116298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a751aef9-2776-4574-892e-5c4a015e9a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:56.116818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a751aef9-2776-4574-892e-5c4a015e9a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:56.117616 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a751aef9-2776-4574-892e-5c4a015e9a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:56.118070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a751aef9-2776-4574-892e-5c4a015e9a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:56.166242 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a751aef9-2776-4574-892e-5c4a015e9a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.062283 Dec 18 21:33:56.166916 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3584/7217] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:56 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:57.178551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d7eeb7fa-288b-45f6-968c-dafa0148c77f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:57.179583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d7eeb7fa-288b-45f6-968c-dafa0148c77f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:57.186844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7eeb7fa-288b-45f6-968c-dafa0148c77f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:57.187293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7eeb7fa-288b-45f6-968c-dafa0148c77f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:57.188144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7eeb7fa-288b-45f6-968c-dafa0148c77f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:57.188587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7eeb7fa-288b-45f6-968c-dafa0148c77f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:57.236269 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d7eeb7fa-288b-45f6-968c-dafa0148c77f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.061444 Dec 18 21:33:57.237017 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3634/7218] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:57 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:58.248574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-15463c0d-3490-4842-939a-594d4450753e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:58.249594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-15463c0d-3490-4842-939a-594d4450753e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:58.256844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15463c0d-3490-4842-939a-594d4450753e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:58.257329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15463c0d-3490-4842-939a-594d4450753e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:58.258121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15463c0d-3490-4842-939a-594d4450753e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:58.258599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-15463c0d-3490-4842-939a-594d4450753e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:58.302964 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-15463c0d-3490-4842-939a-594d4450753e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058241 Dec 18 21:33:58.303619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3585/7219] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:58 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:33:59.315088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41bdf8bd-0614-4735-bf1f-aaf6c1032b96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:33:59.316102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41bdf8bd-0614-4735-bf1f-aaf6c1032b96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:33:59.323487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bdf8bd-0614-4735-bf1f-aaf6c1032b96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:59.323948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bdf8bd-0614-4735-bf1f-aaf6c1032b96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:59.324739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bdf8bd-0614-4735-bf1f-aaf6c1032b96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:33:59.325186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41bdf8bd-0614-4735-bf1f-aaf6c1032b96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:33:59.372216 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41bdf8bd-0614-4735-bf1f-aaf6c1032b96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.061109 Dec 18 21:33:59.372851 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3635/7220] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:33:59 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:00.384863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2148bde3-195a-47b9-b5ed-c79991702381 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:00.385924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2148bde3-195a-47b9-b5ed-c79991702381 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:00.393301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2148bde3-195a-47b9-b5ed-c79991702381 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:00.393770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2148bde3-195a-47b9-b5ed-c79991702381 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:00.394604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2148bde3-195a-47b9-b5ed-c79991702381 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:00.395061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2148bde3-195a-47b9-b5ed-c79991702381 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:00.438229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2148bde3-195a-47b9-b5ed-c79991702381 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.057889 Dec 18 21:34:00.438906 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3586/7221] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:00 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:01.449716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f8f19c3a-25b1-4e0c-b2ed-ff34d7ddf49a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:01.450750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f8f19c3a-25b1-4e0c-b2ed-ff34d7ddf49a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:01.458275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8f19c3a-25b1-4e0c-b2ed-ff34d7ddf49a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:01.458737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8f19c3a-25b1-4e0c-b2ed-ff34d7ddf49a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:01.459520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8f19c3a-25b1-4e0c-b2ed-ff34d7ddf49a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:01.459968 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f8f19c3a-25b1-4e0c-b2ed-ff34d7ddf49a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:01.509230 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f8f19c3a-25b1-4e0c-b2ed-ff34d7ddf49a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.063456 Dec 18 21:34:01.509871 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3636/7222] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:01 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:02.521535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5403f6f0-1bad-4ed7-b8bb-f30e767484de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:02.522577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5403f6f0-1bad-4ed7-b8bb-f30e767484de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:02.529883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5403f6f0-1bad-4ed7-b8bb-f30e767484de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:02.530378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5403f6f0-1bad-4ed7-b8bb-f30e767484de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:02.531176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5403f6f0-1bad-4ed7-b8bb-f30e767484de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:02.531627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5403f6f0-1bad-4ed7-b8bb-f30e767484de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:02.579305 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5403f6f0-1bad-4ed7-b8bb-f30e767484de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.061697 Dec 18 21:34:02.579973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3587/7223] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:02 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:03.591632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-30e5082d-d3bb-4979-a034-bb1635d9414f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:03.592649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-30e5082d-d3bb-4979-a034-bb1635d9414f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:03.600174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30e5082d-d3bb-4979-a034-bb1635d9414f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:03.600634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30e5082d-d3bb-4979-a034-bb1635d9414f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:03.601420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30e5082d-d3bb-4979-a034-bb1635d9414f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:03.601863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-30e5082d-d3bb-4979-a034-bb1635d9414f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:03.648492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-30e5082d-d3bb-4979-a034-bb1635d9414f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060827 Dec 18 21:34:03.649394 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3637/7224] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:03 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:04.660765 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-55e50a6a-68ac-4215-b1db-cd354d462fcc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:04.661811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-55e50a6a-68ac-4215-b1db-cd354d462fcc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:04.669922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e50a6a-68ac-4215-b1db-cd354d462fcc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:04.670428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e50a6a-68ac-4215-b1db-cd354d462fcc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:04.671224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e50a6a-68ac-4215-b1db-cd354d462fcc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:04.671971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-55e50a6a-68ac-4215-b1db-cd354d462fcc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:04.719395 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-55e50a6a-68ac-4215-b1db-cd354d462fcc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.062595 Dec 18 21:34:04.720068 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3588/7225] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:04 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:05.732041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-10969a8f-5278-4f89-8c1b-40eb2e117a0d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:05.734517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-10969a8f-5278-4f89-8c1b-40eb2e117a0d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:05.742475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10969a8f-5278-4f89-8c1b-40eb2e117a0d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:05.742936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10969a8f-5278-4f89-8c1b-40eb2e117a0d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:05.743765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10969a8f-5278-4f89-8c1b-40eb2e117a0d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:05.744218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-10969a8f-5278-4f89-8c1b-40eb2e117a0d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:05.788928 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-10969a8f-5278-4f89-8c1b-40eb2e117a0d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060852 Dec 18 21:34:05.789625 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3638/7226] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:05 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:06.801545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-758d7b52-326f-4dec-a797-d507b6fa78c5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:06.802569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-758d7b52-326f-4dec-a797-d507b6fa78c5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:06.809961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-758d7b52-326f-4dec-a797-d507b6fa78c5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:06.810459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-758d7b52-326f-4dec-a797-d507b6fa78c5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:06.811263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-758d7b52-326f-4dec-a797-d507b6fa78c5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:06.811715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-758d7b52-326f-4dec-a797-d507b6fa78c5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:06.859589 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-758d7b52-326f-4dec-a797-d507b6fa78c5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.062310 Dec 18 21:34:06.860252 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3589/7227] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:06 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:07.872664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4dc4fd6-eea3-441a-afc4-9d98759fb3f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:07.873684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f4dc4fd6-eea3-441a-afc4-9d98759fb3f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:07.881136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4dc4fd6-eea3-441a-afc4-9d98759fb3f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:07.881595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4dc4fd6-eea3-441a-afc4-9d98759fb3f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:07.882454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4dc4fd6-eea3-441a-afc4-9d98759fb3f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:07.882900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4dc4fd6-eea3-441a-afc4-9d98759fb3f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:07.930016 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4dc4fd6-eea3-441a-afc4-9d98759fb3f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060809 Dec 18 21:34:07.930712 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3639/7228] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:07 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:08.942503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d3016dd1-4805-493a-9855-aa201ea33a67 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:08.943439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d3016dd1-4805-493a-9855-aa201ea33a67 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:08.951434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3016dd1-4805-493a-9855-aa201ea33a67 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:08.952163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3016dd1-4805-493a-9855-aa201ea33a67 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:08.952970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3016dd1-4805-493a-9855-aa201ea33a67 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:08.953425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d3016dd1-4805-493a-9855-aa201ea33a67 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:08.997679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d3016dd1-4805-493a-9855-aa201ea33a67 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059344 Dec 18 21:34:08.998345 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3590/7229] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:08 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:10.009953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b74a4dd-f03d-4e7a-81c5-ad7229f268b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:10.011010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b74a4dd-f03d-4e7a-81c5-ad7229f268b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:10.018146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b74a4dd-f03d-4e7a-81c5-ad7229f268b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:10.018637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b74a4dd-f03d-4e7a-81c5-ad7229f268b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:10.019426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b74a4dd-f03d-4e7a-81c5-ad7229f268b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:10.019865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b74a4dd-f03d-4e7a-81c5-ad7229f268b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:10.064618 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b74a4dd-f03d-4e7a-81c5-ad7229f268b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059117 Dec 18 21:34:10.068510 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3640/7230] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:10 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:11.077175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c08e8d0e-7002-4fe3-9248-36c6d8fd35a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:11.078109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c08e8d0e-7002-4fe3-9248-36c6d8fd35a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:11.085987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08e8d0e-7002-4fe3-9248-36c6d8fd35a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:11.086487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08e8d0e-7002-4fe3-9248-36c6d8fd35a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:11.087286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08e8d0e-7002-4fe3-9248-36c6d8fd35a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:11.087742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c08e8d0e-7002-4fe3-9248-36c6d8fd35a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:11.133460 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c08e8d0e-7002-4fe3-9248-36c6d8fd35a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060648 Dec 18 21:34:11.134092 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3591/7231] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:11 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:12.145311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a163e2ce-1787-478e-b6c4-485424777663 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:12.146374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a163e2ce-1787-478e-b6c4-485424777663 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:12.153628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a163e2ce-1787-478e-b6c4-485424777663 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:12.154083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a163e2ce-1787-478e-b6c4-485424777663 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:12.154901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a163e2ce-1787-478e-b6c4-485424777663 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:12.155343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a163e2ce-1787-478e-b6c4-485424777663 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:12.195556 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a163e2ce-1787-478e-b6c4-485424777663 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.054515 Dec 18 21:34:12.196193 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3641/7232] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:12 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:13.208156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-46ef4758-66f1-4f3b-a7c3-b0c8cc2ad956 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:13.209184 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-46ef4758-66f1-4f3b-a7c3-b0c8cc2ad956 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:13.216533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef4758-66f1-4f3b-a7c3-b0c8cc2ad956 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:13.217006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef4758-66f1-4f3b-a7c3-b0c8cc2ad956 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:13.217812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef4758-66f1-4f3b-a7c3-b0c8cc2ad956 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:13.218303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-46ef4758-66f1-4f3b-a7c3-b0c8cc2ad956 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:13.264210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-46ef4758-66f1-4f3b-a7c3-b0c8cc2ad956 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060009 Dec 18 21:34:13.264868 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3592/7233] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:13 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:14.276990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07ffdf39-4dc7-4c64-aa61-ac2e167709a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:14.278002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07ffdf39-4dc7-4c64-aa61-ac2e167709a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:14.285335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ffdf39-4dc7-4c64-aa61-ac2e167709a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:14.285792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ffdf39-4dc7-4c64-aa61-ac2e167709a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:14.286611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ffdf39-4dc7-4c64-aa61-ac2e167709a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:14.287058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07ffdf39-4dc7-4c64-aa61-ac2e167709a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:14.333611 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07ffdf39-4dc7-4c64-aa61-ac2e167709a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.061203 Dec 18 21:34:14.334245 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3642/7234] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:14 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:15.346272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a1aa5303-f252-478d-8dcf-e69a2ce72060 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:15.347316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a1aa5303-f252-478d-8dcf-e69a2ce72060 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:15.355392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1aa5303-f252-478d-8dcf-e69a2ce72060 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:15.355854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1aa5303-f252-478d-8dcf-e69a2ce72060 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:15.356645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1aa5303-f252-478d-8dcf-e69a2ce72060 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:15.357096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a1aa5303-f252-478d-8dcf-e69a2ce72060 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:15.402608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a1aa5303-f252-478d-8dcf-e69a2ce72060 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060261 Dec 18 21:34:15.403315 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3593/7235] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:15 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:16.414870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f285cf77-dff0-481c-94f4-6c61bbf3b4f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:16.415970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f285cf77-dff0-481c-94f4-6c61bbf3b4f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:16.423287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f285cf77-dff0-481c-94f4-6c61bbf3b4f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:16.423738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f285cf77-dff0-481c-94f4-6c61bbf3b4f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:16.424555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f285cf77-dff0-481c-94f4-6c61bbf3b4f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:16.424995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f285cf77-dff0-481c-94f4-6c61bbf3b4f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:16.474185 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f285cf77-dff0-481c-94f4-6c61bbf3b4f7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.063302 Dec 18 21:34:16.475102 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3643/7236] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:16 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:34:17.486137 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf63c127-42e5-4876-aa2c-52de2a53d0be tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:17.487225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf63c127-42e5-4876-aa2c-52de2a53d0be tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:17.494566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf63c127-42e5-4876-aa2c-52de2a53d0be tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:17.495028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf63c127-42e5-4876-aa2c-52de2a53d0be tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:17.495819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf63c127-42e5-4876-aa2c-52de2a53d0be tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:17.496271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf63c127-42e5-4876-aa2c-52de2a53d0be tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:17.542373 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf63c127-42e5-4876-aa2c-52de2a53d0be tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060131 Dec 18 21:34:17.543013 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3594/7237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:17 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:18.553658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bce4fa19-5e2f-43e9-a702-17c66292f263 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:18.554688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bce4fa19-5e2f-43e9-a702-17c66292f263 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:18.561984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce4fa19-5e2f-43e9-a702-17c66292f263 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:18.562533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce4fa19-5e2f-43e9-a702-17c66292f263 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:18.563318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce4fa19-5e2f-43e9-a702-17c66292f263 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:18.563763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bce4fa19-5e2f-43e9-a702-17c66292f263 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:18.609311 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bce4fa19-5e2f-43e9-a702-17c66292f263 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059711 Dec 18 21:34:18.609957 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3644/7238] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:18 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:19.622330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d1ba5397-a44e-4013-b0ce-59253c933e70 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:19.623251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d1ba5397-a44e-4013-b0ce-59253c933e70 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:19.630626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ba5397-a44e-4013-b0ce-59253c933e70 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:19.631095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ba5397-a44e-4013-b0ce-59253c933e70 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:19.631908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ba5397-a44e-4013-b0ce-59253c933e70 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:19.632363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d1ba5397-a44e-4013-b0ce-59253c933e70 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:19.675072 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d1ba5397-a44e-4013-b0ce-59253c933e70 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.056921 Dec 18 21:34:19.675773 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3595/7239] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:19 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:20.687809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a39203a-bfe0-4100-8693-f516b5a134dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:20.688809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a39203a-bfe0-4100-8693-f516b5a134dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:20.696638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a39203a-bfe0-4100-8693-f516b5a134dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:20.697084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a39203a-bfe0-4100-8693-f516b5a134dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:20.697859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a39203a-bfe0-4100-8693-f516b5a134dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:20.698329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a39203a-bfe0-4100-8693-f516b5a134dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:20.743888 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a39203a-bfe0-4100-8693-f516b5a134dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060012 Dec 18 21:34:20.744545 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3645/7240] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:20 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:34:21.756008 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ddc5d0e8-8091-4ada-b745-9757894979e3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:21.757685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ddc5d0e8-8091-4ada-b745-9757894979e3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:21.765072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddc5d0e8-8091-4ada-b745-9757894979e3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:21.765535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddc5d0e8-8091-4ada-b745-9757894979e3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:21.766368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddc5d0e8-8091-4ada-b745-9757894979e3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:21.766825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ddc5d0e8-8091-4ada-b745-9757894979e3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:21.811279 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ddc5d0e8-8091-4ada-b745-9757894979e3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059299 Dec 18 21:34:21.815353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3596/7241] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:21 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:22.823548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ed6b243-e6a5-49fc-a334-b299ede58213 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:22.824544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ed6b243-e6a5-49fc-a334-b299ede58213 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:22.832078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ed6b243-e6a5-49fc-a334-b299ede58213 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:22.832530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ed6b243-e6a5-49fc-a334-b299ede58213 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:22.833306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ed6b243-e6a5-49fc-a334-b299ede58213 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:22.833741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ed6b243-e6a5-49fc-a334-b299ede58213 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:22.883731 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ed6b243-e6a5-49fc-a334-b299ede58213 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.064064 Dec 18 21:34:22.884408 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3646/7242] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:22 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:23.896103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c56f7549-f417-41db-ae69-35da12cd2982 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:23.897126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c56f7549-f417-41db-ae69-35da12cd2982 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:23.904284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c56f7549-f417-41db-ae69-35da12cd2982 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:23.904743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c56f7549-f417-41db-ae69-35da12cd2982 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:23.905532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c56f7549-f417-41db-ae69-35da12cd2982 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:23.905980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c56f7549-f417-41db-ae69-35da12cd2982 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:23.950442 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c56f7549-f417-41db-ae69-35da12cd2982 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058217 Dec 18 21:34:23.951447 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3597/7243] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:23 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:24.962957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7e15fa9-e09a-4bfa-818a-2d6cc41973fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:24.963953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7e15fa9-e09a-4bfa-818a-2d6cc41973fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:24.971311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e15fa9-e09a-4bfa-818a-2d6cc41973fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:24.971748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e15fa9-e09a-4bfa-818a-2d6cc41973fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:24.972548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e15fa9-e09a-4bfa-818a-2d6cc41973fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:24.972995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7e15fa9-e09a-4bfa-818a-2d6cc41973fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:25.018863 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7e15fa9-e09a-4bfa-818a-2d6cc41973fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059834 Dec 18 21:34:25.019500 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3647/7244] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:24 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:26.030675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2700477-3e10-40a7-9ba3-0320fad4acf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:26.031642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2700477-3e10-40a7-9ba3-0320fad4acf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:26.038954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2700477-3e10-40a7-9ba3-0320fad4acf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:26.039443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2700477-3e10-40a7-9ba3-0320fad4acf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:26.040245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2700477-3e10-40a7-9ba3-0320fad4acf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:26.040699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2700477-3e10-40a7-9ba3-0320fad4acf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:26.088512 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2700477-3e10-40a7-9ba3-0320fad4acf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.061889 Dec 18 21:34:26.089193 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3598/7245] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:26 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:27.100341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58d8e2e9-ea4d-4df9-b9cb-cee1eb9c2d63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:27.101827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58d8e2e9-ea4d-4df9-b9cb-cee1eb9c2d63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:27.109131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d8e2e9-ea4d-4df9-b9cb-cee1eb9c2d63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:27.109584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d8e2e9-ea4d-4df9-b9cb-cee1eb9c2d63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:27.110395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d8e2e9-ea4d-4df9-b9cb-cee1eb9c2d63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:27.110837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58d8e2e9-ea4d-4df9-b9cb-cee1eb9c2d63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:27.154791 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58d8e2e9-ea4d-4df9-b9cb-cee1eb9c2d63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058395 Dec 18 21:34:27.155409 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3648/7246] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:27 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:28.166908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9805f06e-25ce-4a35-9f19-84260b06e400 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:28.167942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9805f06e-25ce-4a35-9f19-84260b06e400 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:28.175389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9805f06e-25ce-4a35-9f19-84260b06e400 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:28.175851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9805f06e-25ce-4a35-9f19-84260b06e400 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:28.176637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9805f06e-25ce-4a35-9f19-84260b06e400 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:28.177085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9805f06e-25ce-4a35-9f19-84260b06e400 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:28.222491 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9805f06e-25ce-4a35-9f19-84260b06e400 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059592 Dec 18 21:34:28.223126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3599/7247] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:28 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:29.235016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c97b74ca-e7fe-4c2b-bd11-b529cdcacc6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:29.236062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c97b74ca-e7fe-4c2b-bd11-b529cdcacc6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:29.243376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c97b74ca-e7fe-4c2b-bd11-b529cdcacc6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:29.243830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c97b74ca-e7fe-4c2b-bd11-b529cdcacc6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:29.244612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c97b74ca-e7fe-4c2b-bd11-b529cdcacc6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:29.245055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c97b74ca-e7fe-4c2b-bd11-b529cdcacc6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:29.292021 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c97b74ca-e7fe-4c2b-bd11-b529cdcacc6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060989 Dec 18 21:34:29.292683 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3649/7248] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:29 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:30.303884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3bb72532-1509-4bdc-9d40-df820ef954ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:30.305499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3bb72532-1509-4bdc-9d40-df820ef954ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:30.312896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bb72532-1509-4bdc-9d40-df820ef954ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:30.313366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bb72532-1509-4bdc-9d40-df820ef954ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:30.314175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bb72532-1509-4bdc-9d40-df820ef954ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:30.314665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3bb72532-1509-4bdc-9d40-df820ef954ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:30.362201 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3bb72532-1509-4bdc-9d40-df820ef954ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.062339 Dec 18 21:34:30.365715 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3600/7249] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:30 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:31.373961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-69bd012d-4ef3-46b7-aaa7-d05929d97606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:31.375001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-69bd012d-4ef3-46b7-aaa7-d05929d97606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:31.382942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69bd012d-4ef3-46b7-aaa7-d05929d97606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:31.383405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69bd012d-4ef3-46b7-aaa7-d05929d97606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:31.384194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69bd012d-4ef3-46b7-aaa7-d05929d97606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:31.384637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69bd012d-4ef3-46b7-aaa7-d05929d97606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:31.428629 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-69bd012d-4ef3-46b7-aaa7-d05929d97606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058691 Dec 18 21:34:31.429760 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3650/7250] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:31 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:32.440255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a2c5c2c2-dd63-46ff-830a-3518ed0a4376 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:32.441273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a2c5c2c2-dd63-46ff-830a-3518ed0a4376 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:32.449123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c5c2c2-dd63-46ff-830a-3518ed0a4376 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:32.449590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c5c2c2-dd63-46ff-830a-3518ed0a4376 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:32.450419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c5c2c2-dd63-46ff-830a-3518ed0a4376 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:32.450874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a2c5c2c2-dd63-46ff-830a-3518ed0a4376 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:32.498801 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a2c5c2c2-dd63-46ff-830a-3518ed0a4376 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.062496 Dec 18 21:34:32.499442 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3601/7251] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:32 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:33.510992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1dda6b22-f663-4d9e-b31b-c8752bb4a1a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:33.512006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1dda6b22-f663-4d9e-b31b-c8752bb4a1a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:33.519328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dda6b22-f663-4d9e-b31b-c8752bb4a1a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:33.519783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dda6b22-f663-4d9e-b31b-c8752bb4a1a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:33.520568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dda6b22-f663-4d9e-b31b-c8752bb4a1a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:33.521009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1dda6b22-f663-4d9e-b31b-c8752bb4a1a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:33.567706 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1dda6b22-f663-4d9e-b31b-c8752bb4a1a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060715 Dec 18 21:34:33.568336 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3651/7252] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:33 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:34:34.580117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-139629f2-c623-468f-ae4e-ad0fe067af0c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:34.581132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-139629f2-c623-468f-ae4e-ad0fe067af0c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:34.588487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-139629f2-c623-468f-ae4e-ad0fe067af0c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:34.588962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-139629f2-c623-468f-ae4e-ad0fe067af0c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:34.589767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-139629f2-c623-468f-ae4e-ad0fe067af0c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:34.590222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-139629f2-c623-468f-ae4e-ad0fe067af0c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:34.636205 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-139629f2-c623-468f-ae4e-ad0fe067af0c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060367 Dec 18 21:34:34.636842 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3602/7253] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:34 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:35.647518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8e951fd8-fb98-47bb-8177-95cfa41b5aa4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:35.649161 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8e951fd8-fb98-47bb-8177-95cfa41b5aa4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:35.656533 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e951fd8-fb98-47bb-8177-95cfa41b5aa4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:35.656988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e951fd8-fb98-47bb-8177-95cfa41b5aa4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:35.657778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e951fd8-fb98-47bb-8177-95cfa41b5aa4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:35.658223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8e951fd8-fb98-47bb-8177-95cfa41b5aa4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:35.703070 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8e951fd8-fb98-47bb-8177-95cfa41b5aa4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059189 Dec 18 21:34:35.703866 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3652/7254] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:35 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:36.715935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d52285a9-5846-435e-af61-2f08063142a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:36.716958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d52285a9-5846-435e-af61-2f08063142a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:36.724300 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d52285a9-5846-435e-af61-2f08063142a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:36.724764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d52285a9-5846-435e-af61-2f08063142a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:36.725556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d52285a9-5846-435e-af61-2f08063142a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:36.726005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d52285a9-5846-435e-af61-2f08063142a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:36.770415 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d52285a9-5846-435e-af61-2f08063142a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058434 Dec 18 21:34:36.771045 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3603/7255] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:36 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:37.783001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bbdfb277-30a9-427a-9ab4-c8cdb673a8ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:37.784038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bbdfb277-30a9-427a-9ab4-c8cdb673a8ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:37.792255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbdfb277-30a9-427a-9ab4-c8cdb673a8ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:37.792716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbdfb277-30a9-427a-9ab4-c8cdb673a8ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:37.793526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbdfb277-30a9-427a-9ab4-c8cdb673a8ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:37.793969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bbdfb277-30a9-427a-9ab4-c8cdb673a8ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:37.834499 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bbdfb277-30a9-427a-9ab4-c8cdb673a8ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.055345 Dec 18 21:34:37.838381 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3653/7256] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:37 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:38.845792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eb8e2af5-809e-4ca4-8525-a8fdd73b5f91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:38.846897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eb8e2af5-809e-4ca4-8525-a8fdd73b5f91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:38.854181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb8e2af5-809e-4ca4-8525-a8fdd73b5f91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:38.854692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb8e2af5-809e-4ca4-8525-a8fdd73b5f91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:38.855490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb8e2af5-809e-4ca4-8525-a8fdd73b5f91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:38.855945 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eb8e2af5-809e-4ca4-8525-a8fdd73b5f91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:38.901549 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eb8e2af5-809e-4ca4-8525-a8fdd73b5f91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059722 Dec 18 21:34:38.902115 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3604/7257] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:38 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:39.913628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aecfc91f-e06a-4200-8f82-92d168a6447c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:39.914665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aecfc91f-e06a-4200-8f82-92d168a6447c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:39.921941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aecfc91f-e06a-4200-8f82-92d168a6447c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:39.922424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aecfc91f-e06a-4200-8f82-92d168a6447c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:39.923216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aecfc91f-e06a-4200-8f82-92d168a6447c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:39.923662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aecfc91f-e06a-4200-8f82-92d168a6447c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:39.968793 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aecfc91f-e06a-4200-8f82-92d168a6447c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059119 Dec 18 21:34:39.969359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3654/7258] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:39 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:40.981699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b84eb437-b492-4be0-8253-9aa0ac68de9a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:40.982672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b84eb437-b492-4be0-8253-9aa0ac68de9a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:40.990088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b84eb437-b492-4be0-8253-9aa0ac68de9a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:40.990646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b84eb437-b492-4be0-8253-9aa0ac68de9a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:40.991448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b84eb437-b492-4be0-8253-9aa0ac68de9a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:40.991909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b84eb437-b492-4be0-8253-9aa0ac68de9a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:41.037342 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b84eb437-b492-4be0-8253-9aa0ac68de9a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059716 Dec 18 21:34:41.037976 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3605/7259] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:40 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:42.050170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6558458c-5430-47e3-a2ea-6725713deca5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:42.051137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6558458c-5430-47e3-a2ea-6725713deca5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:42.058955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6558458c-5430-47e3-a2ea-6725713deca5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:42.059410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6558458c-5430-47e3-a2ea-6725713deca5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:42.060193 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6558458c-5430-47e3-a2ea-6725713deca5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:42.060637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6558458c-5430-47e3-a2ea-6725713deca5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:42.107651 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6558458c-5430-47e3-a2ea-6725713deca5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.061527 Dec 18 21:34:42.108281 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3655/7260] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:42 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:34:43.120410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4689c7f-7c91-4244-9a30-3200824690af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:43.121443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4689c7f-7c91-4244-9a30-3200824690af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:43.128792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4689c7f-7c91-4244-9a30-3200824690af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:43.129289 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4689c7f-7c91-4244-9a30-3200824690af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:43.130091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4689c7f-7c91-4244-9a30-3200824690af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:43.130582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4689c7f-7c91-4244-9a30-3200824690af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:43.175919 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4689c7f-7c91-4244-9a30-3200824690af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059824 Dec 18 21:34:43.176565 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3606/7261] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:43 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:44.188510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4a8ccc98-2711-48b1-93aa-1aed9fdd52c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:44.189512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4a8ccc98-2711-48b1-93aa-1aed9fdd52c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:44.196842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ccc98-2711-48b1-93aa-1aed9fdd52c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:44.197292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ccc98-2711-48b1-93aa-1aed9fdd52c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:44.198069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ccc98-2711-48b1-93aa-1aed9fdd52c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:44.198540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4a8ccc98-2711-48b1-93aa-1aed9fdd52c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:44.253228 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4a8ccc98-2711-48b1-93aa-1aed9fdd52c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.068681 Dec 18 21:34:44.253867 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3656/7262] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:44 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:45.265351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ffb9a863-5e6f-4834-aca4-e19e406076ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:45.266414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ffb9a863-5e6f-4834-aca4-e19e406076ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:45.273833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffb9a863-5e6f-4834-aca4-e19e406076ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:45.274329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffb9a863-5e6f-4834-aca4-e19e406076ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:45.275141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffb9a863-5e6f-4834-aca4-e19e406076ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:45.275596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ffb9a863-5e6f-4834-aca4-e19e406076ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:45.320038 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ffb9a863-5e6f-4834-aca4-e19e406076ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058649 Dec 18 21:34:45.320719 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3607/7263] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:45 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:46.333082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-936699c4-5824-4e3b-bb89-528aea0f4465 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:46.334082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-936699c4-5824-4e3b-bb89-528aea0f4465 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:46.342640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-936699c4-5824-4e3b-bb89-528aea0f4465 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:46.343093 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-936699c4-5824-4e3b-bb89-528aea0f4465 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:46.343873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-936699c4-5824-4e3b-bb89-528aea0f4465 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:46.344306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-936699c4-5824-4e3b-bb89-528aea0f4465 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:46.388586 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-936699c4-5824-4e3b-bb89-528aea0f4465 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059684 Dec 18 21:34:46.389222 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3657/7264] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:46 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:34:47.400587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-24c24396-3c18-4e05-aa64-7a7769a92574 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:47.401624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-24c24396-3c18-4e05-aa64-7a7769a92574 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:47.408900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c24396-3c18-4e05-aa64-7a7769a92574 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:47.409361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c24396-3c18-4e05-aa64-7a7769a92574 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:47.410147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c24396-3c18-4e05-aa64-7a7769a92574 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:47.410642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24c24396-3c18-4e05-aa64-7a7769a92574 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:47.456809 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-24c24396-3c18-4e05-aa64-7a7769a92574 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.060247 Dec 18 21:34:47.457431 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3608/7265] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:47 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:48.469364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a839074-fe59-4d37-9fe7-cb890b772633 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:48.470756 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a839074-fe59-4d37-9fe7-cb890b772633 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:48.478025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a839074-fe59-4d37-9fe7-cb890b772633 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:48.478506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a839074-fe59-4d37-9fe7-cb890b772633 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:48.479288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a839074-fe59-4d37-9fe7-cb890b772633 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:48.479719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a839074-fe59-4d37-9fe7-cb890b772633 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:48.524542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a839074-fe59-4d37-9fe7-cb890b772633 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.059226 Dec 18 21:34:48.525166 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3658/7266] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:48 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:49.536813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-70c5033b-21e9-4004-a0b1-978b1352c5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:49.537828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-70c5033b-21e9-4004-a0b1-978b1352c5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:49.545203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70c5033b-21e9-4004-a0b1-978b1352c5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:49.545673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70c5033b-21e9-4004-a0b1-978b1352c5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:49.546502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70c5033b-21e9-4004-a0b1-978b1352c5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:49.546955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-70c5033b-21e9-4004-a0b1-978b1352c5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:49.591427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-70c5033b-21e9-4004-a0b1-978b1352c5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.058600 Dec 18 21:34:49.592331 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3609/7267] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:49 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:50.604035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad9c9d2b-3480-4842-916e-74077e3a07df tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:50.605043 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ad9c9d2b-3480-4842-916e-74077e3a07df tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:50.612269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9c9d2b-3480-4842-916e-74077e3a07df tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:50.612723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9c9d2b-3480-4842-916e-74077e3a07df tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:50.613497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9c9d2b-3480-4842-916e-74077e3a07df tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:50.613933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad9c9d2b-3480-4842-916e-74077e3a07df tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:50.655505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ad9c9d2b-3480-4842-916e-74077e3a07df tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.055906 Dec 18 21:34:50.656142 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3659/7268] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:50 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:51.667716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d9e172a7-674a-4118-9ba2-7f901d6a297b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:51.668653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d9e172a7-674a-4118-9ba2-7f901d6a297b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:51.675955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9e172a7-674a-4118-9ba2-7f901d6a297b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:51.676426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9e172a7-674a-4118-9ba2-7f901d6a297b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:51.677226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9e172a7-674a-4118-9ba2-7f901d6a297b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:51.677677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9e172a7-674a-4118-9ba2-7f901d6a297b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:51.720426 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d9e172a7-674a-4118-9ba2-7f901d6a297b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 32630 microversion: 2.1 time: 0.056792 Dec 18 21:34:51.721074 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3610/7269] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:51 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:52.732821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3e9e7a8c-b197-4b1b-a8a3-d2fd4af4a1f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:52.733829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3e9e7a8c-b197-4b1b-a8a3-d2fd4af4a1f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:52.741219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a8c-b197-4b1b-a8a3-d2fd4af4a1f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:52.741671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a8c-b197-4b1b-a8a3-d2fd4af4a1f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:52.742489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a8c-b197-4b1b-a8a3-d2fd4af4a1f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:52.742933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a8c-b197-4b1b-a8a3-d2fd4af4a1f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:52.795854 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3e9e7a8c-b197-4b1b-a8a3-d2fd4af4a1f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 200 len: 40784 microversion: 2.1 time: 0.066914 Dec 18 21:34:52.796516 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3660/7270] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:52 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 40784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:34:52.807496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:34:52.808216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:52.815262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:52.815731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:52.816533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:52.816994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:53.063163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:53.071114 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a4ea0acd-8f68-4d22-91e3-47eb69c9bddd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1666 microversion: 2.1 time: 0.267885 Dec 18 21:34:53.071692 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3611/7271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:34:52 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1666 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:34:53.087704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:34:53.088753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:53.095800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:53.096251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:53.097040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:53.097481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:53.137909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:53.144954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Old instance type m1.heat2, new instance type m1.heat {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:34:53.151800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:34:53.152279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:34:53.152750 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:34:53.153155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:34:53.153563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:34:53.213936 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d8427997-aa06-4804-bc0d-b0345d98d3bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 202 len: 0 microversion: 2.1 time: 0.130278 Dec 18 21:34:53.218578 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3661/7272] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:34:53 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:34:53.223488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:34:53.224110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:53.230451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:53.230913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:53.231717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:53.232170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:53.375003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:53.382391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b880e42-182f-4ea3-a726-ec99f78d2555 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1675 microversion: 2.1 time: 0.162535 Dec 18 21:34:53.382975 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3612/7273] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:34:53 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:34:54.401246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:34:54.402109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:54.409319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:54.409876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:54.410686 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:54.411121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:54.600225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:54.608212 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4db37ff3-f25c-4262-bf7a-509492846390 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1675 microversion: 2.1 time: 0.212387 Dec 18 21:34:54.608875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3662/7274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:34:54 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:34:55.626163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:34:55.626726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:55.633399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:55.633859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:55.634682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:55.635134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:55.769992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:55.777468 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06c40ca5-4061-4c78-816d-c331e50c4a2d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.155112 Dec 18 21:34:55.778060 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3613/7275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:34:55 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:34:56.794060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:34:56.794711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:56.801495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:56.801952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:56.802788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:56.803237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:56.869609 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:34:56.870215 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:34:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:34:56.933545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:56.940855 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dbc6fda9-f33c-4646-b124-fb25e3f7bd0f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.150540 Dec 18 21:34:56.941429 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3663/7276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:34:56 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:34:57.958514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:34:57.959131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:57.966312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:57.966695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:57.967494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:57.967948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:58.101117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:58.108576 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-80e95867-802a-4c13-b5b8-bbd9f6dbdc92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.153831 Dec 18 21:34:58.109131 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3614/7277] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:34:57 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:34:59.125953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:34:59.126581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:34:59.133243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:59.133690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:59.134501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:34:59.134937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:34:59.265528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:34:59.272982 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7d9f7448-2a4c-48e8-8d59-062f82596d49 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.150692 Dec 18 21:34:59.273640 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3664/7278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:34:59 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:00.291104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:00.291691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:00.298512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:00.298981 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:00.299786 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:00.300250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:00.430974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:00.438451 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-570d7db9-39fe-4aff-9849-16aed9f7fb52 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.151798 Dec 18 21:35:00.439090 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3615/7279] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:00 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:01.455624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:01.456227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:01.463131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:01.463580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:01.464383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:01.464817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:01.594884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:01.602727 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c5a9342-e21d-403a-ac69-c4e6c2deffaf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.151040 Dec 18 21:35:01.603306 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3665/7280] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:01 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:02.620007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:02.620641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:02.627466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:02.627932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:02.628736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:02.629188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:02.759719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:02.766998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97d5b42b-5fe5-4a27-bb4a-75448767d1b2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.151234 Dec 18 21:35:02.767561 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3616/7281] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:02 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:03.783827 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:03.784431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:03.791322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:03.791775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:03.792564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:03.793000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:03.923918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:03.931170 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-285b99c3-cb2a-4f05-8497-e2e00d7b5a81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.151076 Dec 18 21:35:03.931737 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3666/7282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:03 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:04.947938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:04.948562 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:04.955917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:04.956317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:04.957118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:04.957685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:05.093666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:05.100959 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dedce18c-cfd4-4837-b1f5-35ab252a258f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.156809 Dec 18 21:35:05.101552 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3617/7283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:04 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:06.119437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:06.120292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:06.127480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:06.127929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:06.128709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:06.129146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:06.258136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:06.265482 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-968ede7f-a097-41c9-839e-39bdeefaa20f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.150670 Dec 18 21:35:06.266083 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3667/7284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:06 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:07.282547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:07.283164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:07.290356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:07.290823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:07.291615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:07.292068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:07.439958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:07.448737 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b897eed-6c9a-4b26-8323-aae7ca42c05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1680 microversion: 2.1 time: 0.169930 Dec 18 21:35:07.449273 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3618/7285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:07 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:07.880293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-97922bf6-dc7a-448d-a6f3-1f515c7c12a4 req-12561476-f676-4da5-b0c7-6bc75d400c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6d28b1-a536-490d-91f9-aedfd7bc4ba7", "name": "network-vif-unplugged", "status": "completed", "tag": "12e24094-1435-477a-82aa-fb6329af98bf"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:07.881829 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:35:07.881829 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:35:07.894986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-97922bf6-dc7a-448d-a6f3-1f515c7c12a4 req-12561476-f676-4da5-b0c7-6bc75d400c1c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:07.895434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-97922bf6-dc7a-448d-a6f3-1f515c7c12a4 req-12561476-f676-4da5-b0c7-6bc75d400c1c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:07.907975 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-97922bf6-dc7a-448d-a6f3-1f515c7c12a4 req-12561476-f676-4da5-b0c7-6bc75d400c1c service nova] Creating event network-vif-unplugged:12e24094-1435-477a-82aa-fb6329af98bf for instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 on nch2-master-1 Dec 18 21:35:07.913276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-97922bf6-dc7a-448d-a6f3-1f515c7c12a4 req-12561476-f676-4da5-b0c7-6bc75d400c1c service nova] Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:35:07.924250 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-97922bf6-dc7a-448d-a6f3-1f515c7c12a4 req-12561476-f676-4da5-b0c7-6bc75d400c1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047647 Dec 18 21:35:07.925019 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3668/7286] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:35:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:35:08.466533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:08.467606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:08.476464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:08.477224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:08.478164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:08.478871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:08.623336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:08.632294 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ea8aff72-dbdc-48f4-b38e-8c0096d8efe1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1679 microversion: 2.1 time: 0.169263 Dec 18 21:35:08.633481 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3619/7287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:08 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:09.651428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:09.652066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:09.658106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:09.658606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:09.659389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:09.659826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:09.798978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:09.806635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3e5341ec-db47-4e3e-8b1d-3c02da77c983 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1677 microversion: 2.1 time: 0.160664 Dec 18 21:35:09.807212 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3669/7288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:09 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:09.940284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6a629d10-0825-4e8b-87a3-caaeeed936ab req-5c1161fe-b31b-4a48-a0e9-38d84a7f20e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6d28b1-a536-490d-91f9-aedfd7bc4ba7", "tag": "12e24094-1435-477a-82aa-fb6329af98bf"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:09.941958 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:35:09.941958 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:35:09.951823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a629d10-0825-4e8b-87a3-caaeeed936ab req-5c1161fe-b31b-4a48-a0e9-38d84a7f20e8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:09.952183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6a629d10-0825-4e8b-87a3-caaeeed936ab req-5c1161fe-b31b-4a48-a0e9-38d84a7f20e8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:09.964528 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6a629d10-0825-4e8b-87a3-caaeeed936ab req-5c1161fe-b31b-4a48-a0e9-38d84a7f20e8 service nova] Creating event network-changed:12e24094-1435-477a-82aa-fb6329af98bf for instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 on nch2-master-1 Dec 18 21:35:09.969640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-6a629d10-0825-4e8b-87a3-caaeeed936ab req-5c1161fe-b31b-4a48-a0e9-38d84a7f20e8 service nova] Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:35:09.980981 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6a629d10-0825-4e8b-87a3-caaeeed936ab req-5c1161fe-b31b-4a48-a0e9-38d84a7f20e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044275 Dec 18 21:35:09.981695 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3620/7289] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:35:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:35:10.830905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:10.831539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:10.838292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:10.838740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:10.839519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:10.839954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:10.971802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:10.979810 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a63cd7a-6335-4525-9b2d-0f8ce248387e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1674 microversion: 2.1 time: 0.152983 Dec 18 21:35:10.980384 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3670/7290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:10 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:10.997198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ce9e1cb-f1b7-49b6-9c5c-f0183cfee587 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:10.997836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ce9e1cb-f1b7-49b6-9c5c-f0183cfee587 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:11.003904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ce9e1cb-f1b7-49b6-9c5c-f0183cfee587 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:11.004365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ce9e1cb-f1b7-49b6-9c5c-f0183cfee587 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:11.005158 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ce9e1cb-f1b7-49b6-9c5c-f0183cfee587 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:11.005606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ce9e1cb-f1b7-49b6-9c5c-f0183cfee587 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:11.062808 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ce9e1cb-f1b7-49b6-9c5c-f0183cfee587 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action" status: 204 len: 0 microversion: 2.1 time: 0.070155 Dec 18 21:35:11.063365 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3621/7291] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:10 2021] POST /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:35:11.079411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:11.080235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:11.087923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:11.088505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:11.089436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:11.089946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:11.291105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:11.298530 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45a70c41-226e-49c3-9dd0-c95426a2a6f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1674 microversion: 2.1 time: 0.230803 Dec 18 21:35:11.299125 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3671/7292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:11 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:12.314992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:12.315827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:12.323264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:12.323734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:12.324539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:12.324996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:12.460072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:12.467702 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fa99e6d7-db75-4628-9903-8b01e44af98c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1674 microversion: 2.1 time: 0.156701 Dec 18 21:35:12.468267 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3622/7293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:12 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:13.484705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:13.485309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:13.492068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.492665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:13.493446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.494075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:13.630454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:13.638220 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f849221f-d999-418b-bc25-463076ff44ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1666 microversion: 2.1 time: 0.157212 Dec 18 21:35:13.638808 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3672/7294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:13 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:13.654618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:13.655245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:13.661997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.662502 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:13.663295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.663751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:13.792731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:13.800520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9f7b5d17-a0a3-4e68-a341-91b49c38b4bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1666 microversion: 2.1 time: 0.149562 Dec 18 21:35:13.801085 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3623/7295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:13 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:35:13.816322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:13.816935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:13.823403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.823879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:13.824658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.825096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:13.955905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:13.963337 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c854a19-e33c-4edf-ae96-897e0d86b189 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1666 microversion: 2.1 time: 0.150722 Dec 18 21:35:13.963901 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3673/7296] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:13 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:13.979195 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:13.979729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:13.985643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.986108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:13.987037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:13.987490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:14.012485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:35:14.088160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48876420-7078-4949-ba1c-032548b1e9d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 204 len: 0 microversion: 2.1 time: 0.112107 Dec 18 21:35:14.089521 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3624/7297] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:35:13 2021] DELETE /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:35:14.097480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:14.098086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:14.104049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:14.104501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:14.105281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:14.105719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:14.242521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:14.250086 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-009415f9-5359-4219-81c0-0c0b175f1e99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1672 microversion: 2.1 time: 0.156338 Dec 18 21:35:14.250691 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3674/7298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:14 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:35:14.308533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-15f3a909-3d0b-4298-97c7-c835c6e06d4d req-5ac37f9f-01d3-4bc6-b743-b5497ad384b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6d28b1-a536-490d-91f9-aedfd7bc4ba7", "name": "network-vif-plugged", "status": "completed", "tag": "12e24094-1435-477a-82aa-fb6329af98bf"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:14.310128 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:35:14.310128 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:35:14.319252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-15f3a909-3d0b-4298-97c7-c835c6e06d4d req-5ac37f9f-01d3-4bc6-b743-b5497ad384b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:14.319715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-15f3a909-3d0b-4298-97c7-c835c6e06d4d req-5ac37f9f-01d3-4bc6-b743-b5497ad384b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:14.330967 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-15f3a909-3d0b-4298-97c7-c835c6e06d4d req-5ac37f9f-01d3-4bc6-b743-b5497ad384b7 service nova] Creating event network-vif-plugged:12e24094-1435-477a-82aa-fb6329af98bf for instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 on nch2-master-1 Dec 18 21:35:14.335906 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-15f3a909-3d0b-4298-97c7-c835c6e06d4d req-5ac37f9f-01d3-4bc6-b743-b5497ad384b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032359 Dec 18 21:35:14.336846 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3625/7299] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:35:15.267471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:15.268081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:15.275401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:15.275852 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:15.276632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:15.277069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:15.408322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:15.415864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dda1ea62-779d-4d75-b2dd-ea70f57a788b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 200 len: 1672 microversion: 2.1 time: 0.152051 Dec 18 21:35:15.416474 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3675/7300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:15 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:16.250646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-535e51df-a6a3-4ac9-b8a4-1b83537049a8 req-f14ec112-867b-45c7-b0d1-57c7e005487e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6d28b1-a536-490d-91f9-aedfd7bc4ba7", "name": "network-vif-deleted", "tag": "12e24094-1435-477a-82aa-fb6329af98bf"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:16.252302 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:35:16.252302 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:35:16.262737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-535e51df-a6a3-4ac9-b8a4-1b83537049a8 req-f14ec112-867b-45c7-b0d1-57c7e005487e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:16.263277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-535e51df-a6a3-4ac9-b8a4-1b83537049a8 req-f14ec112-867b-45c7-b0d1-57c7e005487e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:16.276545 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-535e51df-a6a3-4ac9-b8a4-1b83537049a8 req-f14ec112-867b-45c7-b0d1-57c7e005487e service nova] Creating event network-vif-deleted:12e24094-1435-477a-82aa-fb6329af98bf for instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 on nch2-master-1 Dec 18 21:35:16.281455 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-535e51df-a6a3-4ac9-b8a4-1b83537049a8 req-f14ec112-867b-45c7-b0d1-57c7e005487e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035001 Dec 18 21:35:16.282367 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3626/7301] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:35:16.433079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:16.434501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:16.441601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:16.442496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:16.443405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:16.443853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:16.458406 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. Dec 18 21:35:16.459004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:35:16.459842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-119936d7-2739-4899-b1d7-c38d9341f0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 404 len: 111 microversion: 2.1 time: 0.030596 Dec 18 21:35:16.461279 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3676/7302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:16 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:35:16.479899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:16.481006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:16.487501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:16.487969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:16.488973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:16.489435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:16.505047 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. Dec 18 21:35:16.505662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:35:16.506546 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2211edf6-302a-4486-97ae-ea63a3c37516 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 404 len: 111 microversion: 2.1 time: 0.031650 Dec 18 21:35:16.507094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3627/7303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:16 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:35:16.558930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1909902803", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "0d5d526c-ff3b-4870-a375-d43b4ba66efb"}], "security_groups": [{"name": "tempest-securitygroup--784507149"}], "key_name": "tempest-keypair-1744532994", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:16.672609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] validate_networks() for [('0d5d526c-ff3b-4870-a375-d43b4ba66efb', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:35:17.057455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:35:17.057872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:35:17.058393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:35:17.058802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:35:17.059236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:35:17.068042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:17.068498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:17.069312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:17.069745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:17.087169 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:35:17.092640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:35:17.105833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:35:17.108253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:35:17.157157 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbfd8455-782f-491b-885d-43b535e876db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.602478 Dec 18 21:35:17.157887 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3677/7304] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:35:16 2021] POST /compute/v2.1/servers => generated 405 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:35:17.168342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6beae95f-0f2c-49c6-9e71-b33e660c981f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:17.168956 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6beae95f-0f2c-49c6-9e71-b33e660c981f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:17.237546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6beae95f-0f2c-49c6-9e71-b33e660c981f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:17.245352 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6beae95f-0f2c-49c6-9e71-b33e660c981f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1239 microversion: 2.1 time: 0.081217 Dec 18 21:35:17.248138 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3628/7305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:17 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:18.264817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:18.265470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:18.272614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:18.273316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:18.274233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:18.274916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:18.347746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:18.355626 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-859cc2de-f6c8-44d4-ac10-d7589cccc6e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1297 microversion: 2.1 time: 0.094734 Dec 18 21:35:18.356199 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3678/7306] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:18 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:19.373380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:19.374411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:19.383993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:19.385316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:19.386572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:19.387305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:19.641663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:19.652878 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1445b2b-d657-4df3-879c-668cf5e13c59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1364 microversion: 2.1 time: 0.283121 Dec 18 21:35:19.653467 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3629/7307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:19 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:19.706667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-32d2c58e-70fb-4bd1-b908-03c59fddbf72 req-e0662765-4b02-4b73-b4b4-b22e55dd16cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9872a41-54f2-47b1-a739-b1c856484f97", "tag": "97e359ac-d66a-43e5-8caa-681afb9b821a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:19.708580 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:35:19.708580 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:35:19.722410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-32d2c58e-70fb-4bd1-b908-03c59fddbf72 req-e0662765-4b02-4b73-b4b4-b22e55dd16cf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:19.722855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-32d2c58e-70fb-4bd1-b908-03c59fddbf72 req-e0662765-4b02-4b73-b4b4-b22e55dd16cf service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:19.743901 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-32d2c58e-70fb-4bd1-b908-03c59fddbf72 req-e0662765-4b02-4b73-b4b4-b22e55dd16cf service nova] Creating event network-changed:97e359ac-d66a-43e5-8caa-681afb9b821a for instance a9872a41-54f2-47b1-a739-b1c856484f97 on nch1-master-1 Dec 18 21:35:19.749878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-32d2c58e-70fb-4bd1-b908-03c59fddbf72 req-e0662765-4b02-4b73-b4b4-b22e55dd16cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166468 Dec 18 21:35:19.750982 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3679/7308] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:35:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:35:20.670804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:20.671336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:20.678151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:20.678648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:20.679447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:20.679905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:20.808134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:20.815456 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0d22cc4e-61df-4da3-80a7-165a0d3aafeb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1364 microversion: 2.1 time: 0.148510 Dec 18 21:35:20.816017 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3630/7309] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:20 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:21.833374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:21.834075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:21.840324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:21.840804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:21.841590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:21.842029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:21.976588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:21.983944 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3cacc9b4-b460-4e1a-855b-a4380310de4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1364 microversion: 2.1 time: 0.155744 Dec 18 21:35:21.984504 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3680/7310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:21 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:23.001725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:23.002286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:23.009133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:23.009601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:23.010427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:23.010893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:23.139305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:23.146659 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7932e568-9271-4bfd-a094-84a31712b4ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1364 microversion: 2.1 time: 0.148910 Dec 18 21:35:23.147229 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3631/7311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:22 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:24.164095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:24.164783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:24.171123 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:24.171585 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:24.172373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:24.172810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:24.314702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:24.322514 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a97cdc2a-ecb5-4f1c-9df7-30cb12c44adf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1364 microversion: 2.1 time: 0.162483 Dec 18 21:35:24.323080 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3681/7312] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:24 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:25.340354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:25.340973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:25.347801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:25.348263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:25.349044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:25.349491 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:25.483382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:25.490650 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2236883f-b370-4a61-b094-11216f2809ed tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1364 microversion: 2.1 time: 0.153954 Dec 18 21:35:25.491217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3632/7313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:25 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:26.249818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1792c45c-4de1-4a75-8ebc-3f1bfd59bfdf req-542e9b56-37e1-40d2-8c13-ce69cd3f8f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9872a41-54f2-47b1-a739-b1c856484f97", "name": "network-vif-plugged", "status": "completed", "tag": "97e359ac-d66a-43e5-8caa-681afb9b821a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:26.251418 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:35:26.251418 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:35:26.259070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1792c45c-4de1-4a75-8ebc-3f1bfd59bfdf req-542e9b56-37e1-40d2-8c13-ce69cd3f8f81 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:26.259511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1792c45c-4de1-4a75-8ebc-3f1bfd59bfdf req-542e9b56-37e1-40d2-8c13-ce69cd3f8f81 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:26.270156 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1792c45c-4de1-4a75-8ebc-3f1bfd59bfdf req-542e9b56-37e1-40d2-8c13-ce69cd3f8f81 service nova] Creating event network-vif-plugged:97e359ac-d66a-43e5-8caa-681afb9b821a for instance a9872a41-54f2-47b1-a739-b1c856484f97 on nch1-master-1 Dec 18 21:35:26.275007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1792c45c-4de1-4a75-8ebc-3f1bfd59bfdf req-542e9b56-37e1-40d2-8c13-ce69cd3f8f81 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095325 Dec 18 21:35:26.275568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3682/7314] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:35:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:35:26.507793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:26.508422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:26.515169 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:26.515636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:26.516432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:26.516886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:26.646854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:26.654577 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18d6210b-cb35-4c16-a55a-b1c0c3271986 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1364 microversion: 2.1 time: 0.150469 Dec 18 21:35:26.655148 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3633/7315] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:26 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:27.673577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:27.674200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:27.681390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:27.681802 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:27.682654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:27.683167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:27.817063 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:35:27.824491 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ff0d37a2-469a-4195-9a05-5885f84f31a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1551 microversion: 2.1 time: 0.155891 Dec 18 21:35:27.825071 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3683/7316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:35:27 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:27.841330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-efef6d4c-b2d9-41da-88e0-e9a01ddf34b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:35:27.841874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-efef6d4c-b2d9-41da-88e0-e9a01ddf34b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:27.848726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efef6d4c-b2d9-41da-88e0-e9a01ddf34b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:27.849193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efef6d4c-b2d9-41da-88e0-e9a01ddf34b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:27.850024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efef6d4c-b2d9-41da-88e0-e9a01ddf34b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:27.850511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efef6d4c-b2d9-41da-88e0-e9a01ddf34b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:27.930377 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-efef6d4c-b2d9-41da-88e0-e9a01ddf34b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092005 Dec 18 21:35:27.930980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3634/7317] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:35:27 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:35:28.845800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9ceac6de-5b82-4f27-9cf1-b29d70118492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:28.846753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9ceac6de-5b82-4f27-9cf1-b29d70118492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:28.849286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4f747756-24e8-466b-8dce-5817cd34444a req-fed71556-c166-403a-a0a4-201c381f815d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9872a41-54f2-47b1-a739-b1c856484f97", "tag": "97e359ac-d66a-43e5-8caa-681afb9b821a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:28.851483 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:35:28.851483 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:35:28.853718 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ceac6de-5b82-4f27-9cf1-b29d70118492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:28.854175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ceac6de-5b82-4f27-9cf1-b29d70118492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:28.855349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ceac6de-5b82-4f27-9cf1-b29d70118492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:28.855464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9ceac6de-5b82-4f27-9cf1-b29d70118492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:28.859266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4f747756-24e8-466b-8dce-5817cd34444a req-fed71556-c166-403a-a0a4-201c381f815d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:28.859799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4f747756-24e8-466b-8dce-5817cd34444a req-fed71556-c166-403a-a0a4-201c381f815d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:28.874513 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4f747756-24e8-466b-8dce-5817cd34444a req-fed71556-c166-403a-a0a4-201c381f815d service nova] Creating event network-changed:97e359ac-d66a-43e5-8caa-681afb9b821a for instance a9872a41-54f2-47b1-a739-b1c856484f97 on nch1-master-1 Dec 18 21:35:28.880087 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4f747756-24e8-466b-8dce-5817cd34444a req-fed71556-c166-403a-a0a4-201c381f815d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035495 Dec 18 21:35:28.881188 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3635/7318] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:35:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:35:28.897542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9ceac6de-5b82-4f27-9cf1-b29d70118492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.055259 Dec 18 21:35:28.898715 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3684/7319] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:28 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:29.909436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-69c9e91b-8a94-4458-87f8-c9025fe5a94b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:29.910463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-69c9e91b-8a94-4458-87f8-c9025fe5a94b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:29.918045 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69c9e91b-8a94-4458-87f8-c9025fe5a94b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:29.918563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69c9e91b-8a94-4458-87f8-c9025fe5a94b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:29.919455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69c9e91b-8a94-4458-87f8-c9025fe5a94b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:29.920089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-69c9e91b-8a94-4458-87f8-c9025fe5a94b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:29.963504 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-69c9e91b-8a94-4458-87f8-c9025fe5a94b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.058026 Dec 18 21:35:29.964152 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3636/7320] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:29 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:30.974915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd8a163b-5f85-4d1b-986d-0011e4ec5ca2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:30.975868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bd8a163b-5f85-4d1b-986d-0011e4ec5ca2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:30.983227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd8a163b-5f85-4d1b-986d-0011e4ec5ca2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:30.983676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd8a163b-5f85-4d1b-986d-0011e4ec5ca2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:30.984450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd8a163b-5f85-4d1b-986d-0011e4ec5ca2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:30.984885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd8a163b-5f85-4d1b-986d-0011e4ec5ca2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:31.021487 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bd8a163b-5f85-4d1b-986d-0011e4ec5ca2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.050695 Dec 18 21:35:31.022103 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3685/7321] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:30 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:32.033463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60f6104e-0728-4395-b59c-8c95077e38d2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:32.034498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60f6104e-0728-4395-b59c-8c95077e38d2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:32.042571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f6104e-0728-4395-b59c-8c95077e38d2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:32.043032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f6104e-0728-4395-b59c-8c95077e38d2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:32.043831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f6104e-0728-4395-b59c-8c95077e38d2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:32.044282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60f6104e-0728-4395-b59c-8c95077e38d2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:32.079687 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60f6104e-0728-4395-b59c-8c95077e38d2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.050180 Dec 18 21:35:32.080286 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3637/7322] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:32 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:33.090607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15379dd3-3023-4160-a8f4-2ad79d3ac99b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:33.091617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15379dd3-3023-4160-a8f4-2ad79d3ac99b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:33.098955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15379dd3-3023-4160-a8f4-2ad79d3ac99b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:33.099412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15379dd3-3023-4160-a8f4-2ad79d3ac99b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:33.100198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15379dd3-3023-4160-a8f4-2ad79d3ac99b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:33.100640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15379dd3-3023-4160-a8f4-2ad79d3ac99b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:33.138144 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15379dd3-3023-4160-a8f4-2ad79d3ac99b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.051556 Dec 18 21:35:33.138800 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3686/7323] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:33 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:35:34.149692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0d96a64-f577-4da1-8ee3-60276c56ebe9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:34.150744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0d96a64-f577-4da1-8ee3-60276c56ebe9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:34.158018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0d96a64-f577-4da1-8ee3-60276c56ebe9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:34.158517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0d96a64-f577-4da1-8ee3-60276c56ebe9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:34.159316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0d96a64-f577-4da1-8ee3-60276c56ebe9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:34.159773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0d96a64-f577-4da1-8ee3-60276c56ebe9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:34.197668 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0d96a64-f577-4da1-8ee3-60276c56ebe9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.051992 Dec 18 21:35:34.198328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3638/7324] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:34 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:35.209012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9f8028f-36c6-46a1-8807-d768c3bf7bfe tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:35.210056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9f8028f-36c6-46a1-8807-d768c3bf7bfe tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:35.217899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8028f-36c6-46a1-8807-d768c3bf7bfe tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:35.218388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8028f-36c6-46a1-8807-d768c3bf7bfe tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:35.219191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8028f-36c6-46a1-8807-d768c3bf7bfe tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:35.219634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9f8028f-36c6-46a1-8807-d768c3bf7bfe tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:35.260359 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9f8028f-36c6-46a1-8807-d768c3bf7bfe tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.055212 Dec 18 21:35:35.260901 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3687/7325] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:35 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:36.271819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cbfdd7a3-0dd1-4854-b603-73ca37b9d8e4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:36.272838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cbfdd7a3-0dd1-4854-b603-73ca37b9d8e4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:36.280237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbfdd7a3-0dd1-4854-b603-73ca37b9d8e4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:36.280733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbfdd7a3-0dd1-4854-b603-73ca37b9d8e4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:36.281536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbfdd7a3-0dd1-4854-b603-73ca37b9d8e4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:36.281988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cbfdd7a3-0dd1-4854-b603-73ca37b9d8e4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:36.320307 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cbfdd7a3-0dd1-4854-b603-73ca37b9d8e4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.052501 Dec 18 21:35:36.320882 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3639/7326] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:36 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:37.332396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-832b4c4e-ebb1-4391-9684-5cf316e361f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:37.333432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-832b4c4e-ebb1-4391-9684-5cf316e361f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:37.340794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832b4c4e-ebb1-4391-9684-5cf316e361f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:37.341282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832b4c4e-ebb1-4391-9684-5cf316e361f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:37.342074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832b4c4e-ebb1-4391-9684-5cf316e361f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:37.342544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-832b4c4e-ebb1-4391-9684-5cf316e361f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:37.380242 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-832b4c4e-ebb1-4391-9684-5cf316e361f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.052432 Dec 18 21:35:37.380875 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3688/7327] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:37 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:38.392330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8dc4546f-33e6-41ea-8455-552cdebd0466 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:38.393360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8dc4546f-33e6-41ea-8455-552cdebd0466 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:38.401373 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc4546f-33e6-41ea-8455-552cdebd0466 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:38.401864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc4546f-33e6-41ea-8455-552cdebd0466 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:38.402682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc4546f-33e6-41ea-8455-552cdebd0466 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:38.403148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8dc4546f-33e6-41ea-8455-552cdebd0466 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:38.439803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8dc4546f-33e6-41ea-8455-552cdebd0466 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.051433 Dec 18 21:35:38.440334 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3640/7328] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:38 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:39.450666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-16f407fc-d250-43ec-aee9-c07c8197abf0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:39.451669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-16f407fc-d250-43ec-aee9-c07c8197abf0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:39.459235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f407fc-d250-43ec-aee9-c07c8197abf0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:39.459684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f407fc-d250-43ec-aee9-c07c8197abf0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:39.460458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f407fc-d250-43ec-aee9-c07c8197abf0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:39.461395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-16f407fc-d250-43ec-aee9-c07c8197abf0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:39.502427 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-16f407fc-d250-43ec-aee9-c07c8197abf0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 14 microversion: 2.1 time: 0.055660 Dec 18 21:35:39.503041 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3689/7329] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:39 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:35:40.513911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff757013-517e-4bf1-9a3e-9b7167a077a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:40.514884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff757013-517e-4bf1-9a3e-9b7167a077a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:40.522096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff757013-517e-4bf1-9a3e-9b7167a077a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:40.522619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff757013-517e-4bf1-9a3e-9b7167a077a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:40.523890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff757013-517e-4bf1-9a3e-9b7167a077a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:40.524348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff757013-517e-4bf1-9a3e-9b7167a077a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:40.575891 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff757013-517e-4bf1-9a3e-9b7167a077a0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 8161 microversion: 2.1 time: 0.066193 Dec 18 21:35:40.576821 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3641/7330] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:40 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 8161 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:35:41.588488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e5fe8526-53a7-4c93-8ed0-a394b2d44561 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:41.589529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e5fe8526-53a7-4c93-8ed0-a394b2d44561 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:41.596859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5fe8526-53a7-4c93-8ed0-a394b2d44561 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:41.597319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5fe8526-53a7-4c93-8ed0-a394b2d44561 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:41.598106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5fe8526-53a7-4c93-8ed0-a394b2d44561 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:41.598592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5fe8526-53a7-4c93-8ed0-a394b2d44561 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:41.644709 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e5fe8526-53a7-4c93-8ed0-a394b2d44561 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 8161 microversion: 2.1 time: 0.060712 Dec 18 21:35:41.645299 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3690/7331] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:41 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 8161 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:35:42.656287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e7f69dc-98a6-4564-b763-212c7516c784 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:42.657325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0e7f69dc-98a6-4564-b763-212c7516c784 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:42.665256 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7f69dc-98a6-4564-b763-212c7516c784 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:42.665710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7f69dc-98a6-4564-b763-212c7516c784 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:42.666531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7f69dc-98a6-4564-b763-212c7516c784 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:42.667007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0e7f69dc-98a6-4564-b763-212c7516c784 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:42.716715 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e7f69dc-98a6-4564-b763-212c7516c784 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 16351 microversion: 2.1 time: 0.063966 Dec 18 21:35:42.717050 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3642/7332] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:42 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 16351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:43.728749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cf2d75f4-14c0-4b66-a826-a9d10a0d4c39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:43.729748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cf2d75f4-14c0-4b66-a826-a9d10a0d4c39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:43.737182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf2d75f4-14c0-4b66-a826-a9d10a0d4c39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:43.737636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf2d75f4-14c0-4b66-a826-a9d10a0d4c39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:43.738472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf2d75f4-14c0-4b66-a826-a9d10a0d4c39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:43.738910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cf2d75f4-14c0-4b66-a826-a9d10a0d4c39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:43.777268 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cf2d75f4-14c0-4b66-a826-a9d10a0d4c39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 16351 microversion: 2.1 time: 0.053002 Dec 18 21:35:43.777905 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3691/7333] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:43 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 16351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:44.789084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1ebef279-c392-46bc-afbb-fbdc9ad7a211 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:44.790684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1ebef279-c392-46bc-afbb-fbdc9ad7a211 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:44.798166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ebef279-c392-46bc-afbb-fbdc9ad7a211 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:44.798666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ebef279-c392-46bc-afbb-fbdc9ad7a211 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:44.799469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ebef279-c392-46bc-afbb-fbdc9ad7a211 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:44.799923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1ebef279-c392-46bc-afbb-fbdc9ad7a211 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:44.839813 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1ebef279-c392-46bc-afbb-fbdc9ad7a211 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 16351 microversion: 2.1 time: 0.054765 Dec 18 21:35:44.840427 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3643/7334] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:44 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 16351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:45.852134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c4d68fa0-c5fa-4996-b9a1-a9eb72b1cea7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:45.853152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c4d68fa0-c5fa-4996-b9a1-a9eb72b1cea7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:45.860412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4d68fa0-c5fa-4996-b9a1-a9eb72b1cea7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:45.860862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4d68fa0-c5fa-4996-b9a1-a9eb72b1cea7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:45.861659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4d68fa0-c5fa-4996-b9a1-a9eb72b1cea7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:45.862094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c4d68fa0-c5fa-4996-b9a1-a9eb72b1cea7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:45.903447 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c4d68fa0-c5fa-4996-b9a1-a9eb72b1cea7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 16351 microversion: 2.1 time: 0.055718 Dec 18 21:35:45.904076 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3692/7335] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:45 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 16351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:46.916001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b684ec8-df55-4f14-8ba3-0ae3de1a9cea tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:46.917092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b684ec8-df55-4f14-8ba3-0ae3de1a9cea tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:46.924651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b684ec8-df55-4f14-8ba3-0ae3de1a9cea tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:46.925133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b684ec8-df55-4f14-8ba3-0ae3de1a9cea tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:46.925947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b684ec8-df55-4f14-8ba3-0ae3de1a9cea tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:46.926443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b684ec8-df55-4f14-8ba3-0ae3de1a9cea tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:46.980777 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b684ec8-df55-4f14-8ba3-0ae3de1a9cea tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.069351 Dec 18 21:35:46.981572 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3644/7336] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:46 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:47.992151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dcf437c2-be2c-418a-8793-40fb4b08c612 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:47.993642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dcf437c2-be2c-418a-8793-40fb4b08c612 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:48.001160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf437c2-be2c-418a-8793-40fb4b08c612 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:48.001610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf437c2-be2c-418a-8793-40fb4b08c612 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:48.002432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf437c2-be2c-418a-8793-40fb4b08c612 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:48.002900 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcf437c2-be2c-418a-8793-40fb4b08c612 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:48.041902 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dcf437c2-be2c-418a-8793-40fb4b08c612 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.053869 Dec 18 21:35:48.042558 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3693/7337] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:47 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:49.053587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-133e3dc9-f697-4647-b4f9-6e8313bc8705 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:49.054593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-133e3dc9-f697-4647-b4f9-6e8313bc8705 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:49.061898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-133e3dc9-f697-4647-b4f9-6e8313bc8705 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:49.062404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-133e3dc9-f697-4647-b4f9-6e8313bc8705 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:49.063215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-133e3dc9-f697-4647-b4f9-6e8313bc8705 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:49.063669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-133e3dc9-f697-4647-b4f9-6e8313bc8705 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:49.105556 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-133e3dc9-f697-4647-b4f9-6e8313bc8705 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.056114 Dec 18 21:35:49.106185 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3645/7338] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:49 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:50.117561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-105fc8c6-77b3-49f5-bcda-38f9b97cc0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:50.118594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-105fc8c6-77b3-49f5-bcda-38f9b97cc0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:50.125819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-105fc8c6-77b3-49f5-bcda-38f9b97cc0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:50.126297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-105fc8c6-77b3-49f5-bcda-38f9b97cc0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:50.127083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-105fc8c6-77b3-49f5-bcda-38f9b97cc0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:50.127517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-105fc8c6-77b3-49f5-bcda-38f9b97cc0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:50.167080 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-105fc8c6-77b3-49f5-bcda-38f9b97cc0a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.053519 Dec 18 21:35:50.167755 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3694/7339] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:50 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:51.179303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8623ef1d-1ea7-4022-b601-2f8b4797e143 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:51.180965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8623ef1d-1ea7-4022-b601-2f8b4797e143 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:51.188226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8623ef1d-1ea7-4022-b601-2f8b4797e143 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:51.188685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8623ef1d-1ea7-4022-b601-2f8b4797e143 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:51.189480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8623ef1d-1ea7-4022-b601-2f8b4797e143 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:51.189927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8623ef1d-1ea7-4022-b601-2f8b4797e143 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:51.230919 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8623ef1d-1ea7-4022-b601-2f8b4797e143 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.055542 Dec 18 21:35:51.231617 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3646/7340] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:51 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:52.243490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25eab542-c399-419c-85d0-2386b3aa1210 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:52.244487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25eab542-c399-419c-85d0-2386b3aa1210 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:52.251726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25eab542-c399-419c-85d0-2386b3aa1210 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:52.252176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25eab542-c399-419c-85d0-2386b3aa1210 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:52.252951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25eab542-c399-419c-85d0-2386b3aa1210 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:52.253390 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25eab542-c399-419c-85d0-2386b3aa1210 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:52.292771 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25eab542-c399-419c-85d0-2386b3aa1210 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.054005 Dec 18 21:35:52.293452 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3695/7341] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:52 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:53.305500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06fd27e8-7bcd-473b-85dc-ecbefb12c6ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:53.307399 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06fd27e8-7bcd-473b-85dc-ecbefb12c6ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:53.314626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06fd27e8-7bcd-473b-85dc-ecbefb12c6ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:53.315093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06fd27e8-7bcd-473b-85dc-ecbefb12c6ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:53.315895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06fd27e8-7bcd-473b-85dc-ecbefb12c6ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:53.316344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06fd27e8-7bcd-473b-85dc-ecbefb12c6ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:53.359193 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06fd27e8-7bcd-473b-85dc-ecbefb12c6ff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.058061 Dec 18 21:35:53.359850 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3647/7342] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:53 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:54.371046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-84afe4b4-361a-47f4-90b5-b9f7a4e32a7d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:54.372081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-84afe4b4-361a-47f4-90b5-b9f7a4e32a7d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:54.378997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84afe4b4-361a-47f4-90b5-b9f7a4e32a7d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:54.379450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84afe4b4-361a-47f4-90b5-b9f7a4e32a7d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:54.380231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84afe4b4-361a-47f4-90b5-b9f7a4e32a7d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:54.380669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-84afe4b4-361a-47f4-90b5-b9f7a4e32a7d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:54.422891 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-84afe4b4-361a-47f4-90b5-b9f7a4e32a7d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.055931 Dec 18 21:35:54.423535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3696/7343] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:54 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:55.436046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3fee25e2-a37c-447c-b3c4-01f41d1066c6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:55.437087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3fee25e2-a37c-447c-b3c4-01f41d1066c6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:55.444386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fee25e2-a37c-447c-b3c4-01f41d1066c6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:55.444850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fee25e2-a37c-447c-b3c4-01f41d1066c6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:55.446357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fee25e2-a37c-447c-b3c4-01f41d1066c6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:55.446809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3fee25e2-a37c-447c-b3c4-01f41d1066c6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:55.488570 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3fee25e2-a37c-447c-b3c4-01f41d1066c6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.056469 Dec 18 21:35:55.489233 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3648/7344] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:55 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:56.501490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66e3b2c4-e076-47f1-aad1-7d62e477cc55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:56.502544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66e3b2c4-e076-47f1-aad1-7d62e477cc55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:56.510448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e3b2c4-e076-47f1-aad1-7d62e477cc55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:56.510937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e3b2c4-e076-47f1-aad1-7d62e477cc55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:56.511737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e3b2c4-e076-47f1-aad1-7d62e477cc55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:56.512182 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66e3b2c4-e076-47f1-aad1-7d62e477cc55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:56.551124 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66e3b2c4-e076-47f1-aad1-7d62e477cc55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.053629 Dec 18 21:35:56.551766 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3697/7345] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:56 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:57.563343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c573332d-e675-43b2-b56e-b9d87c962f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:57.564363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c573332d-e675-43b2-b56e-b9d87c962f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:57.571816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c573332d-e675-43b2-b56e-b9d87c962f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:57.572287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c573332d-e675-43b2-b56e-b9d87c962f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:57.573088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c573332d-e675-43b2-b56e-b9d87c962f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:57.573545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c573332d-e675-43b2-b56e-b9d87c962f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:57.613937 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c573332d-e675-43b2-b56e-b9d87c962f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.054566 Dec 18 21:35:57.614626 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3649/7346] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:57 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:58.625571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09722b01-7043-405c-a33f-e5d3ddd0a3af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:58.626591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09722b01-7043-405c-a33f-e5d3ddd0a3af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:58.633799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09722b01-7043-405c-a33f-e5d3ddd0a3af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:58.634274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09722b01-7043-405c-a33f-e5d3ddd0a3af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:58.635053 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09722b01-7043-405c-a33f-e5d3ddd0a3af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:58.635489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09722b01-7043-405c-a33f-e5d3ddd0a3af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:58.672800 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09722b01-7043-405c-a33f-e5d3ddd0a3af tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.051222 Dec 18 21:35:58.673439 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3698/7347] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:58 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:35:59.685993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7e5eead-ac21-4482-b35f-2baf7a79d3da tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:35:59.686969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7e5eead-ac21-4482-b35f-2baf7a79d3da tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:35:59.694305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7e5eead-ac21-4482-b35f-2baf7a79d3da tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:59.694780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7e5eead-ac21-4482-b35f-2baf7a79d3da tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:59.696227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7e5eead-ac21-4482-b35f-2baf7a79d3da tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:35:59.696681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7e5eead-ac21-4482-b35f-2baf7a79d3da tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:35:59.735436 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7e5eead-ac21-4482-b35f-2baf7a79d3da tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.053469 Dec 18 21:35:59.738710 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3650/7348] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:35:59 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:00.747600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-405c589e-0f5d-4b81-91f9-c648d808d891 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:00.748891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-405c589e-0f5d-4b81-91f9-c648d808d891 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:00.756259 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-405c589e-0f5d-4b81-91f9-c648d808d891 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:00.756713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-405c589e-0f5d-4b81-91f9-c648d808d891 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:00.757980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-405c589e-0f5d-4b81-91f9-c648d808d891 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:00.758479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-405c589e-0f5d-4b81-91f9-c648d808d891 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:00.798914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-405c589e-0f5d-4b81-91f9-c648d808d891 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 24518 microversion: 2.1 time: 0.055323 Dec 18 21:36:00.799552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3699/7349] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:00 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 24518 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:01.811649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf75c610-d85e-44f3-a457-a2c84ab48203 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:01.812694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf75c610-d85e-44f3-a457-a2c84ab48203 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:01.819883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf75c610-d85e-44f3-a457-a2c84ab48203 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:01.820358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf75c610-d85e-44f3-a457-a2c84ab48203 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:01.821141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf75c610-d85e-44f3-a457-a2c84ab48203 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:01.821591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf75c610-d85e-44f3-a457-a2c84ab48203 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:01.883470 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf75c610-d85e-44f3-a457-a2c84ab48203 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.075742 Dec 18 21:36:01.884112 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3651/7350] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:01 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:02.895690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-56c8ad52-5b6b-4982-bb08-f05ef7263950 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:02.896693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-56c8ad52-5b6b-4982-bb08-f05ef7263950 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:02.904339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56c8ad52-5b6b-4982-bb08-f05ef7263950 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:02.904798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56c8ad52-5b6b-4982-bb08-f05ef7263950 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:02.905598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56c8ad52-5b6b-4982-bb08-f05ef7263950 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:02.906074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-56c8ad52-5b6b-4982-bb08-f05ef7263950 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:02.946061 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-56c8ad52-5b6b-4982-bb08-f05ef7263950 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.053752 Dec 18 21:36:02.946716 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3700/7351] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:02 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:03.958620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae3e3471-2c2e-470c-9a8b-3c52e1f9d4a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:03.959639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae3e3471-2c2e-470c-9a8b-3c52e1f9d4a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:03.967713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae3e3471-2c2e-470c-9a8b-3c52e1f9d4a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:03.968119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae3e3471-2c2e-470c-9a8b-3c52e1f9d4a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:03.968921 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae3e3471-2c2e-470c-9a8b-3c52e1f9d4a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:03.969372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae3e3471-2c2e-470c-9a8b-3c52e1f9d4a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:04.009787 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae3e3471-2c2e-470c-9a8b-3c52e1f9d4a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.055252 Dec 18 21:36:04.010455 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3652/7352] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:03 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:05.022026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a7876b3e-c2f0-4570-bc48-46f8673e6736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:05.022992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a7876b3e-c2f0-4570-bc48-46f8673e6736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:05.030566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7876b3e-c2f0-4570-bc48-46f8673e6736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:05.031025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7876b3e-c2f0-4570-bc48-46f8673e6736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:05.031832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7876b3e-c2f0-4570-bc48-46f8673e6736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:05.032262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a7876b3e-c2f0-4570-bc48-46f8673e6736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:05.072996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a7876b3e-c2f0-4570-bc48-46f8673e6736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.055046 Dec 18 21:36:05.073627 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3701/7353] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:05 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:06.086106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b92f448c-a117-4a8f-a3af-87902892bffa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:06.087090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b92f448c-a117-4a8f-a3af-87902892bffa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:06.095058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b92f448c-a117-4a8f-a3af-87902892bffa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:06.095523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b92f448c-a117-4a8f-a3af-87902892bffa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:06.096359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b92f448c-a117-4a8f-a3af-87902892bffa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:06.096821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b92f448c-a117-4a8f-a3af-87902892bffa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:06.141654 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b92f448c-a117-4a8f-a3af-87902892bffa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.060018 Dec 18 21:36:06.142313 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3653/7354] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:06 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:07.153660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5ee3e4f0-bf3a-435c-b77b-945797102f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:07.154710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5ee3e4f0-bf3a-435c-b77b-945797102f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:07.161977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ee3e4f0-bf3a-435c-b77b-945797102f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:07.162487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ee3e4f0-bf3a-435c-b77b-945797102f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:07.163277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ee3e4f0-bf3a-435c-b77b-945797102f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:07.164351 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5ee3e4f0-bf3a-435c-b77b-945797102f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:07.207139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5ee3e4f0-bf3a-435c-b77b-945797102f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.057539 Dec 18 21:36:07.207779 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3702/7355] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:07 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:08.219043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d87fbd5d-1ffc-4a3a-ba8d-8eaff2c76174 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:08.220067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d87fbd5d-1ffc-4a3a-ba8d-8eaff2c76174 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:08.228130 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d87fbd5d-1ffc-4a3a-ba8d-8eaff2c76174 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:08.229582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d87fbd5d-1ffc-4a3a-ba8d-8eaff2c76174 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:08.230465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d87fbd5d-1ffc-4a3a-ba8d-8eaff2c76174 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:08.230932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d87fbd5d-1ffc-4a3a-ba8d-8eaff2c76174 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:08.280403 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d87fbd5d-1ffc-4a3a-ba8d-8eaff2c76174 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.065330 Dec 18 21:36:08.281057 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3654/7356] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:08 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:09.291709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9939615f-d69f-42ba-9735-6f1d7bd240e7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:09.292721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9939615f-d69f-42ba-9735-6f1d7bd240e7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:09.300135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9939615f-d69f-42ba-9735-6f1d7bd240e7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:09.300583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9939615f-d69f-42ba-9735-6f1d7bd240e7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:09.301360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9939615f-d69f-42ba-9735-6f1d7bd240e7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:09.301799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9939615f-d69f-42ba-9735-6f1d7bd240e7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:09.348348 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9939615f-d69f-42ba-9735-6f1d7bd240e7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.060585 Dec 18 21:36:09.348968 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3703/7357] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:09 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:10.360629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c5c17c6f-af36-4c0e-be0e-0fc3aa57a4b7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:10.361643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c5c17c6f-af36-4c0e-be0e-0fc3aa57a4b7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:10.369122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5c17c6f-af36-4c0e-be0e-0fc3aa57a4b7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:10.369588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5c17c6f-af36-4c0e-be0e-0fc3aa57a4b7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:10.370416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5c17c6f-af36-4c0e-be0e-0fc3aa57a4b7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:10.370873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c5c17c6f-af36-4c0e-be0e-0fc3aa57a4b7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:10.410444 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c5c17c6f-af36-4c0e-be0e-0fc3aa57a4b7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.053729 Dec 18 21:36:10.411392 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3655/7358] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:10 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:11.423417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-857fdf3a-06e9-4d2e-8443-3ac072e1b05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:11.424463 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-857fdf3a-06e9-4d2e-8443-3ac072e1b05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:11.431794 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-857fdf3a-06e9-4d2e-8443-3ac072e1b05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:11.432257 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-857fdf3a-06e9-4d2e-8443-3ac072e1b05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:11.433041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-857fdf3a-06e9-4d2e-8443-3ac072e1b05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:11.433485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-857fdf3a-06e9-4d2e-8443-3ac072e1b05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:11.479477 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-857fdf3a-06e9-4d2e-8443-3ac072e1b05d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.060173 Dec 18 21:36:11.480105 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3704/7359] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:11 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:12.491859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-745a1c9d-7f4b-492a-9153-e29672b9b2c1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:12.492864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-745a1c9d-7f4b-492a-9153-e29672b9b2c1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:12.500233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-745a1c9d-7f4b-492a-9153-e29672b9b2c1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:12.500693 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-745a1c9d-7f4b-492a-9153-e29672b9b2c1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:12.501482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-745a1c9d-7f4b-492a-9153-e29672b9b2c1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:12.501934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-745a1c9d-7f4b-492a-9153-e29672b9b2c1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:12.545882 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-745a1c9d-7f4b-492a-9153-e29672b9b2c1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058116 Dec 18 21:36:12.546812 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3656/7360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:12 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:13.558187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de7ead19-bb48-46a8-baee-47546145c470 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:13.559236 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de7ead19-bb48-46a8-baee-47546145c470 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:13.566667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de7ead19-bb48-46a8-baee-47546145c470 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:13.567126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de7ead19-bb48-46a8-baee-47546145c470 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:13.567915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de7ead19-bb48-46a8-baee-47546145c470 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:13.568361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de7ead19-bb48-46a8-baee-47546145c470 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:13.611328 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de7ead19-bb48-46a8-baee-47546145c470 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.057811 Dec 18 21:36:13.611987 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3705/7361] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:13 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:36:14.624027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0ca52cd-d776-47c0-ab45-0c3680a83a73 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:14.625035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0ca52cd-d776-47c0-ab45-0c3680a83a73 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:14.632870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0ca52cd-d776-47c0-ab45-0c3680a83a73 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:14.633338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0ca52cd-d776-47c0-ab45-0c3680a83a73 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:14.634127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0ca52cd-d776-47c0-ab45-0c3680a83a73 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:14.634607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0ca52cd-d776-47c0-ab45-0c3680a83a73 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:14.673554 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0ca52cd-d776-47c0-ab45-0c3680a83a73 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.053513 Dec 18 21:36:14.674180 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3657/7362] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:14 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:15.685753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66071d34-88fd-440c-a265-c9a97b0f8752 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:15.686792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66071d34-88fd-440c-a265-c9a97b0f8752 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:15.693971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66071d34-88fd-440c-a265-c9a97b0f8752 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:15.694464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66071d34-88fd-440c-a265-c9a97b0f8752 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:15.695240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66071d34-88fd-440c-a265-c9a97b0f8752 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:15.695673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66071d34-88fd-440c-a265-c9a97b0f8752 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:15.743535 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66071d34-88fd-440c-a265-c9a97b0f8752 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.061777 Dec 18 21:36:15.744188 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3706/7363] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:15 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:16.755834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-502f9bb6-58b7-416f-a15a-7333e476c135 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:16.756844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-502f9bb6-58b7-416f-a15a-7333e476c135 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:16.764030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502f9bb6-58b7-416f-a15a-7333e476c135 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:16.764498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502f9bb6-58b7-416f-a15a-7333e476c135 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:16.765296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502f9bb6-58b7-416f-a15a-7333e476c135 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:16.765743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-502f9bb6-58b7-416f-a15a-7333e476c135 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:16.811391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-502f9bb6-58b7-416f-a15a-7333e476c135 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059524 Dec 18 21:36:16.812034 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3658/7364] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:16 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:17.824127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c701ec8-3484-490e-8860-31e9b4eb0f2e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:17.825122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c701ec8-3484-490e-8860-31e9b4eb0f2e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:17.832612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c701ec8-3484-490e-8860-31e9b4eb0f2e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:17.833062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c701ec8-3484-490e-8860-31e9b4eb0f2e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:17.833841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c701ec8-3484-490e-8860-31e9b4eb0f2e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:17.834295 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c701ec8-3484-490e-8860-31e9b4eb0f2e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:17.877802 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c701ec8-3484-490e-8860-31e9b4eb0f2e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058305 Dec 18 21:36:17.878430 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3707/7365] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:17 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:18.889710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f0e18c83-79cf-45f0-bffc-e12b85a66d29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:18.890758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f0e18c83-79cf-45f0-bffc-e12b85a66d29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:18.899068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0e18c83-79cf-45f0-bffc-e12b85a66d29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:18.899362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0e18c83-79cf-45f0-bffc-e12b85a66d29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:18.899895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0e18c83-79cf-45f0-bffc-e12b85a66d29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:18.900353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f0e18c83-79cf-45f0-bffc-e12b85a66d29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:18.945104 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f0e18c83-79cf-45f0-bffc-e12b85a66d29 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058867 Dec 18 21:36:18.945744 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3659/7366] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:18 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:19.957640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b89dc604-5ad0-4299-abfa-9dfa4984087e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:19.958770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b89dc604-5ad0-4299-abfa-9dfa4984087e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:19.966963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b89dc604-5ad0-4299-abfa-9dfa4984087e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:19.967355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b89dc604-5ad0-4299-abfa-9dfa4984087e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:19.968147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b89dc604-5ad0-4299-abfa-9dfa4984087e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:19.968588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b89dc604-5ad0-4299-abfa-9dfa4984087e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:20.022127 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b89dc604-5ad0-4299-abfa-9dfa4984087e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.068862 Dec 18 21:36:20.023299 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3708/7367] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:19 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:21.034353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-02991c59-fa11-4c94-833f-1ac4eda73e0b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:21.035310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-02991c59-fa11-4c94-833f-1ac4eda73e0b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:21.043183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02991c59-fa11-4c94-833f-1ac4eda73e0b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:21.043653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02991c59-fa11-4c94-833f-1ac4eda73e0b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:21.044455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02991c59-fa11-4c94-833f-1ac4eda73e0b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:21.044910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02991c59-fa11-4c94-833f-1ac4eda73e0b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:21.103886 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-02991c59-fa11-4c94-833f-1ac4eda73e0b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.073408 Dec 18 21:36:21.104594 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3660/7368] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:21 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:36:22.115947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8aefc1a0-6e86-4145-953a-9aeeab5c7d2b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:22.117455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8aefc1a0-6e86-4145-953a-9aeeab5c7d2b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:22.124703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8aefc1a0-6e86-4145-953a-9aeeab5c7d2b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:22.125170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8aefc1a0-6e86-4145-953a-9aeeab5c7d2b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:22.125926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8aefc1a0-6e86-4145-953a-9aeeab5c7d2b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:22.126386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8aefc1a0-6e86-4145-953a-9aeeab5c7d2b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:22.170172 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8aefc1a0-6e86-4145-953a-9aeeab5c7d2b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058265 Dec 18 21:36:22.170863 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3709/7369] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:22 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:23.183200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e3e6644-1480-4a4e-a818-04e2038cd37e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:23.184254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e3e6644-1480-4a4e-a818-04e2038cd37e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:23.191231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e3e6644-1480-4a4e-a818-04e2038cd37e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:23.191706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e3e6644-1480-4a4e-a818-04e2038cd37e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:23.192515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e3e6644-1480-4a4e-a818-04e2038cd37e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:23.192973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e3e6644-1480-4a4e-a818-04e2038cd37e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:23.240952 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e3e6644-1480-4a4e-a818-04e2038cd37e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.061958 Dec 18 21:36:23.241587 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3661/7370] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:23 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:24.252865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8868ba74-0a41-459b-a627-a8eff71d4c8a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:24.253876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8868ba74-0a41-459b-a627-a8eff71d4c8a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:24.260999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8868ba74-0a41-459b-a627-a8eff71d4c8a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:24.261458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8868ba74-0a41-459b-a627-a8eff71d4c8a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:24.262245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8868ba74-0a41-459b-a627-a8eff71d4c8a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:24.262729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8868ba74-0a41-459b-a627-a8eff71d4c8a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:24.307167 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8868ba74-0a41-459b-a627-a8eff71d4c8a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058301 Dec 18 21:36:24.307795 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3710/7371] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:24 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:36:25.319260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-57fa6038-a48e-47b9-a0f2-2680fd6a5936 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:25.320271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-57fa6038-a48e-47b9-a0f2-2680fd6a5936 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:25.328105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fa6038-a48e-47b9-a0f2-2680fd6a5936 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:25.328568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fa6038-a48e-47b9-a0f2-2680fd6a5936 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:25.329608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fa6038-a48e-47b9-a0f2-2680fd6a5936 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:25.330057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-57fa6038-a48e-47b9-a0f2-2680fd6a5936 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:25.373997 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-57fa6038-a48e-47b9-a0f2-2680fd6a5936 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058662 Dec 18 21:36:25.374730 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3662/7372] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:25 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:26.386089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-efd8977f-c2b5-4ada-8335-5a598b2ea4a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:26.387121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-efd8977f-c2b5-4ada-8335-5a598b2ea4a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:26.394458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efd8977f-c2b5-4ada-8335-5a598b2ea4a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:26.394920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efd8977f-c2b5-4ada-8335-5a598b2ea4a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:26.395710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efd8977f-c2b5-4ada-8335-5a598b2ea4a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:26.396152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-efd8977f-c2b5-4ada-8335-5a598b2ea4a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:26.443846 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-efd8977f-c2b5-4ada-8335-5a598b2ea4a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.062295 Dec 18 21:36:26.444740 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3711/7373] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:26 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:27.457010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-474a370e-cc50-44b4-9571-87e666885b30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:27.458031 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-474a370e-cc50-44b4-9571-87e666885b30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:27.465888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474a370e-cc50-44b4-9571-87e666885b30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:27.466387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474a370e-cc50-44b4-9571-87e666885b30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:27.467192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474a370e-cc50-44b4-9571-87e666885b30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:27.467647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-474a370e-cc50-44b4-9571-87e666885b30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:27.513681 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-474a370e-cc50-44b4-9571-87e666885b30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.060951 Dec 18 21:36:27.514336 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3663/7374] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:27 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:28.526095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05f6f718-2413-4332-95c7-1f0dae3740ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:28.527162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05f6f718-2413-4332-95c7-1f0dae3740ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:28.534407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f6f718-2413-4332-95c7-1f0dae3740ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:28.534858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f6f718-2413-4332-95c7-1f0dae3740ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:28.535635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f6f718-2413-4332-95c7-1f0dae3740ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:28.536073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05f6f718-2413-4332-95c7-1f0dae3740ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:28.580691 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05f6f718-2413-4332-95c7-1f0dae3740ba tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058649 Dec 18 21:36:28.581311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3712/7375] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:28 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:29.593149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a9a9fd8-9d8c-4653-aee1-49f6b692c42d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:29.594190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a9a9fd8-9d8c-4653-aee1-49f6b692c42d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:29.601482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9a9fd8-9d8c-4653-aee1-49f6b692c42d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:29.602315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9a9fd8-9d8c-4653-aee1-49f6b692c42d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:29.603275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9a9fd8-9d8c-4653-aee1-49f6b692c42d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:29.603829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a9a9fd8-9d8c-4653-aee1-49f6b692c42d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:29.646450 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a9a9fd8-9d8c-4653-aee1-49f6b692c42d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.057225 Dec 18 21:36:29.647096 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3664/7376] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:29 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:30.658023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5452ca6-3f04-44b2-9e64-0300b65db39a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:30.659072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5452ca6-3f04-44b2-9e64-0300b65db39a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:30.666960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5452ca6-3f04-44b2-9e64-0300b65db39a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:30.667416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5452ca6-3f04-44b2-9e64-0300b65db39a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:30.668206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5452ca6-3f04-44b2-9e64-0300b65db39a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:30.668648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5452ca6-3f04-44b2-9e64-0300b65db39a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:30.718374 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5452ca6-3f04-44b2-9e64-0300b65db39a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.064286 Dec 18 21:36:30.719042 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3713/7377] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:30 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:31.731131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c9620ba-1f46-49c3-8dea-900a0f5e14f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:31.732194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c9620ba-1f46-49c3-8dea-900a0f5e14f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:31.739660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c9620ba-1f46-49c3-8dea-900a0f5e14f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:31.740128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c9620ba-1f46-49c3-8dea-900a0f5e14f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:31.740932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c9620ba-1f46-49c3-8dea-900a0f5e14f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:31.741384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c9620ba-1f46-49c3-8dea-900a0f5e14f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:31.787309 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c9620ba-1f46-49c3-8dea-900a0f5e14f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.060715 Dec 18 21:36:31.787949 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3665/7378] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:31 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:32.800188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d873b185-87b4-4d52-97c8-7b773e103448 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:32.801196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d873b185-87b4-4d52-97c8-7b773e103448 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:32.808979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d873b185-87b4-4d52-97c8-7b773e103448 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:32.809434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d873b185-87b4-4d52-97c8-7b773e103448 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:32.810717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d873b185-87b4-4d52-97c8-7b773e103448 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:32.811165 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d873b185-87b4-4d52-97c8-7b773e103448 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:32.858704 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d873b185-87b4-4d52-97c8-7b773e103448 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.062571 Dec 18 21:36:32.859337 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3714/7379] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:32 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:33.870878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3458c806-a842-4203-9213-a299113eebad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:33.871887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3458c806-a842-4203-9213-a299113eebad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:33.879156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3458c806-a842-4203-9213-a299113eebad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:33.879621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3458c806-a842-4203-9213-a299113eebad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:33.880410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3458c806-a842-4203-9213-a299113eebad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:33.880863 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3458c806-a842-4203-9213-a299113eebad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:33.928945 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3458c806-a842-4203-9213-a299113eebad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.062090 Dec 18 21:36:33.929880 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3666/7380] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:33 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:34.941121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82edd24e-aea7-4b16-b573-5302a31c3404 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:34.942124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82edd24e-aea7-4b16-b573-5302a31c3404 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:34.949449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82edd24e-aea7-4b16-b573-5302a31c3404 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:34.949909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82edd24e-aea7-4b16-b573-5302a31c3404 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:34.950735 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82edd24e-aea7-4b16-b573-5302a31c3404 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:34.951176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82edd24e-aea7-4b16-b573-5302a31c3404 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:34.995621 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82edd24e-aea7-4b16-b573-5302a31c3404 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058444 Dec 18 21:36:34.996545 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3715/7381] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:34 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:36.008476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75f6e19e-52fb-4260-916d-af7cacd7364c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:36.009451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75f6e19e-52fb-4260-916d-af7cacd7364c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:36.018050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75f6e19e-52fb-4260-916d-af7cacd7364c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:36.018589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75f6e19e-52fb-4260-916d-af7cacd7364c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:36.019452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75f6e19e-52fb-4260-916d-af7cacd7364c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:36.019916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75f6e19e-52fb-4260-916d-af7cacd7364c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:36.071198 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75f6e19e-52fb-4260-916d-af7cacd7364c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.066686 Dec 18 21:36:36.071856 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3667/7382] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:36 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:37.082904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d6777212-e4f9-4dce-9f0b-a060014bdaa9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:37.083908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d6777212-e4f9-4dce-9f0b-a060014bdaa9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:37.091671 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6777212-e4f9-4dce-9f0b-a060014bdaa9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:37.092124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6777212-e4f9-4dce-9f0b-a060014bdaa9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:37.092901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6777212-e4f9-4dce-9f0b-a060014bdaa9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:37.093337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d6777212-e4f9-4dce-9f0b-a060014bdaa9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:37.138692 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d6777212-e4f9-4dce-9f0b-a060014bdaa9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.060017 Dec 18 21:36:37.139305 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3716/7383] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:37 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:38.151178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7a461e7-f7ba-4b6b-8d7f-e8dc254480a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:38.152252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7a461e7-f7ba-4b6b-8d7f-e8dc254480a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:38.159558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a461e7-f7ba-4b6b-8d7f-e8dc254480a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:38.160043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a461e7-f7ba-4b6b-8d7f-e8dc254480a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:38.160831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a461e7-f7ba-4b6b-8d7f-e8dc254480a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:38.161279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7a461e7-f7ba-4b6b-8d7f-e8dc254480a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:38.206648 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7a461e7-f7ba-4b6b-8d7f-e8dc254480a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059397 Dec 18 21:36:38.207273 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3668/7384] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:38 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:38.484636 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:36:38.485161 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:36:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:36:39.219010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc2bb409-ad0e-48bd-86cb-f635fce62fb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:39.220016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc2bb409-ad0e-48bd-86cb-f635fce62fb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:39.227362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc2bb409-ad0e-48bd-86cb-f635fce62fb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:39.227817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc2bb409-ad0e-48bd-86cb-f635fce62fb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:39.228599 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc2bb409-ad0e-48bd-86cb-f635fce62fb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:39.229040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc2bb409-ad0e-48bd-86cb-f635fce62fb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:39.274017 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc2bb409-ad0e-48bd-86cb-f635fce62fb7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058258 Dec 18 21:36:39.274931 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3717/7385] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:39 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:36:40.285610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e0fd7699-9641-40f4-9973-43548d499d59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:40.286650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e0fd7699-9641-40f4-9973-43548d499d59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:40.294514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fd7699-9641-40f4-9973-43548d499d59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:40.294978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fd7699-9641-40f4-9973-43548d499d59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:40.295770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fd7699-9641-40f4-9973-43548d499d59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:40.296219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e0fd7699-9641-40f4-9973-43548d499d59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:40.345684 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e0fd7699-9641-40f4-9973-43548d499d59 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.064097 Dec 18 21:36:40.346322 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3669/7386] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:40 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:41.358522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c19aeafd-25fb-4a0a-93a6-0b03c74a3264 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:41.359540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c19aeafd-25fb-4a0a-93a6-0b03c74a3264 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:41.366897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c19aeafd-25fb-4a0a-93a6-0b03c74a3264 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:41.367999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c19aeafd-25fb-4a0a-93a6-0b03c74a3264 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:41.368787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c19aeafd-25fb-4a0a-93a6-0b03c74a3264 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:41.369229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c19aeafd-25fb-4a0a-93a6-0b03c74a3264 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:41.417531 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c19aeafd-25fb-4a0a-93a6-0b03c74a3264 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.063046 Dec 18 21:36:41.418625 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3718/7387] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:41 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:42.430350 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-adee9b1c-9f10-42c0-b9d5-78fe44d0e736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:42.431366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-adee9b1c-9f10-42c0-b9d5-78fe44d0e736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:42.438624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adee9b1c-9f10-42c0-b9d5-78fe44d0e736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:42.439092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adee9b1c-9f10-42c0-b9d5-78fe44d0e736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:42.439882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adee9b1c-9f10-42c0-b9d5-78fe44d0e736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:42.440431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adee9b1c-9f10-42c0-b9d5-78fe44d0e736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:42.484340 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-adee9b1c-9f10-42c0-b9d5-78fe44d0e736 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058541 Dec 18 21:36:42.484982 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3670/7388] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:42 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:43.496087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dde03b2d-3011-40dd-bb0e-7f34321becb3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:43.497118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dde03b2d-3011-40dd-bb0e-7f34321becb3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:43.504424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dde03b2d-3011-40dd-bb0e-7f34321becb3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:43.504886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dde03b2d-3011-40dd-bb0e-7f34321becb3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:43.505667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dde03b2d-3011-40dd-bb0e-7f34321becb3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:43.506135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dde03b2d-3011-40dd-bb0e-7f34321becb3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:43.551250 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dde03b2d-3011-40dd-bb0e-7f34321becb3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059160 Dec 18 21:36:43.551895 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3719/7389] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:43 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:44.563662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a052ad01-7953-4d1c-ba66-93bb8668ea80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:44.564733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a052ad01-7953-4d1c-ba66-93bb8668ea80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:44.572026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a052ad01-7953-4d1c-ba66-93bb8668ea80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:44.572494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a052ad01-7953-4d1c-ba66-93bb8668ea80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:44.573291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a052ad01-7953-4d1c-ba66-93bb8668ea80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:44.573746 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a052ad01-7953-4d1c-ba66-93bb8668ea80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:44.620268 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a052ad01-7953-4d1c-ba66-93bb8668ea80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.060598 Dec 18 21:36:44.620890 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3671/7390] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:44 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:45.631616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6f98711-4275-4e73-b3ac-0fde767b5715 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:45.633280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f6f98711-4275-4e73-b3ac-0fde767b5715 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:45.640513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f98711-4275-4e73-b3ac-0fde767b5715 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:45.640964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f98711-4275-4e73-b3ac-0fde767b5715 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:45.641743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f98711-4275-4e73-b3ac-0fde767b5715 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:45.642180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f98711-4275-4e73-b3ac-0fde767b5715 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:45.688932 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f6f98711-4275-4e73-b3ac-0fde767b5715 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.061346 Dec 18 21:36:45.690119 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3720/7391] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:45 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:46.702219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b195a172-4cca-4e97-a907-9480d822052c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:46.703283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b195a172-4cca-4e97-a907-9480d822052c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:46.712307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b195a172-4cca-4e97-a907-9480d822052c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:46.712783 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b195a172-4cca-4e97-a907-9480d822052c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:46.713604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b195a172-4cca-4e97-a907-9480d822052c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:46.714067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b195a172-4cca-4e97-a907-9480d822052c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:46.763748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b195a172-4cca-4e97-a907-9480d822052c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.065520 Dec 18 21:36:46.764402 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3672/7392] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:46 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:47.777587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70264bbe-a88e-440d-b2f3-8bebaaab5860 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:47.778783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70264bbe-a88e-440d-b2f3-8bebaaab5860 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:47.787150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70264bbe-a88e-440d-b2f3-8bebaaab5860 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:47.787607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70264bbe-a88e-440d-b2f3-8bebaaab5860 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:47.788401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70264bbe-a88e-440d-b2f3-8bebaaab5860 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:47.789607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70264bbe-a88e-440d-b2f3-8bebaaab5860 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:47.836661 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70264bbe-a88e-440d-b2f3-8bebaaab5860 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.063558 Dec 18 21:36:47.837546 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3721/7393] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:47 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:48.848965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ab43ee1-7ce0-44f3-bee2-30a518822acd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:48.850006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ab43ee1-7ce0-44f3-bee2-30a518822acd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:48.858036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab43ee1-7ce0-44f3-bee2-30a518822acd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:48.858538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab43ee1-7ce0-44f3-bee2-30a518822acd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:48.859343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab43ee1-7ce0-44f3-bee2-30a518822acd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:48.859800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab43ee1-7ce0-44f3-bee2-30a518822acd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:48.904815 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ab43ee1-7ce0-44f3-bee2-30a518822acd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059813 Dec 18 21:36:48.905451 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3673/7394] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:48 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:49.916764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c36321c9-82cc-41f5-8770-f18e4dd5ab5a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:49.917769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c36321c9-82cc-41f5-8770-f18e4dd5ab5a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:49.925754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36321c9-82cc-41f5-8770-f18e4dd5ab5a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:49.926201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36321c9-82cc-41f5-8770-f18e4dd5ab5a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:49.927010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36321c9-82cc-41f5-8770-f18e4dd5ab5a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:49.927447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c36321c9-82cc-41f5-8770-f18e4dd5ab5a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:49.972894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c36321c9-82cc-41f5-8770-f18e4dd5ab5a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059969 Dec 18 21:36:49.973699 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3722/7395] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:49 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:50.985313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9916ae50-bd23-45c9-86fe-91cec9514a91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:50.986234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9916ae50-bd23-45c9-86fe-91cec9514a91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:50.993558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9916ae50-bd23-45c9-86fe-91cec9514a91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:50.994020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9916ae50-bd23-45c9-86fe-91cec9514a91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:50.994845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9916ae50-bd23-45c9-86fe-91cec9514a91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:50.995294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9916ae50-bd23-45c9-86fe-91cec9514a91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:51.039052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9916ae50-bd23-45c9-86fe-91cec9514a91 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.057750 Dec 18 21:36:51.039791 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3674/7396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:50 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:52.050949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-def72787-d721-4a2c-b063-440e30f0f44c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:52.051930 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-def72787-d721-4a2c-b063-440e30f0f44c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:52.062540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-def72787-d721-4a2c-b063-440e30f0f44c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:52.064096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-def72787-d721-4a2c-b063-440e30f0f44c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:52.065424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-def72787-d721-4a2c-b063-440e30f0f44c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:52.065889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-def72787-d721-4a2c-b063-440e30f0f44c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:52.113379 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-def72787-d721-4a2c-b063-440e30f0f44c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.066881 Dec 18 21:36:52.114008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3723/7397] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:52 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:36:53.125998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8860f556-901e-4886-af8f-3cb09eb1b0e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:53.127042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8860f556-901e-4886-af8f-3cb09eb1b0e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:53.134555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8860f556-901e-4886-af8f-3cb09eb1b0e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:53.135015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8860f556-901e-4886-af8f-3cb09eb1b0e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:53.135815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8860f556-901e-4886-af8f-3cb09eb1b0e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:53.136254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8860f556-901e-4886-af8f-3cb09eb1b0e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:53.181000 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8860f556-901e-4886-af8f-3cb09eb1b0e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059340 Dec 18 21:36:53.181867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3675/7398] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:53 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:54.192297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-767a414a-0d50-43a9-8d4f-9f68957e4533 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:54.193305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-767a414a-0d50-43a9-8d4f-9f68957e4533 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:54.200651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-767a414a-0d50-43a9-8d4f-9f68957e4533 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:54.201126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-767a414a-0d50-43a9-8d4f-9f68957e4533 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:54.201938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-767a414a-0d50-43a9-8d4f-9f68957e4533 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:54.202413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-767a414a-0d50-43a9-8d4f-9f68957e4533 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:54.246817 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-767a414a-0d50-43a9-8d4f-9f68957e4533 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058506 Dec 18 21:36:54.247444 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3724/7399] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:54 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:36:55.259069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ccabad3a-da51-4f00-b464-8742b1d07791 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:55.260112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ccabad3a-da51-4f00-b464-8742b1d07791 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:55.267687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccabad3a-da51-4f00-b464-8742b1d07791 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:55.268156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccabad3a-da51-4f00-b464-8742b1d07791 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:55.268953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccabad3a-da51-4f00-b464-8742b1d07791 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:55.269404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ccabad3a-da51-4f00-b464-8742b1d07791 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:55.311486 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ccabad3a-da51-4f00-b464-8742b1d07791 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.056161 Dec 18 21:36:55.312200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3676/7400] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:55 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:36:56.323530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da15d042-684b-45e1-a42b-047b46ef7dc8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:56.324548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da15d042-684b-45e1-a42b-047b46ef7dc8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:56.332179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da15d042-684b-45e1-a42b-047b46ef7dc8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:56.332640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da15d042-684b-45e1-a42b-047b46ef7dc8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:56.333433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da15d042-684b-45e1-a42b-047b46ef7dc8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:56.333877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da15d042-684b-45e1-a42b-047b46ef7dc8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:56.380878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da15d042-684b-45e1-a42b-047b46ef7dc8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.061383 Dec 18 21:36:56.381760 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3725/7401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:56 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:57.394282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-960bcaf8-0c2d-4459-9487-1bb643cf5e80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:57.395503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-960bcaf8-0c2d-4459-9487-1bb643cf5e80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:57.402872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960bcaf8-0c2d-4459-9487-1bb643cf5e80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:57.403338 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960bcaf8-0c2d-4459-9487-1bb643cf5e80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:57.404139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960bcaf8-0c2d-4459-9487-1bb643cf5e80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:57.404587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-960bcaf8-0c2d-4459-9487-1bb643cf5e80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:57.449566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-960bcaf8-0c2d-4459-9487-1bb643cf5e80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059947 Dec 18 21:36:57.450296 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3677/7402] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:57 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:58.462350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99fe41b4-c7ec-47a2-a3c4-3a58ea58c005 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:58.463371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-99fe41b4-c7ec-47a2-a3c4-3a58ea58c005 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:58.470608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99fe41b4-c7ec-47a2-a3c4-3a58ea58c005 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:58.471062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99fe41b4-c7ec-47a2-a3c4-3a58ea58c005 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:58.471844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99fe41b4-c7ec-47a2-a3c4-3a58ea58c005 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:58.472280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99fe41b4-c7ec-47a2-a3c4-3a58ea58c005 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:58.519462 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99fe41b4-c7ec-47a2-a3c4-3a58ea58c005 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.061679 Dec 18 21:36:58.520249 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3726/7403] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:58 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:36:59.532310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b5d44829-42c6-4f06-9d16-00ce9f5237bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:36:59.533398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b5d44829-42c6-4f06-9d16-00ce9f5237bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:36:59.542168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5d44829-42c6-4f06-9d16-00ce9f5237bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:59.542649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5d44829-42c6-4f06-9d16-00ce9f5237bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:59.543446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5d44829-42c6-4f06-9d16-00ce9f5237bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:36:59.543895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b5d44829-42c6-4f06-9d16-00ce9f5237bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:36:59.590706 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b5d44829-42c6-4f06-9d16-00ce9f5237bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.062372 Dec 18 21:36:59.591353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3678/7404] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:36:59 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:00.603133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8fb72ac0-06ed-48f3-b7f4-fd022d28a70b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:00.604138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8fb72ac0-06ed-48f3-b7f4-fd022d28a70b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:00.611480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb72ac0-06ed-48f3-b7f4-fd022d28a70b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:00.611929 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb72ac0-06ed-48f3-b7f4-fd022d28a70b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:00.612713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb72ac0-06ed-48f3-b7f4-fd022d28a70b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:00.613150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8fb72ac0-06ed-48f3-b7f4-fd022d28a70b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:00.657323 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8fb72ac0-06ed-48f3-b7f4-fd022d28a70b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058206 Dec 18 21:37:00.657941 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3727/7405] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:00 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:01.669496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-eaab2dff-e6bb-46a1-98d2-88ce770ced79 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:01.670549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-eaab2dff-e6bb-46a1-98d2-88ce770ced79 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:01.677797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaab2dff-e6bb-46a1-98d2-88ce770ced79 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:01.678201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaab2dff-e6bb-46a1-98d2-88ce770ced79 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:01.679016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaab2dff-e6bb-46a1-98d2-88ce770ced79 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:01.679461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-eaab2dff-e6bb-46a1-98d2-88ce770ced79 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:01.724998 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-eaab2dff-e6bb-46a1-98d2-88ce770ced79 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.059361 Dec 18 21:37:01.725659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3679/7406] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:01 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:02.737274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c2f95363-6b8b-4ea4-a65b-40f7adc22e20 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:02.738305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c2f95363-6b8b-4ea4-a65b-40f7adc22e20 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:02.745632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2f95363-6b8b-4ea4-a65b-40f7adc22e20 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:02.746094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2f95363-6b8b-4ea4-a65b-40f7adc22e20 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:02.746922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2f95363-6b8b-4ea4-a65b-40f7adc22e20 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:02.747374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c2f95363-6b8b-4ea4-a65b-40f7adc22e20 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:02.790663 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c2f95363-6b8b-4ea4-a65b-40f7adc22e20 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.057386 Dec 18 21:37:02.791325 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3728/7407] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:02 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:03.803014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-91dd65d7-04a4-4de8-b965-850445ea31c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:03.804624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-91dd65d7-04a4-4de8-b965-850445ea31c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:03.811999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91dd65d7-04a4-4de8-b965-850445ea31c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:03.812467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91dd65d7-04a4-4de8-b965-850445ea31c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:03.813269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91dd65d7-04a4-4de8-b965-850445ea31c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:03.813733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-91dd65d7-04a4-4de8-b965-850445ea31c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:03.861230 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-91dd65d7-04a4-4de8-b965-850445ea31c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.062268 Dec 18 21:37:03.862126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3680/7408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:03 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:04.873513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c90298a7-3aa4-4938-b147-d102b64bb5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:04.874537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c90298a7-3aa4-4938-b147-d102b64bb5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:04.881874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c90298a7-3aa4-4938-b147-d102b64bb5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:04.882386 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c90298a7-3aa4-4938-b147-d102b64bb5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:04.883168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c90298a7-3aa4-4938-b147-d102b64bb5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:04.883611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c90298a7-3aa4-4938-b147-d102b64bb5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:04.926683 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c90298a7-3aa4-4938-b147-d102b64bb5cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.057202 Dec 18 21:37:04.927311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3729/7409] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:04 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:05.938756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-214eb4f9-38cc-49be-b4c9-4af181476b81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:05.939790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-214eb4f9-38cc-49be-b4c9-4af181476b81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:05.947713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214eb4f9-38cc-49be-b4c9-4af181476b81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:05.948178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214eb4f9-38cc-49be-b4c9-4af181476b81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:05.948964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214eb4f9-38cc-49be-b4c9-4af181476b81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:05.949443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-214eb4f9-38cc-49be-b4c9-4af181476b81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:05.996381 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-214eb4f9-38cc-49be-b4c9-4af181476b81 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.061556 Dec 18 21:37:05.996943 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3681/7410] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:05 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:07.009024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-05ab1167-7931-4ea2-944e-dfe86ce7e03c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:07.010084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-05ab1167-7931-4ea2-944e-dfe86ce7e03c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:07.017623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05ab1167-7931-4ea2-944e-dfe86ce7e03c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:07.018079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05ab1167-7931-4ea2-944e-dfe86ce7e03c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:07.018893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05ab1167-7931-4ea2-944e-dfe86ce7e03c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:07.019330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-05ab1167-7931-4ea2-944e-dfe86ce7e03c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:07.063374 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-05ab1167-7931-4ea2-944e-dfe86ce7e03c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.058785 Dec 18 21:37:07.064027 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3730/7411] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:07 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:37:08.075695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e315c541-af01-4be9-85cd-dbbf7e54797f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:08.076638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e315c541-af01-4be9-85cd-dbbf7e54797f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:08.084255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e315c541-af01-4be9-85cd-dbbf7e54797f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:08.084726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e315c541-af01-4be9-85cd-dbbf7e54797f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:08.086020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e315c541-af01-4be9-85cd-dbbf7e54797f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:08.086510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e315c541-af01-4be9-85cd-dbbf7e54797f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:08.126205 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e315c541-af01-4be9-85cd-dbbf7e54797f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.054659 Dec 18 21:37:08.126854 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3682/7412] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:08 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:09.138090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ce4323be-d825-4708-9c45-c80c95e6b5dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:09.139115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ce4323be-d825-4708-9c45-c80c95e6b5dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:09.146359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce4323be-d825-4708-9c45-c80c95e6b5dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:09.146821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce4323be-d825-4708-9c45-c80c95e6b5dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:09.147596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce4323be-d825-4708-9c45-c80c95e6b5dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:09.148031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ce4323be-d825-4708-9c45-c80c95e6b5dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:09.196690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ce4323be-d825-4708-9c45-c80c95e6b5dd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.062612 Dec 18 21:37:09.197324 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3731/7413] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:09 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:37:10.209494 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c1bfadec-829f-417b-b2a6-2619bbd9a41f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:10.210598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c1bfadec-829f-417b-b2a6-2619bbd9a41f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:10.218513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1bfadec-829f-417b-b2a6-2619bbd9a41f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:10.219004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1bfadec-829f-417b-b2a6-2619bbd9a41f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:10.219833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1bfadec-829f-417b-b2a6-2619bbd9a41f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:10.220307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c1bfadec-829f-417b-b2a6-2619bbd9a41f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:10.262597 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c1bfadec-829f-417b-b2a6-2619bbd9a41f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 32582 microversion: 2.1 time: 0.057077 Dec 18 21:37:10.263448 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3683/7414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:10 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 32582 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:11.275473 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b3e1ded-26ed-4349-8864-cbbb7de75d22 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:11.276509 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b3e1ded-26ed-4349-8864-cbbb7de75d22 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:11.283836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b3e1ded-26ed-4349-8864-cbbb7de75d22 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:11.284293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b3e1ded-26ed-4349-8864-cbbb7de75d22 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:11.285076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b3e1ded-26ed-4349-8864-cbbb7de75d22 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:11.285523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b3e1ded-26ed-4349-8864-cbbb7de75d22 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:11.339985 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b3e1ded-26ed-4349-8864-cbbb7de75d22 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 200 len: 40739 microversion: 2.1 time: 0.069127 Dec 18 21:37:11.340619 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3732/7415] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:11 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 40739 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:37:11.351154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6d9c2bc3-0e37-4905-bf89-a2b8bd50b2aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:11.358536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bc3-0e37-4905-bf89-a2b8bd50b2aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:11.359005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bc3-0e37-4905-bf89-a2b8bd50b2aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:11.384524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6d9c2bc3-0e37-4905-bf89-a2b8bd50b2aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Going to try to stop instance {{(pid=140731) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 21:37:11.425317 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6d9c2bc3-0e37-4905-bf89-a2b8bd50b2aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 202 len: 0 microversion: 2.1 time: 0.078111 Dec 18 21:37:11.425919 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3684/7416] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:11 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:37:11.439430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:11.440229 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:11.448506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:11.449058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:11.449857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:11.450330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:11.597097 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:11.605089 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d649d639-069d-4d0f-914c-14e4619d0e55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.174500 Dec 18 21:37:11.605654 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3733/7417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:11 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:12.622056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:12.622807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:12.630429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:12.630894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:12.631687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:12.632138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:12.778769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:12.786194 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cc840227-026f-48ec-a029-66dfc1072268 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.168208 Dec 18 21:37:12.786790 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3685/7418] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:12 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:13.803210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:13.804462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:13.811287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:13.811737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:13.812507 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:13.812945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:13.946591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:13.953957 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-75c4aac9-3371-46dd-b21a-584d25633c55 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.154502 Dec 18 21:37:13.954823 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3734/7419] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:13 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:14.971584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:14.972139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:14.979614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:14.980085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:14.980885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:14.981343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:15.109242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:15.117255 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2114495-dcb9-44f3-bf71-15551dee4d8e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.148870 Dec 18 21:37:15.117829 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3686/7420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:14 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:16.134030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:16.134663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:16.141371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:16.141825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:16.142635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:16.143077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:16.278540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:16.285780 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44975518-45a4-4960-85da-e41c4a850a6c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.155479 Dec 18 21:37:16.286371 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3735/7421] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:16 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:17.303196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:17.304476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:17.311492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:17.311960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:17.312760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:17.313222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:17.441138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:17.448452 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd02ff37-6957-43a3-833f-707431557421 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.148988 Dec 18 21:37:17.449019 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3687/7422] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:17 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:18.464733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:18.465382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:18.472089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:18.472544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:18.473330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:18.473770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:18.605618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:18.612927 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62747424-f0f3-4319-8271-b2e0f23b996a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.151938 Dec 18 21:37:18.613503 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3736/7423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:18 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:19.630542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:19.631160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:19.638366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:19.638835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:19.639622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:19.640072 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:19.768749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:19.776665 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04b1110f-ab4b-4a4f-a9fe-b5a298faab07 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.149857 Dec 18 21:37:19.777230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3688/7424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:19 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:20.794148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:20.794784 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:20.801517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:20.801972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:20.802783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:20.803230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:20.929644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:20.937231 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2eb3e66d-16ab-4927-80a5-ad4be3c79fd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.146856 Dec 18 21:37:20.937797 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3737/7425] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:20 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:21.954125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:21.955046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:21.961720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:21.962182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:21.963010 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:21.963464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:22.110432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:22.117808 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51de0cba-af89-47c9-97f3-035a000af704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1656 microversion: 2.1 time: 0.167296 Dec 18 21:37:22.118406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3689/7426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:21 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:22.133783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:22.134765 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:22.141393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:22.141840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:22.142649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:22.143086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:22.173495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:22.179261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Old instance type m1.heat2, new instance type m1.heat {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:37:22.185248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:37:22.185668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:37:22.186136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:37:22.186594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:37:22.187000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:37:22.249548 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5dffce3-edb5-4e20-8fc9-14fed2c270fa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 202 len: 0 microversion: 2.1 time: 0.119435 Dec 18 21:37:22.250367 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3738/7427] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:22 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:37:22.258234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:22.258879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:22.264707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:22.265272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:22.266134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:22.266615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:22.403261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:22.411717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-71d95bf3-6893-4d53-bd56-94fb20e4b53b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.157094 Dec 18 21:37:22.412295 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3690/7428] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:22 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:23.431410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:23.432042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:23.438282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:23.438741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:23.439519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:23.439954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:23.657699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:23.665695 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b0d5ef1-52cc-4be2-a397-20f1482b5c7e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1679 microversion: 2.1 time: 0.239510 Dec 18 21:37:23.666295 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3739/7429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:23 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:24.682978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:24.683589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:24.690379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:24.690840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:24.691626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:24.692071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:24.823014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:24.830558 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5c1a03c3-423e-4b07-a689-4883ebff9e23 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1684 microversion: 2.1 time: 0.151397 Dec 18 21:37:24.831128 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3691/7430] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:24 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:25.848771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:25.849377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:25.856747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:25.857200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:25.857983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:25.858469 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:25.989055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:25.996936 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9d7cd7f1-c9c8-4ef9-9218-d0075d98c5a9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1684 microversion: 2.1 time: 0.151962 Dec 18 21:37:25.997512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3740/7431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:25 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:27.013962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:27.014598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:27.021681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:27.022135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:27.022985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:27.023932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:27.066481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f99f49bf-4fbb-458b-8326-0d6c13bf9d75 req-820442c2-d086-452a-a62b-2a9dfe5599b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9872a41-54f2-47b1-a739-b1c856484f97", "name": "network-vif-unplugged", "status": "completed", "tag": "97e359ac-d66a-43e5-8caa-681afb9b821a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:27.068357 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:37:27.068357 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:37:27.081818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f99f49bf-4fbb-458b-8326-0d6c13bf9d75 req-820442c2-d086-452a-a62b-2a9dfe5599b3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:27.081967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f99f49bf-4fbb-458b-8326-0d6c13bf9d75 req-820442c2-d086-452a-a62b-2a9dfe5599b3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:27.112430 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f99f49bf-4fbb-458b-8326-0d6c13bf9d75 req-820442c2-d086-452a-a62b-2a9dfe5599b3 service nova] Creating event network-vif-unplugged:97e359ac-d66a-43e5-8caa-681afb9b821a for instance a9872a41-54f2-47b1-a739-b1c856484f97 on nch2-master-1 Dec 18 21:37:27.121451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-f99f49bf-4fbb-458b-8326-0d6c13bf9d75 req-820442c2-d086-452a-a62b-2a9dfe5599b3 service nova] Instance a9872a41-54f2-47b1-a739-b1c856484f97 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:37:27.137090 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f99f49bf-4fbb-458b-8326-0d6c13bf9d75 req-820442c2-d086-452a-a62b-2a9dfe5599b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148402 Dec 18 21:37:27.138004 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3692/7432] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:37:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:27.179434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:27.187767 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65b3ce6d-e5db-47ad-9235-b8f4d06b8430 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1683 microversion: 2.1 time: 0.178177 Dec 18 21:37:27.188619 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3741/7433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:27 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:28.206262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:28.207046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:28.213715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:28.214178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:28.214991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:28.215464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:28.346015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:28.354185 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a4d66c25-cd2c-4b93-b683-4f39c71f337b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1681 microversion: 2.1 time: 0.152967 Dec 18 21:37:28.354742 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3693/7434] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:28 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:29.154011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4b26a7e3-93b2-4901-9320-888296cc6265 req-98b0ac6a-fffc-4e3c-b916-c67c6df4587f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9872a41-54f2-47b1-a739-b1c856484f97", "tag": "97e359ac-d66a-43e5-8caa-681afb9b821a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:29.155642 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:37:29.155642 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:37:29.163568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4b26a7e3-93b2-4901-9320-888296cc6265 req-98b0ac6a-fffc-4e3c-b916-c67c6df4587f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:29.164089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4b26a7e3-93b2-4901-9320-888296cc6265 req-98b0ac6a-fffc-4e3c-b916-c67c6df4587f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:29.176301 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4b26a7e3-93b2-4901-9320-888296cc6265 req-98b0ac6a-fffc-4e3c-b916-c67c6df4587f service nova] Creating event network-changed:97e359ac-d66a-43e5-8caa-681afb9b821a for instance a9872a41-54f2-47b1-a739-b1c856484f97 on nch2-master-1 Dec 18 21:37:29.181531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-4b26a7e3-93b2-4901-9320-888296cc6265 req-98b0ac6a-fffc-4e3c-b916-c67c6df4587f service nova] Instance a9872a41-54f2-47b1-a739-b1c856484f97 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:37:29.193297 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4b26a7e3-93b2-4901-9320-888296cc6265 req-98b0ac6a-fffc-4e3c-b916-c67c6df4587f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043036 Dec 18 21:37:29.193944 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3742/7435] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:37:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:29.372046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:29.372763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:29.380535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:29.381142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:29.381813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:29.382286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:29.587159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:29.596550 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c91a6011-3053-4524-a968-7b10d2f793eb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1677 microversion: 2.1 time: 0.228753 Dec 18 21:37:29.597267 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3694/7436] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:29 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:29.613908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2796fd4-1596-4a24-80ff-ab0f0df6569f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:29.614601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2796fd4-1596-4a24-80ff-ab0f0df6569f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:29.621542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2796fd4-1596-4a24-80ff-ab0f0df6569f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:29.622539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2796fd4-1596-4a24-80ff-ab0f0df6569f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:29.623352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2796fd4-1596-4a24-80ff-ab0f0df6569f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:29.623798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2796fd4-1596-4a24-80ff-ab0f0df6569f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:29.688141 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2796fd4-1596-4a24-80ff-ab0f0df6569f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 204 len: 0 microversion: 2.1 time: 0.078126 Dec 18 21:37:29.690354 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3743/7437] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:29 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:37:29.697936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:29.698797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:29.705339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:29.706139 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:29.707246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:29.707958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:29.933061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:29.942652 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-77d537e5-320e-474b-8003-33914373d590 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1677 microversion: 2.1 time: 0.249015 Dec 18 21:37:29.943250 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3695/7438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:29 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:30.961458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:30.962521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:30.969042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:30.969499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:30.970365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:30.970812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:31.119306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:31.127158 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4cb747c4-fda2-4e73-a4df-8a949c1afaee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1656 microversion: 2.1 time: 0.170648 Dec 18 21:37:31.127735 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3744/7439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:30 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:31.143667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:31.144268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:31.151486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:31.151948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:31.152972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:31.153425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:31.286881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:31.295001 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-adfce702-1efe-4253-b846-19c2a7836580 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1656 microversion: 2.1 time: 0.155097 Dec 18 21:37:31.295582 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3696/7440] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:31 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:31.311217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28a7019b-ea42-4b8a-a436-e8023a05ca11 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:31.317413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28a7019b-ea42-4b8a-a436-e8023a05ca11 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:31.317876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28a7019b-ea42-4b8a-a436-e8023a05ca11 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:31.340577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28a7019b-ea42-4b8a-a436-e8023a05ca11 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Going to try to start instance {{(pid=140732) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 21:37:31.382076 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28a7019b-ea42-4b8a-a436-e8023a05ca11 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action" status: 202 len: 0 microversion: 2.1 time: 0.074319 Dec 18 21:37:31.382974 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3745/7441] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:31 2021] POST /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:37:31.391615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:31.392161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:31.399241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:31.399753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:31.400645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:31.401173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:31.538231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:31.545787 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a89fd6e1-3a2d-4ede-b19a-6e80586cf2a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1665 microversion: 2.1 time: 0.158330 Dec 18 21:37:31.546410 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3697/7442] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:31 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:32.564147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:32.564840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:32.571101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:32.571552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:32.572331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:32.572768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:32.703235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:32.710853 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c862c6dd-8635-4227-ad7e-afd53542170a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1669 microversion: 2.1 time: 0.151585 Dec 18 21:37:32.711913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3746/7443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:32 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:32.727988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:32.728519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:32.735447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:32.735917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:32.736706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:32.737154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:32.762059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:37:32.833791 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f600c300-8f70-45bf-824b-e67ddf76b8b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 204 len: 0 microversion: 2.1 time: 0.109758 Dec 18 21:37:32.834345 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3698/7444] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:37:32 2021] DELETE /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:37:32.842970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:32.843579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:32.849405 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:32.849858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:32.850670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:32.851111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:32.981415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:32.988899 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-52d8bd46-5684-4399-83b5-5bf17cf1767b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1675 microversion: 2.1 time: 0.149563 Dec 18 21:37:32.989463 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3747/7445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:32 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:37:33.065824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ba5864bd-367f-45aa-81f0-346d4a3647a5 req-47423ba6-e143-42db-9575-765bda3524e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9872a41-54f2-47b1-a739-b1c856484f97", "name": "network-vif-plugged", "status": "completed", "tag": "97e359ac-d66a-43e5-8caa-681afb9b821a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:33.067378 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:37:33.067378 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:37:33.075102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ba5864bd-367f-45aa-81f0-346d4a3647a5 req-47423ba6-e143-42db-9575-765bda3524e9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:33.075567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ba5864bd-367f-45aa-81f0-346d4a3647a5 req-47423ba6-e143-42db-9575-765bda3524e9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:33.088142 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ba5864bd-367f-45aa-81f0-346d4a3647a5 req-47423ba6-e143-42db-9575-765bda3524e9 service nova] Creating event network-vif-plugged:97e359ac-d66a-43e5-8caa-681afb9b821a for instance a9872a41-54f2-47b1-a739-b1c856484f97 on nch2-master-1 Dec 18 21:37:33.093120 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ba5864bd-367f-45aa-81f0-346d4a3647a5 req-47423ba6-e143-42db-9575-765bda3524e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Dec 18 21:37:33.093703 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3699/7446] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:37:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:34.005975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:34.006574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:34.013170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:34.013620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:34.014526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:34.014962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:34.148243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:34.155559 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aca39e49-3b20-4927-9c4b-3a73efe8e510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1675 microversion: 2.1 time: 0.153381 Dec 18 21:37:34.156127 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3748/7447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:34 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:35.173658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:35.179604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:35.186064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:35.186939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:35.188120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:35.188645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:35.218167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e825efe2-518b-4dd1-b6ab-4a0607a5f7eb req-2fb5c1ec-0459-4341-b2aa-1a43d3ccf1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9872a41-54f2-47b1-a739-b1c856484f97", "name": "network-vif-deleted", "tag": "97e359ac-d66a-43e5-8caa-681afb9b821a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:35.219860 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:37:35.219860 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:37:35.234627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e825efe2-518b-4dd1-b6ab-4a0607a5f7eb req-2fb5c1ec-0459-4341-b2aa-1a43d3ccf1a6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:35.235485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e825efe2-518b-4dd1-b6ab-4a0607a5f7eb req-2fb5c1ec-0459-4341-b2aa-1a43d3ccf1a6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:35.250591 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e825efe2-518b-4dd1-b6ab-4a0607a5f7eb req-2fb5c1ec-0459-4341-b2aa-1a43d3ccf1a6 service nova] Creating event network-vif-deleted:97e359ac-d66a-43e5-8caa-681afb9b821a for instance a9872a41-54f2-47b1-a739-b1c856484f97 on nch2-master-1 Dec 18 21:37:35.271406 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e825efe2-518b-4dd1-b6ab-4a0607a5f7eb req-2fb5c1ec-0459-4341-b2aa-1a43d3ccf1a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058782 Dec 18 21:37:35.276122 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3749/7448] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:37:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:35.276542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:35.285596 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74820e6c-7c66-47d0-a094-9641fdcc4d38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 200 len: 1608 microversion: 2.1 time: 0.116730 Dec 18 21:37:35.286656 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3700/7449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:35 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 1608 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:36.304054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:36.304748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:36.311356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:36.311810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:36.312590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:36.313029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:36.326505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. Dec 18 21:37:36.327084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:37:36.327915 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f455f600-f170-4456-a180-37e33132861b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 404 len: 111 microversion: 2.1 time: 0.028819 Dec 18 21:37:36.328437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3750/7450] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:36 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:37:36.381343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:36.381962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:36.389583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:36.390056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:36.390867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:36.391315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:36.404310 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. Dec 18 21:37:36.404891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:37:36.405779 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e9318ce3-315b-4f98-9b46-0195c3659b6d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 404 len: 111 microversion: 2.1 time: 0.028172 Dec 18 21:37:36.406317 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3701/7451] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:36 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:37:36.452870 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1760297795", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "0d5d526c-ff3b-4870-a375-d43b4ba66efb"}], "security_groups": [{"name": "tempest-securitygroup--784507149"}], "key_name": "tempest-keypair-1744532994", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:36.554496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] validate_networks() for [('0d5d526c-ff3b-4870-a375-d43b4ba66efb', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:37:36.953446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:37:36.953873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:37:36.954384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:37:36.955050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:37:36.955465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:37:36.964220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:36.964672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:36.965538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:36.965926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:36.982646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:37:36.987610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:37:36.999923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:37:37.002272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:37:37.046790 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9d69e99-f8ad-4454-a101-450f6a39ab82 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.597569 Dec 18 21:37:37.047450 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3751/7452] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:37:36 2021] POST /compute/v2.1/servers => generated 405 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:37:37.057214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-538b6ab5-6b76-4746-aa6b-2526d99db393 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:37.057968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-538b6ab5-6b76-4746-aa6b-2526d99db393 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:37.110182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-538b6ab5-6b76-4746-aa6b-2526d99db393 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:37.117106 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-538b6ab5-6b76-4746-aa6b-2526d99db393 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1239 microversion: 2.1 time: 0.063543 Dec 18 21:37:37.117656 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3702/7453] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:37 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:37:38.134187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:38.135188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:38.154788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:38.155245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:38.156051 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:38.156926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:38.486700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:38.494710 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fa6d91c2-232c-4b24-84ab-6dfd4aeb5bff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1309 microversion: 2.1 time: 0.363652 Dec 18 21:37:38.495282 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3752/7454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:38 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1309 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:39.514189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:39.517127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:39.526736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:39.527601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:39.528425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:39.528874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:39.727347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:39.734730 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0f4482b2-8386-4f98-994c-f1d1f6af5378 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1364 microversion: 2.1 time: 0.226990 Dec 18 21:37:39.735471 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3703/7455] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:39 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:39.797667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f94671d5-3468-4d09-a251-4e4cc93ee862 req-d9ec1143-2c5e-4876-b0f2-3347aa2cc27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:39.800075 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:37:39.800075 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:37:39.808693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f94671d5-3468-4d09-a251-4e4cc93ee862 req-d9ec1143-2c5e-4876-b0f2-3347aa2cc27f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:39.809160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f94671d5-3468-4d09-a251-4e4cc93ee862 req-d9ec1143-2c5e-4876-b0f2-3347aa2cc27f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:39.820572 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-f94671d5-3468-4d09-a251-4e4cc93ee862 req-d9ec1143-2c5e-4876-b0f2-3347aa2cc27f service nova] Creating event network-changed:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch1-master-1 Dec 18 21:37:39.825928 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f94671d5-3468-4d09-a251-4e4cc93ee862 req-d9ec1143-2c5e-4876-b0f2-3347aa2cc27f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033913 Dec 18 21:37:39.826733 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3753/7456] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:37:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:40.752340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:40.753125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:40.759910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:40.760390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:40.761198 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:40.761658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:40.891438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:40.898895 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad5b398a-df34-44a1-a61b-f582b8db0491 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1364 microversion: 2.1 time: 0.150220 Dec 18 21:37:40.899466 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3704/7457] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:40 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:41.917796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:41.918558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:41.924767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:41.925225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:41.926023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:41.926497 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:42.061117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:42.068322 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-73a87251-d46e-4e6c-94b1-22baa7ba7a4e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1364 microversion: 2.1 time: 0.155419 Dec 18 21:37:42.068898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3754/7458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:41 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:43.086161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:43.086816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:43.093795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:43.094274 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:43.095088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:43.095544 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:43.236768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:43.244086 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8a0d4b6d-2361-4ead-82f5-ac20f704d6f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1364 microversion: 2.1 time: 0.161711 Dec 18 21:37:43.244886 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3705/7459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:43 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:44.260684 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:44.261315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:44.268015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:44.268554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:44.269335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:44.269787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:44.401593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:44.409307 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d043fcc0-5985-40be-b532-c79afb209d2f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1364 microversion: 2.1 time: 0.152300 Dec 18 21:37:44.409862 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3755/7460] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:44 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:44.782488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-20c993c7-f0b4-4c8d-b9d0-c2df589ddca9 req-c66042ca-26b6-49bb-97ef-9758f8b643b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "name": "network-vif-plugged", "status": "completed", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:44.784303 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:37:44.784303 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:37:44.793624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-20c993c7-f0b4-4c8d-b9d0-c2df589ddca9 req-c66042ca-26b6-49bb-97ef-9758f8b643b6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:44.794079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-20c993c7-f0b4-4c8d-b9d0-c2df589ddca9 req-c66042ca-26b6-49bb-97ef-9758f8b643b6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:44.804838 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-20c993c7-f0b4-4c8d-b9d0-c2df589ddca9 req-c66042ca-26b6-49bb-97ef-9758f8b643b6 service nova] Creating event network-vif-plugged:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch1-master-1 Dec 18 21:37:44.810184 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-20c993c7-f0b4-4c8d-b9d0-c2df589ddca9 req-c66042ca-26b6-49bb-97ef-9758f8b643b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031794 Dec 18 21:37:44.810802 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3706/7461] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:37:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:45.426807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:45.427465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:45.434106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:45.434618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:45.435393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:45.435828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:45.565873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:45.573165 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-45cb05b1-d47d-4b0f-a447-3ca8f6e784e9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1364 microversion: 2.1 time: 0.150075 Dec 18 21:37:45.573731 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3756/7462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:45 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:46.592127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:46.592701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:46.599558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:46.600020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:46.600813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:46.601266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:46.730650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:37:46.738048 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58e52e36-90be-43ce-ac7d-550d38fe18bc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1551 microversion: 2.1 time: 0.150870 Dec 18 21:37:46.738646 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3707/7463] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:37:46 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:37:46.755310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8f30bf97-4bef-44bb-8786-42c54d3d0336 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:37:46.755829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8f30bf97-4bef-44bb-8786-42c54d3d0336 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:46.762516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f30bf97-4bef-44bb-8786-42c54d3d0336 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:46.762966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f30bf97-4bef-44bb-8786-42c54d3d0336 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:46.763739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f30bf97-4bef-44bb-8786-42c54d3d0336 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:46.764172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8f30bf97-4bef-44bb-8786-42c54d3d0336 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:46.841345 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8f30bf97-4bef-44bb-8786-42c54d3d0336 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089769 Dec 18 21:37:46.841942 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3757/7464] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:37:46 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:47.756719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1c262928-4ac1-43ed-a101-13d3b39daaf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:47.757889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1c262928-4ac1-43ed-a101-13d3b39daaf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:47.761370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-37231614-82d3-463b-b0fb-3dd84bf25cca req-90a62ed7-65a4-47bb-ac37-ab707646e075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:47.763124 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:37:47.763124 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:37:47.765537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c262928-4ac1-43ed-a101-13d3b39daaf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:47.766066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c262928-4ac1-43ed-a101-13d3b39daaf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:47.766996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c262928-4ac1-43ed-a101-13d3b39daaf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:47.767522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1c262928-4ac1-43ed-a101-13d3b39daaf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:47.771409 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-37231614-82d3-463b-b0fb-3dd84bf25cca req-90a62ed7-65a4-47bb-ac37-ab707646e075 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:47.771869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-37231614-82d3-463b-b0fb-3dd84bf25cca req-90a62ed7-65a4-47bb-ac37-ab707646e075 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:47.783356 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-37231614-82d3-463b-b0fb-3dd84bf25cca req-90a62ed7-65a4-47bb-ac37-ab707646e075 service nova] Creating event network-changed:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch1-master-1 Dec 18 21:37:47.788725 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-37231614-82d3-463b-b0fb-3dd84bf25cca req-90a62ed7-65a4-47bb-ac37-ab707646e075 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031591 Dec 18 21:37:47.789405 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3758/7465] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:37:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:37:47.806981 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1c262928-4ac1-43ed-a101-13d3b39daaf1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.053370 Dec 18 21:37:47.808082 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3708/7466] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:47 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:48.820068 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-846ff31e-d829-4a5e-b093-64d714eb46ec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:48.821191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-846ff31e-d829-4a5e-b093-64d714eb46ec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:48.827817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-846ff31e-d829-4a5e-b093-64d714eb46ec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:48.828276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-846ff31e-d829-4a5e-b093-64d714eb46ec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:48.829073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-846ff31e-d829-4a5e-b093-64d714eb46ec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:48.829512 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-846ff31e-d829-4a5e-b093-64d714eb46ec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:48.870430 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-846ff31e-d829-4a5e-b093-64d714eb46ec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.055263 Dec 18 21:37:48.871089 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3759/7467] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:48 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:37:49.881601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f97468b2-6cd0-494a-9857-414cb7ada02d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:49.882679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f97468b2-6cd0-494a-9857-414cb7ada02d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:49.890222 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f97468b2-6cd0-494a-9857-414cb7ada02d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:49.890723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f97468b2-6cd0-494a-9857-414cb7ada02d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:49.891529 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f97468b2-6cd0-494a-9857-414cb7ada02d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:49.891993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f97468b2-6cd0-494a-9857-414cb7ada02d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:49.928218 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f97468b2-6cd0-494a-9857-414cb7ada02d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.050579 Dec 18 21:37:49.928829 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3709/7468] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:49 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:50.939526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ce48ec2-f18a-4d30-95d5-73f465e90fdf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:50.940530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ce48ec2-f18a-4d30-95d5-73f465e90fdf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:50.948348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce48ec2-f18a-4d30-95d5-73f465e90fdf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:50.948793 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce48ec2-f18a-4d30-95d5-73f465e90fdf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:50.949581 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce48ec2-f18a-4d30-95d5-73f465e90fdf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:50.950017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce48ec2-f18a-4d30-95d5-73f465e90fdf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:50.987394 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ce48ec2-f18a-4d30-95d5-73f465e90fdf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.051778 Dec 18 21:37:50.987934 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3760/7469] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:50 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:51.999278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b14f9db9-b639-459a-89d6-c2af0400a240 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:52.000213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b14f9db9-b639-459a-89d6-c2af0400a240 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:52.007521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b14f9db9-b639-459a-89d6-c2af0400a240 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:52.007988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b14f9db9-b639-459a-89d6-c2af0400a240 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:52.008784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b14f9db9-b639-459a-89d6-c2af0400a240 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:52.009238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b14f9db9-b639-459a-89d6-c2af0400a240 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:52.046477 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b14f9db9-b639-459a-89d6-c2af0400a240 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.051159 Dec 18 21:37:52.048083 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3710/7470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:51 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:53.058090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7528bcdd-e9f2-4017-96af-ada0ace19de7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:53.059044 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7528bcdd-e9f2-4017-96af-ada0ace19de7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:53.066296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7528bcdd-e9f2-4017-96af-ada0ace19de7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:53.066789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7528bcdd-e9f2-4017-96af-ada0ace19de7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:53.067586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7528bcdd-e9f2-4017-96af-ada0ace19de7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:53.068025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7528bcdd-e9f2-4017-96af-ada0ace19de7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:53.105733 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7528bcdd-e9f2-4017-96af-ada0ace19de7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.052188 Dec 18 21:37:53.106349 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3761/7471] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:53 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:54.117210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6439258b-89e5-4003-b0d4-e2aa8d81ae44 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:54.118230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6439258b-89e5-4003-b0d4-e2aa8d81ae44 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:54.125241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6439258b-89e5-4003-b0d4-e2aa8d81ae44 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:54.125711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6439258b-89e5-4003-b0d4-e2aa8d81ae44 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:54.126557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6439258b-89e5-4003-b0d4-e2aa8d81ae44 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:54.127018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6439258b-89e5-4003-b0d4-e2aa8d81ae44 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:54.164858 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6439258b-89e5-4003-b0d4-e2aa8d81ae44 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.051789 Dec 18 21:37:54.165647 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3711/7472] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:54 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:55.177251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6fc58dd2-1535-4a40-b483-078176eb2d12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:55.178354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6fc58dd2-1535-4a40-b483-078176eb2d12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:55.186115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fc58dd2-1535-4a40-b483-078176eb2d12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:55.186595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fc58dd2-1535-4a40-b483-078176eb2d12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:55.187385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fc58dd2-1535-4a40-b483-078176eb2d12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:55.187826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fc58dd2-1535-4a40-b483-078176eb2d12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:55.224997 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6fc58dd2-1535-4a40-b483-078176eb2d12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.052376 Dec 18 21:37:55.225725 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3762/7473] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:55 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:56.236874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e961c38e-0f87-4e44-9420-0f9a8fca278c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:56.237886 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e961c38e-0f87-4e44-9420-0f9a8fca278c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:56.245856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e961c38e-0f87-4e44-9420-0f9a8fca278c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:56.246353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e961c38e-0f87-4e44-9420-0f9a8fca278c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:56.247153 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e961c38e-0f87-4e44-9420-0f9a8fca278c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:56.247606 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e961c38e-0f87-4e44-9420-0f9a8fca278c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:56.286384 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e961c38e-0f87-4e44-9420-0f9a8fca278c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.053391 Dec 18 21:37:56.287023 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3712/7474] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:56 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:57.297768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-04c5a05f-1639-46fb-8d62-e23ca33c8056 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:57.298791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-04c5a05f-1639-46fb-8d62-e23ca33c8056 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:57.306561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04c5a05f-1639-46fb-8d62-e23ca33c8056 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:57.307007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04c5a05f-1639-46fb-8d62-e23ca33c8056 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:57.307778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04c5a05f-1639-46fb-8d62-e23ca33c8056 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:57.308241 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-04c5a05f-1639-46fb-8d62-e23ca33c8056 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:57.344984 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-04c5a05f-1639-46fb-8d62-e23ca33c8056 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.051200 Dec 18 21:37:57.345717 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3763/7475] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:57 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:58.356814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9c83ad54-136c-498f-aac2-585b67b785e5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:58.357835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9c83ad54-136c-498f-aac2-585b67b785e5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:58.365151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c83ad54-136c-498f-aac2-585b67b785e5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:58.365619 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c83ad54-136c-498f-aac2-585b67b785e5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:58.366446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c83ad54-136c-498f-aac2-585b67b785e5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:58.366902 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9c83ad54-136c-498f-aac2-585b67b785e5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:58.406458 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9c83ad54-136c-498f-aac2-585b67b785e5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 14 microversion: 2.1 time: 0.054083 Dec 18 21:37:58.407068 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3713/7476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:58 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:37:59.466446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a3bebffc-209c-47c8-b619-52ee7ee3a6a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:37:59.468136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a3bebffc-209c-47c8-b619-52ee7ee3a6a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:37:59.474217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3bebffc-209c-47c8-b619-52ee7ee3a6a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:59.474738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3bebffc-209c-47c8-b619-52ee7ee3a6a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:59.475513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3bebffc-209c-47c8-b619-52ee7ee3a6a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:37:59.475951 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a3bebffc-209c-47c8-b619-52ee7ee3a6a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:37:59.526842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a3bebffc-209c-47c8-b619-52ee7ee3a6a1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 8205 microversion: 2.1 time: 0.113335 Dec 18 21:37:59.527445 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3764/7477] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:37:59 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 8205 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:38:00.537739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5577d7ec-e537-4074-a296-1245d96e3ba6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:00.538835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5577d7ec-e537-4074-a296-1245d96e3ba6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:00.546743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5577d7ec-e537-4074-a296-1245d96e3ba6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:00.547205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5577d7ec-e537-4074-a296-1245d96e3ba6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:00.547993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5577d7ec-e537-4074-a296-1245d96e3ba6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:00.548447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5577d7ec-e537-4074-a296-1245d96e3ba6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:00.612826 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5577d7ec-e537-4074-a296-1245d96e3ba6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 16397 microversion: 2.1 time: 0.078993 Dec 18 21:38:00.613464 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3714/7478] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:00 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 16397 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:01.625233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cc3cb391-e843-40d6-aea5-4504098d0dd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:01.626286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cc3cb391-e843-40d6-aea5-4504098d0dd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:01.633633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc3cb391-e843-40d6-aea5-4504098d0dd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:01.634084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc3cb391-e843-40d6-aea5-4504098d0dd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:01.634902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc3cb391-e843-40d6-aea5-4504098d0dd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:01.635343 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cc3cb391-e843-40d6-aea5-4504098d0dd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:01.673839 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cc3cb391-e843-40d6-aea5-4504098d0dd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 16397 microversion: 2.1 time: 0.052622 Dec 18 21:38:01.674489 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3765/7479] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:01 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 16397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:02.684968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc900ce6-940e-434c-9b26-dcf732198d41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:02.685984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc900ce6-940e-434c-9b26-dcf732198d41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:02.693353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc900ce6-940e-434c-9b26-dcf732198d41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:02.693820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc900ce6-940e-434c-9b26-dcf732198d41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:02.694653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc900ce6-940e-434c-9b26-dcf732198d41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:02.695106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc900ce6-940e-434c-9b26-dcf732198d41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:02.735995 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc900ce6-940e-434c-9b26-dcf732198d41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 16397 microversion: 2.1 time: 0.054969 Dec 18 21:38:02.737484 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3715/7480] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:02 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 16397 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:03.747972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40fd1eba-459d-44a9-85c5-1f4e286c305a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:03.748977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40fd1eba-459d-44a9-85c5-1f4e286c305a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:03.756284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40fd1eba-459d-44a9-85c5-1f4e286c305a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:03.756736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40fd1eba-459d-44a9-85c5-1f4e286c305a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:03.757518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40fd1eba-459d-44a9-85c5-1f4e286c305a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:03.757958 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40fd1eba-459d-44a9-85c5-1f4e286c305a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:03.797147 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40fd1eba-459d-44a9-85c5-1f4e286c305a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 16397 microversion: 2.1 time: 0.053157 Dec 18 21:38:03.797754 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3766/7481] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:03 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 16397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:04.808692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5c60883-2eb3-4378-afdb-9a0dce308dda tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:04.809707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5c60883-2eb3-4378-afdb-9a0dce308dda tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:04.816976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5c60883-2eb3-4378-afdb-9a0dce308dda tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:04.817437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5c60883-2eb3-4378-afdb-9a0dce308dda tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:04.818226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5c60883-2eb3-4378-afdb-9a0dce308dda tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:04.818699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5c60883-2eb3-4378-afdb-9a0dce308dda tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:04.858532 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5c60883-2eb3-4378-afdb-9a0dce308dda tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 16397 microversion: 2.1 time: 0.054313 Dec 18 21:38:04.859177 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3716/7482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:04 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 16397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:05.869933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aaa2b531-0ccf-4e8e-9a68-1e4b18972805 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:05.870959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aaa2b531-0ccf-4e8e-9a68-1e4b18972805 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:05.878136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa2b531-0ccf-4e8e-9a68-1e4b18972805 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:05.878623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa2b531-0ccf-4e8e-9a68-1e4b18972805 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:05.879404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa2b531-0ccf-4e8e-9a68-1e4b18972805 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:05.879839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aaa2b531-0ccf-4e8e-9a68-1e4b18972805 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:05.928880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aaa2b531-0ccf-4e8e-9a68-1e4b18972805 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.063467 Dec 18 21:38:05.929490 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3767/7483] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:05 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:06.941649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f00bcd9b-ebe3-4424-9c94-6239f4236437 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:06.942751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f00bcd9b-ebe3-4424-9c94-6239f4236437 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:06.950469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f00bcd9b-ebe3-4424-9c94-6239f4236437 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:06.950935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f00bcd9b-ebe3-4424-9c94-6239f4236437 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:06.951728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f00bcd9b-ebe3-4424-9c94-6239f4236437 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:06.952183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f00bcd9b-ebe3-4424-9c94-6239f4236437 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:06.994212 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f00bcd9b-ebe3-4424-9c94-6239f4236437 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.056492 Dec 18 21:38:06.995094 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3717/7484] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:06 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:08.005677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ad1ce70c-1c7f-4cc3-a264-e171196b7015 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:08.006624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ad1ce70c-1c7f-4cc3-a264-e171196b7015 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:08.013823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad1ce70c-1c7f-4cc3-a264-e171196b7015 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:08.014289 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad1ce70c-1c7f-4cc3-a264-e171196b7015 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:08.015074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad1ce70c-1c7f-4cc3-a264-e171196b7015 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:08.015508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ad1ce70c-1c7f-4cc3-a264-e171196b7015 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:08.054790 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ad1ce70c-1c7f-4cc3-a264-e171196b7015 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.053164 Dec 18 21:38:08.055642 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3768/7485] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:08 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:38:09.066214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-61898a14-fea1-4576-b157-21ac0b8fb0a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:09.067168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-61898a14-fea1-4576-b157-21ac0b8fb0a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:09.074925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-61898a14-fea1-4576-b157-21ac0b8fb0a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:09.075423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-61898a14-fea1-4576-b157-21ac0b8fb0a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:09.076212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-61898a14-fea1-4576-b157-21ac0b8fb0a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:09.076660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-61898a14-fea1-4576-b157-21ac0b8fb0a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:09.119810 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-61898a14-fea1-4576-b157-21ac0b8fb0a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.057602 Dec 18 21:38:09.120466 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3718/7486] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:09 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:10.131836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cedfa42a-b5b7-45a4-94fa-8b0a9e78c701 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:10.132834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cedfa42a-b5b7-45a4-94fa-8b0a9e78c701 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:10.140078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cedfa42a-b5b7-45a4-94fa-8b0a9e78c701 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:10.140529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cedfa42a-b5b7-45a4-94fa-8b0a9e78c701 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:10.141308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cedfa42a-b5b7-45a4-94fa-8b0a9e78c701 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:10.141741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cedfa42a-b5b7-45a4-94fa-8b0a9e78c701 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:10.183847 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cedfa42a-b5b7-45a4-94fa-8b0a9e78c701 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.055980 Dec 18 21:38:10.184737 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3769/7487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:10 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:38:11.195967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-459ce221-92a9-4820-ac6f-445e0e563e39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:11.197466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-459ce221-92a9-4820-ac6f-445e0e563e39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:11.204839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-459ce221-92a9-4820-ac6f-445e0e563e39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:11.205573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-459ce221-92a9-4820-ac6f-445e0e563e39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:11.206414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-459ce221-92a9-4820-ac6f-445e0e563e39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:11.206873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-459ce221-92a9-4820-ac6f-445e0e563e39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:11.246908 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-459ce221-92a9-4820-ac6f-445e0e563e39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.054877 Dec 18 21:38:11.247589 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3719/7488] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:11 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:12.258890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-87343946-105f-43ef-8755-f64966a860c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:12.259892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-87343946-105f-43ef-8755-f64966a860c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:12.267128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87343946-105f-43ef-8755-f64966a860c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:12.267580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87343946-105f-43ef-8755-f64966a860c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:12.268359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87343946-105f-43ef-8755-f64966a860c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:12.268798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-87343946-105f-43ef-8755-f64966a860c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:12.309197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-87343946-105f-43ef-8755-f64966a860c7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.054208 Dec 18 21:38:12.309882 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3770/7489] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:12 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:13.320416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fa708f0-e848-43a0-ab2b-eeaf586739f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:13.322015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2fa708f0-e848-43a0-ab2b-eeaf586739f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:13.329291 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fa708f0-e848-43a0-ab2b-eeaf586739f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:13.329755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fa708f0-e848-43a0-ab2b-eeaf586739f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:13.330846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fa708f0-e848-43a0-ab2b-eeaf586739f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:13.331303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fa708f0-e848-43a0-ab2b-eeaf586739f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:13.370965 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2fa708f0-e848-43a0-ab2b-eeaf586739f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.054502 Dec 18 21:38:13.371605 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3720/7490] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:13 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:38:14.382391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-47fca57f-05b2-46c1-8076-0e0df8dba28c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:14.383396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-47fca57f-05b2-46c1-8076-0e0df8dba28c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:14.390732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47fca57f-05b2-46c1-8076-0e0df8dba28c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:14.391186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47fca57f-05b2-46c1-8076-0e0df8dba28c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:14.391967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47fca57f-05b2-46c1-8076-0e0df8dba28c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:14.392408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-47fca57f-05b2-46c1-8076-0e0df8dba28c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:14.438690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-47fca57f-05b2-46c1-8076-0e0df8dba28c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.060341 Dec 18 21:38:14.439341 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3771/7491] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:14 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:15.450773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a1734f0-6c07-4e61-ac2b-29ae6e9b2bec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:15.451813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7a1734f0-6c07-4e61-ac2b-29ae6e9b2bec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:15.459480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1734f0-6c07-4e61-ac2b-29ae6e9b2bec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:15.459949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1734f0-6c07-4e61-ac2b-29ae6e9b2bec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:15.460748 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1734f0-6c07-4e61-ac2b-29ae6e9b2bec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:15.461199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1734f0-6c07-4e61-ac2b-29ae6e9b2bec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:15.501938 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a1734f0-6c07-4e61-ac2b-29ae6e9b2bec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.055192 Dec 18 21:38:15.502618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3721/7492] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:15 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:16.513423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-318f05c2-c808-446f-813c-2a0015b1bc5c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:16.514489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-318f05c2-c808-446f-813c-2a0015b1bc5c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:16.522040 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f05c2-c808-446f-813c-2a0015b1bc5c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:16.522521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f05c2-c808-446f-813c-2a0015b1bc5c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:16.523301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f05c2-c808-446f-813c-2a0015b1bc5c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:16.523764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-318f05c2-c808-446f-813c-2a0015b1bc5c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:16.563421 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-318f05c2-c808-446f-813c-2a0015b1bc5c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.053960 Dec 18 21:38:16.564211 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3772/7493] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:16 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:16.835116 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:38:16.835621 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:38:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:38:16.889164 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:38:16.889328 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:38:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:38:17.576024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95a0d652-9ff9-481d-816a-725970b1fbde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:17.577027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95a0d652-9ff9-481d-816a-725970b1fbde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:17.585172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a0d652-9ff9-481d-816a-725970b1fbde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:17.585639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a0d652-9ff9-481d-816a-725970b1fbde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:17.586462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a0d652-9ff9-481d-816a-725970b1fbde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:17.587259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95a0d652-9ff9-481d-816a-725970b1fbde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:17.627002 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95a0d652-9ff9-481d-816a-725970b1fbde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.055500 Dec 18 21:38:17.627640 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3722/7494] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:17 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:18.639526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c9c5c2a2-86ae-4ed7-8697-49e984778704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:18.640518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c9c5c2a2-86ae-4ed7-8697-49e984778704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:18.647737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9c5c2a2-86ae-4ed7-8697-49e984778704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:18.648186 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9c5c2a2-86ae-4ed7-8697-49e984778704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:18.648962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9c5c2a2-86ae-4ed7-8697-49e984778704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:18.649399 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c9c5c2a2-86ae-4ed7-8697-49e984778704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:18.688620 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c9c5c2a2-86ae-4ed7-8697-49e984778704 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 24572 microversion: 2.1 time: 0.053129 Dec 18 21:38:18.689278 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3773/7495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:18 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:19.701405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4985daad-774d-4f69-bff1-8fac7518afd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:19.702486 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4985daad-774d-4f69-bff1-8fac7518afd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:19.710210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4985daad-774d-4f69-bff1-8fac7518afd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:19.710709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4985daad-774d-4f69-bff1-8fac7518afd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:19.711546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4985daad-774d-4f69-bff1-8fac7518afd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:19.712503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4985daad-774d-4f69-bff1-8fac7518afd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:19.766906 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4985daad-774d-4f69-bff1-8fac7518afd9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.069435 Dec 18 21:38:19.768162 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3723/7496] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:19 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:20.779152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea2e1b09-a13e-4c2d-b46b-b865bb2a3bbf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:20.780156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ea2e1b09-a13e-4c2d-b46b-b865bb2a3bbf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:20.787402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2e1b09-a13e-4c2d-b46b-b865bb2a3bbf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:20.787858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2e1b09-a13e-4c2d-b46b-b865bb2a3bbf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:20.788646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2e1b09-a13e-4c2d-b46b-b865bb2a3bbf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:20.789087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2e1b09-a13e-4c2d-b46b-b865bb2a3bbf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:20.834829 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ea2e1b09-a13e-4c2d-b46b-b865bb2a3bbf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059466 Dec 18 21:38:20.835479 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3774/7497] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:20 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:21.847143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52e8bfc8-f27f-4e7a-a6de-f185ff0c27f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:21.848186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52e8bfc8-f27f-4e7a-a6de-f185ff0c27f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:21.855980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc8-f27f-4e7a-a6de-f185ff0c27f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:21.856449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc8-f27f-4e7a-a6de-f185ff0c27f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:21.857249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc8-f27f-4e7a-a6de-f185ff0c27f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:21.857701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc8-f27f-4e7a-a6de-f185ff0c27f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:21.899798 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52e8bfc8-f27f-4e7a-a6de-f185ff0c27f5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.056687 Dec 18 21:38:21.900426 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3724/7498] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:21 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:22.911955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e8a14a7-0df9-4281-ac4b-12d67b5bec96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:22.912986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e8a14a7-0df9-4281-ac4b-12d67b5bec96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:22.920205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e8a14a7-0df9-4281-ac4b-12d67b5bec96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:22.920650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e8a14a7-0df9-4281-ac4b-12d67b5bec96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:22.921425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e8a14a7-0df9-4281-ac4b-12d67b5bec96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:22.921858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e8a14a7-0df9-4281-ac4b-12d67b5bec96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:22.962921 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e8a14a7-0df9-4281-ac4b-12d67b5bec96 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.054882 Dec 18 21:38:22.963791 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3775/7499] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:22 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:23.975348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-121ded5c-de31-4ced-af85-8305a72e2db8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:23.976577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-121ded5c-de31-4ced-af85-8305a72e2db8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:23.983573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-121ded5c-de31-4ced-af85-8305a72e2db8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:23.984043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-121ded5c-de31-4ced-af85-8305a72e2db8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:23.984885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-121ded5c-de31-4ced-af85-8305a72e2db8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:23.985335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-121ded5c-de31-4ced-af85-8305a72e2db8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:24.025027 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-121ded5c-de31-4ced-af85-8305a72e2db8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.053231 Dec 18 21:38:24.025669 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3725/7500] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:23 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:25.037367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae615a13-7d9a-46e3-8e1c-40197594b510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:25.038311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae615a13-7d9a-46e3-8e1c-40197594b510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:25.046057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae615a13-7d9a-46e3-8e1c-40197594b510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:25.046536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae615a13-7d9a-46e3-8e1c-40197594b510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:25.047313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae615a13-7d9a-46e3-8e1c-40197594b510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:25.047747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae615a13-7d9a-46e3-8e1c-40197594b510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:25.087568 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae615a13-7d9a-46e3-8e1c-40197594b510 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.053758 Dec 18 21:38:25.088194 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3776/7501] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:25 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:26.099353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e4f86777-c350-4381-8b21-68ac170f082f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:26.100391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e4f86777-c350-4381-8b21-68ac170f082f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:26.108250 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f86777-c350-4381-8b21-68ac170f082f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:26.108719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f86777-c350-4381-8b21-68ac170f082f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:26.109505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f86777-c350-4381-8b21-68ac170f082f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:26.109954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e4f86777-c350-4381-8b21-68ac170f082f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:26.156885 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e4f86777-c350-4381-8b21-68ac170f082f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.061500 Dec 18 21:38:26.157763 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3726/7502] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:26 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:27.169679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc7c288b-701f-4f5f-841c-ed553f715df6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:27.170760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc7c288b-701f-4f5f-841c-ed553f715df6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:27.178048 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc7c288b-701f-4f5f-841c-ed553f715df6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:27.178537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc7c288b-701f-4f5f-841c-ed553f715df6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:27.179329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc7c288b-701f-4f5f-841c-ed553f715df6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:27.179774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bc7c288b-701f-4f5f-841c-ed553f715df6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:27.226031 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc7c288b-701f-4f5f-841c-ed553f715df6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060845 Dec 18 21:38:27.226754 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3777/7503] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:27 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:28.238977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53ecff65-681f-44c9-beb6-ff0f8dce19ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:28.239996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53ecff65-681f-44c9-beb6-ff0f8dce19ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:28.247796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53ecff65-681f-44c9-beb6-ff0f8dce19ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:28.248265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53ecff65-681f-44c9-beb6-ff0f8dce19ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:28.249069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53ecff65-681f-44c9-beb6-ff0f8dce19ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:28.249522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53ecff65-681f-44c9-beb6-ff0f8dce19ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:28.292801 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53ecff65-681f-44c9-beb6-ff0f8dce19ab tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.057789 Dec 18 21:38:28.293654 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3727/7504] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:28 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:29.305091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3be47ff8-af76-4d1a-a750-a92d4d9d83ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:29.306100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3be47ff8-af76-4d1a-a750-a92d4d9d83ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:29.313387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3be47ff8-af76-4d1a-a750-a92d4d9d83ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:29.313843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3be47ff8-af76-4d1a-a750-a92d4d9d83ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:29.314664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3be47ff8-af76-4d1a-a750-a92d4d9d83ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:29.315145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3be47ff8-af76-4d1a-a750-a92d4d9d83ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:29.361296 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3be47ff8-af76-4d1a-a750-a92d4d9d83ca tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060099 Dec 18 21:38:29.361969 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3778/7505] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:29 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:30.374113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ed76a7f-063f-4379-a460-5f552c3ece57 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:30.375149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2ed76a7f-063f-4379-a460-5f552c3ece57 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:30.382423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed76a7f-063f-4379-a460-5f552c3ece57 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:30.382887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed76a7f-063f-4379-a460-5f552c3ece57 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:30.384287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed76a7f-063f-4379-a460-5f552c3ece57 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:30.384735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2ed76a7f-063f-4379-a460-5f552c3ece57 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:30.429807 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ed76a7f-063f-4379-a460-5f552c3ece57 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059746 Dec 18 21:38:30.430930 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3728/7506] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:30 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:31.442498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fe20eb82-e67c-484c-a71d-9906f6cebb05 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:31.443526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fe20eb82-e67c-484c-a71d-9906f6cebb05 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:31.451275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe20eb82-e67c-484c-a71d-9906f6cebb05 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:31.451728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe20eb82-e67c-484c-a71d-9906f6cebb05 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:31.452511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe20eb82-e67c-484c-a71d-9906f6cebb05 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:31.452954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe20eb82-e67c-484c-a71d-9906f6cebb05 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:31.497078 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fe20eb82-e67c-484c-a71d-9906f6cebb05 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058577 Dec 18 21:38:31.497699 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3779/7507] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:31 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:32.509277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-feaabfc1-530a-42cc-a8fd-5ae4e078ac9f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:32.510352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-feaabfc1-530a-42cc-a8fd-5ae4e078ac9f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:32.517649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feaabfc1-530a-42cc-a8fd-5ae4e078ac9f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:32.518117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feaabfc1-530a-42cc-a8fd-5ae4e078ac9f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:32.518952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feaabfc1-530a-42cc-a8fd-5ae4e078ac9f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:32.519407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-feaabfc1-530a-42cc-a8fd-5ae4e078ac9f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:32.564053 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-feaabfc1-530a-42cc-a8fd-5ae4e078ac9f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058776 Dec 18 21:38:32.564699 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3729/7508] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:32 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:33.576909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e9990ce3-6f7f-4611-ae27-e72eb5605fc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:33.577916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e9990ce3-6f7f-4611-ae27-e72eb5605fc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:33.585493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9990ce3-6f7f-4611-ae27-e72eb5605fc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:33.585956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9990ce3-6f7f-4611-ae27-e72eb5605fc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:33.586778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9990ce3-6f7f-4611-ae27-e72eb5605fc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:33.587225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9990ce3-6f7f-4611-ae27-e72eb5605fc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:33.633145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e9990ce3-6f7f-4611-ae27-e72eb5605fc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060179 Dec 18 21:38:33.633821 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3780/7509] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:33 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:34.644870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92a828a6-1e47-443d-b251-1e5fde42b076 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:34.645887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92a828a6-1e47-443d-b251-1e5fde42b076 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:34.653835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a828a6-1e47-443d-b251-1e5fde42b076 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:34.654332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a828a6-1e47-443d-b251-1e5fde42b076 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:34.655138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a828a6-1e47-443d-b251-1e5fde42b076 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:34.655592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92a828a6-1e47-443d-b251-1e5fde42b076 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:34.698742 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92a828a6-1e47-443d-b251-1e5fde42b076 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.057899 Dec 18 21:38:34.699624 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3730/7510] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:34 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:35.711940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2eed60d-e075-4261-b4d9-59baad20aba8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:35.712969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2eed60d-e075-4261-b4d9-59baad20aba8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:35.720291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2eed60d-e075-4261-b4d9-59baad20aba8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:35.720745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2eed60d-e075-4261-b4d9-59baad20aba8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:35.721531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2eed60d-e075-4261-b4d9-59baad20aba8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:35.721986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2eed60d-e075-4261-b4d9-59baad20aba8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:35.766644 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2eed60d-e075-4261-b4d9-59baad20aba8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059197 Dec 18 21:38:35.767520 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3781/7511] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:35 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:36.779076 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7a72ff7-2d33-4152-beec-6c11c69a914d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:36.780134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7a72ff7-2d33-4152-beec-6c11c69a914d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:36.787509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7a72ff7-2d33-4152-beec-6c11c69a914d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:36.787980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7a72ff7-2d33-4152-beec-6c11c69a914d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:36.788819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7a72ff7-2d33-4152-beec-6c11c69a914d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:36.789276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7a72ff7-2d33-4152-beec-6c11c69a914d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:36.835759 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7a72ff7-2d33-4152-beec-6c11c69a914d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060550 Dec 18 21:38:36.836315 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3731/7512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:36 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:37.847822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-81ef1519-3a21-434a-b65f-4e79e25c389c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:37.848812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-81ef1519-3a21-434a-b65f-4e79e25c389c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:37.856024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ef1519-3a21-434a-b65f-4e79e25c389c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:37.856471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ef1519-3a21-434a-b65f-4e79e25c389c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:37.857247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ef1519-3a21-434a-b65f-4e79e25c389c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:37.857681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-81ef1519-3a21-434a-b65f-4e79e25c389c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:37.905043 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-81ef1519-3a21-434a-b65f-4e79e25c389c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.061173 Dec 18 21:38:37.909088 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3782/7513] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:37 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:38.917532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c281034d-038c-4124-a102-aa4ff9c229d5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:38.918566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c281034d-038c-4124-a102-aa4ff9c229d5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:38.925920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c281034d-038c-4124-a102-aa4ff9c229d5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:38.926422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c281034d-038c-4124-a102-aa4ff9c229d5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:38.927236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c281034d-038c-4124-a102-aa4ff9c229d5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:38.927719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c281034d-038c-4124-a102-aa4ff9c229d5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:38.973168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c281034d-038c-4124-a102-aa4ff9c229d5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059858 Dec 18 21:38:38.973840 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3732/7514] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:38 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:39.985448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-968dde36-9305-466e-b7c6-2199c860ee72 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:39.986483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-968dde36-9305-466e-b7c6-2199c860ee72 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:39.993939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968dde36-9305-466e-b7c6-2199c860ee72 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:39.994418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968dde36-9305-466e-b7c6-2199c860ee72 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:39.995205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968dde36-9305-466e-b7c6-2199c860ee72 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:39.995644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-968dde36-9305-466e-b7c6-2199c860ee72 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:40.043140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-968dde36-9305-466e-b7c6-2199c860ee72 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.061646 Dec 18 21:38:40.043797 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3783/7515] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:39 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:41.054884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-08d3023b-1f2a-42cd-8788-a0303bec1900 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:41.056345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-08d3023b-1f2a-42cd-8788-a0303bec1900 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:41.063770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d3023b-1f2a-42cd-8788-a0303bec1900 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:41.064271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d3023b-1f2a-42cd-8788-a0303bec1900 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:41.065078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d3023b-1f2a-42cd-8788-a0303bec1900 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:41.065533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08d3023b-1f2a-42cd-8788-a0303bec1900 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:41.110747 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-08d3023b-1f2a-42cd-8788-a0303bec1900 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059911 Dec 18 21:38:41.111436 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3733/7516] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:41 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:42.123139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aea3e3d1-dcf8-4e75-b2c3-93876be579f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:42.124156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aea3e3d1-dcf8-4e75-b2c3-93876be579f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:42.131672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aea3e3d1-dcf8-4e75-b2c3-93876be579f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:42.132128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aea3e3d1-dcf8-4e75-b2c3-93876be579f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:42.132925 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aea3e3d1-dcf8-4e75-b2c3-93876be579f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:42.133372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aea3e3d1-dcf8-4e75-b2c3-93876be579f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:42.187677 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aea3e3d1-dcf8-4e75-b2c3-93876be579f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.068534 Dec 18 21:38:42.188566 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3784/7517] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:42 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:43.200532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-04f7702d-cc11-44e7-835d-115fa34ba357 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:43.201559 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-04f7702d-cc11-44e7-835d-115fa34ba357 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:43.209188 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f7702d-cc11-44e7-835d-115fa34ba357 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:43.209655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f7702d-cc11-44e7-835d-115fa34ba357 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:43.210492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f7702d-cc11-44e7-835d-115fa34ba357 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:43.211005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-04f7702d-cc11-44e7-835d-115fa34ba357 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:43.257836 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-04f7702d-cc11-44e7-835d-115fa34ba357 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.061281 Dec 18 21:38:43.258505 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3734/7518] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:43 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:44.270204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cb524bf6-1f86-4bb1-a574-246cdb73541f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:44.271273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cb524bf6-1f86-4bb1-a574-246cdb73541f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:44.278592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb524bf6-1f86-4bb1-a574-246cdb73541f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:44.279049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb524bf6-1f86-4bb1-a574-246cdb73541f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:44.279844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb524bf6-1f86-4bb1-a574-246cdb73541f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:44.280983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cb524bf6-1f86-4bb1-a574-246cdb73541f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:44.326435 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cb524bf6-1f86-4bb1-a574-246cdb73541f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060157 Dec 18 21:38:44.327320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3785/7519] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:44 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:45.339258 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-19440427-1cca-430c-9c03-2692fd8e2286 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:45.340264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-19440427-1cca-430c-9c03-2692fd8e2286 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:45.347531 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19440427-1cca-430c-9c03-2692fd8e2286 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:45.347991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19440427-1cca-430c-9c03-2692fd8e2286 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:45.348776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19440427-1cca-430c-9c03-2692fd8e2286 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:45.349252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-19440427-1cca-430c-9c03-2692fd8e2286 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:45.392671 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-19440427-1cca-430c-9c03-2692fd8e2286 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.057428 Dec 18 21:38:45.393292 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3735/7520] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:45 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:46.405464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0d121afb-4e47-4496-8e9d-59106395f21a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:46.406520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0d121afb-4e47-4496-8e9d-59106395f21a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:46.413899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d121afb-4e47-4496-8e9d-59106395f21a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:46.414396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d121afb-4e47-4496-8e9d-59106395f21a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:46.415228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d121afb-4e47-4496-8e9d-59106395f21a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:46.415721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0d121afb-4e47-4496-8e9d-59106395f21a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:46.459802 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0d121afb-4e47-4496-8e9d-59106395f21a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058317 Dec 18 21:38:46.460711 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3786/7521] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:46 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:47.472710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b62a4f2-68f1-4c65-a76b-d515619b29d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:47.473727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b62a4f2-68f1-4c65-a76b-d515619b29d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:47.481623 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b62a4f2-68f1-4c65-a76b-d515619b29d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:47.482095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b62a4f2-68f1-4c65-a76b-d515619b29d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:47.482930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b62a4f2-68f1-4c65-a76b-d515619b29d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:47.483407 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b62a4f2-68f1-4c65-a76b-d515619b29d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:47.529586 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b62a4f2-68f1-4c65-a76b-d515619b29d1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060869 Dec 18 21:38:47.530531 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3736/7522] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:47 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:48.541460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a0fffcc-f17a-4e03-a91e-601a6fdeec34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:48.542596 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a0fffcc-f17a-4e03-a91e-601a6fdeec34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:48.549811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a0fffcc-f17a-4e03-a91e-601a6fdeec34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:48.550270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a0fffcc-f17a-4e03-a91e-601a6fdeec34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:48.551064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a0fffcc-f17a-4e03-a91e-601a6fdeec34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:48.551505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a0fffcc-f17a-4e03-a91e-601a6fdeec34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:48.595699 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a0fffcc-f17a-4e03-a91e-601a6fdeec34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058206 Dec 18 21:38:48.596638 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3787/7523] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:48 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:49.607901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2c02585a-59db-4fe9-b22c-ee7e37a8ab63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:49.608917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2c02585a-59db-4fe9-b22c-ee7e37a8ab63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:49.616521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c02585a-59db-4fe9-b22c-ee7e37a8ab63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:49.616986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c02585a-59db-4fe9-b22c-ee7e37a8ab63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:49.617785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c02585a-59db-4fe9-b22c-ee7e37a8ab63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:49.618416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c02585a-59db-4fe9-b22c-ee7e37a8ab63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:49.662748 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2c02585a-59db-4fe9-b22c-ee7e37a8ab63 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058815 Dec 18 21:38:49.663406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3737/7524] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:49 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:50.675026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c323f0c-0acc-4c3f-9597-15c31ef68787 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:50.676064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c323f0c-0acc-4c3f-9597-15c31ef68787 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:50.683368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c323f0c-0acc-4c3f-9597-15c31ef68787 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:50.683833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c323f0c-0acc-4c3f-9597-15c31ef68787 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:50.684640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c323f0c-0acc-4c3f-9597-15c31ef68787 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:50.685087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c323f0c-0acc-4c3f-9597-15c31ef68787 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:50.733658 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c323f0c-0acc-4c3f-9597-15c31ef68787 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.062585 Dec 18 21:38:50.737619 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3788/7525] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:50 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:51.746107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-caa5c98c-af07-4245-9dec-31dbd71430c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:51.747228 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-caa5c98c-af07-4245-9dec-31dbd71430c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:51.754818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caa5c98c-af07-4245-9dec-31dbd71430c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:51.755277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caa5c98c-af07-4245-9dec-31dbd71430c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:51.756064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caa5c98c-af07-4245-9dec-31dbd71430c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:51.756545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-caa5c98c-af07-4245-9dec-31dbd71430c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:51.800701 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-caa5c98c-af07-4245-9dec-31dbd71430c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059244 Dec 18 21:38:51.801712 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3738/7526] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:51 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:52.813127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-344771b6-7996-4bf1-899f-7d35f39ac16d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:52.814122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-344771b6-7996-4bf1-899f-7d35f39ac16d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:52.821956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-344771b6-7996-4bf1-899f-7d35f39ac16d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:52.822439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-344771b6-7996-4bf1-899f-7d35f39ac16d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:52.823215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-344771b6-7996-4bf1-899f-7d35f39ac16d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:52.823651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-344771b6-7996-4bf1-899f-7d35f39ac16d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:52.870546 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-344771b6-7996-4bf1-899f-7d35f39ac16d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.061293 Dec 18 21:38:52.871200 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3789/7527] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:52 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:53.882719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-88eb3de8-5515-408a-8e9e-2f418086de41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:53.884219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-88eb3de8-5515-408a-8e9e-2f418086de41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:53.891414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88eb3de8-5515-408a-8e9e-2f418086de41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:53.891881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88eb3de8-5515-408a-8e9e-2f418086de41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:53.892683 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88eb3de8-5515-408a-8e9e-2f418086de41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:53.893135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-88eb3de8-5515-408a-8e9e-2f418086de41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:53.938274 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-88eb3de8-5515-408a-8e9e-2f418086de41 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059580 Dec 18 21:38:53.939228 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3739/7528] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:53 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:54.950413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-631bf2b3-7d34-408b-8e23-f92befb6f40a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:54.951411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-631bf2b3-7d34-408b-8e23-f92befb6f40a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:54.958664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-631bf2b3-7d34-408b-8e23-f92befb6f40a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:54.959117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-631bf2b3-7d34-408b-8e23-f92befb6f40a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:54.959890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-631bf2b3-7d34-408b-8e23-f92befb6f40a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:54.960327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-631bf2b3-7d34-408b-8e23-f92befb6f40a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:55.007020 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-631bf2b3-7d34-408b-8e23-f92befb6f40a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060453 Dec 18 21:38:55.007577 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3790/7529] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:54 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:56.019215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53341215-352c-4d30-87e3-e68682bad9a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:56.020270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53341215-352c-4d30-87e3-e68682bad9a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:56.027651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53341215-352c-4d30-87e3-e68682bad9a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:56.028119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53341215-352c-4d30-87e3-e68682bad9a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:56.028948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53341215-352c-4d30-87e3-e68682bad9a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:56.029406 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53341215-352c-4d30-87e3-e68682bad9a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:56.073369 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53341215-352c-4d30-87e3-e68682bad9a4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058092 Dec 18 21:38:56.074298 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3740/7530] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:56 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:57.085816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-807b52ff-c3f3-4ee4-9429-96a3b70e20b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:57.087402 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-807b52ff-c3f3-4ee4-9429-96a3b70e20b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:57.094840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-807b52ff-c3f3-4ee4-9429-96a3b70e20b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:57.095208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-807b52ff-c3f3-4ee4-9429-96a3b70e20b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:57.095973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-807b52ff-c3f3-4ee4-9429-96a3b70e20b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:57.096396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-807b52ff-c3f3-4ee4-9429-96a3b70e20b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:57.141190 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-807b52ff-c3f3-4ee4-9429-96a3b70e20b6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059488 Dec 18 21:38:57.142104 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3791/7531] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:57 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:58.154046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7baa0b77-ef65-4340-ab4d-65abef00744b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:58.155113 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7baa0b77-ef65-4340-ab4d-65abef00744b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:58.162855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7baa0b77-ef65-4340-ab4d-65abef00744b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:58.163324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7baa0b77-ef65-4340-ab4d-65abef00744b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:58.164192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7baa0b77-ef65-4340-ab4d-65abef00744b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:58.164651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7baa0b77-ef65-4340-ab4d-65abef00744b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:58.209977 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7baa0b77-ef65-4340-ab4d-65abef00744b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060395 Dec 18 21:38:58.210643 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3741/7532] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:58 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:38:59.223197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bb3576c2-d52d-4d7d-9052-c3cc1e31b869 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:38:59.224205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bb3576c2-d52d-4d7d-9052-c3cc1e31b869 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:38:59.232184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb3576c2-d52d-4d7d-9052-c3cc1e31b869 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:59.232642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb3576c2-d52d-4d7d-9052-c3cc1e31b869 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:59.233433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb3576c2-d52d-4d7d-9052-c3cc1e31b869 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:38:59.233878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bb3576c2-d52d-4d7d-9052-c3cc1e31b869 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:38:59.278537 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bb3576c2-d52d-4d7d-9052-c3cc1e31b869 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059325 Dec 18 21:38:59.279297 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3792/7533] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:38:59 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:00.290932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-920ac140-6132-4d92-acd4-ec8e52beb54f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:00.291943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-920ac140-6132-4d92-acd4-ec8e52beb54f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:00.299236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-920ac140-6132-4d92-acd4-ec8e52beb54f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:00.299809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-920ac140-6132-4d92-acd4-ec8e52beb54f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:00.300604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-920ac140-6132-4d92-acd4-ec8e52beb54f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:00.301059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-920ac140-6132-4d92-acd4-ec8e52beb54f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:00.348901 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-920ac140-6132-4d92-acd4-ec8e52beb54f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.061956 Dec 18 21:39:00.349621 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3742/7534] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:00 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:01.363980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f9e8df77-287a-4941-8eb2-c56495512418 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:01.365015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f9e8df77-287a-4941-8eb2-c56495512418 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:01.372332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9e8df77-287a-4941-8eb2-c56495512418 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:01.372795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9e8df77-287a-4941-8eb2-c56495512418 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:01.373591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9e8df77-287a-4941-8eb2-c56495512418 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:01.374037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f9e8df77-287a-4941-8eb2-c56495512418 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:01.418685 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f9e8df77-287a-4941-8eb2-c56495512418 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059995 Dec 18 21:39:01.419321 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3793/7535] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:01 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:02.431806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-216b4e3c-01a8-48a2-874c-8e97dcbd5f30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:02.432826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-216b4e3c-01a8-48a2-874c-8e97dcbd5f30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:02.440272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-216b4e3c-01a8-48a2-874c-8e97dcbd5f30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:02.440741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-216b4e3c-01a8-48a2-874c-8e97dcbd5f30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:02.441541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-216b4e3c-01a8-48a2-874c-8e97dcbd5f30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:02.441995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-216b4e3c-01a8-48a2-874c-8e97dcbd5f30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:02.487978 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-216b4e3c-01a8-48a2-874c-8e97dcbd5f30 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060833 Dec 18 21:39:02.488737 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3743/7536] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:02 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:03.500331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1b9578c2-bed0-4c12-b77b-46444f330fc0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:03.501329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1b9578c2-bed0-4c12-b77b-46444f330fc0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:03.509151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b9578c2-bed0-4c12-b77b-46444f330fc0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:03.509598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b9578c2-bed0-4c12-b77b-46444f330fc0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:03.510417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b9578c2-bed0-4c12-b77b-46444f330fc0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:03.510859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1b9578c2-bed0-4c12-b77b-46444f330fc0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:03.556222 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1b9578c2-bed0-4c12-b77b-46444f330fc0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059399 Dec 18 21:39:03.556867 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3794/7537] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:03 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:04.567904 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-efa99774-74cb-4423-a1b5-60a5513a44a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:04.568957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-efa99774-74cb-4423-a1b5-60a5513a44a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:04.577264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efa99774-74cb-4423-a1b5-60a5513a44a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:04.577744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efa99774-74cb-4423-a1b5-60a5513a44a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:04.578597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efa99774-74cb-4423-a1b5-60a5513a44a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:04.579059 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-efa99774-74cb-4423-a1b5-60a5513a44a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:04.624085 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-efa99774-74cb-4423-a1b5-60a5513a44a5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060144 Dec 18 21:39:04.624756 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3744/7538] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:04 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:39:05.636341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-78fab9c4-65df-4bdb-82a5-c4505276db42 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:05.637353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-78fab9c4-65df-4bdb-82a5-c4505276db42 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:05.644712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78fab9c4-65df-4bdb-82a5-c4505276db42 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:05.645170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78fab9c4-65df-4bdb-82a5-c4505276db42 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:05.645961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78fab9c4-65df-4bdb-82a5-c4505276db42 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:05.646447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-78fab9c4-65df-4bdb-82a5-c4505276db42 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:05.697572 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-78fab9c4-65df-4bdb-82a5-c4505276db42 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.065246 Dec 18 21:39:05.698214 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3795/7539] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:05 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:06.710572 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d450da5f-f798-4853-9208-9b8af9d3a667 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:06.711600 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d450da5f-f798-4853-9208-9b8af9d3a667 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:06.719060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d450da5f-f798-4853-9208-9b8af9d3a667 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:06.719534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d450da5f-f798-4853-9208-9b8af9d3a667 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:06.720343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d450da5f-f798-4853-9208-9b8af9d3a667 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:06.720799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d450da5f-f798-4853-9208-9b8af9d3a667 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:06.766472 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d450da5f-f798-4853-9208-9b8af9d3a667 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060245 Dec 18 21:39:06.767333 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3745/7540] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:06 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:07.778969 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-108f9efe-9c1d-4d37-8eee-0a537c681177 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:07.779892 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-108f9efe-9c1d-4d37-8eee-0a537c681177 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:07.787138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-108f9efe-9c1d-4d37-8eee-0a537c681177 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:07.787593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-108f9efe-9c1d-4d37-8eee-0a537c681177 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:07.788361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-108f9efe-9c1d-4d37-8eee-0a537c681177 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:07.788829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-108f9efe-9c1d-4d37-8eee-0a537c681177 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:07.836905 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-108f9efe-9c1d-4d37-8eee-0a537c681177 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.062098 Dec 18 21:39:07.837813 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3796/7541] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:07 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:08.849365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-86802758-3e46-47be-a54b-960c94c7eda4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:08.850435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-86802758-3e46-47be-a54b-960c94c7eda4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:08.857741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86802758-3e46-47be-a54b-960c94c7eda4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:08.858206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86802758-3e46-47be-a54b-960c94c7eda4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:08.859025 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86802758-3e46-47be-a54b-960c94c7eda4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:08.859487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-86802758-3e46-47be-a54b-960c94c7eda4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:08.904942 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-86802758-3e46-47be-a54b-960c94c7eda4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059425 Dec 18 21:39:08.905753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3746/7542] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:08 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:09.917129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e57faa7-9029-4cd3-9af3-aa417cfce75f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:09.918136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e57faa7-9029-4cd3-9af3-aa417cfce75f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:09.925517 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e57faa7-9029-4cd3-9af3-aa417cfce75f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:09.925977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e57faa7-9029-4cd3-9af3-aa417cfce75f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:09.926820 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e57faa7-9029-4cd3-9af3-aa417cfce75f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:09.927266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e57faa7-9029-4cd3-9af3-aa417cfce75f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:09.967440 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e57faa7-9029-4cd3-9af3-aa417cfce75f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.054777 Dec 18 21:39:09.968433 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3797/7543] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:09 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:10.979838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b8b06dd8-6efc-4617-90c4-62a5be1870fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:10.980795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b8b06dd8-6efc-4617-90c4-62a5be1870fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:10.988096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8b06dd8-6efc-4617-90c4-62a5be1870fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:10.988558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8b06dd8-6efc-4617-90c4-62a5be1870fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:10.989356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8b06dd8-6efc-4617-90c4-62a5be1870fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:10.989805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b8b06dd8-6efc-4617-90c4-62a5be1870fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:11.035220 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b8b06dd8-6efc-4617-90c4-62a5be1870fc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059430 Dec 18 21:39:11.035888 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3747/7544] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:10 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:12.047803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-446ffe35-8da6-4e14-8302-d6fed7a207ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:12.048873 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-446ffe35-8da6-4e14-8302-d6fed7a207ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:12.056110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446ffe35-8da6-4e14-8302-d6fed7a207ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:12.056565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446ffe35-8da6-4e14-8302-d6fed7a207ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:12.057348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446ffe35-8da6-4e14-8302-d6fed7a207ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:12.057801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-446ffe35-8da6-4e14-8302-d6fed7a207ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:12.102478 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-446ffe35-8da6-4e14-8302-d6fed7a207ef tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058900 Dec 18 21:39:12.103469 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3798/7545] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:12 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:13.114933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-979c391b-861d-43ae-a8c5-3e8187d559ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:13.115969 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-979c391b-861d-43ae-a8c5-3e8187d559ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:13.124161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-979c391b-861d-43ae-a8c5-3e8187d559ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:13.124633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-979c391b-861d-43ae-a8c5-3e8187d559ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:13.125474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-979c391b-861d-43ae-a8c5-3e8187d559ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:13.125924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-979c391b-861d-43ae-a8c5-3e8187d559ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:13.173189 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-979c391b-861d-43ae-a8c5-3e8187d559ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.062263 Dec 18 21:39:13.173900 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3748/7546] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:13 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:14.185151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c0f95b83-f789-4f0d-943a-7856f07b9d56 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:14.186183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c0f95b83-f789-4f0d-943a-7856f07b9d56 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:14.193486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0f95b83-f789-4f0d-943a-7856f07b9d56 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:14.193941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0f95b83-f789-4f0d-943a-7856f07b9d56 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:14.194767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0f95b83-f789-4f0d-943a-7856f07b9d56 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:14.195208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c0f95b83-f789-4f0d-943a-7856f07b9d56 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:14.236108 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c0f95b83-f789-4f0d-943a-7856f07b9d56 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.055598 Dec 18 21:39:14.236970 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3799/7547] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:14 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:15.248858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06ef90cc-92fa-4c65-8c23-d750665341f2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:15.249874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06ef90cc-92fa-4c65-8c23-d750665341f2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:15.257260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06ef90cc-92fa-4c65-8c23-d750665341f2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:15.257723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06ef90cc-92fa-4c65-8c23-d750665341f2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:15.258548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06ef90cc-92fa-4c65-8c23-d750665341f2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:15.259637 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06ef90cc-92fa-4c65-8c23-d750665341f2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:15.304470 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06ef90cc-92fa-4c65-8c23-d750665341f2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059593 Dec 18 21:39:15.305131 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3749/7548] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:15 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:16.317412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66ba64c3-f020-4783-893b-4030cda9988e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:16.318458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66ba64c3-f020-4783-893b-4030cda9988e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:16.326196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66ba64c3-f020-4783-893b-4030cda9988e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:16.326809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66ba64c3-f020-4783-893b-4030cda9988e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:16.327609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66ba64c3-f020-4783-893b-4030cda9988e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:16.328057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66ba64c3-f020-4783-893b-4030cda9988e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:16.372404 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66ba64c3-f020-4783-893b-4030cda9988e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059004 Dec 18 21:39:16.373035 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3800/7549] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:16 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:17.384402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-90f1ef65-7f4b-4aa4-834d-f1408c3221cc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:17.385445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-90f1ef65-7f4b-4aa4-834d-f1408c3221cc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:17.392753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f1ef65-7f4b-4aa4-834d-f1408c3221cc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:17.393218 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f1ef65-7f4b-4aa4-834d-f1408c3221cc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:17.394012 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f1ef65-7f4b-4aa4-834d-f1408c3221cc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:17.394484 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90f1ef65-7f4b-4aa4-834d-f1408c3221cc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:17.439367 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-90f1ef65-7f4b-4aa4-834d-f1408c3221cc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058986 Dec 18 21:39:17.440000 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3750/7550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:17 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:39:18.452412 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-825fdae5-049c-41fa-ad86-4a8243b10ab1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:18.453413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-825fdae5-049c-41fa-ad86-4a8243b10ab1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:18.460995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825fdae5-049c-41fa-ad86-4a8243b10ab1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:18.461448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825fdae5-049c-41fa-ad86-4a8243b10ab1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:18.462230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825fdae5-049c-41fa-ad86-4a8243b10ab1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:18.462782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825fdae5-049c-41fa-ad86-4a8243b10ab1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:18.511457 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-825fdae5-049c-41fa-ad86-4a8243b10ab1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.063011 Dec 18 21:39:18.512099 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3801/7551] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:18 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:19.523276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2dbed0ad-7838-4747-b2b7-b03cafbc725b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:19.524288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2dbed0ad-7838-4747-b2b7-b03cafbc725b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:19.532311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbed0ad-7838-4747-b2b7-b03cafbc725b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:19.532773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbed0ad-7838-4747-b2b7-b03cafbc725b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:19.533565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbed0ad-7838-4747-b2b7-b03cafbc725b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:19.534013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2dbed0ad-7838-4747-b2b7-b03cafbc725b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:19.577277 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2dbed0ad-7838-4747-b2b7-b03cafbc725b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058040 Dec 18 21:39:19.577907 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3751/7552] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:19 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:20.589470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fd15167-9fb6-470f-bc8d-158d3efba3ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:20.590515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fd15167-9fb6-470f-bc8d-158d3efba3ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:20.598155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fd15167-9fb6-470f-bc8d-158d3efba3ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:20.598666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fd15167-9fb6-470f-bc8d-158d3efba3ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:20.599455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fd15167-9fb6-470f-bc8d-158d3efba3ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:20.599928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fd15167-9fb6-470f-bc8d-158d3efba3ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:20.643586 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fd15167-9fb6-470f-bc8d-158d3efba3ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058679 Dec 18 21:39:20.644201 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3802/7553] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:20 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:21.655866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9146efc1-6523-49a6-a976-745b530f165c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:21.656878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9146efc1-6523-49a6-a976-745b530f165c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:21.664119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9146efc1-6523-49a6-a976-745b530f165c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:21.664581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9146efc1-6523-49a6-a976-745b530f165c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:21.665861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9146efc1-6523-49a6-a976-745b530f165c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:21.666332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9146efc1-6523-49a6-a976-745b530f165c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:21.712549 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9146efc1-6523-49a6-a976-745b530f165c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.060592 Dec 18 21:39:21.713220 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3752/7554] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:21 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:22.724665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9099016-dc22-4b0f-916b-7cdcf4819870 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:22.725680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9099016-dc22-4b0f-916b-7cdcf4819870 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:22.733368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9099016-dc22-4b0f-916b-7cdcf4819870 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:22.733830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9099016-dc22-4b0f-916b-7cdcf4819870 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:22.734652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9099016-dc22-4b0f-916b-7cdcf4819870 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:22.735096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9099016-dc22-4b0f-916b-7cdcf4819870 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:22.784679 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9099016-dc22-4b0f-916b-7cdcf4819870 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.063943 Dec 18 21:39:22.785337 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3803/7555] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:22 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:23.796634 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-62dd4d0d-0171-4988-a1fd-1af5b6c85638 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:23.797567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-62dd4d0d-0171-4988-a1fd-1af5b6c85638 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:23.804708 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62dd4d0d-0171-4988-a1fd-1af5b6c85638 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:23.805171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62dd4d0d-0171-4988-a1fd-1af5b6c85638 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:23.805957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62dd4d0d-0171-4988-a1fd-1af5b6c85638 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:23.806442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-62dd4d0d-0171-4988-a1fd-1af5b6c85638 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:23.851648 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-62dd4d0d-0171-4988-a1fd-1af5b6c85638 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.059042 Dec 18 21:39:23.852265 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3753/7556] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:23 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:24.863828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1c27f8f4-d1e0-436c-bcd1-c995baab738c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:24.864857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1c27f8f4-d1e0-436c-bcd1-c995baab738c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:24.872573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c27f8f4-d1e0-436c-bcd1-c995baab738c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:24.873032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c27f8f4-d1e0-436c-bcd1-c995baab738c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:24.873821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c27f8f4-d1e0-436c-bcd1-c995baab738c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:24.874288 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1c27f8f4-d1e0-436c-bcd1-c995baab738c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:24.917921 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1c27f8f4-d1e0-436c-bcd1-c995baab738c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.058087 Dec 18 21:39:24.918584 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3804/7557] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:24 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:25.929395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-663f332d-529e-460b-9d4e-d60887a034fd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:25.930970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-663f332d-529e-460b-9d4e-d60887a034fd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:25.938275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-663f332d-529e-460b-9d4e-d60887a034fd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:25.938757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-663f332d-529e-460b-9d4e-d60887a034fd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:25.939555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-663f332d-529e-460b-9d4e-d60887a034fd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:25.940011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-663f332d-529e-460b-9d4e-d60887a034fd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:25.982077 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-663f332d-529e-460b-9d4e-d60887a034fd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.056626 Dec 18 21:39:25.982782 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3754/7558] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:25 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:26.993564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ae2a5332-684b-4ccc-aad8-4aeaa68b97c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:26.994539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ae2a5332-684b-4ccc-aad8-4aeaa68b97c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:27.001758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae2a5332-684b-4ccc-aad8-4aeaa68b97c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:27.002207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae2a5332-684b-4ccc-aad8-4aeaa68b97c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:27.003010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae2a5332-684b-4ccc-aad8-4aeaa68b97c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:27.003445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ae2a5332-684b-4ccc-aad8-4aeaa68b97c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:27.044296 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ae2a5332-684b-4ccc-aad8-4aeaa68b97c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 32640 microversion: 2.1 time: 0.054769 Dec 18 21:39:27.044925 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3805/7559] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:26 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 32640 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:28.056459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0993890e-1daa-4980-b512-6a469edbe26c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:28.057464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0993890e-1daa-4980-b512-6a469edbe26c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:28.064733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0993890e-1daa-4980-b512-6a469edbe26c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:28.065200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0993890e-1daa-4980-b512-6a469edbe26c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:28.065989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0993890e-1daa-4980-b512-6a469edbe26c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:28.066469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0993890e-1daa-4980-b512-6a469edbe26c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:28.121662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0993890e-1daa-4980-b512-6a469edbe26c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 200 len: 40795 microversion: 2.1 time: 0.069106 Dec 18 21:39:28.122353 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3755/7560] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:28 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 40795 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:39:28.132614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:28.133652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:28.141036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:28.141519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:28.142319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:28.142757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:28.170135 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:28.176055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Old instance type m1.heat2, new instance type m1.heat {{(pid=140732) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:39:28.181966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:39:28.182451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:39:28.182927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:39:28.183329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:39:28.183736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:39:28.244163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a18ed370-99a1-48c4-b198-264f5fa05a76 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 202 len: 0 microversion: 2.1 time: 0.115592 Dec 18 21:39:28.244798 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3806/7561] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:28 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:39:28.253204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:28.253919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:28.261288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:28.261960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:28.262842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:28.263348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:28.402992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:28.410370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c49f0815-f589-4443-aa19-985c8cc50aff tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1678 microversion: 2.1 time: 0.161114 Dec 18 21:39:28.410951 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3756/7562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:28 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:39:29.428501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:29.429113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:29.439252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:29.439713 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:29.440505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:29.440946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:29.644303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:29.652357 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-869cd932-178a-4cf0-bbc3-bb0df33d69c0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1678 microversion: 2.1 time: 0.228355 Dec 18 21:39:29.652944 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3807/7563] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:29 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:30.669285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:30.670275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:30.677131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:30.677610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:30.678458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:30.678922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:30.810522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:30.817816 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c4a5e47-3c7a-43e9-b418-76866d772bfc tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.152842 Dec 18 21:39:30.818406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3757/7564] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:30 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:31.835141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:31.835734 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:31.842967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:31.843427 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:31.844215 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:31.844660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:31.971809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:31.983095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66f84f4b-aef4-469b-9ac5-f6df4f076a99 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.151362 Dec 18 21:39:31.983674 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3808/7565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:31 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:33.001343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:33.001927 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:33.008770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:33.009251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:33.010022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:33.010507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:33.147057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:33.154538 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e70ce472-272f-4517-bbf5-3b3edd9a5ec7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.156968 Dec 18 21:39:33.155126 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3758/7566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:32 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:34.172147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:34.172763 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:34.179697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:34.180147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:34.181204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:34.181640 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:34.310114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:34.317697 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e0ac425a-ce63-49bc-9a66-af90f5899a40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.149267 Dec 18 21:39:34.318314 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3809/7567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:34 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:35.335263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:35.335889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:35.343379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:35.343877 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:35.344672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:35.345122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:35.477086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:35.484630 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cd473870-2fc1-45a9-9214-8b5c11bd6f21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.153067 Dec 18 21:39:35.485208 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3759/7568] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:35 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:36.502356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:36.502961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:36.510278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:36.510722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:36.511499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:36.511933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:36.640850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:36.648114 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-06700cd9-ca8c-4ac5-b90f-0b2161d52dee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.149552 Dec 18 21:39:36.648682 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3810/7569] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:36 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:37.664760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:37.665389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:37.672136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:37.672608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:37.673413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:37.673873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:37.810488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:37.818168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d194ac0c-20d6-4190-af8c-874bec9b1f6b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.157196 Dec 18 21:39:37.818801 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3760/7570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:37 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:38.837878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:38.838529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:38.845353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:38.845812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:38.846648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:38.847112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:38.978675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:38.985978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d207ed03-ac3b-48b7-b0d2-c3b0a090f3fb tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.152507 Dec 18 21:39:38.986573 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3811/7571] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:38 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:40.002003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:40.002652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:40.009949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:40.010448 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:40.011237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:40.011688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:40.139327 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:40.146786 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3335158b-e9dd-4a49-ad16-c61119c151a7 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.148389 Dec 18 21:39:40.147362 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3761/7572] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:39 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:41.162842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:41.163448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:41.170199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:41.170680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:41.171451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:41.171884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:41.303293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:41.310623 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49c948f8-0ed9-42a9-8bef-e60fdbdadc5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1683 microversion: 2.1 time: 0.151394 Dec 18 21:39:41.311194 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3812/7573] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:41 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:42.327255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:42.327873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:42.335227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:42.335686 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:42.336983 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:42.337435 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:42.482474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:42.490083 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8074435-02ee-418c-a4ae-3493d181484c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1682 microversion: 2.1 time: 0.166505 Dec 18 21:39:42.490753 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3762/7574] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:42 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:39:42.722700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-14e9af58-70e3-4e6e-a8d3-b5d7945b7288 req-1794a4d1-4a25-4d9d-837c-66b82db9d6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "name": "network-vif-unplugged", "status": "completed", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:42.724407 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:39:42.724407 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:39:42.732385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-14e9af58-70e3-4e6e-a8d3-b5d7945b7288 req-1794a4d1-4a25-4d9d-837c-66b82db9d6a5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:42.732825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-14e9af58-70e3-4e6e-a8d3-b5d7945b7288 req-1794a4d1-4a25-4d9d-837c-66b82db9d6a5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:42.747995 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-14e9af58-70e3-4e6e-a8d3-b5d7945b7288 req-1794a4d1-4a25-4d9d-837c-66b82db9d6a5 service nova] Creating event network-vif-unplugged:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch2-master-1 Dec 18 21:39:42.753593 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-14e9af58-70e3-4e6e-a8d3-b5d7945b7288 req-1794a4d1-4a25-4d9d-837c-66b82db9d6a5 service nova] Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:39:42.765834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-14e9af58-70e3-4e6e-a8d3-b5d7945b7288 req-1794a4d1-4a25-4d9d-837c-66b82db9d6a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046856 Dec 18 21:39:42.766495 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3813/7575] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:39:43.506988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:43.507608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:43.514631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:43.515097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:43.515890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:43.516341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:43.653064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:43.660451 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-051d6596-6ef4-4c67-af8d-e1f8737728d4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1682 microversion: 2.1 time: 0.157107 Dec 18 21:39:43.661031 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3763/7576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:43 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:44.678795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:44.679490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:44.685678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:44.686131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:44.686940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:44.687376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:44.789442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4f01e8f3-ec5f-434c-a565-c168be36cc7d req-64067c4f-64c1-48c7-89c6-c3f5a81ec836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:44.791071 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:39:44.791071 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:39:44.799669 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4f01e8f3-ec5f-434c-a565-c168be36cc7d req-64067c4f-64c1-48c7-89c6-c3f5a81ec836 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:44.800242 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4f01e8f3-ec5f-434c-a565-c168be36cc7d req-64067c4f-64c1-48c7-89c6-c3f5a81ec836 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:44.811959 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4f01e8f3-ec5f-434c-a565-c168be36cc7d req-64067c4f-64c1-48c7-89c6-c3f5a81ec836 service nova] Creating event network-changed:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch2-master-1 Dec 18 21:39:44.817335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-4f01e8f3-ec5f-434c-a565-c168be36cc7d req-64067c4f-64c1-48c7-89c6-c3f5a81ec836 service nova] Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:39:44.818841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:44.827484 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d10a9590-93fb-4b9a-8004-436d9244a158 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1680 microversion: 2.1 time: 0.153337 Dec 18 21:39:44.828058 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3814/7577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:44 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:44.828658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4f01e8f3-ec5f-434c-a565-c168be36cc7d req-64067c4f-64c1-48c7-89c6-c3f5a81ec836 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042811 Dec 18 21:39:44.829402 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3764/7578] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:39:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:39:45.846245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:45.846876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:45.854269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:45.854727 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:45.855501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:45.855938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:45.990366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:45.998042 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-77710473-36b3-4a67-a546-d19c9930f124 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1677 microversion: 2.1 time: 0.155387 Dec 18 21:39:45.998767 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3815/7579] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:45 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:46.016282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:46.016919 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:46.025265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:46.025735 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:46.026571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:46.027210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:46.058947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:46.059417 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:46.060251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:46.060704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:46.080246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:39:46.085415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:39:46.185744 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b577bab-17d5-45ff-a44f-85d76bbdcf2a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action" status: 202 len: 0 microversion: 2.1 time: 0.174085 Dec 18 21:39:46.186328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3765/7580] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:39:46 2021] POST /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:39:46.194280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:46.194893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:46.200876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:46.201333 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:46.202187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:46.202601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:46.337872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:46.345384 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ede783f9-f680-448c-a535-37b699e3ba62 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1676 microversion: 2.1 time: 0.154717 Dec 18 21:39:46.346169 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3816/7581] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:46 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:47.363753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:47.364489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:47.374829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:47.375296 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:47.376127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:47.376587 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:47.503583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:47.511503 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ef544ec1-69cb-4c93-be91-b232c153f64b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1676 microversion: 2.1 time: 0.152571 Dec 18 21:39:47.512004 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3766/7582] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:47 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:47.728885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0bf14380-e9e2-4c1f-8172-09f5b01d147b req-227ad19d-ca76-45a8-99df-5c8636b4f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "name": "network-vif-plugged", "status": "completed", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:47.730572 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:39:47.730572 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:39:47.738792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0bf14380-e9e2-4c1f-8172-09f5b01d147b req-227ad19d-ca76-45a8-99df-5c8636b4f1bd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:47.739262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0bf14380-e9e2-4c1f-8172-09f5b01d147b req-227ad19d-ca76-45a8-99df-5c8636b4f1bd service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:47.751575 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0bf14380-e9e2-4c1f-8172-09f5b01d147b req-227ad19d-ca76-45a8-99df-5c8636b4f1bd service nova] Creating event network-vif-plugged:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch2-master-1 Dec 18 21:39:47.757107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-0bf14380-e9e2-4c1f-8172-09f5b01d147b req-227ad19d-ca76-45a8-99df-5c8636b4f1bd service nova] Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:39:47.768570 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0bf14380-e9e2-4c1f-8172-09f5b01d147b req-227ad19d-ca76-45a8-99df-5c8636b4f1bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043883 Dec 18 21:39:47.769372 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3817/7583] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:39:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:39:48.528488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:48.529112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:48.536422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:48.536889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:48.537689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:48.538145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:48.675160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:48.683210 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-95528158-6d1e-433a-ae0b-873c2a2e5f84 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1676 microversion: 2.1 time: 0.158600 Dec 18 21:39:48.683779 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3767/7584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:48 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:49.158304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-22b1c1a3-dbde-4baf-a2bf-e1bfc5e422f2 req-7175c265-10cc-4beb-bab0-15fb2f083156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "name": "network-vif-unplugged", "status": "completed", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:49.159801 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:39:49.159801 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:39:49.168428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-22b1c1a3-dbde-4baf-a2bf-e1bfc5e422f2 req-7175c265-10cc-4beb-bab0-15fb2f083156 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:49.168872 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-22b1c1a3-dbde-4baf-a2bf-e1bfc5e422f2 req-7175c265-10cc-4beb-bab0-15fb2f083156 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:49.182761 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-22b1c1a3-dbde-4baf-a2bf-e1bfc5e422f2 req-7175c265-10cc-4beb-bab0-15fb2f083156 service nova] Creating event network-vif-unplugged:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch1-master-1 Dec 18 21:39:49.188109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-22b1c1a3-dbde-4baf-a2bf-e1bfc5e422f2 req-7175c265-10cc-4beb-bab0-15fb2f083156 service nova] Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:39:49.199089 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-22b1c1a3-dbde-4baf-a2bf-e1bfc5e422f2 req-7175c265-10cc-4beb-bab0-15fb2f083156 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044822 Dec 18 21:39:49.199700 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3818/7585] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:39:49.700809 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:49.702120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:49.713974 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:49.714749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:49.715598 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:49.716088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:49.929510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:49.937434 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a76ba7c9-0980-4b26-ace4-b099696a401a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1676 microversion: 2.1 time: 0.240321 Dec 18 21:39:49.938009 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3768/7586] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:49 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:50.956898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:50.957592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:50.964474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:50.964927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:50.965864 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:50.966374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:51.096853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:51.104197 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-102b14ea-a5b2-4732-b544-db6edb2636b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1676 microversion: 2.1 time: 0.152831 Dec 18 21:39:51.104773 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3819/7587] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:50 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:51.217028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-0e1c47dc-f208-4ae1-9b76-caeced562422 req-abe02f6f-00b3-4916-8677-7dc16f9ce260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:51.218554 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:39:51.218554 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:39:51.226211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0e1c47dc-f208-4ae1-9b76-caeced562422 req-abe02f6f-00b3-4916-8677-7dc16f9ce260 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:51.226699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-0e1c47dc-f208-4ae1-9b76-caeced562422 req-abe02f6f-00b3-4916-8677-7dc16f9ce260 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:51.237822 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-0e1c47dc-f208-4ae1-9b76-caeced562422 req-abe02f6f-00b3-4916-8677-7dc16f9ce260 service nova] Creating event network-changed:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch1-master-1 Dec 18 21:39:51.243478 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-0e1c47dc-f208-4ae1-9b76-caeced562422 req-abe02f6f-00b3-4916-8677-7dc16f9ce260 service nova] Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:39:51.253923 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-0e1c47dc-f208-4ae1-9b76-caeced562422 req-abe02f6f-00b3-4916-8677-7dc16f9ce260 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040557 Dec 18 21:39:51.254549 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3769/7588] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:39:52.120426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:52.121297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:52.129107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.129641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.130548 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.131106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.259669 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:52.267036 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31548711-9445-454b-967c-d1820cbcb492 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1669 microversion: 2.1 time: 0.150451 Dec 18 21:39:52.267624 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3820/7589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:52 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:52.284968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:52.285682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:52.292520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.292988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.293788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.294276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.429062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:52.436645 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-af5a941d-86e5-408f-9c16-6a51ba31279f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1669 microversion: 2.1 time: 0.156641 Dec 18 21:39:52.437251 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3770/7590] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:52 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:52.453256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:52.453862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:52.459895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.460348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.461755 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.462201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.592730 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:52.600035 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-faaab8ac-3b8e-4ddf-920f-f3da1fcd02aa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1669 microversion: 2.1 time: 0.150400 Dec 18 21:39:52.600713 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3821/7591] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:52 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:52.615804 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:52.616341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:52.622363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.622775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.623564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.624019 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.648109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:39:52.721158 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a8204996-65ed-4353-b210-a60e15346298 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 204 len: 0 microversion: 2.1 time: 0.108735 Dec 18 21:39:52.721756 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3771/7592] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:39:52 2021] DELETE /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:39:52.730041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:52.730675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:52.736693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.737144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.737927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:52.738388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:52.865948 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:52.873761 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7be56fa-9cb7-4461-9d32-099906b4309a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1675 microversion: 2.1 time: 0.147783 Dec 18 21:39:52.874270 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3822/7593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:52 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:53.891696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:53.892461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:53.899837 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:53.900301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:53.901106 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:53.901558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:54.147514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:54.155542 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ef01b48b-a5b3-4ec8-9618-1138d4524f2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1675 microversion: 2.1 time: 0.267940 Dec 18 21:39:54.156334 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3772/7594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:53 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1675 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:54.952859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ecf6ebea-1e52-4649-85eb-0538a96addfd req-a18d248b-f575-4306-b6d0-3e336c7cd3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814c4a36-6ed2-4170-a5f8-6674d35f8a13", "name": "network-vif-deleted", "tag": "2b2e7e99-ea6e-45ff-a905-9a41097dcf97"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:54.955377 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:39:54.955377 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:39:54.964373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ecf6ebea-1e52-4649-85eb-0538a96addfd req-a18d248b-f575-4306-b6d0-3e336c7cd3d3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:54.964907 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ecf6ebea-1e52-4649-85eb-0538a96addfd req-a18d248b-f575-4306-b6d0-3e336c7cd3d3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:54.976478 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ecf6ebea-1e52-4649-85eb-0538a96addfd req-a18d248b-f575-4306-b6d0-3e336c7cd3d3 service nova] Creating event network-vif-deleted:2b2e7e99-ea6e-45ff-a905-9a41097dcf97 for instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 on nch1-master-1 Dec 18 21:39:54.982690 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ecf6ebea-1e52-4649-85eb-0538a96addfd req-a18d248b-f575-4306-b6d0-3e336c7cd3d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033783 Dec 18 21:39:54.983889 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3823/7595] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:39:55.172651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:55.173490 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:55.180341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:55.180817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:55.181627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:55.182083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:55.213709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:55.214177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:55.214674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lazy-loading 'fault' on Instance uuid 814c4a36-6ed2-4170-a5f8-6674d35f8a13 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:39:55.253833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:55.261258 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2c5569e9-4841-4b57-a5f5-5181fa3866ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 200 len: 1329 microversion: 2.1 time: 0.092307 Dec 18 21:39:55.261921 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3773/7596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:55 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:56.279298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:56.280014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:56.286057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:56.286545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:56.287342 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:56.287781 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:56.301018 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. Dec 18 21:39:56.301586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:39:56.302405 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d9d7acf4-0033-49b1-b9c2-35c2b1cabf39 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 404 len: 111 microversion: 2.1 time: 0.028029 Dec 18 21:39:56.302913 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3824/7597] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:56 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:39:56.355635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:56.356255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:56.363073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:56.363548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:56.364341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:56.364853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:56.378647 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. Dec 18 21:39:56.379246 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:39:56.380136 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ced1cfe8-cd21-4048-8a56-56748ad1faf3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 404 len: 111 microversion: 2.1 time: 0.028839 Dec 18 21:39:56.380666 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3774/7598] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:56 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:39:56.425857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2037276889", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "0d5d526c-ff3b-4870-a375-d43b4ba66efb"}], "security_groups": [{"name": "tempest-securitygroup--784507149"}], "key_name": "tempest-keypair-1744532994", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:56.691466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] validate_networks() for [('0d5d526c-ff3b-4870-a375-d43b4ba66efb', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:39:57.045625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:39:57.046233 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:39:57.046780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:39:57.047503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:39:57.048041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:39:57.056967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:57.057428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:57.058234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:57.058696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:57.075033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:39:57.079959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:39:57.092363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:39:57.094696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:39:57.139680 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a1f36678-211f-448a-a2ba-2bb36f131aa6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.717404 Dec 18 21:39:57.140332 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3825/7599] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:39:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:39:57.150774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f46ad1ce-05a7-4df6-8dde-6ea68865fe64 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:57.151390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f46ad1ce-05a7-4df6-8dde-6ea68865fe64 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:57.204324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f46ad1ce-05a7-4df6-8dde-6ea68865fe64 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:57.211441 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f46ad1ce-05a7-4df6-8dde-6ea68865fe64 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1239 microversion: 2.1 time: 0.064936 Dec 18 21:39:57.212000 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3775/7600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:57 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:58.230198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:58.230835 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:58.236676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:58.237133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:58.237924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:58.238389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:58.299723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:58.308614 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-83cbdf34-93e2-4f9d-b398-8e17d80057b1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1297 microversion: 2.1 time: 0.083622 Dec 18 21:39:58.309245 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3826/7601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:58 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:39:58.502186 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:39:58.502450 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:39:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:39:59.326091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:39:59.327450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:39:59.334768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:59.335244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:59.336065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:59.337269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:59.359363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8f9c6a50-7f3d-4b29-b65d-de9a5dbed895 req-73b05e35-0a89-4c11-af7d-b2e5262db810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:39:59.361455 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:39:59.361455 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:39:59.376954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8f9c6a50-7f3d-4b29-b65d-de9a5dbed895 req-73b05e35-0a89-4c11-af7d-b2e5262db810 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:39:59.377678 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8f9c6a50-7f3d-4b29-b65d-de9a5dbed895 req-73b05e35-0a89-4c11-af7d-b2e5262db810 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:39:59.398646 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8f9c6a50-7f3d-4b29-b65d-de9a5dbed895 req-73b05e35-0a89-4c11-af7d-b2e5262db810 service nova] Creating event network-changed:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch2-master-1 Dec 18 21:39:59.404734 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8f9c6a50-7f3d-4b29-b65d-de9a5dbed895 req-73b05e35-0a89-4c11-af7d-b2e5262db810 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048868 Dec 18 21:39:59.406476 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3827/7602] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:39:59.516290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:39:59.524954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3b4e509f-52ef-4b36-b879-0d9e28467bc2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1364 microversion: 2.1 time: 0.202516 Dec 18 21:39:59.525532 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3776/7603] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:39:59 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:40:00.543747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:40:00.544471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:00.550545 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:00.551000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:00.551783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:00.552224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:00.684038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:40:00.691301 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8dd66f1d-91fa-454d-acce-056b3c3e1f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1364 microversion: 2.1 time: 0.152515 Dec 18 21:40:00.692072 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3828/7604] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:40:00 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:40:01.708013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:40:01.708650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:01.716174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:01.716314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:01.717093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:01.717547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:01.856346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:40:01.863881 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b22cc67d-ff07-467d-b50d-bd651d35f245 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1364 microversion: 2.1 time: 0.159884 Dec 18 21:40:01.864463 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3777/7605] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:40:01 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:40:02.881774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:40:02.882407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:02.889525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:02.889977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:02.890787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:02.891223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:03.022656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:40:03.031062 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-69ded60c-d6ef-4398-b1fd-58b68d9dbaec tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1364 microversion: 2.1 time: 0.152925 Dec 18 21:40:03.031638 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3829/7606] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:40:02 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:40:03.800963 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a864b8f7-08e5-4515-91ef-51078e810837 req-62aced25-f485-4734-b995-7026928aec69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "name": "network-vif-plugged", "status": "completed", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:03.802586 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:40:03.802586 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:40:03.812163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a864b8f7-08e5-4515-91ef-51078e810837 req-62aced25-f485-4734-b995-7026928aec69 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:03.812629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a864b8f7-08e5-4515-91ef-51078e810837 req-62aced25-f485-4734-b995-7026928aec69 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:03.823679 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a864b8f7-08e5-4515-91ef-51078e810837 req-62aced25-f485-4734-b995-7026928aec69 service nova] Creating event network-vif-plugged:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch2-master-1 Dec 18 21:40:03.828785 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a864b8f7-08e5-4515-91ef-51078e810837 req-62aced25-f485-4734-b995-7026928aec69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Dec 18 21:40:03.829383 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3778/7607] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:40:04.048966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:40:04.049476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:04.056205 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:04.056651 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:04.057426 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:04.057858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:04.186660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:40:04.193796 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-50c73e3f-17ab-44f1-b2b5-e15e968e0181 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1364 microversion: 2.1 time: 0.148552 Dec 18 21:40:04.194395 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3830/7608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:40:04 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:40:05.212602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:40:05.213354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:05.220277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:05.220745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:05.221542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:05.221996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:05.356088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:40:05.363392 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8d43372d-3459-4fb2-91f2-f82bc8e534ee tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1550 microversion: 2.1 time: 0.155514 Dec 18 21:40:05.363971 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3779/7609] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:40:05 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:40:05.379916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bacfbcbc-3b53-4d0a-a7dc-f8ee8348fa9d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:40:05.380430 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bacfbcbc-3b53-4d0a-a7dc-f8ee8348fa9d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:05.387912 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bacfbcbc-3b53-4d0a-a7dc-f8ee8348fa9d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:05.388370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bacfbcbc-3b53-4d0a-a7dc-f8ee8348fa9d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:05.389149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bacfbcbc-3b53-4d0a-a7dc-f8ee8348fa9d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:05.389591 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bacfbcbc-3b53-4d0a-a7dc-f8ee8348fa9d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:05.467352 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bacfbcbc-3b53-4d0a-a7dc-f8ee8348fa9d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091046 Dec 18 21:40:05.467956 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3831/7610] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:40:05 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:40:06.390357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7ae2bbcb-357f-4869-a1f1-0f6780e6dad9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:06.396642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ee504618-198d-4f5b-8b4c-1724e209908b req-d3139231-903b-4bf0-ba11-73c84f33d8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:06.397563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7ae2bbcb-357f-4869-a1f1-0f6780e6dad9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:06.398439 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:40:06.398439 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:40:06.404647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ae2bbcb-357f-4869-a1f1-0f6780e6dad9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:06.405120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ae2bbcb-357f-4869-a1f1-0f6780e6dad9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:06.405539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ee504618-198d-4f5b-8b4c-1724e209908b req-d3139231-903b-4bf0-ba11-73c84f33d8d5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:06.406060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ee504618-198d-4f5b-8b4c-1724e209908b req-d3139231-903b-4bf0-ba11-73c84f33d8d5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:06.406234 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ae2bbcb-357f-4869-a1f1-0f6780e6dad9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:06.406551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7ae2bbcb-357f-4869-a1f1-0f6780e6dad9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:06.418702 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ee504618-198d-4f5b-8b4c-1724e209908b req-d3139231-903b-4bf0-ba11-73c84f33d8d5 service nova] Creating event network-changed:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch2-master-1 Dec 18 21:40:06.423776 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ee504618-198d-4f5b-8b4c-1724e209908b req-d3139231-903b-4bf0-ba11-73c84f33d8d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031512 Dec 18 21:40:06.424908 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3832/7611] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:40:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:40:06.445668 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7ae2bbcb-357f-4869-a1f1-0f6780e6dad9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.059028 Dec 18 21:40:06.446408 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3780/7612] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:06 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:07.457922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-44577587-de47-4d01-88af-cc5a819a70a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:07.459211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-44577587-de47-4d01-88af-cc5a819a70a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:07.469032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44577587-de47-4d01-88af-cc5a819a70a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:07.469481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44577587-de47-4d01-88af-cc5a819a70a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:07.470175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44577587-de47-4d01-88af-cc5a819a70a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:07.470638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-44577587-de47-4d01-88af-cc5a819a70a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:07.509492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-44577587-de47-4d01-88af-cc5a819a70a8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.055784 Dec 18 21:40:07.512714 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3833/7613] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:07 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:08.520649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7f437aca-e1b3-49f9-871f-95031e417dd8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:08.521611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7f437aca-e1b3-49f9-871f-95031e417dd8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:08.529574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f437aca-e1b3-49f9-871f-95031e417dd8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:08.529885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f437aca-e1b3-49f9-871f-95031e417dd8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:08.530714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f437aca-e1b3-49f9-871f-95031e417dd8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:08.531168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7f437aca-e1b3-49f9-871f-95031e417dd8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:08.569953 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7f437aca-e1b3-49f9-871f-95031e417dd8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.053428 Dec 18 21:40:08.570767 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3781/7614] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:08 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:09.581717 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc6032ca-4d05-4578-bdc0-09a15fc947f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:09.582761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc6032ca-4d05-4578-bdc0-09a15fc947f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:09.589988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6032ca-4d05-4578-bdc0-09a15fc947f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:09.590481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6032ca-4d05-4578-bdc0-09a15fc947f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:09.591269 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6032ca-4d05-4578-bdc0-09a15fc947f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:09.591714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc6032ca-4d05-4578-bdc0-09a15fc947f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:09.628003 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc6032ca-4d05-4578-bdc0-09a15fc947f1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.050519 Dec 18 21:40:09.628807 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3834/7615] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:09 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:10.639836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-276b45b9-32bc-44a4-b177-d4473ea0f012 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:10.640859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-276b45b9-32bc-44a4-b177-d4473ea0f012 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:10.648204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276b45b9-32bc-44a4-b177-d4473ea0f012 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:10.648677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276b45b9-32bc-44a4-b177-d4473ea0f012 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:10.650584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276b45b9-32bc-44a4-b177-d4473ea0f012 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:10.651437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276b45b9-32bc-44a4-b177-d4473ea0f012 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:10.689012 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-276b45b9-32bc-44a4-b177-d4473ea0f012 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.053115 Dec 18 21:40:10.689659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3782/7616] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:10 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 21:40:11.700451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-af22b37d-3a42-45b7-9f15-a6c98c2060cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:11.701490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-af22b37d-3a42-45b7-9f15-a6c98c2060cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:11.709056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af22b37d-3a42-45b7-9f15-a6c98c2060cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:11.709526 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af22b37d-3a42-45b7-9f15-a6c98c2060cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:11.710316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af22b37d-3a42-45b7-9f15-a6c98c2060cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:11.710760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-af22b37d-3a42-45b7-9f15-a6c98c2060cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:11.748286 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-af22b37d-3a42-45b7-9f15-a6c98c2060cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.051784 Dec 18 21:40:11.749075 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3835/7617] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:11 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:12.760191 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e8886077-e126-48df-87e3-d78afbf3e9b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:12.761199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e8886077-e126-48df-87e3-d78afbf3e9b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:12.768590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8886077-e126-48df-87e3-d78afbf3e9b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:12.769052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8886077-e126-48df-87e3-d78afbf3e9b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:12.769840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8886077-e126-48df-87e3-d78afbf3e9b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:12.770317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e8886077-e126-48df-87e3-d78afbf3e9b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:12.806738 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e8886077-e126-48df-87e3-d78afbf3e9b4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.050967 Dec 18 21:40:12.807544 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3783/7618] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:12 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:13.817535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e12dc6c3-0920-4c6a-bb12-597b2c0eafd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:13.818587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e12dc6c3-0920-4c6a-bb12-597b2c0eafd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:13.826125 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12dc6c3-0920-4c6a-bb12-597b2c0eafd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:13.826610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12dc6c3-0920-4c6a-bb12-597b2c0eafd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:13.827391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12dc6c3-0920-4c6a-bb12-597b2c0eafd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:13.827832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e12dc6c3-0920-4c6a-bb12-597b2c0eafd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:13.863272 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e12dc6c3-0920-4c6a-bb12-597b2c0eafd6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.049791 Dec 18 21:40:13.863868 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3836/7619] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:13 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:14.874827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c916e2ae-63ae-400d-a318-b41343a7ac16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:14.875878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c916e2ae-63ae-400d-a318-b41343a7ac16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:14.883711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c916e2ae-63ae-400d-a318-b41343a7ac16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:14.884189 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c916e2ae-63ae-400d-a318-b41343a7ac16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:14.884991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c916e2ae-63ae-400d-a318-b41343a7ac16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:14.885451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c916e2ae-63ae-400d-a318-b41343a7ac16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:14.926225 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c916e2ae-63ae-400d-a318-b41343a7ac16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.055408 Dec 18 21:40:14.926867 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3784/7620] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:14 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:15.937901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-66f83ac2-9028-4cd2-a9d8-4474c8e5779e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:15.938775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-66f83ac2-9028-4cd2-a9d8-4474c8e5779e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:15.946611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f83ac2-9028-4cd2-a9d8-4474c8e5779e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:15.947058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f83ac2-9028-4cd2-a9d8-4474c8e5779e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:15.947839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f83ac2-9028-4cd2-a9d8-4474c8e5779e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:15.948278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-66f83ac2-9028-4cd2-a9d8-4474c8e5779e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:15.987399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-66f83ac2-9028-4cd2-a9d8-4474c8e5779e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.053471 Dec 18 21:40:15.988682 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3837/7621] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:15 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:16.999238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d8223d42-77d0-4bbe-a35c-1630b3916886 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:17.000283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d8223d42-77d0-4bbe-a35c-1630b3916886 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:17.007832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8223d42-77d0-4bbe-a35c-1630b3916886 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:17.008940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8223d42-77d0-4bbe-a35c-1630b3916886 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:17.009733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8223d42-77d0-4bbe-a35c-1630b3916886 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:17.010186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d8223d42-77d0-4bbe-a35c-1630b3916886 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:17.049306 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d8223d42-77d0-4bbe-a35c-1630b3916886 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 14 microversion: 2.1 time: 0.054018 Dec 18 21:40:17.049921 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3785/7622] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:16 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:40:18.061216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6020aa3f-79cb-4a4c-b7e3-fcf56fa33b92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:18.062270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6020aa3f-79cb-4a4c-b7e3-fcf56fa33b92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:18.069556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6020aa3f-79cb-4a4c-b7e3-fcf56fa33b92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:18.070015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6020aa3f-79cb-4a4c-b7e3-fcf56fa33b92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:18.070851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6020aa3f-79cb-4a4c-b7e3-fcf56fa33b92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:18.071298 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6020aa3f-79cb-4a4c-b7e3-fcf56fa33b92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:18.125879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6020aa3f-79cb-4a4c-b7e3-fcf56fa33b92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 8206 microversion: 2.1 time: 0.068671 Dec 18 21:40:18.126511 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3838/7623] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:18 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 8206 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:40:19.138665 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-862b4eef-e5d1-4a15-b102-60f6ca7c1601 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:19.139688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-862b4eef-e5d1-4a15-b102-60f6ca7c1601 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:19.147065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-862b4eef-e5d1-4a15-b102-60f6ca7c1601 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:19.147558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-862b4eef-e5d1-4a15-b102-60f6ca7c1601 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:19.148363 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-862b4eef-e5d1-4a15-b102-60f6ca7c1601 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:19.148819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-862b4eef-e5d1-4a15-b102-60f6ca7c1601 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:19.196256 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-862b4eef-e5d1-4a15-b102-60f6ca7c1601 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 16397 microversion: 2.1 time: 0.062160 Dec 18 21:40:19.198302 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3786/7624] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:19 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 16397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:20.208628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1342a7c-15d0-4ecd-8333-4d8cff8bb820 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:20.209557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1342a7c-15d0-4ecd-8333-4d8cff8bb820 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:20.216787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1342a7c-15d0-4ecd-8333-4d8cff8bb820 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:20.217238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1342a7c-15d0-4ecd-8333-4d8cff8bb820 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:20.218021 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1342a7c-15d0-4ecd-8333-4d8cff8bb820 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:20.218495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1342a7c-15d0-4ecd-8333-4d8cff8bb820 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:20.254718 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d1342a7c-15d0-4ecd-8333-4d8cff8bb820 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 16397 microversion: 2.1 time: 0.050442 Dec 18 21:40:20.255320 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3839/7625] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:20 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 16397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:21.265867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a5d1db22-ecfe-4e32-a767-2f2dfa087e66 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:21.266935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a5d1db22-ecfe-4e32-a767-2f2dfa087e66 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:21.274275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d1db22-ecfe-4e32-a767-2f2dfa087e66 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:21.274764 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d1db22-ecfe-4e32-a767-2f2dfa087e66 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:21.275567 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d1db22-ecfe-4e32-a767-2f2dfa087e66 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:21.276026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a5d1db22-ecfe-4e32-a767-2f2dfa087e66 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:21.316300 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a5d1db22-ecfe-4e32-a767-2f2dfa087e66 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 16397 microversion: 2.1 time: 0.054460 Dec 18 21:40:21.316970 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3787/7626] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:21 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 16397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:22.328629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d1a01475-fcca-44a7-8f8c-5ae10eb5b606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:22.329714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d1a01475-fcca-44a7-8f8c-5ae10eb5b606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:22.338078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1a01475-fcca-44a7-8f8c-5ae10eb5b606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:22.338551 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1a01475-fcca-44a7-8f8c-5ae10eb5b606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:22.339331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1a01475-fcca-44a7-8f8c-5ae10eb5b606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:22.339767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d1a01475-fcca-44a7-8f8c-5ae10eb5b606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:22.376819 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d1a01475-fcca-44a7-8f8c-5ae10eb5b606 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 16397 microversion: 2.1 time: 0.052499 Dec 18 21:40:22.377435 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3840/7627] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:22 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 16397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:23.389247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aa072df2-2b84-42c3-9062-f0f4c19cc194 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:23.390277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aa072df2-2b84-42c3-9062-f0f4c19cc194 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:23.397223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa072df2-2b84-42c3-9062-f0f4c19cc194 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:23.397695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa072df2-2b84-42c3-9062-f0f4c19cc194 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:23.398512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa072df2-2b84-42c3-9062-f0f4c19cc194 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:23.399512 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aa072df2-2b84-42c3-9062-f0f4c19cc194 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:23.448935 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aa072df2-2b84-42c3-9062-f0f4c19cc194 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.063753 Dec 18 21:40:23.449637 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3788/7628] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:23 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:24.461458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-99427588-9120-4514-ad13-1576031536c2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:24.462498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-99427588-9120-4514-ad13-1576031536c2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:24.469336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99427588-9120-4514-ad13-1576031536c2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:24.469786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99427588-9120-4514-ad13-1576031536c2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:24.470590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99427588-9120-4514-ad13-1576031536c2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:24.471027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-99427588-9120-4514-ad13-1576031536c2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:24.508981 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-99427588-9120-4514-ad13-1576031536c2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.050971 Dec 18 21:40:24.509584 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3841/7629] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:24 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:25.521011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7b2b3602-3af5-4378-ab0d-26b6bebd53ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:25.522035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7b2b3602-3af5-4378-ab0d-26b6bebd53ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:25.530063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b2b3602-3af5-4378-ab0d-26b6bebd53ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:25.530566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b2b3602-3af5-4378-ab0d-26b6bebd53ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:25.531372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b2b3602-3af5-4378-ab0d-26b6bebd53ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:25.531829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7b2b3602-3af5-4378-ab0d-26b6bebd53ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:25.572321 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7b2b3602-3af5-4378-ab0d-26b6bebd53ad tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.055291 Dec 18 21:40:25.572990 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3789/7630] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:25 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:26.584559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9aa4647e-4636-4aab-a18e-7216b2ca5f3b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:26.585558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9aa4647e-4636-4aab-a18e-7216b2ca5f3b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:26.593379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9aa4647e-4636-4aab-a18e-7216b2ca5f3b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:26.593826 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9aa4647e-4636-4aab-a18e-7216b2ca5f3b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:26.594635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9aa4647e-4636-4aab-a18e-7216b2ca5f3b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:26.595072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9aa4647e-4636-4aab-a18e-7216b2ca5f3b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:26.634886 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9aa4647e-4636-4aab-a18e-7216b2ca5f3b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.054460 Dec 18 21:40:26.635552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3842/7631] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:26 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:27.646943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5b1cca2d-dd24-4dbb-8f59-578d89bdc941 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:27.647965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5b1cca2d-dd24-4dbb-8f59-578d89bdc941 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:27.655389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b1cca2d-dd24-4dbb-8f59-578d89bdc941 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:27.655860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b1cca2d-dd24-4dbb-8f59-578d89bdc941 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:27.656659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b1cca2d-dd24-4dbb-8f59-578d89bdc941 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:27.657111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5b1cca2d-dd24-4dbb-8f59-578d89bdc941 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:27.695993 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5b1cca2d-dd24-4dbb-8f59-578d89bdc941 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.053099 Dec 18 21:40:27.696619 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3790/7632] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:27 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:28.708460 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8d50fd75-2094-4156-9d66-7048fc69a734 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:28.709456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8d50fd75-2094-4156-9d66-7048fc69a734 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:28.717261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d50fd75-2094-4156-9d66-7048fc69a734 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:28.717710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d50fd75-2094-4156-9d66-7048fc69a734 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:28.718569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d50fd75-2094-4156-9d66-7048fc69a734 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:28.718960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8d50fd75-2094-4156-9d66-7048fc69a734 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:28.768799 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8d50fd75-2094-4156-9d66-7048fc69a734 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.064079 Dec 18 21:40:28.769892 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3843/7633] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:28 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:29.781278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8e4af23-b346-44fe-889e-33ea8ac4465b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:29.782220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8e4af23-b346-44fe-889e-33ea8ac4465b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:29.790150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e4af23-b346-44fe-889e-33ea8ac4465b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:29.790626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e4af23-b346-44fe-889e-33ea8ac4465b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:29.791425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e4af23-b346-44fe-889e-33ea8ac4465b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:29.791883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8e4af23-b346-44fe-889e-33ea8ac4465b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:29.830517 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8e4af23-b346-44fe-889e-33ea8ac4465b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.053263 Dec 18 21:40:29.831144 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3791/7634] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:29 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:30.843337 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01c77cfe-f48e-477e-a2a6-83bfb51ca995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:30.844352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-01c77cfe-f48e-477e-a2a6-83bfb51ca995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:30.851637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01c77cfe-f48e-477e-a2a6-83bfb51ca995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:30.852086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01c77cfe-f48e-477e-a2a6-83bfb51ca995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:30.852869 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01c77cfe-f48e-477e-a2a6-83bfb51ca995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:30.853311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01c77cfe-f48e-477e-a2a6-83bfb51ca995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:30.891370 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01c77cfe-f48e-477e-a2a6-83bfb51ca995 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.051988 Dec 18 21:40:30.891987 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3844/7635] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:30 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:31.904135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e7b8b17a-e182-4cc0-9a24-331fa51c5293 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:31.904696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e7b8b17a-e182-4cc0-9a24-331fa51c5293 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:31.911677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7b8b17a-e182-4cc0-9a24-331fa51c5293 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:31.912143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7b8b17a-e182-4cc0-9a24-331fa51c5293 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:31.912946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7b8b17a-e182-4cc0-9a24-331fa51c5293 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:31.913397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e7b8b17a-e182-4cc0-9a24-331fa51c5293 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:31.951652 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e7b8b17a-e182-4cc0-9a24-331fa51c5293 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.052424 Dec 18 21:40:31.952377 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3792/7636] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:31 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:32.965110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d51f2bbd-d23d-4992-b934-45606606c1bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:32.966163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d51f2bbd-d23d-4992-b934-45606606c1bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:32.973959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d51f2bbd-d23d-4992-b934-45606606c1bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:32.974436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d51f2bbd-d23d-4992-b934-45606606c1bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:32.975420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d51f2bbd-d23d-4992-b934-45606606c1bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:32.975858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d51f2bbd-d23d-4992-b934-45606606c1bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:33.025259 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d51f2bbd-d23d-4992-b934-45606606c1bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.065413 Dec 18 21:40:33.025890 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3845/7637] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:32 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:34.036597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e4eaa53-18b3-4053-a138-b01d87e8a40c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:34.037624 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e4eaa53-18b3-4053-a138-b01d87e8a40c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:34.045614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4eaa53-18b3-4053-a138-b01d87e8a40c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:34.046081 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4eaa53-18b3-4053-a138-b01d87e8a40c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:34.046972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4eaa53-18b3-4053-a138-b01d87e8a40c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:34.047431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e4eaa53-18b3-4053-a138-b01d87e8a40c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:34.087195 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e4eaa53-18b3-4053-a138-b01d87e8a40c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 24575 microversion: 2.1 time: 0.054661 Dec 18 21:40:34.087829 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3793/7638] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:34 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 24575 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:35.098866 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-23651ca2-c956-4a33-ba15-9b6a9b395daa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:35.099865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-23651ca2-c956-4a33-ba15-9b6a9b395daa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:35.107654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23651ca2-c956-4a33-ba15-9b6a9b395daa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:35.108103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23651ca2-c956-4a33-ba15-9b6a9b395daa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:35.108881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23651ca2-c956-4a33-ba15-9b6a9b395daa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:35.109318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-23651ca2-c956-4a33-ba15-9b6a9b395daa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:35.157894 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-23651ca2-c956-4a33-ba15-9b6a9b395daa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.063031 Dec 18 21:40:35.158542 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3846/7639] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:35 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:36.170238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd9ff9aa-48d7-4725-ab4b-180a6d988802 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:36.171349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dd9ff9aa-48d7-4725-ab4b-180a6d988802 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:36.178704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9aa-48d7-4725-ab4b-180a6d988802 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:36.179176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9aa-48d7-4725-ab4b-180a6d988802 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:36.180477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9aa-48d7-4725-ab4b-180a6d988802 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:36.180933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9aa-48d7-4725-ab4b-180a6d988802 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:36.223373 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd9ff9aa-48d7-4725-ab4b-180a6d988802 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.057019 Dec 18 21:40:36.224025 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3794/7640] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:36 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:37.236433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64586855-70dd-41cc-bcdd-e4639b25c6db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:37.238108 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64586855-70dd-41cc-bcdd-e4639b25c6db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:37.246986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64586855-70dd-41cc-bcdd-e4639b25c6db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:37.247470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64586855-70dd-41cc-bcdd-e4639b25c6db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:37.248255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64586855-70dd-41cc-bcdd-e4639b25c6db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:37.248690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64586855-70dd-41cc-bcdd-e4639b25c6db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:37.291236 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64586855-70dd-41cc-bcdd-e4639b25c6db tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.059606 Dec 18 21:40:37.291847 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3847/7641] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:37 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:38.303784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2eac2c01-6b3d-4e01-9e2c-c5e874834ace tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:38.304890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2eac2c01-6b3d-4e01-9e2c-c5e874834ace tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:38.312816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2eac2c01-6b3d-4e01-9e2c-c5e874834ace tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:38.313353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2eac2c01-6b3d-4e01-9e2c-c5e874834ace tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:38.314439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2eac2c01-6b3d-4e01-9e2c-c5e874834ace tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:38.314891 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2eac2c01-6b3d-4e01-9e2c-c5e874834ace tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:38.354129 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2eac2c01-6b3d-4e01-9e2c-c5e874834ace tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054494 Dec 18 21:40:38.354793 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3795/7642] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:38 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:39.367367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b6bfb509-1d66-40a8-9fbd-6a07ce12ac43 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:39.368380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b6bfb509-1d66-40a8-9fbd-6a07ce12ac43 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:39.375646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6bfb509-1d66-40a8-9fbd-6a07ce12ac43 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:39.376103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6bfb509-1d66-40a8-9fbd-6a07ce12ac43 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:39.376893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6bfb509-1d66-40a8-9fbd-6a07ce12ac43 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:39.377340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b6bfb509-1d66-40a8-9fbd-6a07ce12ac43 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:39.415880 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b6bfb509-1d66-40a8-9fbd-6a07ce12ac43 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053049 Dec 18 21:40:39.416669 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3848/7643] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:39 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:40.427739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-446173e0-0e3f-4cc6-be4d-9bd13dd7f3bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:40.428762 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-446173e0-0e3f-4cc6-be4d-9bd13dd7f3bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:40.436753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446173e0-0e3f-4cc6-be4d-9bd13dd7f3bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:40.437219 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446173e0-0e3f-4cc6-be4d-9bd13dd7f3bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:40.438050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446173e0-0e3f-4cc6-be4d-9bd13dd7f3bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:40.438527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-446173e0-0e3f-4cc6-be4d-9bd13dd7f3bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:40.477943 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-446173e0-0e3f-4cc6-be4d-9bd13dd7f3bf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054207 Dec 18 21:40:40.478884 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3796/7644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:40 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:41.490059 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c28aba23-19c3-4253-80d9-68643fedf7cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:41.491148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c28aba23-19c3-4253-80d9-68643fedf7cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:41.499041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c28aba23-19c3-4253-80d9-68643fedf7cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:41.499491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c28aba23-19c3-4253-80d9-68643fedf7cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:41.500258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c28aba23-19c3-4253-80d9-68643fedf7cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:41.500692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c28aba23-19c3-4253-80d9-68643fedf7cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:41.541493 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c28aba23-19c3-4253-80d9-68643fedf7cf tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.055366 Dec 18 21:40:41.542425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3849/7645] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:41 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:42.553547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f768871-a8d5-4504-b968-c2cfd2c39f5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:42.554618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4f768871-a8d5-4504-b968-c2cfd2c39f5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:42.561911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f768871-a8d5-4504-b968-c2cfd2c39f5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:42.562415 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f768871-a8d5-4504-b968-c2cfd2c39f5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:42.563216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f768871-a8d5-4504-b968-c2cfd2c39f5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:42.563672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f768871-a8d5-4504-b968-c2cfd2c39f5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:42.603509 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4f768871-a8d5-4504-b968-c2cfd2c39f5b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053996 Dec 18 21:40:42.604144 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3797/7646] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:42 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:43.615297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-027a8b37-17d5-4cef-8233-a42692a41c90 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:43.616328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-027a8b37-17d5-4cef-8233-a42692a41c90 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:43.624247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-027a8b37-17d5-4cef-8233-a42692a41c90 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:43.624699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-027a8b37-17d5-4cef-8233-a42692a41c90 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:43.625481 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-027a8b37-17d5-4cef-8233-a42692a41c90 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:43.625924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-027a8b37-17d5-4cef-8233-a42692a41c90 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:43.664881 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-027a8b37-17d5-4cef-8233-a42692a41c90 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053028 Dec 18 21:40:43.665741 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3850/7647] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:43 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:44.677263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b216e882-13c0-49dd-bdec-22461f714b2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:44.678294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b216e882-13c0-49dd-bdec-22461f714b2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:44.685580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216e882-13c0-49dd-bdec-22461f714b2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:44.686060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216e882-13c0-49dd-bdec-22461f714b2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:44.686861 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216e882-13c0-49dd-bdec-22461f714b2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:44.687310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b216e882-13c0-49dd-bdec-22461f714b2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:44.726178 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b216e882-13c0-49dd-bdec-22461f714b2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.052725 Dec 18 21:40:44.727502 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3798/7648] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:44 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:45.739357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9986b21d-93ff-4bfa-a854-af990c9989d0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:45.740355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9986b21d-93ff-4bfa-a854-af990c9989d0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:45.748156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9986b21d-93ff-4bfa-a854-af990c9989d0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:45.748606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9986b21d-93ff-4bfa-a854-af990c9989d0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:45.749413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9986b21d-93ff-4bfa-a854-af990c9989d0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:45.749851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9986b21d-93ff-4bfa-a854-af990c9989d0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:45.787957 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9986b21d-93ff-4bfa-a854-af990c9989d0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.052611 Dec 18 21:40:45.789125 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3851/7649] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:45 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:40:46.800946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-adce0908-16d2-41da-8bb8-ab8bddafc8f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:46.801952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-adce0908-16d2-41da-8bb8-ab8bddafc8f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:46.809897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adce0908-16d2-41da-8bb8-ab8bddafc8f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:46.810395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adce0908-16d2-41da-8bb8-ab8bddafc8f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:46.811192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adce0908-16d2-41da-8bb8-ab8bddafc8f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:46.811638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-adce0908-16d2-41da-8bb8-ab8bddafc8f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:46.854705 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-adce0908-16d2-41da-8bb8-ab8bddafc8f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.057694 Dec 18 21:40:46.855637 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3799/7650] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:46 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:47.866658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-86e1010c-73dc-4e9f-bc5f-7e9739401425 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:47.867656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-86e1010c-73dc-4e9f-bc5f-7e9739401425 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:47.874916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86e1010c-73dc-4e9f-bc5f-7e9739401425 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:47.875366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86e1010c-73dc-4e9f-bc5f-7e9739401425 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:47.876142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86e1010c-73dc-4e9f-bc5f-7e9739401425 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:47.876579 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-86e1010c-73dc-4e9f-bc5f-7e9739401425 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:47.916944 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-86e1010c-73dc-4e9f-bc5f-7e9739401425 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054208 Dec 18 21:40:47.917568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3852/7651] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:47 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:48.929595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-931f7ccd-a49c-4165-9d21-9779956c1de5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:48.930638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-931f7ccd-a49c-4165-9d21-9779956c1de5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:48.937922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-931f7ccd-a49c-4165-9d21-9779956c1de5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:48.938439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-931f7ccd-a49c-4165-9d21-9779956c1de5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:48.939245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-931f7ccd-a49c-4165-9d21-9779956c1de5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:48.939700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-931f7ccd-a49c-4165-9d21-9779956c1de5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:48.980040 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-931f7ccd-a49c-4165-9d21-9779956c1de5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054364 Dec 18 21:40:48.980585 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3800/7652] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:48 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:49.992693 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e779c7aa-83df-41d7-a30b-dcc354ae7c38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:49.993692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e779c7aa-83df-41d7-a30b-dcc354ae7c38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:50.000910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e779c7aa-83df-41d7-a30b-dcc354ae7c38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:50.001356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e779c7aa-83df-41d7-a30b-dcc354ae7c38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:50.002126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e779c7aa-83df-41d7-a30b-dcc354ae7c38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:50.002587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e779c7aa-83df-41d7-a30b-dcc354ae7c38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:50.041503 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e779c7aa-83df-41d7-a30b-dcc354ae7c38 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053330 Dec 18 21:40:50.042426 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3853/7653] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:49 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:51.053576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e782c48a-b249-452d-9cfc-6daa2ed16859 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:51.054628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e782c48a-b249-452d-9cfc-6daa2ed16859 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:51.061914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e782c48a-b249-452d-9cfc-6daa2ed16859 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:51.062423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e782c48a-b249-452d-9cfc-6daa2ed16859 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:51.063233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e782c48a-b249-452d-9cfc-6daa2ed16859 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:51.063695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e782c48a-b249-452d-9cfc-6daa2ed16859 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:51.102508 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e782c48a-b249-452d-9cfc-6daa2ed16859 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.052980 Dec 18 21:40:51.103446 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3801/7654] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:51 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:52.114452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-825ff9e4-a230-4b18-b2d4-63325db67a5d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:52.115489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-825ff9e4-a230-4b18-b2d4-63325db67a5d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:52.123492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825ff9e4-a230-4b18-b2d4-63325db67a5d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:52.123946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825ff9e4-a230-4b18-b2d4-63325db67a5d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:52.124738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825ff9e4-a230-4b18-b2d4-63325db67a5d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:52.125176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-825ff9e4-a230-4b18-b2d4-63325db67a5d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:52.164015 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-825ff9e4-a230-4b18-b2d4-63325db67a5d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053607 Dec 18 21:40:52.164631 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3854/7655] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:52 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:53.175932 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7ae156b-d41d-43ed-a611-4c9700774d87 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:53.176960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7ae156b-d41d-43ed-a611-4c9700774d87 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:53.183903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7ae156b-d41d-43ed-a611-4c9700774d87 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:53.184372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7ae156b-d41d-43ed-a611-4c9700774d87 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:53.185173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7ae156b-d41d-43ed-a611-4c9700774d87 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:53.185631 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7ae156b-d41d-43ed-a611-4c9700774d87 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:53.225081 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7ae156b-d41d-43ed-a611-4c9700774d87 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053316 Dec 18 21:40:53.225709 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3802/7656] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:53 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:54.237680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-111c74ad-89c4-4afb-8775-ec5aa3486854 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:54.238711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-111c74ad-89c4-4afb-8775-ec5aa3486854 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:54.245657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-111c74ad-89c4-4afb-8775-ec5aa3486854 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:54.246112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-111c74ad-89c4-4afb-8775-ec5aa3486854 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:54.246927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-111c74ad-89c4-4afb-8775-ec5aa3486854 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:54.247365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-111c74ad-89c4-4afb-8775-ec5aa3486854 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:54.289326 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-111c74ad-89c4-4afb-8775-ec5aa3486854 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.055102 Dec 18 21:40:54.290035 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3855/7657] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:54 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:55.301507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9d4c96f5-e1fe-4af4-b77d-9bfd09ce9bb6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:55.302584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9d4c96f5-e1fe-4af4-b77d-9bfd09ce9bb6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:55.310561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4c96f5-e1fe-4af4-b77d-9bfd09ce9bb6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:55.311034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4c96f5-e1fe-4af4-b77d-9bfd09ce9bb6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:55.311830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4c96f5-e1fe-4af4-b77d-9bfd09ce9bb6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:55.312292 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9d4c96f5-e1fe-4af4-b77d-9bfd09ce9bb6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:55.350662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9d4c96f5-e1fe-4af4-b77d-9bfd09ce9bb6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053121 Dec 18 21:40:55.351804 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3803/7658] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:55 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:56.363468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3ece3ef-9140-481d-a2dc-c89196de6253 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:56.364492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3ece3ef-9140-481d-a2dc-c89196de6253 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:56.371716 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ece3ef-9140-481d-a2dc-c89196de6253 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:56.372163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ece3ef-9140-481d-a2dc-c89196de6253 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:56.372947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ece3ef-9140-481d-a2dc-c89196de6253 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:56.373380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3ece3ef-9140-481d-a2dc-c89196de6253 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:56.412685 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3ece3ef-9140-481d-a2dc-c89196de6253 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053160 Dec 18 21:40:56.413321 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3856/7659] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:56 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:40:57.425099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a035a7f9-5552-4f1d-a088-841f115f3f02 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:57.426119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a035a7f9-5552-4f1d-a088-841f115f3f02 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:57.433446 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a035a7f9-5552-4f1d-a088-841f115f3f02 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:57.433909 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a035a7f9-5552-4f1d-a088-841f115f3f02 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:57.434736 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a035a7f9-5552-4f1d-a088-841f115f3f02 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:57.435224 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a035a7f9-5552-4f1d-a088-841f115f3f02 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:57.474531 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a035a7f9-5552-4f1d-a088-841f115f3f02 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053461 Dec 18 21:40:57.475174 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3804/7660] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:57 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:58.487448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3a2ea33e-1c6f-4c0e-8d03-62da2052ede5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:58.488450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3a2ea33e-1c6f-4c0e-8d03-62da2052ede5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:58.496320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a2ea33e-1c6f-4c0e-8d03-62da2052ede5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:58.496775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a2ea33e-1c6f-4c0e-8d03-62da2052ede5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:58.497561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a2ea33e-1c6f-4c0e-8d03-62da2052ede5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:58.498003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3a2ea33e-1c6f-4c0e-8d03-62da2052ede5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:58.536043 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3a2ea33e-1c6f-4c0e-8d03-62da2052ede5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.052667 Dec 18 21:40:58.536655 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3857/7661] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:58 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:40:59.549066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74c12326-593c-4fb5-b29e-d380a2c22966 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:40:59.550080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74c12326-593c-4fb5-b29e-d380a2c22966 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:40:59.557828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74c12326-593c-4fb5-b29e-d380a2c22966 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:59.558317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74c12326-593c-4fb5-b29e-d380a2c22966 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:59.559108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74c12326-593c-4fb5-b29e-d380a2c22966 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:40:59.559555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74c12326-593c-4fb5-b29e-d380a2c22966 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:40:59.600756 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74c12326-593c-4fb5-b29e-d380a2c22966 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.055736 Dec 18 21:40:59.601406 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3805/7662] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:40:59 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:00.612983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-07d884ab-e5ba-454e-b0c1-cd54eebaa3a3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:00.613998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-07d884ab-e5ba-454e-b0c1-cd54eebaa3a3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:00.621312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07d884ab-e5ba-454e-b0c1-cd54eebaa3a3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:00.621775 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07d884ab-e5ba-454e-b0c1-cd54eebaa3a3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:00.622600 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07d884ab-e5ba-454e-b0c1-cd54eebaa3a3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:00.623052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-07d884ab-e5ba-454e-b0c1-cd54eebaa3a3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:00.661699 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-07d884ab-e5ba-454e-b0c1-cd54eebaa3a3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.052699 Dec 18 21:41:00.662385 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3858/7663] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:00 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:01.673671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba6bd189-62a4-42d2-927a-c2ae44769017 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:01.674640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba6bd189-62a4-42d2-927a-c2ae44769017 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:01.682516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6bd189-62a4-42d2-927a-c2ae44769017 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:01.682986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6bd189-62a4-42d2-927a-c2ae44769017 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:01.683791 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6bd189-62a4-42d2-927a-c2ae44769017 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:01.684251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba6bd189-62a4-42d2-927a-c2ae44769017 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:01.723288 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba6bd189-62a4-42d2-927a-c2ae44769017 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053678 Dec 18 21:41:01.723939 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3806/7664] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:01 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:02.735284 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3709d177-ed77-4824-80e0-c9a46be7a04c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:02.736296 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3709d177-ed77-4824-80e0-c9a46be7a04c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:02.744129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3709d177-ed77-4824-80e0-c9a46be7a04c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:02.744583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3709d177-ed77-4824-80e0-c9a46be7a04c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:02.745377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3709d177-ed77-4824-80e0-c9a46be7a04c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:02.745840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3709d177-ed77-4824-80e0-c9a46be7a04c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:02.785627 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3709d177-ed77-4824-80e0-c9a46be7a04c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054285 Dec 18 21:41:02.786311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3859/7665] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:02 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:03.797766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-acaac4c1-6aef-4a7f-8267-358dbf6aa889 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:03.798724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-acaac4c1-6aef-4a7f-8267-358dbf6aa889 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:03.806190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acaac4c1-6aef-4a7f-8267-358dbf6aa889 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:03.806688 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acaac4c1-6aef-4a7f-8267-358dbf6aa889 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:03.807503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acaac4c1-6aef-4a7f-8267-358dbf6aa889 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:03.807966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-acaac4c1-6aef-4a7f-8267-358dbf6aa889 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:03.848081 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-acaac4c1-6aef-4a7f-8267-358dbf6aa889 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054301 Dec 18 21:41:03.851428 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3807/7666] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:03 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:04.859841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5a3cc7d0-de22-4008-bb47-5ae5008f5864 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:04.860841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5a3cc7d0-de22-4008-bb47-5ae5008f5864 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:04.868649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a3cc7d0-de22-4008-bb47-5ae5008f5864 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:04.869099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a3cc7d0-de22-4008-bb47-5ae5008f5864 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:04.869881 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a3cc7d0-de22-4008-bb47-5ae5008f5864 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:04.870349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5a3cc7d0-de22-4008-bb47-5ae5008f5864 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:04.908972 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5a3cc7d0-de22-4008-bb47-5ae5008f5864 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053161 Dec 18 21:41:04.909615 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3860/7667] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:04 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:05.921266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3c0d9238-baea-4ae7-b984-fd1c2c20dc94 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:05.922297 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3c0d9238-baea-4ae7-b984-fd1c2c20dc94 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:05.929676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0d9238-baea-4ae7-b984-fd1c2c20dc94 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:05.930142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0d9238-baea-4ae7-b984-fd1c2c20dc94 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:05.930968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0d9238-baea-4ae7-b984-fd1c2c20dc94 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:05.931420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3c0d9238-baea-4ae7-b984-fd1c2c20dc94 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:05.970418 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3c0d9238-baea-4ae7-b984-fd1c2c20dc94 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053086 Dec 18 21:41:05.971305 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3808/7668] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:05 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:06.982769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fbcd675d-6e27-4078-b44d-69bd62ba648a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:06.983800 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fbcd675d-6e27-4078-b44d-69bd62ba648a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:06.991072 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbcd675d-6e27-4078-b44d-69bd62ba648a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:06.992017 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbcd675d-6e27-4078-b44d-69bd62ba648a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:06.992786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbcd675d-6e27-4078-b44d-69bd62ba648a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:06.993221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fbcd675d-6e27-4078-b44d-69bd62ba648a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:07.034928 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fbcd675d-6e27-4078-b44d-69bd62ba648a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.056098 Dec 18 21:41:07.035537 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3861/7669] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:06 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:08.047319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-85d9fd23-87be-482a-888e-1f508da39d26 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:08.048336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-85d9fd23-87be-482a-888e-1f508da39d26 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:08.055784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85d9fd23-87be-482a-888e-1f508da39d26 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:08.056254 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85d9fd23-87be-482a-888e-1f508da39d26 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:08.057080 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85d9fd23-87be-482a-888e-1f508da39d26 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:08.057536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85d9fd23-87be-482a-888e-1f508da39d26 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:08.096881 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-85d9fd23-87be-482a-888e-1f508da39d26 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053540 Dec 18 21:41:08.097508 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3809/7670] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:08 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:09.108105 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a6a89224-0d07-408b-81b2-5884aaf15834 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:09.109104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a6a89224-0d07-408b-81b2-5884aaf15834 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:09.116979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a89224-0d07-408b-81b2-5884aaf15834 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:09.117434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a89224-0d07-408b-81b2-5884aaf15834 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:09.118223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a89224-0d07-408b-81b2-5884aaf15834 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:09.118697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6a89224-0d07-408b-81b2-5884aaf15834 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:09.157364 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a6a89224-0d07-408b-81b2-5884aaf15834 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053179 Dec 18 21:41:09.158231 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3862/7671] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:09 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:10.169077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d978ed0b-7f97-4b6b-b72e-efe5e1b51f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:10.170133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d978ed0b-7f97-4b6b-b72e-efe5e1b51f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:10.177532 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d978ed0b-7f97-4b6b-b72e-efe5e1b51f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:10.177997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d978ed0b-7f97-4b6b-b72e-efe5e1b51f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:10.179361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d978ed0b-7f97-4b6b-b72e-efe5e1b51f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:10.179852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d978ed0b-7f97-4b6b-b72e-efe5e1b51f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:10.219388 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d978ed0b-7f97-4b6b-b72e-efe5e1b51f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054317 Dec 18 21:41:10.220014 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3810/7672] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:10 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:11.231445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecc84fe3-6f8a-47b8-b6f3-d69a0200eb21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:11.232464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecc84fe3-6f8a-47b8-b6f3-d69a0200eb21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:11.239795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc84fe3-6f8a-47b8-b6f3-d69a0200eb21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:11.240286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc84fe3-6f8a-47b8-b6f3-d69a0200eb21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:11.241110 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc84fe3-6f8a-47b8-b6f3-d69a0200eb21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:11.241557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc84fe3-6f8a-47b8-b6f3-d69a0200eb21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:11.282471 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecc84fe3-6f8a-47b8-b6f3-d69a0200eb21 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054965 Dec 18 21:41:11.283292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3863/7673] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:11 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:12.295148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-60784e9e-754e-4fd4-ab51-fbdd3b00ec12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:12.296172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-60784e9e-754e-4fd4-ab51-fbdd3b00ec12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:12.303485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60784e9e-754e-4fd4-ab51-fbdd3b00ec12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:12.303949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60784e9e-754e-4fd4-ab51-fbdd3b00ec12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:12.304747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60784e9e-754e-4fd4-ab51-fbdd3b00ec12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:12.305204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-60784e9e-754e-4fd4-ab51-fbdd3b00ec12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:12.347007 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-60784e9e-754e-4fd4-ab51-fbdd3b00ec12 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.056446 Dec 18 21:41:12.347677 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3811/7674] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:12 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:13.359658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0527162f-4efa-47aa-a69f-7f4bff8a740f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:13.360655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0527162f-4efa-47aa-a69f-7f4bff8a740f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:13.368532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0527162f-4efa-47aa-a69f-7f4bff8a740f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:13.368980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0527162f-4efa-47aa-a69f-7f4bff8a740f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:13.369764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0527162f-4efa-47aa-a69f-7f4bff8a740f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:13.370198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0527162f-4efa-47aa-a69f-7f4bff8a740f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:13.409964 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0527162f-4efa-47aa-a69f-7f4bff8a740f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054264 Dec 18 21:41:13.410653 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3864/7675] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:13 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:14.422401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7f19928-6126-4a5a-b25e-b09f8def5a34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:14.423453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7f19928-6126-4a5a-b25e-b09f8def5a34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:14.431329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7f19928-6126-4a5a-b25e-b09f8def5a34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:14.432048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7f19928-6126-4a5a-b25e-b09f8def5a34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:14.432859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7f19928-6126-4a5a-b25e-b09f8def5a34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:14.433316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7f19928-6126-4a5a-b25e-b09f8def5a34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:14.473018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7f19928-6126-4a5a-b25e-b09f8def5a34 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054707 Dec 18 21:41:14.473648 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3812/7676] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:14 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:15.485150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4effd5e0-3969-4348-895e-97c13137ec92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:15.486144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4effd5e0-3969-4348-895e-97c13137ec92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:15.493448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4effd5e0-3969-4348-895e-97c13137ec92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:15.493897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4effd5e0-3969-4348-895e-97c13137ec92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:15.494700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4effd5e0-3969-4348-895e-97c13137ec92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:15.495136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4effd5e0-3969-4348-895e-97c13137ec92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:15.534111 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4effd5e0-3969-4348-895e-97c13137ec92 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.052891 Dec 18 21:41:15.534762 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3865/7677] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:15 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:16.546058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cc17bc3-5762-4475-9480-d479ef12c774 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:16.547112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cc17bc3-5762-4475-9480-d479ef12c774 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:16.554476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc17bc3-5762-4475-9480-d479ef12c774 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:16.554949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc17bc3-5762-4475-9480-d479ef12c774 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:16.556345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc17bc3-5762-4475-9480-d479ef12c774 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:16.556801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cc17bc3-5762-4475-9480-d479ef12c774 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:16.595799 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cc17bc3-5762-4475-9480-d479ef12c774 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053742 Dec 18 21:41:16.596435 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3813/7678] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:16 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:17.608002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62a8b6d3-b538-43d8-a3e9-1c5bdd8b6651 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:17.608998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62a8b6d3-b538-43d8-a3e9-1c5bdd8b6651 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:17.616172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a8b6d3-b538-43d8-a3e9-1c5bdd8b6651 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:17.616620 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a8b6d3-b538-43d8-a3e9-1c5bdd8b6651 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:17.617391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a8b6d3-b538-43d8-a3e9-1c5bdd8b6651 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:17.618364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a8b6d3-b538-43d8-a3e9-1c5bdd8b6651 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:17.658578 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62a8b6d3-b538-43d8-a3e9-1c5bdd8b6651 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054469 Dec 18 21:41:17.659204 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3866/7679] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:17 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:18.670241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4658af4-8bc6-46f8-b5c1-2a490ec21e2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:18.671315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4658af4-8bc6-46f8-b5c1-2a490ec21e2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:18.678709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4658af4-8bc6-46f8-b5c1-2a490ec21e2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:18.679176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4658af4-8bc6-46f8-b5c1-2a490ec21e2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:18.679985 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4658af4-8bc6-46f8-b5c1-2a490ec21e2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:18.680430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4658af4-8bc6-46f8-b5c1-2a490ec21e2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:18.719637 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4658af4-8bc6-46f8-b5c1-2a490ec21e2c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053305 Dec 18 21:41:18.720294 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3814/7680] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:18 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:41:19.732519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a04b0ee8-23d9-42d9-8616-fe73a66cc356 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:19.733587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a04b0ee8-23d9-42d9-8616-fe73a66cc356 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:19.740975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a04b0ee8-23d9-42d9-8616-fe73a66cc356 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:19.741433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a04b0ee8-23d9-42d9-8616-fe73a66cc356 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:19.742227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a04b0ee8-23d9-42d9-8616-fe73a66cc356 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:19.742699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a04b0ee8-23d9-42d9-8616-fe73a66cc356 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:19.783643 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a04b0ee8-23d9-42d9-8616-fe73a66cc356 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.055715 Dec 18 21:41:19.784399 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3867/7681] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:19 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:20.796335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e34145de-2b1a-41ac-8487-ac7bb4f4185e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:20.797344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e34145de-2b1a-41ac-8487-ac7bb4f4185e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:20.804628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e34145de-2b1a-41ac-8487-ac7bb4f4185e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:20.805091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e34145de-2b1a-41ac-8487-ac7bb4f4185e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:20.805882 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e34145de-2b1a-41ac-8487-ac7bb4f4185e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:20.806936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e34145de-2b1a-41ac-8487-ac7bb4f4185e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:20.845660 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e34145de-2b1a-41ac-8487-ac7bb4f4185e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053291 Dec 18 21:41:20.846295 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3815/7682] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:20 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:41:21.857425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccd89f61-efb6-459c-807f-d8802f912403 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:21.858458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccd89f61-efb6-459c-807f-d8802f912403 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:21.865706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd89f61-efb6-459c-807f-d8802f912403 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:21.866166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd89f61-efb6-459c-807f-d8802f912403 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:21.866977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd89f61-efb6-459c-807f-d8802f912403 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:21.867418 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd89f61-efb6-459c-807f-d8802f912403 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:21.906666 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccd89f61-efb6-459c-807f-d8802f912403 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053156 Dec 18 21:41:21.907575 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3868/7683] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:21 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:22.919027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a78abc4f-0ab7-481e-846b-f8b3ac73e9de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:22.920101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a78abc4f-0ab7-481e-846b-f8b3ac73e9de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:22.927069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78abc4f-0ab7-481e-846b-f8b3ac73e9de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:22.927527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78abc4f-0ab7-481e-846b-f8b3ac73e9de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:22.928317 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78abc4f-0ab7-481e-846b-f8b3ac73e9de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:22.928767 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a78abc4f-0ab7-481e-846b-f8b3ac73e9de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:22.967776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a78abc4f-0ab7-481e-846b-f8b3ac73e9de tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053506 Dec 18 21:41:22.968345 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3816/7684] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:22 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:23.979458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-13a2e80f-6cea-447b-a621-25e0b943c009 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:23.980452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-13a2e80f-6cea-447b-a621-25e0b943c009 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:23.987387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a2e80f-6cea-447b-a621-25e0b943c009 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:23.987833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a2e80f-6cea-447b-a621-25e0b943c009 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:23.988610 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a2e80f-6cea-447b-a621-25e0b943c009 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:23.989071 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-13a2e80f-6cea-447b-a621-25e0b943c009 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:24.028446 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-13a2e80f-6cea-447b-a621-25e0b943c009 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053115 Dec 18 21:41:24.029097 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3869/7685] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:23 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:25.041182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c94a816f-d328-4013-bbbb-a205659890bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:25.042141 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c94a816f-d328-4013-bbbb-a205659890bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:25.049389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94a816f-d328-4013-bbbb-a205659890bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:25.049854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94a816f-d328-4013-bbbb-a205659890bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:25.050670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94a816f-d328-4013-bbbb-a205659890bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:25.051122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c94a816f-d328-4013-bbbb-a205659890bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:25.091944 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c94a816f-d328-4013-bbbb-a205659890bd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.055422 Dec 18 21:41:25.092850 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3817/7686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:25 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:26.105077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1d70126-7c26-41b1-a77c-d075c9f6cb75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:26.106079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1d70126-7c26-41b1-a77c-d075c9f6cb75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:26.113332 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1d70126-7c26-41b1-a77c-d075c9f6cb75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:26.113783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1d70126-7c26-41b1-a77c-d075c9f6cb75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:26.114594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1d70126-7c26-41b1-a77c-d075c9f6cb75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:26.115036 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1d70126-7c26-41b1-a77c-d075c9f6cb75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:26.154055 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1d70126-7c26-41b1-a77c-d075c9f6cb75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053510 Dec 18 21:41:26.154703 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3870/7687] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:26 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:27.166849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e7278fe-2304-4e7e-82f2-51d4d83622c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:27.167858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e7278fe-2304-4e7e-82f2-51d4d83622c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:27.175089 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7278fe-2304-4e7e-82f2-51d4d83622c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:27.175551 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7278fe-2304-4e7e-82f2-51d4d83622c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:27.176343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7278fe-2304-4e7e-82f2-51d4d83622c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:27.176792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e7278fe-2304-4e7e-82f2-51d4d83622c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:27.219794 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e7278fe-2304-4e7e-82f2-51d4d83622c9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.057580 Dec 18 21:41:27.220419 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3818/7688] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:27 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:28.232370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6280aba6-7ede-40b5-b767-e4cd09366c40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:28.233379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6280aba6-7ede-40b5-b767-e4cd09366c40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:28.240695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6280aba6-7ede-40b5-b767-e4cd09366c40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:28.241146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6280aba6-7ede-40b5-b767-e4cd09366c40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:28.241923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6280aba6-7ede-40b5-b767-e4cd09366c40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:28.242397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6280aba6-7ede-40b5-b767-e4cd09366c40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:28.282139 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6280aba6-7ede-40b5-b767-e4cd09366c40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054290 Dec 18 21:41:28.283038 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3871/7689] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:28 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:41:29.294427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bf7d78f-ba26-4ac5-bdbd-19193759999e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:29.295476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1bf7d78f-ba26-4ac5-bdbd-19193759999e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:29.302913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bf7d78f-ba26-4ac5-bdbd-19193759999e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:29.303383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bf7d78f-ba26-4ac5-bdbd-19193759999e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:29.304181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bf7d78f-ba26-4ac5-bdbd-19193759999e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:29.304646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bf7d78f-ba26-4ac5-bdbd-19193759999e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:29.348408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1bf7d78f-ba26-4ac5-bdbd-19193759999e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.057918 Dec 18 21:41:29.349073 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3819/7690] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:29 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:30.360340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b2bedce-d400-43c1-9ca4-d2dafeaaf6b9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:30.361345 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9b2bedce-d400-43c1-9ca4-d2dafeaaf6b9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:30.370181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b2bedce-d400-43c1-9ca4-d2dafeaaf6b9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:30.370660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b2bedce-d400-43c1-9ca4-d2dafeaaf6b9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:30.371445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b2bedce-d400-43c1-9ca4-d2dafeaaf6b9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:30.371884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b2bedce-d400-43c1-9ca4-d2dafeaaf6b9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:30.410727 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b2bedce-d400-43c1-9ca4-d2dafeaaf6b9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054320 Dec 18 21:41:30.411346 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3872/7691] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:30 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:31.423281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-05ae952e-85a7-4b27-92c3-a273b0df6a51 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:31.424318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-05ae952e-85a7-4b27-92c3-a273b0df6a51 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:31.431584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05ae952e-85a7-4b27-92c3-a273b0df6a51 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:31.432046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05ae952e-85a7-4b27-92c3-a273b0df6a51 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:31.432836 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05ae952e-85a7-4b27-92c3-a273b0df6a51 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:31.433287 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-05ae952e-85a7-4b27-92c3-a273b0df6a51 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:31.473161 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-05ae952e-85a7-4b27-92c3-a273b0df6a51 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053895 Dec 18 21:41:31.473837 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3820/7692] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:31 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:32.485987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-94fecde8-56f6-49f7-91da-48ff110cd243 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:32.487052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-94fecde8-56f6-49f7-91da-48ff110cd243 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:32.494277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94fecde8-56f6-49f7-91da-48ff110cd243 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:32.494741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94fecde8-56f6-49f7-91da-48ff110cd243 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:32.495516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94fecde8-56f6-49f7-91da-48ff110cd243 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:32.495954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-94fecde8-56f6-49f7-91da-48ff110cd243 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:32.535785 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-94fecde8-56f6-49f7-91da-48ff110cd243 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053791 Dec 18 21:41:32.536404 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3873/7693] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:32 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:33.547949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-92c8eccd-ddf5-487d-a298-e4f1189a5bf4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:33.548992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-92c8eccd-ddf5-487d-a298-e4f1189a5bf4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:33.557181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92c8eccd-ddf5-487d-a298-e4f1189a5bf4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:33.557429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92c8eccd-ddf5-487d-a298-e4f1189a5bf4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:33.558223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92c8eccd-ddf5-487d-a298-e4f1189a5bf4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:33.558714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-92c8eccd-ddf5-487d-a298-e4f1189a5bf4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:33.598836 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-92c8eccd-ddf5-487d-a298-e4f1189a5bf4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054776 Dec 18 21:41:33.599468 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3821/7694] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:33 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:34.611782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a079f78-0f6f-4878-83fc-4cd471b6cde5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:34.612808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a079f78-0f6f-4878-83fc-4cd471b6cde5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:34.622970 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a079f78-0f6f-4878-83fc-4cd471b6cde5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:34.623423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a079f78-0f6f-4878-83fc-4cd471b6cde5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:34.626521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a079f78-0f6f-4878-83fc-4cd471b6cde5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:34.626990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a079f78-0f6f-4878-83fc-4cd471b6cde5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:34.667265 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a079f78-0f6f-4878-83fc-4cd471b6cde5 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.059582 Dec 18 21:41:34.667920 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3874/7695] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:34 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:35.679813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-872a344a-2dea-4915-9086-49a1d8bc2721 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:35.680830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-872a344a-2dea-4915-9086-49a1d8bc2721 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:35.688236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872a344a-2dea-4915-9086-49a1d8bc2721 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:35.688711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872a344a-2dea-4915-9086-49a1d8bc2721 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:35.689506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872a344a-2dea-4915-9086-49a1d8bc2721 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:35.689961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-872a344a-2dea-4915-9086-49a1d8bc2721 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:35.730717 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-872a344a-2dea-4915-9086-49a1d8bc2721 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054840 Dec 18 21:41:35.731603 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3822/7696] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:35 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:36.743748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57ead651-de2b-43ae-9295-2f10f50ce31f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:36.744865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57ead651-de2b-43ae-9295-2f10f50ce31f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:36.752150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ead651-de2b-43ae-9295-2f10f50ce31f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:36.752598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ead651-de2b-43ae-9295-2f10f50ce31f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:36.753370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ead651-de2b-43ae-9295-2f10f50ce31f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:36.753806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57ead651-de2b-43ae-9295-2f10f50ce31f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:36.792214 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57ead651-de2b-43ae-9295-2f10f50ce31f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053091 Dec 18 21:41:36.792943 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3875/7697] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:36 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:36.853393 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:41:36.853925 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:41:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:41:36.905610 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:41:36.905750 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:41:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:41:37.804728 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-39159279-e33a-40b2-b28d-9faaf076f7ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:37.805768 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-39159279-e33a-40b2-b28d-9faaf076f7ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:37.816972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39159279-e33a-40b2-b28d-9faaf076f7ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:37.817379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39159279-e33a-40b2-b28d-9faaf076f7ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:37.818168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39159279-e33a-40b2-b28d-9faaf076f7ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:37.818642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-39159279-e33a-40b2-b28d-9faaf076f7ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:37.857682 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-39159279-e33a-40b2-b28d-9faaf076f7ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.056892 Dec 18 21:41:37.858364 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3823/7698] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:37 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:38.870042 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35e1d87d-d68a-4dd0-96a7-f74bf2d60ed3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:38.871075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35e1d87d-d68a-4dd0-96a7-f74bf2d60ed3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:38.878385 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35e1d87d-d68a-4dd0-96a7-f74bf2d60ed3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:38.878845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35e1d87d-d68a-4dd0-96a7-f74bf2d60ed3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:38.879639 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35e1d87d-d68a-4dd0-96a7-f74bf2d60ed3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:38.880081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35e1d87d-d68a-4dd0-96a7-f74bf2d60ed3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:38.919506 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35e1d87d-d68a-4dd0-96a7-f74bf2d60ed3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053381 Dec 18 21:41:38.920062 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3876/7699] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:38 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 21:41:39.932050 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-beb10da3-e0c3-4bec-b9e2-feb1a6b2d290 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:39.933078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-beb10da3-e0c3-4bec-b9e2-feb1a6b2d290 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:39.940335 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beb10da3-e0c3-4bec-b9e2-feb1a6b2d290 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:39.940794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beb10da3-e0c3-4bec-b9e2-feb1a6b2d290 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:39.941581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beb10da3-e0c3-4bec-b9e2-feb1a6b2d290 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:39.942029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-beb10da3-e0c3-4bec-b9e2-feb1a6b2d290 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:39.981302 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-beb10da3-e0c3-4bec-b9e2-feb1a6b2d290 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.053448 Dec 18 21:41:39.982189 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3824/7700] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:39 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:40.993476 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f0f1980a-7adb-4fa1-bf14-6a78ce89ceb4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:40.994633 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f0f1980a-7adb-4fa1-bf14-6a78ce89ceb4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:41.003687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f1980a-7adb-4fa1-bf14-6a78ce89ceb4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:41.004140 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f1980a-7adb-4fa1-bf14-6a78ce89ceb4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:41.004924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f1980a-7adb-4fa1-bf14-6a78ce89ceb4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:41.005366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f0f1980a-7adb-4fa1-bf14-6a78ce89ceb4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:41.045871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f0f1980a-7adb-4fa1-bf14-6a78ce89ceb4 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.056380 Dec 18 21:41:41.046856 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3877/7701] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:40 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:42.058087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f498d74c-90fb-440a-8484-989a8cb939c3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:42.059127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f498d74c-90fb-440a-8484-989a8cb939c3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:42.066487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f498d74c-90fb-440a-8484-989a8cb939c3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:42.066966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f498d74c-90fb-440a-8484-989a8cb939c3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:42.067766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f498d74c-90fb-440a-8484-989a8cb939c3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:42.068221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f498d74c-90fb-440a-8484-989a8cb939c3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:42.107900 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f498d74c-90fb-440a-8484-989a8cb939c3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 32633 microversion: 2.1 time: 0.054459 Dec 18 21:41:42.108863 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3825/7702] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:42 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:43.120537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-425b9e2d-6a82-435c-ab6f-7fc180f0399c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:43.121542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-425b9e2d-6a82-435c-ab6f-7fc180f0399c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:43.128829 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-425b9e2d-6a82-435c-ab6f-7fc180f0399c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:43.129279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-425b9e2d-6a82-435c-ab6f-7fc180f0399c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:43.130057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-425b9e2d-6a82-435c-ab6f-7fc180f0399c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:43.130519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-425b9e2d-6a82-435c-ab6f-7fc180f0399c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:43.183145 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-425b9e2d-6a82-435c-ab6f-7fc180f0399c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 200 len: 40787 microversion: 2.1 time: 0.067010 Dec 18 21:41:43.183797 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3878/7703] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:43 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 40787 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:41:44.518463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:44.519202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:44.526463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:44.526934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:44.527725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:44.528171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:44.666368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:44.678853 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-97184b22-77a3-4582-bd38-9c3210b90b1d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1668 microversion: 2.1 time: 0.164277 Dec 18 21:41:44.679471 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3826/7704] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:44 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:44.696143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98550aac-23e9-4b06-bdb9-4688641ed7d0"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:44.697934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:44.705156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:44.705605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:44.706420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:44.707099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:45.208209 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2e8f999-645e-4173-bf4e-b6ba705c16a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.516034 Dec 18 21:41:45.208812 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3879/7705] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:41:44 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:41:48.472935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:41:48.473896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:48.481944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:48.482442 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:48.483235 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:48.483685 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:48.580237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:48.586737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Old instance type m1.heat2, new instance type m1.heat {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:41:48.593245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:41:48.593672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:41:48.594151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:41:48.594614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:41:48.595038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:41:48.656630 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f39b73ea-47cb-4307-a8b6-acbfad4ea13b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 202 len: 0 microversion: 2.1 time: 0.187335 Dec 18 21:41:48.657334 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3827/7706] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:41:48 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:41:48.667086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:48.667871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:48.674354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:48.674817 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:48.675607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:48.676046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:48.809222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:48.817098 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fc7b902b-a8e1-4efd-a0b3-a9c047542be8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1723 microversion: 2.1 time: 0.155563 Dec 18 21:41:48.817654 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3880/7707] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:48 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:49.834440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:49.835196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:49.841914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:49.842410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:49.843202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:49.843653 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:49.987144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:49.996072 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8284fa86-196e-480c-8507-bb87fa3c6130 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1723 microversion: 2.1 time: 0.165640 Dec 18 21:41:49.996669 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3828/7708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:49 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:51.013250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:51.013786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:51.020479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:51.020937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:51.021722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:51.022166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:51.153963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:51.161695 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6127bf3d-ec4d-40a5-b021-57c321f7d525 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.152739 Dec 18 21:41:51.162472 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3881/7709] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:51 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:52.179028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:52.179651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:52.185990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:52.186501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:52.187318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:52.187754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:52.315527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:52.324259 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-76453330-6e01-4542-831e-491fdecbbc4f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.149030 Dec 18 21:41:52.324856 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3829/7710] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:52 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:53.342033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:53.342677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:53.349118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:53.349569 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:53.350411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:53.350856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:53.483860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:53.491665 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40c09ab7-2b63-49da-aaae-e0723d2d5110 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.153404 Dec 18 21:41:53.492221 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3882/7711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:53 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:54.508615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:54.509273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:54.516121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:54.516596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:54.517427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:54.517887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:54.649800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:54.658055 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ad16210d-e2e9-4b96-b7ec-9d344b9828f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.153219 Dec 18 21:41:54.658678 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3830/7712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:54 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:55.675401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:55.676004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:55.683137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:55.683586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:55.684367 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:55.684803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:55.812396 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:55.820122 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-64576f6b-6a12-4c3f-aa49-e196cdecce16 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.148390 Dec 18 21:41:55.820628 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3883/7713] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:55 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:56.837866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:56.838504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:56.845830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:56.846325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:56.847121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:56.847573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:56.978596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:56.986450 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93ea347b-bf36-4bd4-86f4-1ea6a2290f4b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.152338 Dec 18 21:41:56.987027 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3831/7714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:56 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:58.003744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:58.004360 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:58.011266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:58.011724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:58.012510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:58.012955 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:58.139704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:58.147481 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e9414356-b984-4fd6-b2a9-a9491013aa3d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.147538 Dec 18 21:41:58.148045 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3884/7715] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:57 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:41:59.164855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:41:59.165977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:41:59.172831 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:59.173303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:59.174092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:41:59.174580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:41:59.305475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:41:59.313993 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a859b872-4d47-4b8a-904f-1c343120baaa tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.152863 Dec 18 21:41:59.314608 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3832/7716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:41:59 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:42:00.330849 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:00.331466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:00.338484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:00.338941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:00.339731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:00.340175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:00.470324 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:00.478718 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22380f1e-f38a-4916-9646-57897fcb597a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.151568 Dec 18 21:42:00.479289 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3885/7717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:00 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:01.495142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:01.495794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:01.502525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:01.502995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:01.503792 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:01.504248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:01.636261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:01.644082 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1d93f63-a4ef-4988-9b0e-a6080b5e939d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.152699 Dec 18 21:42:01.644652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3833/7718] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:01 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:02.660922 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:02.661518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:02.669204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:02.669658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:02.670480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:02.671085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:02.806218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:02.814090 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b4ed4270-589c-422d-8dc3-dd53e659fdd0 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1728 microversion: 2.1 time: 0.156951 Dec 18 21:42:02.814693 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3886/7719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:02 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:03.683604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-06791fa3-41ac-4901-b3e7-7e6cf83a95d3 req-b4353e08-0488-4ff4-96bc-106ff2a8963c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "name": "network-vif-unplugged", "status": "completed", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:03.685215 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:03.685215 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:42:03.692165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-06791fa3-41ac-4901-b3e7-7e6cf83a95d3 req-b4353e08-0488-4ff4-96bc-106ff2a8963c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:03.693143 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-06791fa3-41ac-4901-b3e7-7e6cf83a95d3 req-b4353e08-0488-4ff4-96bc-106ff2a8963c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:03.716078 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-06791fa3-41ac-4901-b3e7-7e6cf83a95d3 req-b4353e08-0488-4ff4-96bc-106ff2a8963c service nova] Creating event network-vif-unplugged:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch1-master-1 Dec 18 21:42:03.722852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-06791fa3-41ac-4901-b3e7-7e6cf83a95d3 req-b4353e08-0488-4ff4-96bc-106ff2a8963c service nova] Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:42:03.740100 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-06791fa3-41ac-4901-b3e7-7e6cf83a95d3 req-b4353e08-0488-4ff4-96bc-106ff2a8963c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119456 Dec 18 21:42:03.740880 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3834/7720] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:03.831971 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:03.833314 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:03.841054 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:03.841618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:03.842508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:03.843208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:04.209056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:04.217626 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e5ee197f-a89a-47b4-bd4a-ee0b93386068 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1727 microversion: 2.1 time: 0.389500 Dec 18 21:42:04.218202 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3887/7721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:03 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1727 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:05.236433 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:05.237171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:05.244247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:05.244723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:05.245539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:05.245990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:05.400298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:05.408405 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bf2b55da-caf8-4489-8d16-cfdca316c935 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1725 microversion: 2.1 time: 0.177064 Dec 18 21:42:05.409889 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3835/7722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:05 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:06.001352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5db3fbee-7180-4e20-9ebb-ebc0e3fbbc22 req-a26c8fd2-568e-4e7b-853b-e7316493ea81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:06.002934 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:06.002934 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:42:06.010774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5db3fbee-7180-4e20-9ebb-ebc0e3fbbc22 req-a26c8fd2-568e-4e7b-853b-e7316493ea81 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:06.011220 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5db3fbee-7180-4e20-9ebb-ebc0e3fbbc22 req-a26c8fd2-568e-4e7b-853b-e7316493ea81 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:06.022588 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5db3fbee-7180-4e20-9ebb-ebc0e3fbbc22 req-a26c8fd2-568e-4e7b-853b-e7316493ea81 service nova] Creating event network-changed:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch1-master-1 Dec 18 21:42:06.027711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-5db3fbee-7180-4e20-9ebb-ebc0e3fbbc22 req-a26c8fd2-568e-4e7b-853b-e7316493ea81 service nova] Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:42:06.039005 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5db3fbee-7180-4e20-9ebb-ebc0e3fbbc22 req-a26c8fd2-568e-4e7b-853b-e7316493ea81 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041253 Dec 18 21:42:06.039642 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3888/7723] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:42:06.426940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:06.427564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:06.434186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:06.434910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:06.435894 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:06.436411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:06.638880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:06.647065 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7dff544-58cf-4a48-bddb-666108bd857e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1725 microversion: 2.1 time: 0.223775 Dec 18 21:42:06.647650 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3836/7724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:06 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:07.666806 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:07.667506 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:07.673644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:07.674099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:07.674911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:07.675357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:07.804983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:07.812790 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7b45e2ba-ad36-4a51-b253-4366166f51ce tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1725 microversion: 2.1 time: 0.151662 Dec 18 21:42:07.813359 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3889/7725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:07 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:08.829348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:08.829964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:08.836923 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:08.837371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:08.838156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:08.838633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:08.971470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:08.979823 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c2d3bece-fc6d-411c-b021-d2bf0f20437b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1725 microversion: 2.1 time: 0.154174 Dec 18 21:42:08.980427 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3837/7726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:08 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:09.997240 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:09.997851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:10.004493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.004959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.005749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.006190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.137942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:10.145719 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ea2b004c-138e-456c-ae84-3f237430ee3a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1722 microversion: 2.1 time: 0.152651 Dec 18 21:42:10.146512 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3890/7727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:09 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:10.162127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:10.162699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:10.170093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.170601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.171409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.171867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.207386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.207883 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.208726 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.209185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.231277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:42:10.236640 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Getting quotas for user 8ad7185a2f28494a95c01e273e6f7212 and project 542852f38d9b4ee7a351cc80abbd3d19. Resources: {'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:42:10.345767 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ac6cb6a0-e482-4593-a2b9-e3be9c6f53ae tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action" status: 202 len: 0 microversion: 2.1 time: 0.187151 Dec 18 21:42:10.346425 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3838/7728] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:42:10 2021] POST /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:42:10.355226 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:10.355995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:10.362923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.363754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.364787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:10.365452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:10.571913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:10.581834 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-761000cc-de55-4c31-bdd9-877defca0d1c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1721 microversion: 2.1 time: 0.230954 Dec 18 21:42:10.588962 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3891/7729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:10 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:11.600679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:11.601411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:11.608336 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:11.608795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:11.609579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:11.610029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:11.739889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:11.748665 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-36ff761f-d59c-4d39-838a-48384ca9409d tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1721 microversion: 2.1 time: 0.152067 Dec 18 21:42:11.749230 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3839/7730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:11 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:12.224189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5f629bc2-b372-463c-8416-0a2bbad15d14 req-a4647b42-dc05-48ca-89c6-80250858caba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "name": "network-vif-plugged", "status": "completed", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:12.225757 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:12.225757 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:42:12.233504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5f629bc2-b372-463c-8416-0a2bbad15d14 req-a4647b42-dc05-48ca-89c6-80250858caba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:12.234033 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5f629bc2-b372-463c-8416-0a2bbad15d14 req-a4647b42-dc05-48ca-89c6-80250858caba service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:12.245262 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5f629bc2-b372-463c-8416-0a2bbad15d14 req-a4647b42-dc05-48ca-89c6-80250858caba service nova] Creating event network-vif-plugged:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch1-master-1 Dec 18 21:42:12.250520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-5f629bc2-b372-463c-8416-0a2bbad15d14 req-a4647b42-dc05-48ca-89c6-80250858caba service nova] Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:42:12.260922 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5f629bc2-b372-463c-8416-0a2bbad15d14 req-a4647b42-dc05-48ca-89c6-80250858caba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107734 Dec 18 21:42:12.261499 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3892/7731] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:12.765504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:12.766123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:12.772817 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:12.773276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:12.774060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:12.774535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:12.906110 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:12.913797 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd134820-e5eb-4596-8de4-488884ebd8e8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1721 microversion: 2.1 time: 0.152006 Dec 18 21:42:12.914386 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3840/7732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:12 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:13.931940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:13.932694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:13.938855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:13.939307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:13.940094 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:13.940627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:14.073468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:14.081420 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cd31f8c5-543b-449c-b15e-3bebbca59ce2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1721 microversion: 2.1 time: 0.154373 Dec 18 21:42:14.081950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3893/7733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:13 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:14.234724 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6c4985d8-d511-45de-aefa-7a1ccb65ec70 req-bc845255-ef7b-4af8-b9c5-cc3ca8d98682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "name": "network-vif-unplugged", "status": "completed", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:14.236243 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:14.236243 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:42:14.244117 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6c4985d8-d511-45de-aefa-7a1ccb65ec70 req-bc845255-ef7b-4af8-b9c5-cc3ca8d98682 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:14.244581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6c4985d8-d511-45de-aefa-7a1ccb65ec70 req-bc845255-ef7b-4af8-b9c5-cc3ca8d98682 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:14.259208 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6c4985d8-d511-45de-aefa-7a1ccb65ec70 req-bc845255-ef7b-4af8-b9c5-cc3ca8d98682 service nova] Creating event network-vif-unplugged:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch2-master-1 Dec 18 21:42:14.265380 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-6c4985d8-d511-45de-aefa-7a1ccb65ec70 req-bc845255-ef7b-4af8-b9c5-cc3ca8d98682 service nova] Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:42:14.276745 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6c4985d8-d511-45de-aefa-7a1ccb65ec70 req-bc845255-ef7b-4af8-b9c5-cc3ca8d98682 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044975 Dec 18 21:42:14.277378 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3841/7734] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:15.099321 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:15.099933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:15.107466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:15.109369 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:15.110180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:15.110650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:15.247915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:15.258619 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-42118e9c-849b-45e5-898d-337ae6dc3db1 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1721 microversion: 2.1 time: 0.160376 Dec 18 21:42:15.259381 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3894/7735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:15 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:16.277070 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:16.277673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:16.283937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:16.284408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:16.285211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:16.285670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:16.293277 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cd526e2f-d6de-46f2-92c4-54e814d333bd req-82b1f614-76ed-4af7-93d5-335d47d0fc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:16.294807 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:16.294807 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:42:16.302742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cd526e2f-d6de-46f2-92c4-54e814d333bd req-82b1f614-76ed-4af7-93d5-335d47d0fc8c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:16.303194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cd526e2f-d6de-46f2-92c4-54e814d333bd req-82b1f614-76ed-4af7-93d5-335d47d0fc8c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:16.315429 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cd526e2f-d6de-46f2-92c4-54e814d333bd req-82b1f614-76ed-4af7-93d5-335d47d0fc8c service nova] Creating event network-changed:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch2-master-1 Dec 18 21:42:16.321007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-cd526e2f-d6de-46f2-92c4-54e814d333bd req-82b1f614-76ed-4af7-93d5-335d47d0fc8c service nova] Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:42:16.336022 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cd526e2f-d6de-46f2-92c4-54e814d333bd req-82b1f614-76ed-4af7-93d5-335d47d0fc8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046577 Dec 18 21:42:16.337100 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3895/7736] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:42:16.458931 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:16.466929 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-024fa5f8-d5d9-4f79-bd49-bfd6ff131061 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1721 microversion: 2.1 time: 0.194824 Dec 18 21:42:16.467600 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3842/7737] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:16 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:17.484144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:17.484838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:17.490994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:17.491444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:17.492222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:17.492663 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:17.627268 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:17.635572 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-216319d6-6295-46b9-8f19-dd7871c12f7b tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1721 microversion: 2.1 time: 0.155660 Dec 18 21:42:17.636136 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3896/7738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:17 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:18.653231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:18.653766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:18.660496 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:18.660960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:18.661745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:18.662201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:18.794026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:18.801803 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd42982e-02de-4d76-aee5-3ee6cedabaf8 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1714 microversion: 2.1 time: 0.153070 Dec 18 21:42:18.802391 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3843/7739] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:18 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:18.817898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:18.818528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:18.825680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:18.826130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:18.826933 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:18.827376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:18.953884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:18.961851 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a5c94395-e10e-4c87-8803-ff4df9b00b3f tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1714 microversion: 2.1 time: 0.147567 Dec 18 21:42:18.962567 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3897/7740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:18 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:18.977459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:18.978079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:18.983933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:18.984401 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:18.985286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:18.985741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:19.112459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:19.120850 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a61a3f1f-5ab0-457f-bf1b-feccbd49be9e tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1714 microversion: 2.1 time: 0.147107 Dec 18 21:42:19.121422 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3844/7741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:18 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1714 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:19.137242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:19.137740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:19.143608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:19.144058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:19.144834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:19.145270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:19.169155 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:42:19.245057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25f5fe99-489b-47e2-9040-fc0491ed6bbd tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 204 len: 0 microversion: 2.1 time: 0.111257 Dec 18 21:42:19.245597 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3898/7742] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:19 2021] DELETE /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:42:19.253940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:19.254603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:19.260561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:19.261030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:19.261823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:19.262301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:19.397207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:19.405345 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc534732-6833-48a0-b8bb-b60bc32b7f80 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1720 microversion: 2.1 time: 0.155097 Dec 18 21:42:19.405921 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3845/7743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:19 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:20.423025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:20.423758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:20.430443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:20.430899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:20.432191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:20.432634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:20.568480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:20.578885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0184e603-700b-43ad-a7f7-18f2d42b7922 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1720 microversion: 2.1 time: 0.159560 Dec 18 21:42:20.579480 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3899/7744] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:20 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:21.596710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:21.597314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:21.604794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:21.605201 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:21.606002 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:21.606475 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:21.677657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad7185a2f28494a95c01e273e6f7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542852f38d9b4ee7a351cc80abbd3d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:21.679499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ac00e8ad-8b48-4e48-92ba-b91b4d642b44 req-cc7c7300-cf4c-4798-9cd0-2f0bd1ae8cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a6307b-e64e-4af8-8cde-b68f3ac5b95c", "name": "network-vif-deleted", "tag": "90b75a1e-069a-43ca-b122-ae791df3d46f"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:21.681733 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:21.681733 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:42:21.687021 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-06001820-24de-4170-ab4b-146f998add75 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 200 len: 1653 microversion: 2.1 time: 0.093969 Dec 18 21:42:21.687657 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3846/7745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:21 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 1653 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:21.691682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ac00e8ad-8b48-4e48-92ba-b91b4d642b44 req-cc7c7300-cf4c-4798-9cd0-2f0bd1ae8cc9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:21.692416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ac00e8ad-8b48-4e48-92ba-b91b4d642b44 req-cc7c7300-cf4c-4798-9cd0-2f0bd1ae8cc9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:21.706006 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ac00e8ad-8b48-4e48-92ba-b91b4d642b44 req-cc7c7300-cf4c-4798-9cd0-2f0bd1ae8cc9 service nova] Creating event network-vif-deleted:90b75a1e-069a-43ca-b122-ae791df3d46f for instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c on nch2-master-1 Dec 18 21:42:21.711193 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ac00e8ad-8b48-4e48-92ba-b91b4d642b44 req-cc7c7300-cf4c-4798-9cd0-2f0bd1ae8cc9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035337 Dec 18 21:42:21.712015 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3900/7746] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:42:22.704578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:22.705208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:22.711560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:22.712030 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:22.713318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:22.713773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:22.727125 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. Dec 18 21:42:22.727759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:22.729195 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f43d06d-315a-4647-98f6-2db31631700a tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 404 len: 111 microversion: 2.1 time: 0.028136 Dec 18 21:42:22.729730 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3847/7747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:22 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:22.784272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:22.785292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:22.792029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:22.792478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:22.793255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:22.793688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:22.806478 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. Dec 18 21:42:22.807057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:22.807878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-28db4d46-a057-466b-b75c-ac500156666c tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029449 Dec 18 21:42:22.808441 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3901/7748] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:42:22 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.024243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.024749 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.031979 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.032439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.033229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.033678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.047228 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. Dec 18 21:42:24.047815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.048639 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8c7320ba-be6f-46f8-95d4-42e2ca913dd2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 404 len: 111 microversion: 2.1 time: 0.028083 Dec 18 21:42:24.049147 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3848/7749] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:24 2021] DELETE /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.056904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.057515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 67a6307b-e64e-4af8-8cde-b68f3ac5b95c] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.063561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.064020 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.064810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.065250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.078107 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. Dec 18 21:42:24.078715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 67a6307b-e64e-4af8-8cde-b68f3ac5b95c could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.079527 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d63b6266-184e-466b-9171-cec48e086da6 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c" status: 404 len: 111 microversion: 2.1 time: 0.026513 Dec 18 21:42:24.080069 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3902/7750] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:24 2021] GET /compute/v2.1/servers/67a6307b-e64e-4af8-8cde-b68f3ac5b95c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 21:42:24.088116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.088610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.094560 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.095026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.095815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.096267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.109749 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. Dec 18 21:42:24.110369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.111187 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4f28eaaa-3126-4996-94de-a1f78ded6e40 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 404 len: 111 microversion: 2.1 time: 0.027180 Dec 18 21:42:24.111699 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3849/7751] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:24 2021] DELETE /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.119091 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.119853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 814c4a36-6ed2-4170-a5f8-6674d35f8a13] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.125582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.126039 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.126859 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.127300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.140129 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. Dec 18 21:42:24.140704 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 814c4a36-6ed2-4170-a5f8-6674d35f8a13 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.141505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dbab5642-088b-4a0a-87c2-515bfb847992 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13" status: 404 len: 111 microversion: 2.1 time: 0.026060 Dec 18 21:42:24.142016 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3903/7752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:24 2021] GET /compute/v2.1/servers/814c4a36-6ed2-4170-a5f8-6674d35f8a13 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.149301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.149811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.156067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.156538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.157332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.157787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.173141 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. Dec 18 21:42:24.173729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.174590 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-90bf21b5-7a02-42f6-930c-06a4b5551630 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 404 len: 111 microversion: 2.1 time: 0.028810 Dec 18 21:42:24.175107 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3850/7753] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:24 2021] DELETE /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.182611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.183222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: a9872a41-54f2-47b1-a739-b1c856484f97] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.189570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.190061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.190926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.191374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.204567 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. Dec 18 21:42:24.205152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance a9872a41-54f2-47b1-a739-b1c856484f97 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.205999 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-12032a14-284f-4620-80fc-dcd5c852d2a2 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97" status: 404 len: 111 microversion: 2.1 time: 0.027111 Dec 18 21:42:24.206549 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3904/7754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:24 2021] GET /compute/v2.1/servers/a9872a41-54f2-47b1-a739-b1c856484f97 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.215075 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.215593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.222223 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.222721 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.223594 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.227908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.238446 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. Dec 18 21:42:24.239053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.239904 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cab503bd-8b1c-4500-b6d1-bf64a0543bde tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 404 len: 111 microversion: 2.1 time: 0.029295 Dec 18 21:42:24.240449 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3851/7755] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:24 2021] DELETE /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.248431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.249073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] [instance: 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:24.255154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.255537 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.256323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:24.256768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:24.270044 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] HTTP exception thrown: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. Dec 18 21:42:24.270665 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Returning 404 to user: Instance 6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:24.271539 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2185e238-57a2-4c3b-9ee8-d48ba4c8a3f9 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7" status: 404 len: 111 microversion: 2.1 time: 0.026807 Dec 18 21:42:24.272055 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3905/7756] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:24 2021] GET /compute/v2.1/servers/6b6d28b1-a536-490d-91f9-aedfd7bc4ba7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:24.280477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a522b89f-906a-4923-9196-5081323d87f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] Calling method '.version_select at 0x7f714edf14c0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:24.302231 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a522b89f-906a-4923-9196-5081323d87f3 tempest-ServerActionsTestJSON-1912105552 tempest-ServerActionsTestJSON-1912105552-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744532994" status: 202 len: 0 microversion: 2.1 time: 0.025391 Dec 18 21:42:24.302835 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3852/7757] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:42:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744532994 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:42:30.029478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2090533562", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "e2dabeab-0a8a-4404-9cca-bcca05a86fdd"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:30.084090 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] validate_networks() for [('e2dabeab-0a8a-4404-9cca-bcca05a86fdd', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:42:30.672340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:42:30.672789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:42:30.673264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:42:30.673674 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:42:30.674084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:42:30.683489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:30.683943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:30.684761 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:30.685202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:30.701322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Getting quotas for project 42db9342b99048278dc6eb082fbe7941. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:42:30.706354 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Getting quotas for user 8d2747fedaf441218a89cdf5bedb81b4 and project 42db9342b99048278dc6eb082fbe7941. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:42:30.718644 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:42:30.720981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:42:30.766057 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cd4d649e-5c63-4bb8-b65f-4f525d07b054 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870933 Dec 18 21:42:30.766670 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3906/7758] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:42:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:42:30.777922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f1016e8b-f211-4055-b280-127effc5c787 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:30.778579 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f1016e8b-f211-4055-b280-127effc5c787 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:30.830048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f1016e8b-f211-4055-b280-127effc5c787 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:30.838016 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f1016e8b-f211-4055-b280-127effc5c787 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1217 microversion: 2.1 time: 0.064881 Dec 18 21:42:30.838837 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3853/7759] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:30 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:31.855422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:31.856070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:31.864308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:31.864774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:31.865590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:31.866041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:31.928782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:31.937334 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c01c645a-6be5-4868-afc1-de94f8587d46 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1275 microversion: 2.1 time: 0.086736 Dec 18 21:42:31.938045 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3907/7760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:31 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:32.954823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:32.955454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:32.963645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:32.964196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:32.965078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:32.965540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:33.124897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:33.132611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45869f65-4707-4732-bd6e-c907f4d9371e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1317 microversion: 2.1 time: 0.181521 Dec 18 21:42:33.133186 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3854/7761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:32 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:33.309176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4e670c34-db81-400f-ac32-4fb5f56fa2f7 req-1c8aec06-008c-4f39-94fb-9f59b7591e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa513f5-0a11-485f-a047-9f91e938e997", "tag": "b5069322-eb53-418b-bc45-8c1e692022f1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:33.310760 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:33.310760 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:42:33.318580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4e670c34-db81-400f-ac32-4fb5f56fa2f7 req-1c8aec06-008c-4f39-94fb-9f59b7591e63 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:33.319027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4e670c34-db81-400f-ac32-4fb5f56fa2f7 req-1c8aec06-008c-4f39-94fb-9f59b7591e63 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:33.332925 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4e670c34-db81-400f-ac32-4fb5f56fa2f7 req-1c8aec06-008c-4f39-94fb-9f59b7591e63 service nova] Creating event network-changed:b5069322-eb53-418b-bc45-8c1e692022f1 for instance 6fa513f5-0a11-485f-a047-9f91e938e997 on nch2-master-1 Dec 18 21:42:33.337784 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4e670c34-db81-400f-ac32-4fb5f56fa2f7 req-1c8aec06-008c-4f39-94fb-9f59b7591e63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105817 Dec 18 21:42:33.338458 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3908/7762] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:42:34.149652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:34.150827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:34.157430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:34.157893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:34.158719 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:34.159168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:34.288752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:34.296091 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e842bd22-2280-410c-bdc9-3b48b71a6001 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1317 microversion: 2.1 time: 0.150213 Dec 18 21:42:34.296664 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3855/7763] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:34 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:35.313434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:35.314171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:35.320378 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:35.320838 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:35.321624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:35.322064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:35.449415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:35.456751 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-36a6614b-4439-4108-af97-1f86ebd5344b tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1317 microversion: 2.1 time: 0.148235 Dec 18 21:42:35.457559 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3909/7764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:35 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:36.473835 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:36.474576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:36.481844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:36.482354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:36.483171 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:36.483629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:36.619986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:36.627800 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cffb4ef3-1c70-4f26-a271-7aea404fc6c0 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1317 microversion: 2.1 time: 0.157670 Dec 18 21:42:36.628503 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3856/7765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:36 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:37.644410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:37.645027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:37.651847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:37.652310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:37.653107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:37.653572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:37.782764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:37.790068 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ecc89ec-ff79-4e99-bf76-5baab6c3e854 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1317 microversion: 2.1 time: 0.149460 Dec 18 21:42:37.790839 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3910/7766] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:37 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:38.538155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ff40a4f1-9b9d-40ec-a93d-98c5e0f00c6c req-884996c3-22aa-447e-aee1-8763794b2368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa513f5-0a11-485f-a047-9f91e938e997", "name": "network-vif-plugged", "status": "completed", "tag": "b5069322-eb53-418b-bc45-8c1e692022f1"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:38.539810 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:38.539810 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:42:38.548281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ff40a4f1-9b9d-40ec-a93d-98c5e0f00c6c req-884996c3-22aa-447e-aee1-8763794b2368 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:38.548741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ff40a4f1-9b9d-40ec-a93d-98c5e0f00c6c req-884996c3-22aa-447e-aee1-8763794b2368 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:38.559780 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ff40a4f1-9b9d-40ec-a93d-98c5e0f00c6c req-884996c3-22aa-447e-aee1-8763794b2368 service nova] Creating event network-vif-plugged:b5069322-eb53-418b-bc45-8c1e692022f1 for instance 6fa513f5-0a11-485f-a047-9f91e938e997 on nch2-master-1 Dec 18 21:42:38.564755 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ff40a4f1-9b9d-40ec-a93d-98c5e0f00c6c req-884996c3-22aa-447e-aee1-8763794b2368 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Dec 18 21:42:38.565506 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3857/7767] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:38.806782 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:38.807306 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:38.814029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:38.814531 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:38.815322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:38.815777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:38.947777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:38.954992 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e32c5f31-e477-4931-8177-020ed05db713 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1317 microversion: 2.1 time: 0.152072 Dec 18 21:42:38.956064 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3911/7768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:38 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:39.974162 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:39.974907 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:39.981875 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:39.982375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:39.983186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:39.983647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:40.112311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:40.119806 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bc1cd702-ad3b-481a-a46e-f04cba99e080 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1505 microversion: 2.1 time: 0.150589 Dec 18 21:42:40.120378 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3858/7769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:39 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:40.172453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-289278523", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "e2dabeab-0a8a-4404-9cca-bcca05a86fdd"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:40.223559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] validate_networks() for [('e2dabeab-0a8a-4404-9cca-bcca05a86fdd', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:42:40.628592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:42:40.629014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:42:40.629510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:42:40.629916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:42:40.630352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:42:40.640103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:40.640559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:40.641379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:40.641822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:40.658026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Getting quotas for project 42db9342b99048278dc6eb082fbe7941. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:42:40.663029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Getting quotas for user 8d2747fedaf441218a89cdf5bedb81b4 and project 42db9342b99048278dc6eb082fbe7941. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:42:40.674921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:42:40.677270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:42:40.720986 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-daa121ec-4757-43c7-bd16-7e66d58fc9f9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552189 Dec 18 21:42:40.721629 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3912/7770] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:42:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:42:40.731479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-254a6c30-a8f8-4d69-bcfb-cc3d2f002a70 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:40.732302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-254a6c30-a8f8-4d69-bcfb-cc3d2f002a70 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:40.784589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-254a6c30-a8f8-4d69-bcfb-cc3d2f002a70 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:40.791265 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-254a6c30-a8f8-4d69-bcfb-cc3d2f002a70 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1216 microversion: 2.1 time: 0.063753 Dec 18 21:42:40.791838 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3859/7771] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:40 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:41.809423 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:41.810064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:41.816748 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:41.817379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:41.818089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:41.818643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:41.880447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:41.888059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8c4cccb9-2503-4a29-9b4e-9fddffb063e6 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1268 microversion: 2.1 time: 0.083827 Dec 18 21:42:41.888926 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3913/7772] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:41 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1268 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:42.905419 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:42.906163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:42.917238 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:42.917779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:42.918613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:42.919085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:43.120788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:43.128076 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-222fed83-03b6-43b2-abc8-9af7967e7862 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1316 microversion: 2.1 time: 0.226339 Dec 18 21:42:43.128659 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3860/7773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:42 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:43.197672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5733a4fb-29fd-4bb7-b327-903280f5791c req-ab9f9040-c0ca-4f03-bac4-178f642ab586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e", "tag": "533221a8-c2ef-4dcf-bc51-2c2b3af0af97"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:43.200164 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:43.200164 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:42:43.209001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5733a4fb-29fd-4bb7-b327-903280f5791c req-ab9f9040-c0ca-4f03-bac4-178f642ab586 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:43.209263 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5733a4fb-29fd-4bb7-b327-903280f5791c req-ab9f9040-c0ca-4f03-bac4-178f642ab586 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:43.222704 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5733a4fb-29fd-4bb7-b327-903280f5791c req-ab9f9040-c0ca-4f03-bac4-178f642ab586 service nova] Creating event network-changed:533221a8-c2ef-4dcf-bc51-2c2b3af0af97 for instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e on nch1-master-1 Dec 18 21:42:43.228724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5733a4fb-29fd-4bb7-b327-903280f5791c req-ab9f9040-c0ca-4f03-bac4-178f642ab586 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035133 Dec 18 21:42:43.229912 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3914/7774] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:44.145456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:44.146084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:44.152903 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:44.153376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:44.154181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:44.154661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:44.289425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:44.297340 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c4585bb5-f796-4a98-addb-dd5ce9ba0b20 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1316 microversion: 2.1 time: 0.155618 Dec 18 21:42:44.297910 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3861/7775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:44 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:45.315313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:45.316011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:45.322144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:45.322634 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:45.323416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:45.323858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:45.455898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:45.464017 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-421f6ae8-b649-45a7-955f-c63a8fb79847 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1316 microversion: 2.1 time: 0.153863 Dec 18 21:42:45.464610 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3915/7776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:45 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:46.481033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:46.481599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:46.488466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:46.488942 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:46.489743 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:46.490203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:46.620378 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:46.627783 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c01ed320-5f47-46d4-93c6-5e4d9796cb50 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1316 microversion: 2.1 time: 0.151076 Dec 18 21:42:46.628559 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3862/7777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:46 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:47.644541 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:47.645144 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:47.651910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:47.652356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:47.653162 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:47.653597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:47.798172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:47.805370 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4ca28687-03fd-4974-bebd-949189b09bab tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1316 microversion: 2.1 time: 0.164522 Dec 18 21:42:47.805931 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3916/7778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:47 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:48.280436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4d296471-3954-41d2-9c77-77f385dffcfc req-8e87853f-86a4-47af-ab75-f00656d8cafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e", "name": "network-vif-plugged", "status": "completed", "tag": "533221a8-c2ef-4dcf-bc51-2c2b3af0af97"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:48.282032 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:48.282032 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:42:48.290124 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4d296471-3954-41d2-9c77-77f385dffcfc req-8e87853f-86a4-47af-ab75-f00656d8cafb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:48.290723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4d296471-3954-41d2-9c77-77f385dffcfc req-8e87853f-86a4-47af-ab75-f00656d8cafb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:48.302227 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4d296471-3954-41d2-9c77-77f385dffcfc req-8e87853f-86a4-47af-ab75-f00656d8cafb service nova] Creating event network-vif-plugged:533221a8-c2ef-4dcf-bc51-2c2b3af0af97 for instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e on nch1-master-1 Dec 18 21:42:48.307182 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4d296471-3954-41d2-9c77-77f385dffcfc req-8e87853f-86a4-47af-ab75-f00656d8cafb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030452 Dec 18 21:42:48.307973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3863/7779] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:48.823018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:48.823619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:48.830977 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:48.831425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:48.832206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:48.832906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:48.963339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:48.971252 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bc17c2a-85f2-40e9-bc34-e837954be845 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1316 microversion: 2.1 time: 0.152528 Dec 18 21:42:48.971747 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3917/7780] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:48 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:49.988818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:49.989516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:49.995745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:49.996210 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:49.997005 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:49.997455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:50.124830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:50.132203 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd4c0ceb-a4de-4b5b-b100-5058c6b4cd59 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1504 microversion: 2.1 time: 0.148344 Dec 18 21:42:50.132794 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3864/7781] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:49 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:50.148376 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:50.148899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:50.156272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:50.156729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:50.157511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:50.157956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:50.181557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:42:50.254178 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-622a98e8-f4c3-4fea-858d-3c0b8e5108cb tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 204 len: 0 microversion: 2.1 time: 0.108806 Dec 18 21:42:50.254930 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3918/7782] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:50 2021] DELETE /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:42:50.263285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:50.263910 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:50.269820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:50.270325 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:50.271149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:50.271607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:50.402538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:50.409971 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c78f4d99-57af-4715-a117-11653ef262d9 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1510 microversion: 2.1 time: 0.150963 Dec 18 21:42:50.410592 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3865/7783] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:50 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:51.427239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:51.427941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:51.434627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:51.435087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:51.435871 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:51.436344 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:51.567953 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:51.575996 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-635e7a27-538c-4024-9086-c79b2b9e3250 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1510 microversion: 2.1 time: 0.152876 Dec 18 21:42:51.576605 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3919/7784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:51 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:52.125379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-67d06930-546d-458b-8667-2a78d4ad9802 req-38ed829f-9dc7-4fc6-a094-97898caf2bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e", "name": "network-vif-deleted", "tag": "533221a8-c2ef-4dcf-bc51-2c2b3af0af97"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:52.128173 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:52.128173 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:42:52.137885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-67d06930-546d-458b-8667-2a78d4ad9802 req-38ed829f-9dc7-4fc6-a094-97898caf2bed service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:52.138405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-67d06930-546d-458b-8667-2a78d4ad9802 req-38ed829f-9dc7-4fc6-a094-97898caf2bed service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:52.152633 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-67d06930-546d-458b-8667-2a78d4ad9802 req-38ed829f-9dc7-4fc6-a094-97898caf2bed service nova] Creating event network-vif-deleted:533221a8-c2ef-4dcf-bc51-2c2b3af0af97 for instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e on nch1-master-1 Dec 18 21:42:52.158720 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-67d06930-546d-458b-8667-2a78d4ad9802 req-38ed829f-9dc7-4fc6-a094-97898caf2bed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037068 Dec 18 21:42:52.159333 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3866/7785] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:52.592754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:52.593359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:52.600320 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:52.600801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:52.601625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:52.602070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:52.634811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:52.635266 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:52.635724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lazy-loading 'fault' on Instance uuid d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:42:52.678138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:52.685505 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f34b52d8-cc61-4cc5-9382-e7f465c2e76e tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 200 len: 1306 microversion: 2.1 time: 0.096504 Dec 18 21:42:52.686079 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3920/7786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:52 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:53.704112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:53.704826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:53.711345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:53.711815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:53.712614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:53.713071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:53.726559 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] HTTP exception thrown: Instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e could not be found. Dec 18 21:42:53.727165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Returning 404 to user: Instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:53.728003 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ee082c1f-a152-46c0-96eb-49b8f6741844 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 404 len: 111 microversion: 2.1 time: 0.028841 Dec 18 21:42:53.728530 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3867/7787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:53 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:53.737206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:53.737819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:53.743957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:53.744415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:53.745729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:53.746173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:53.877745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:53.885030 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a9faf535-0326-4e54-b1e8-98ece46fb0e8 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1505 microversion: 2.1 time: 0.151755 Dec 18 21:42:53.886231 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3921/7788] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:53 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:53.901543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-147ed0c6-0302-44df-92ae-6c6a796009d5 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:53.902555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-147ed0c6-0302-44df-92ae-6c6a796009d5 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 43f529ce-04cf-4b2b-8c8e-75be2db1ce38] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:53.907851 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-147ed0c6-0302-44df-92ae-6c6a796009d5 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] HTTP exception thrown: Instance 43f529ce-04cf-4b2b-8c8e-75be2db1ce38 could not be found. Dec 18 21:42:53.908434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-147ed0c6-0302-44df-92ae-6c6a796009d5 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Returning 404 to user: Instance 43f529ce-04cf-4b2b-8c8e-75be2db1ce38 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:53.909247 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-147ed0c6-0302-44df-92ae-6c6a796009d5 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "POST /compute/v2.1/servers/43f529ce-04cf-4b2b-8c8e-75be2db1ce38/action" status: 404 len: 111 microversion: 2.1 time: 0.011548 Dec 18 21:42:53.909773 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3868/7789] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:42:53 2021] POST /compute/v2.1/servers/43f529ce-04cf-4b2b-8c8e-75be2db1ce38/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:53.917274 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:53.917903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:53.923603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:53.924052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:53.924824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:53.925262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.058483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:54.065783 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9c737046-3b3f-4085-a463-ed0965760b94 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1505 microversion: 2.1 time: 0.152088 Dec 18 21:42:54.066369 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3922/7790] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:53 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:42:54.082952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.083601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.092479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.092949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.093821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.094295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.222556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:54.230374 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0dd809fa-61d6-421d-9930-30a9be584397 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1505 microversion: 2.1 time: 0.151358 Dec 18 21:42:54.230948 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3869/7791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:54 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:42:54.246672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "0b404090-d42e-45c4-bb2b-4822388e48a4"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:54.247652 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.253391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.253842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.254650 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.255089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.293450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:54.298644 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] HTTP exception thrown: Flavor 0b404090-d42e-45c4-bb2b-4822388e48a4 could not be found. Dec 18 21:42:54.299260 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Returning 400 to user: Flavor 0b404090-d42e-45c4-bb2b-4822388e48a4 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:54.300088 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-82a0bbac-8e5b-42b6-8561-4baf80ab450c tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "POST /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997/action" status: 400 len: 107 microversion: 2.1 time: 0.057846 Dec 18 21:42:54.300633 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3923/7792] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:42:54 2021] POST /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997/action => generated 107 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:42:54.309146 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.309761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.315555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.316022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.316803 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.317252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.443825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:54.451145 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7c872695-9530-4efb-b438-a41d704e15ac tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1505 microversion: 2.1 time: 0.146333 Dec 18 21:42:54.451701 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3870/7793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:54 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:54.468254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.468860 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.474609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.475062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.475839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.476276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.607375 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:54.614767 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4cb36b98-6600-4e8a-b408-1bb62413c6af tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1505 microversion: 2.1 time: 0.150134 Dec 18 21:42:54.615377 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3924/7794] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:54 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:54.630571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5aa9dfaa-bf87-47e6-bfc3-372de8068f70 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:54.631706 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5aa9dfaa-bf87-47e6-bfc3-372de8068f70 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:54.632520 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5aa9dfaa-bf87-47e6-bfc3-372de8068f70 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "POST /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997/action" status: 400 len: 113 microversion: 2.1 time: 0.005726 Dec 18 21:42:54.633029 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3871/7795] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:42:54 2021] POST /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 21:42:54.640326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.640985 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.646858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.647252 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.648035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.648478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.776999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:54.784367 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-556c3796-4139-4714-b488-0f30f088ab7a tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1505 microversion: 2.1 time: 0.147533 Dec 18 21:42:54.784935 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3925/7796] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:54 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:54.804397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.804895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.811808 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.812273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.813068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.813522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.826801 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] HTTP exception thrown: Instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e could not be found. Dec 18 21:42:54.827403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Returning 404 to user: Instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:54.828217 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dbddda0f-53d3-4d48-8921-8b348d50a543 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 404 len: 111 microversion: 2.1 time: 0.028307 Dec 18 21:42:54.828731 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3872/7797] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:54 2021] DELETE /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:54.836608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.837210 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.843710 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.844159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.844936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.845374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.858605 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] HTTP exception thrown: Instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e could not be found. Dec 18 21:42:54.859184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Returning 404 to user: Instance d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:54.860003 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5099b228-472c-473d-ba71-a0d0725b9a53 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e" status: 404 len: 111 microversion: 2.1 time: 0.027342 Dec 18 21:42:54.860573 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3926/7798] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:54 2021] GET /compute/v2.1/servers/d1cdad72-ece1-4e90-9e9f-d2ec6d5fa65e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:42:54.868355 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.868866 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.874785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.875252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.876044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.876505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.900550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:42:54.972758 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dc1470fd-3957-4120-bed8-93923372f4b3 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 204 len: 0 microversion: 2.1 time: 0.107730 Dec 18 21:42:54.973491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3873/7799] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:42:54 2021] DELETE /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:42:54.981293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:54.981910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:54.987863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.988326 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:54.989119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:54.989567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:55.120223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:55.127482 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d058a542-fe08-4b7b-9d98-2687300372ca tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1511 microversion: 2.1 time: 0.149986 Dec 18 21:42:55.128052 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3927/7800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:54 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:42:56.145107 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:56.145813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:56.152995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:56.153468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:56.154284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:56.154738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:56.284321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2747fedaf441218a89cdf5bedb81b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42db9342b99048278dc6eb082fbe7941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:42:56.291662 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-809e33fe-0f93-43d6-9e23-99c10f9baca1 tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 200 len: 1511 microversion: 2.1 time: 0.150657 Dec 18 21:42:56.292226 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3874/7801] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:56 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:42:56.817310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d5ea6192-a3c6-4588-a436-8c9c0ab5555f req-d6dc7cab-2f97-44f5-97ee-3be53fe23bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa513f5-0a11-485f-a047-9f91e938e997", "name": "network-vif-deleted", "tag": "b5069322-eb53-418b-bc45-8c1e692022f1"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:42:56.819125 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:42:56.819125 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:42:56.827875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d5ea6192-a3c6-4588-a436-8c9c0ab5555f req-d6dc7cab-2f97-44f5-97ee-3be53fe23bc7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:56.828327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d5ea6192-a3c6-4588-a436-8c9c0ab5555f req-d6dc7cab-2f97-44f5-97ee-3be53fe23bc7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:56.842700 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d5ea6192-a3c6-4588-a436-8c9c0ab5555f req-d6dc7cab-2f97-44f5-97ee-3be53fe23bc7 service nova] Creating event network-vif-deleted:b5069322-eb53-418b-bc45-8c1e692022f1 for instance 6fa513f5-0a11-485f-a047-9f91e938e997 on nch2-master-1 Dec 18 21:42:56.847649 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d5ea6192-a3c6-4588-a436-8c9c0ab5555f req-d6dc7cab-2f97-44f5-97ee-3be53fe23bc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 Dec 18 21:42:56.848375 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3928/7802] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:42:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:42:57.309011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:42:57.309646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] [instance: 6fa513f5-0a11-485f-a047-9f91e938e997] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:42:57.316489 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:57.316947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:57.317744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:42:57.318203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:42:57.331112 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] HTTP exception thrown: Instance 6fa513f5-0a11-485f-a047-9f91e938e997 could not be found. Dec 18 21:42:57.331711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] Returning 404 to user: Instance 6fa513f5-0a11-485f-a047-9f91e938e997 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:42:57.332799 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52721d84-1354-478f-a83d-dafcc8011eee tempest-ServersNegativeTestJSON-1901211673 tempest-ServersNegativeTestJSON-1901211673-project] 10.222.0.13 "GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997" status: 404 len: 111 microversion: 2.1 time: 0.028062 Dec 18 21:42:57.333323 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3875/7803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:42:57 2021] GET /compute/v2.1/servers/6fa513f5-0a11-485f-a047-9f91e938e997 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:43:18.521687 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:43:18.521687 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:43:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:43:35.981779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-855f09a3-dc3d-4b22-8db8-702effe8fe96 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Action: 'create', calling method: .version_select at 0x7f714e2be790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1702214054"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:43:35.996117 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-855f09a3-dc3d-4b22-8db8-702effe8fe96 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Getting quotas for project fb1a66fd59be4793a6090985e8ae5998. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:43:36.000927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-855f09a3-dc3d-4b22-8db8-702effe8fe96 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Getting quotas for user 9ce8de7276144144a52e038b19adda07 and project fb1a66fd59be4793a6090985e8ae5998. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:43:36.111451 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-855f09a3-dc3d-4b22-8db8-702effe8fe96 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Getting quotas for project fb1a66fd59be4793a6090985e8ae5998. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:43:36.116327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-855f09a3-dc3d-4b22-8db8-702effe8fe96 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Getting quotas for user 9ce8de7276144144a52e038b19adda07 and project fb1a66fd59be4793a6090985e8ae5998. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:43:36.130469 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-855f09a3-dc3d-4b22-8db8-702effe8fe96 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.152672 Dec 18 21:43:36.131251 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3929/7804] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:43:35 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:36.176890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-899070711", "imageRef": "1e7d3e3f-f798-481f-a9e8-1a81a686dd64", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1702214054", "networks": [{"uuid": "1116cea5-4729-4abb-9c60-c0a1568c7c11"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:43:36.225359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] validate_networks() for [('1116cea5-4729-4abb-9c60-c0a1568c7c11', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:43:36.599868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:43:36.600310 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:43:36.600802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:43:36.601227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:43:36.601655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:43:36.611122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:36.611595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:36.612431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:36.612888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:36.629607 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Getting quotas for project fb1a66fd59be4793a6090985e8ae5998. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:43:36.634918 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Getting quotas for user 9ce8de7276144144a52e038b19adda07 and project fb1a66fd59be4793a6090985e8ae5998. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:43:36.646893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:43:36.649138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e7d3e3f-f798-481f-a9e8-1a81a686dd64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:43:36.692160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68707f05-a1df-4d7e-a79c-aa0a66ca76e3 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518956 Dec 18 21:43:36.692725 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3876/7805] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:43:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:43:36.702429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e6e62a4d-1460-49db-8a56-8ae00c0fe36a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:36.703239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e6e62a4d-1460-49db-8a56-8ae00c0fe36a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:36.758863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e6e62a4d-1460-49db-8a56-8ae00c0fe36a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:36.766714 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e6e62a4d-1460-49db-8a56-8ae00c0fe36a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1258 microversion: 2.1 time: 0.067976 Dec 18 21:43:36.767273 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3930/7806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:36 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:37.784750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:37.785601 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:37.792900 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:37.793366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:37.794166 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:37.794644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:37.866603 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:37.874668 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8fbdf7d3-8e6c-421b-bcc6-71113d989fa9 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1316 microversion: 2.1 time: 0.094575 Dec 18 21:43:37.875233 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3877/7807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:37 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:38.891480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:38.893107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:38.902147 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:38.903340 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:38.904764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:38.905524 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:39.079685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:39.088479 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3d9fb80-ddbe-4cd5-9c50-2ea3b8e8354d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.199880 Dec 18 21:43:39.089210 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3931/7808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:38 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:40.104887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:40.105644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:40.112410 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:40.112873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:40.113663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:40.114123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:40.242870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:40.251519 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-35b19720-e13a-437d-92b6-bbc29d594cc2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.150370 Dec 18 21:43:40.252352 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3878/7809] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:40 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:41.268824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:41.269530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:41.277050 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:41.277580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:41.278419 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:41.278868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:41.421196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:41.429675 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cbafbb27-9064-4e45-bf7f-e221fc754175 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.164487 Dec 18 21:43:41.430950 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3932/7810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:41 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:42.445717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:42.446431 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:42.453307 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:42.453773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:42.454596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:42.455056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:42.606459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:42.614777 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13238978-d0d4-4694-b90a-3e9f28711df4 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.172427 Dec 18 21:43:42.616078 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3879/7811] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:42 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:43.633810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:43.635404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:43.643139 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:43.643792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:43.644878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:43.645387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:43.778885 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:43.786183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-513ae481-0731-4caf-b51c-9968ddbd038a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.158671 Dec 18 21:43:43.786790 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3933/7812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:43 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:44.804255 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:44.804889 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:44.812522 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:44.812995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:44.813811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:44.814392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:44.948680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:44.959489 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a4e0320-a1e1-4313-956a-62aa79f8da84 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.159609 Dec 18 21:43:44.960207 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3880/7813] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:44 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:45.978932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:45.979630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:45.987384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:45.987980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:45.988850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:45.989384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:46.119719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:46.127013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5e66208f-0922-400e-aea2-2f488fdc71f5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.151892 Dec 18 21:43:46.127575 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3934/7814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:45 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:47.143455 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:47.144083 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:47.151613 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:47.152096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:47.152899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:47.153356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:47.291859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:47.312270 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-26a53b6c-33d3-4982-b300-7847d42b58e1 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.172491 Dec 18 21:43:47.312861 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3881/7815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:47 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:48.329429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:48.330031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:48.337232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:48.337681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:48.338510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:48.338947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:48.488672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:48.498712 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b10cc7f2-bba6-46b8-9577-a900aac67487 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.173069 Dec 18 21:43:48.500549 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3935/7816] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:48 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:49.517053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:49.517650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:49.524425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:49.524881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:49.525663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:49.526109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:49.655997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:49.667133 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-aee0322f-a306-4a5d-90f9-cda0376601ae tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.153666 Dec 18 21:43:49.667716 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3882/7817] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:49 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:50.313250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-4fae3a60-3abe-4088-a5e6-9d82736b92c5 req-ddafe3d0-80b3-4356-9515-65c83e5f2af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63429460-0d40-4233-beff-7d31febf0c67", "tag": "6bb261dc-7a36-4515-9b4c-0b054e6864b5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:43:50.314988 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:43:50.314988 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:43:50.326801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4fae3a60-3abe-4088-a5e6-9d82736b92c5 req-ddafe3d0-80b3-4356-9515-65c83e5f2af6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:50.327251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-4fae3a60-3abe-4088-a5e6-9d82736b92c5 req-ddafe3d0-80b3-4356-9515-65c83e5f2af6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:50.346811 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-4fae3a60-3abe-4088-a5e6-9d82736b92c5 req-ddafe3d0-80b3-4356-9515-65c83e5f2af6 service nova] Creating event network-changed:6bb261dc-7a36-4515-9b4c-0b054e6864b5 for instance 63429460-0d40-4233-beff-7d31febf0c67 on nch2-master-1 Dec 18 21:43:50.351879 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-4fae3a60-3abe-4088-a5e6-9d82736b92c5 req-ddafe3d0-80b3-4356-9515-65c83e5f2af6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042214 Dec 18 21:43:50.352942 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3936/7818] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:43:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:43:50.688301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:50.689295 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:50.696190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:50.697383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:50.698203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:50.698824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:50.834895 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:50.842917 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-07d749b2-5ea4-49fa-b02a-c30bf0ed1b52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.158890 Dec 18 21:43:50.843509 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3883/7819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:50 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:51.860986 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:51.861683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:51.867875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:51.868362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:51.869141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:51.869587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:52.007478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:52.015259 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dcab14ce-6fa5-4f62-9547-f5657859bbfc tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.159216 Dec 18 21:43:52.015822 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3937/7820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:51 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:53.032007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:53.032609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:53.038588 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:53.039042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:53.039826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:53.040280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:53.171770 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:53.179308 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-276856bb-a614-469a-a51a-211b97154398 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.151261 Dec 18 21:43:53.180103 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3884/7821] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:53 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:54.197128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:54.197739 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:54.203690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:54.204143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:54.204926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:54.205365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:54.340157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:54.347464 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-384632d5-f5a5-4b76-a887-3931a5269a92 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.154918 Dec 18 21:43:54.348034 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3938/7822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:54 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:54.842027 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f5c0de1c-d1d5-4940-a32a-2983942930ff req-c6312f01-07b0-47ed-a04e-7be5bddfa1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63429460-0d40-4233-beff-7d31febf0c67", "name": "network-vif-plugged", "status": "completed", "tag": "6bb261dc-7a36-4515-9b4c-0b054e6864b5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:43:54.843624 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:43:54.843624 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:43:54.853127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f5c0de1c-d1d5-4940-a32a-2983942930ff req-c6312f01-07b0-47ed-a04e-7be5bddfa1af service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:54.853593 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f5c0de1c-d1d5-4940-a32a-2983942930ff req-c6312f01-07b0-47ed-a04e-7be5bddfa1af service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:54.865006 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f5c0de1c-d1d5-4940-a32a-2983942930ff req-c6312f01-07b0-47ed-a04e-7be5bddfa1af service nova] Creating event network-vif-plugged:6bb261dc-7a36-4515-9b4c-0b054e6864b5 for instance 63429460-0d40-4233-beff-7d31febf0c67 on nch2-master-1 Dec 18 21:43:54.870617 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f5c0de1c-d1d5-4940-a32a-2983942930ff req-c6312f01-07b0-47ed-a04e-7be5bddfa1af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Dec 18 21:43:54.871216 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3885/7823] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:43:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:43:55.364008 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:55.364624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:55.371389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:55.371845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:55.372638 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:55.373079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:55.508397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:55.516250 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6e95d071-2df5-4eb9-91e2-ae286f5958ec tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1358 microversion: 2.1 time: 0.155997 Dec 18 21:43:55.516810 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3939/7824] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:55 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:56.535676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:56.536411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:56.543098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.543566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:56.544365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.544811 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:56.673056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:56.680432 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-18c4c46d-5b20-4d12-aad7-a36697873a5b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1548 microversion: 2.1 time: 0.149652 Dec 18 21:43:56.681026 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3886/7825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:56 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:56.696275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:56.696887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:56.703499 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.703959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:56.704754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.705195 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:56.834732 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:56.842492 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-abb1451e-2cc3-46c4-a066-48ba31c3768d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1548 microversion: 2.1 time: 0.149918 Dec 18 21:43:56.843061 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3940/7826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:56 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:56.858666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:56.861892 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:43:56.861892 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:43:56.863001 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:56.863784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Searching by: {'deleted': False, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998'} {{(pid=140731) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 21:43:56.869015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.869480 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:56.870341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.870800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:56.893131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.multi_cell_list [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 21:43:56.919427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98d35320-2523-4223-b9db-be46813acf21 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.064437 Dec 18 21:43:56.919998 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3887/7827] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 21:43:56 2021] GET /compute/v2.1/servers => generated 342 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:43:56.929754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:43:56.930413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:56.936170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.936648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:56.937422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:56.937886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:57.088979 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:43:57.110008 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4b7b6ed7-b0f2-4a08-9cb4-15ad4a012ce5 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1548 microversion: 2.1 time: 0.183735 Dec 18 21:43:57.110620 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3941/7828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:43:56 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:43:58.591144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4f8783f7-bfff-485f-b799-83e4b03b32f2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c57b6da4-a8a2-442b-b899-a74aef3b9e13"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:43:58.592211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4f8783f7-bfff-485f-b799-83e4b03b32f2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:43:58.599006 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f8783f7-bfff-485f-b799-83e4b03b32f2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:58.599509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f8783f7-bfff-485f-b799-83e4b03b32f2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:58.600305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f8783f7-bfff-485f-b799-83e4b03b32f2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:43:58.600756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4f8783f7-bfff-485f-b799-83e4b03b32f2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:43:58.822014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4f8783f7-bfff-485f-b799-83e4b03b32f2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.234700 Dec 18 21:43:58.822662 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3888/7829] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Dec 18 21:43:58 2021] POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:44:01.080982 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:01.081570 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:01.088574 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:01.089028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:01.089808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:01.090282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:01.216991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:01.224733 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a010ac0f-0ca0-485d-8ae6-d0593a30b6e0 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1594 microversion: 2.1 time: 0.147409 Dec 18 21:44:01.225240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3942/7830] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:01 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1594 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:03.140098 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7cccfffc-9e7a-4346-b548-68e82f98adf6 req-314c829d-c1ad-4b92-87d9-fab1ae2a4f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63429460-0d40-4233-beff-7d31febf0c67", "tag": "6bb261dc-7a36-4515-9b4c-0b054e6864b5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:44:03.141582 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:44:03.141582 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:44:03.148758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7cccfffc-9e7a-4346-b548-68e82f98adf6 req-314c829d-c1ad-4b92-87d9-fab1ae2a4f0d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:03.149890 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7cccfffc-9e7a-4346-b548-68e82f98adf6 req-314c829d-c1ad-4b92-87d9-fab1ae2a4f0d service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:03.161480 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7cccfffc-9e7a-4346-b548-68e82f98adf6 req-314c829d-c1ad-4b92-87d9-fab1ae2a4f0d service nova] Creating event network-changed:6bb261dc-7a36-4515-9b4c-0b054e6864b5 for instance 63429460-0d40-4233-beff-7d31febf0c67 on nch2-master-1 Dec 18 21:44:03.166702 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7cccfffc-9e7a-4346-b548-68e82f98adf6 req-314c829d-c1ad-4b92-87d9-fab1ae2a4f0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 Dec 18 21:44:03.170277 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3889/7831] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:44:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:44:04.239573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-607035437"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:44:04.240196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:04.247365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:04.247828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:04.248648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:04.249101 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:04.384467 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.network.security_group_api [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Adding security group 0b981714-bcf7-4cdf-b04c-b4ed2050504a to port 6bb261dc-7a36-4515-9b4c-0b054e6864b5 Dec 18 21:44:04.739472 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3f29baf7-f18e-4b71-b39a-2f5960223503 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/action" status: 202 len: 0 microversion: 2.1 time: 0.504667 Dec 18 21:44:04.740096 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3943/7832] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:44:04 2021] POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:44:04.751221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:04.751643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:04.759249 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:04.759718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:04.761328 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:04.761954 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:04.936390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:04.946608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ea42522e-818d-4706-93dd-8da083c2c294 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1758 microversion: 2.1 time: 0.201364 Dec 18 21:44:04.947262 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3890/7833] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:04 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:05.181079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ef11e330-79d7-4315-9fce-632c6ee796ff req-f799b1a8-293d-4ffc-8ea9-69adf1d316c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63429460-0d40-4233-beff-7d31febf0c67", "tag": "6bb261dc-7a36-4515-9b4c-0b054e6864b5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:44:05.182652 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:44:05.182652 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:44:05.189500 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ef11e330-79d7-4315-9fce-632c6ee796ff req-f799b1a8-293d-4ffc-8ea9-69adf1d316c5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:05.189950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ef11e330-79d7-4315-9fce-632c6ee796ff req-f799b1a8-293d-4ffc-8ea9-69adf1d316c5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:05.200676 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ef11e330-79d7-4315-9fce-632c6ee796ff req-f799b1a8-293d-4ffc-8ea9-69adf1d316c5 service nova] Creating event network-changed:6bb261dc-7a36-4515-9b4c-0b054e6864b5 for instance 63429460-0d40-4233-beff-7d31febf0c67 on nch2-master-1 Dec 18 21:44:05.205642 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ef11e330-79d7-4315-9fce-632c6ee796ff req-f799b1a8-293d-4ffc-8ea9-69adf1d316c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028436 Dec 18 21:44:05.206223 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3944/7834] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:44:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:44:30.317851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6c62b471-828c-4349-92e5-f169e6f5494f tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:44:30.318832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6c62b471-828c-4349-92e5-f169e6f5494f tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:30.325865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c62b471-828c-4349-92e5-f169e6f5494f tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:30.326356 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c62b471-828c-4349-92e5-f169e6f5494f tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:30.327154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c62b471-828c-4349-92e5-f169e6f5494f tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:30.327604 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6c62b471-828c-4349-92e5-f169e6f5494f tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:30.400455 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6c62b471-828c-4349-92e5-f169e6f5494f tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/action" status: 202 len: 0 microversion: 2.1 time: 0.085966 Dec 18 21:44:30.401194 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3891/7835] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:44:30 2021] POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:44:30.415590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:30.416902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:30.424534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:30.425056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:30.426126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:30.426670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:30.592276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:30.600669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-802b39c6-b8c1-4db7-b9a6-2d743a51f437 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1750 microversion: 2.1 time: 0.194329 Dec 18 21:44:30.601277 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3945/7836] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:30 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1750 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:31.619704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:31.620436 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:31.626586 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:31.627043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:31.627827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:31.628275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:31.777112 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:31.784989 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7e7a29ed-a542-4861-9478-1e2fe6bd53ff tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.170204 Dec 18 21:44:31.785549 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3892/7837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:31 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:32.801170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:32.801840 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:32.808562 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:32.809018 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:32.809799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:32.810243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:32.955848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:32.964416 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-03513bdb-e6b7-4d16-91e3-a59f45fafe5d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.166948 Dec 18 21:44:32.964998 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3946/7838] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:32 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:33.981641 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:33.982173 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:33.988972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:33.989447 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:33.990239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:33.990729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:34.132622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:34.140408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d84fea76-9260-4fca-ac13-a6cb42cc8fad tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.162560 Dec 18 21:44:34.140980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3893/7839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:33 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:35.158187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:35.158805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:35.165446 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:35.165903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:35.166719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:35.167166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:35.312312 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:35.320405 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-93271f4e-99d0-4106-a37d-fcd7336ed779 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.166202 Dec 18 21:44:35.320999 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3947/7840] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:35 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:36.337612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:36.338243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:36.344970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:36.345440 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:36.346237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:36.346720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:36.605197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:36.613133 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-48e66a45-8b23-4e12-ae39-ac860e328a1a tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.280121 Dec 18 21:44:36.613702 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3894/7841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:36 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:37.630691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:37.631322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:37.638152 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:37.638655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:37.639450 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:37.639895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:37.816980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:37.824792 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df54fe07-e98f-4dfa-a427-09e4e497002b tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.197956 Dec 18 21:44:37.825366 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3948/7842] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:37 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:38.842178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:38.842826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:38.849547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:38.850016 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:38.850844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:38.851298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:39.090821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:39.098833 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e313a011-82f6-4a38-9db6-1ab727edcfe8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.260334 Dec 18 21:44:39.099407 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3895/7843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:38 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:40.115928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:40.116550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:40.123858 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:40.124323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:40.125137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:40.125583 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:40.265363 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:40.273305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-60ed4df8-5f2a-4c69-83f3-e1c3e7244439 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.161098 Dec 18 21:44:40.273871 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3949/7844] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:40 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:41.290018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:41.290668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:41.297466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:41.297960 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:41.298773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:41.299225 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:41.440024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:41.447874 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0cae9bf1-037b-4849-9e03-fdfe79946d6d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.162023 Dec 18 21:44:41.448446 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3896/7845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:41 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:42.464721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:42.465371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:42.472174 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:42.472629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:42.473431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:42.473878 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:42.694812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:42.703163 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-100a0f40-1694-4e65-8ed9-80b08b6a4a52 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.242163 Dec 18 21:44:42.703733 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3950/7846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:42 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:43.719553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:43.720187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:43.727298 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:43.727797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:43.728597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:43.729055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:43.873132 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:43.880931 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-31f8fd27-ea39-4bc1-aff2-309cc53e78e2 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.165161 Dec 18 21:44:43.881515 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3897/7847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:43 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:44.897940 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:44.899085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:44.905744 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:44.906194 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:44.907003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:44.907442 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:45.051786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:45.059646 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6ca638c8-f7fc-4bf3-906e-59ca9570fa01 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.165515 Dec 18 21:44:45.060217 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3951/7848] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:44 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:46.076510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:46.077052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:46.083971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:46.084434 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:46.085243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:46.085695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:46.225595 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:46.234142 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9dbcd22b-b8a4-45a6-84e5-3acf31024a0c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1755 microversion: 2.1 time: 0.161430 Dec 18 21:44:46.234736 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3898/7849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:46 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:47.251109 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:44:47.251726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:44:47.259074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:47.259536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:47.260335 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:44:47.260813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:44:47.407384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:44:47.415667 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a51f74cb-7b4b-4b19-bc59-a0ae848da5ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1758 microversion: 2.1 time: 0.168449 Dec 18 21:44:47.416240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3952/7850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:44:47 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:44:56.870644 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:44:56.871250 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:44:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:45:19.513114 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-607035437"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:19.513816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:19.519998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:19.520468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:19.521263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:19.521716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:19.647864 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.network.security_group_api [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Removing security group 0b981714-bcf7-4cdf-b04c-b4ed2050504a from port 6bb261dc-7a36-4515-9b4c-0b054e6864b5 Dec 18 21:45:19.979391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1459e682-57ad-45dd-a5c8-0b060ccb0185 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/action" status: 202 len: 0 microversion: 2.1 time: 0.470048 Dec 18 21:45:19.983150 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3899/7851] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:45:19 2021] POST /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:45:20.122563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cc2ef039-0500-43f9-ab2e-33fbfcb38236 req-2e24f60f-4189-425f-b327-e699b6d3a1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63429460-0d40-4233-beff-7d31febf0c67", "tag": "6bb261dc-7a36-4515-9b4c-0b054e6864b5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:20.126307 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:45:20.126307 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:45:20.137504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cc2ef039-0500-43f9-ab2e-33fbfcb38236 req-2e24f60f-4189-425f-b327-e699b6d3a1ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:20.138522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cc2ef039-0500-43f9-ab2e-33fbfcb38236 req-2e24f60f-4189-425f-b327-e699b6d3a1ff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:20.153660 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cc2ef039-0500-43f9-ab2e-33fbfcb38236 req-2e24f60f-4189-425f-b327-e699b6d3a1ff service nova] Creating event network-changed:6bb261dc-7a36-4515-9b4c-0b054e6864b5 for instance 63429460-0d40-4233-beff-7d31febf0c67 on nch2-master-1 Dec 18 21:45:20.160370 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cc2ef039-0500-43f9-ab2e-33fbfcb38236 req-2e24f60f-4189-425f-b327-e699b6d3a1ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111802 Dec 18 21:45:20.161419 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3953/7852] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:45:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:45:21.106109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:21.106699 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:21.112860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:21.113330 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:21.114134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:21.114757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:21.203004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lazy-loading 'services' on Instance uuid 63429460-0d40-4233-beff-7d31febf0c67 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:45:21.271987 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ea6efc5b-202e-49c1-92f1-1ca25473f45c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments/c57b6da4-a8a2-442b-b899-a74aef3b9e13" status: 202 len: 0 microversion: 2.1 time: 0.171020 Dec 18 21:45:21.272985 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3900/7853] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:45:21 2021] DELETE /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments/c57b6da4-a8a2-442b-b899-a74aef3b9e13 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:45:21.281938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0bc789c2-e741-41b7-8f0c-4883e6fe7d42 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:21.283127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0bc789c2-e741-41b7-8f0c-4883e6fe7d42 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:21.291336 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bc789c2-e741-41b7-8f0c-4883e6fe7d42 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:21.291816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bc789c2-e741-41b7-8f0c-4883e6fe7d42 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:21.292637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bc789c2-e741-41b7-8f0c-4883e6fe7d42 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:21.293273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0bc789c2-e741-41b7-8f0c-4883e6fe7d42 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:21.325005 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0bc789c2-e741-41b7-8f0c-4883e6fe7d42 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047325 Dec 18 21:45:21.325682 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3954/7854] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:45:21 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:45:22.177536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1cfc624e-f7e1-41ae-9513-a361c60e6fe5 req-2d4b74c2-a4d2-4b4d-9a4f-408728b71011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63429460-0d40-4233-beff-7d31febf0c67", "tag": "6bb261dc-7a36-4515-9b4c-0b054e6864b5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:22.179150 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:45:22.179150 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:45:22.187140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1cfc624e-f7e1-41ae-9513-a361c60e6fe5 req-2d4b74c2-a4d2-4b4d-9a4f-408728b71011 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:22.187727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1cfc624e-f7e1-41ae-9513-a361c60e6fe5 req-2d4b74c2-a4d2-4b4d-9a4f-408728b71011 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:22.199427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1cfc624e-f7e1-41ae-9513-a361c60e6fe5 req-2d4b74c2-a4d2-4b4d-9a4f-408728b71011 service nova] Creating event network-changed:6bb261dc-7a36-4515-9b4c-0b054e6864b5 for instance 63429460-0d40-4233-beff-7d31febf0c67 on nch2-master-1 Dec 18 21:45:22.204362 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1cfc624e-f7e1-41ae-9513-a361c60e6fe5 req-2d4b74c2-a4d2-4b4d-9a4f-408728b71011 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032058 Dec 18 21:45:22.204989 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3901/7855] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:45:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:45:22.337061 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-427e47cd-b087-4cce-890c-bd7caca03a91 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:22.337936 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-427e47cd-b087-4cce-890c-bd7caca03a91 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:22.344491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-427e47cd-b087-4cce-890c-bd7caca03a91 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:22.344943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-427e47cd-b087-4cce-890c-bd7caca03a91 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:22.345722 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-427e47cd-b087-4cce-890c-bd7caca03a91 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:22.346156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-427e47cd-b087-4cce-890c-bd7caca03a91 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:22.375384 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-427e47cd-b087-4cce-890c-bd7caca03a91 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042491 Dec 18 21:45:22.375959 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3955/7856] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:45:22 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 21:45:22.386805 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:22.387492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:22.393741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:22.394323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:22.395793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:22.396332 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:22.474820 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] HTTP exception thrown: Instance 63429460-0d40-4233-beff-7d31febf0c67 is not attached to volume c57b6da4-a8a2-442b-b899-a74aef3b9e13 Dec 18 21:45:22.475521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Returning 404 to user: Instance 63429460-0d40-4233-beff-7d31febf0c67 is not attached to volume c57b6da4-a8a2-442b-b899-a74aef3b9e13 {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:45:22.476563 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1bedbbb4-78a0-48b3-ba48-527adf89bff6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments/c57b6da4-a8a2-442b-b899-a74aef3b9e13" status: 404 len: 154 microversion: 2.1 time: 0.094585 Dec 18 21:45:22.478188 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3902/7857] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Dec 18 21:45:22 2021] DELETE /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67/os-volume_attachments/c57b6da4-a8a2-442b-b899-a74aef3b9e13 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:45:23.612989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:23.613483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:23.620216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:23.620675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:23.621462 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:23.621899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:23.646373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:45:23.721245 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-76ca3799-c127-4029-abe9-a200533fd29c tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 204 len: 0 microversion: 2.1 time: 0.111319 Dec 18 21:45:23.722005 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3956/7858] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:45:23 2021] DELETE /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:45:23.730438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:23.731061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:23.738716 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:23.739183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:23.739986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:23.740645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:23.873032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:23.880431 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-96e7aede-fae9-43c5-964d-3e295b84e8e6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1554 microversion: 2.1 time: 0.153774 Dec 18 21:45:23.880991 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3903/7859] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:23 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:24.898861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:24.900275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:24.906939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:24.907395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:24.908183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:24.908624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:25.037547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:25.044892 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f4b10973-44ab-4a76-88ec-d5bce2b4d7ee tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1554 microversion: 2.1 time: 0.150172 Dec 18 21:45:25.045755 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3957/7860] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:24 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:25.909528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-985ee59b-542e-4a54-b56e-ebc185fb8e0f req-358e6864-6d5b-4dbe-aaca-d0a6daedb8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63429460-0d40-4233-beff-7d31febf0c67", "name": "network-vif-deleted", "tag": "6bb261dc-7a36-4515-9b4c-0b054e6864b5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:25.911129 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:45:25.911129 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:45:25.918978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-985ee59b-542e-4a54-b56e-ebc185fb8e0f req-358e6864-6d5b-4dbe-aaca-d0a6daedb8b3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:25.919385 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-985ee59b-542e-4a54-b56e-ebc185fb8e0f req-358e6864-6d5b-4dbe-aaca-d0a6daedb8b3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:25.930764 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-985ee59b-542e-4a54-b56e-ebc185fb8e0f req-358e6864-6d5b-4dbe-aaca-d0a6daedb8b3 service nova] Creating event network-vif-deleted:6bb261dc-7a36-4515-9b4c-0b054e6864b5 for instance 63429460-0d40-4233-beff-7d31febf0c67 on nch2-master-1 Dec 18 21:45:25.935585 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-985ee59b-542e-4a54-b56e-ebc185fb8e0f req-358e6864-6d5b-4dbe-aaca-d0a6daedb8b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083137 Dec 18 21:45:25.936180 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3904/7861] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:45:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:45:26.061187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:26.061993 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:26.069416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:26.069874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:26.070719 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:26.071159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:26.110379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:26.110379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:26.110379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lazy-loading 'fault' on Instance uuid 63429460-0d40-4233-beff-7d31febf0c67 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:45:26.163341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce8de7276144144a52e038b19adda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1a66fd59be4793a6090985e8ae5998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:26.173380 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f9c032d-e6f7-44f7-9d3a-d06a49bb0ac6 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 200 len: 1348 microversion: 2.1 time: 0.115628 Dec 18 21:45:26.185286 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3958/7862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:26 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 1348 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:27.193545 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:27.194261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] [instance: 63429460-0d40-4233-beff-7d31febf0c67] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:27.200534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:27.200996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:27.201784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:27.202233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:27.215222 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] HTTP exception thrown: Instance 63429460-0d40-4233-beff-7d31febf0c67 could not be found. Dec 18 21:45:27.215812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Returning 404 to user: Instance 63429460-0d40-4233-beff-7d31febf0c67 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:45:27.216658 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0b01e15b-8c53-4be6-b223-5db0c591cfa8 tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67" status: 404 len: 111 microversion: 2.1 time: 0.028003 Dec 18 21:45:27.217183 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3905/7863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:27 2021] GET /compute/v2.1/servers/63429460-0d40-4233-beff-7d31febf0c67 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:45:27.225218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c990d758-868b-44c1-b2e8-336a255f153d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] Calling method '.version_select at 0x7f714f6c9310>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:27.244752 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c990d758-868b-44c1-b2e8-336a255f153d tempest-TestMinimumBasicScenario-1655937233 tempest-TestMinimumBasicScenario-1655937233-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1702214054" status: 202 len: 0 microversion: 2.1 time: 0.023140 Dec 18 21:45:27.245322 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3959/7864] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Dec 18 21:45:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1702214054 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:45:36.311952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68cb3341-e496-4539-8733-7f3064959e72 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: .version_select at 0x7f714c49ef70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-159841737"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:36.329341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68cb3341-e496-4539-8733-7f3064959e72 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:45:36.334548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68cb3341-e496-4539-8733-7f3064959e72 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:45:36.646934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68cb3341-e496-4539-8733-7f3064959e72 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:45:36.651752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68cb3341-e496-4539-8733-7f3064959e72 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:45:36.665479 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68cb3341-e496-4539-8733-7f3064959e72 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.520374 Dec 18 21:45:36.666300 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3906/7865] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:45:36 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:42.822611 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-993353757", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "1d5a1137-431e-4ba7-84ce-1483b1c52486"}], "key_name": "tempest-TestNetworkAdvancedServerOps-159841737", "security_groups": [{"name": "tempest-secgroup-smoke-124277281"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:42.950906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] validate_networks() for [('1d5a1137-431e-4ba7-84ce-1483b1c52486', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:45:43.483341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:45:43.483772 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:45:43.484248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:45:43.484662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:45:43.485078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:45:43.494511 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:43.494972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:43.496434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:43.496889 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:43.513740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:45:43.518888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:45:43.531366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:45:43.533937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:45:43.580518 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7512f54f-8cd6-43fc-ad50-f1ae0e45b8fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764033 Dec 18 21:45:43.581676 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3960/7866] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:45:42 2021] POST /compute/v2.1/servers => generated 405 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:45:43.593618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3bceb7a3-28e9-47cb-a4f6-0822eb3ea2b3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:43.595021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3bceb7a3-28e9-47cb-a4f6-0822eb3ea2b3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:43.655474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3bceb7a3-28e9-47cb-a4f6-0822eb3ea2b3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:43.662199 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3bceb7a3-28e9-47cb-a4f6-0822eb3ea2b3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1265 microversion: 2.1 time: 0.073472 Dec 18 21:45:43.663289 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3907/7867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:43 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:44.689286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:44.691490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:44.705213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:44.705833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:44.707173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:44.707625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:44.807118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:44.818460 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7f39172-e08c-4981-80f6-9450a9ae8280 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1335 microversion: 2.1 time: 0.141221 Dec 18 21:45:44.829902 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3961/7868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:44 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:45.837088 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:45.837885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:45.850501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:45.850975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:45.852331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:45.852994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:46.113345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:46.125391 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1b2b49e4-c8c8-4bee-a0c2-5ea10cb1ef19 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.292185 Dec 18 21:45:46.126566 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3908/7869] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:45 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:46.339150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-eb64e819-2c5b-46a7-85ee-de7362a65987 req-5c7b33f0-db67-404b-8a43-3dd9b32d3162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7ce6e1-319c-4ca0-9de9-7b4cfc928111", "tag": "40897270-a2ce-4795-8670-42c475863352"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:46.340986 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:45:46.340986 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:45:46.350217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-eb64e819-2c5b-46a7-85ee-de7362a65987 req-5c7b33f0-db67-404b-8a43-3dd9b32d3162 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:46.350978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-eb64e819-2c5b-46a7-85ee-de7362a65987 req-5c7b33f0-db67-404b-8a43-3dd9b32d3162 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:46.364458 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-eb64e819-2c5b-46a7-85ee-de7362a65987 req-5c7b33f0-db67-404b-8a43-3dd9b32d3162 service nova] Creating event network-changed:40897270-a2ce-4795-8670-42c475863352 for instance 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 on nch1-master-1 Dec 18 21:45:46.369888 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-eb64e819-2c5b-46a7-85ee-de7362a65987 req-5c7b33f0-db67-404b-8a43-3dd9b32d3162 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037255 Dec 18 21:45:46.370527 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3962/7870] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:45:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:45:47.142840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:47.144155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:47.151705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:47.152285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:47.153758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:47.154212 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:47.390392 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:47.397782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-93d66c46-8060-4bc1-bea4-9a60569e02df tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.258853 Dec 18 21:45:47.398380 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3909/7871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:47 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:48.416073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:48.416846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:48.423821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:48.424281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:48.425070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:48.425516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:48.561831 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:48.569216 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3958be70-3d8a-4921-891d-86613bd9cfbe tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.158133 Dec 18 21:45:48.569808 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3963/7872] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:48 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:49.591156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:49.591794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:49.598626 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:49.599093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:49.599917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:49.600371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:49.733539 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:49.741072 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e5ae0800-3855-41ee-9dc0-bc496a1f8e6d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.158240 Dec 18 21:45:49.741733 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3910/7873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:49 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:50.758980 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:50.759597 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:50.766624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:50.767085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:50.767879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:50.768325 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:50.899550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:50.906942 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ee248609-e0de-4253-bd36-066d6678cd41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.152361 Dec 18 21:45:50.907518 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3964/7874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:50 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:51.923453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:51.924077 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:51.931192 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:51.931870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:51.933955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:51.933955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:52.082073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:52.090104 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ba215135-090e-4ffe-9801-9a116f6fae4a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.170352 Dec 18 21:45:52.090696 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3911/7875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:51 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:53.107202 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:53.107818 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:53.113813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:53.114305 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:53.115111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:53.115559 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:53.230513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9668cea5-28f6-4115-a337-9bea75b0d429 req-79a1bcf3-9a34-4f4e-8dd0-fe94d09a2c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7ce6e1-319c-4ca0-9de9-7b4cfc928111", "name": "network-vif-plugged", "status": "completed", "tag": "40897270-a2ce-4795-8670-42c475863352"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:53.232059 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:45:53.232059 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:45:53.238857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9668cea5-28f6-4115-a337-9bea75b0d429 req-79a1bcf3-9a34-4f4e-8dd0-fe94d09a2c32 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:53.239311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9668cea5-28f6-4115-a337-9bea75b0d429 req-79a1bcf3-9a34-4f4e-8dd0-fe94d09a2c32 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:53.250449 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9668cea5-28f6-4115-a337-9bea75b0d429 req-79a1bcf3-9a34-4f4e-8dd0-fe94d09a2c32 service nova] Creating event network-vif-plugged:40897270-a2ce-4795-8670-42c475863352 for instance 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 on nch1-master-1 Dec 18 21:45:53.255064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:53.256168 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9668cea5-28f6-4115-a337-9bea75b0d429 req-79a1bcf3-9a34-4f4e-8dd0-fe94d09a2c32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081568 Dec 18 21:45:53.256991 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3912/7876] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:45:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:45:53.263585 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-72d6ccef-0bbc-4edd-9fed-c11853764a4b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.160402 Dec 18 21:45:53.264192 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3965/7877] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:53 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:54.281260 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:54.281958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:54.288413 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:54.289405 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:54.290233 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:54.290712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:54.420414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:54.427669 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-013e685d-39f0-4513-a33f-289dc9597a0b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1390 microversion: 2.1 time: 0.151271 Dec 18 21:45:54.428244 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3913/7878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:54 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:55.443666 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:55.444283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:55.451601 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:55.452058 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:55.452836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:55.453273 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:55.586238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:55.593918 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-25fd815e-4cf0-4b73-a250-2fc6a52ba66f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1563 microversion: 2.1 time: 0.154061 Dec 18 21:45:55.594518 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3966/7879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:55 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:55.611084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:55.611714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:55.619216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:55.619689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:55.620495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:55.620950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:55.756099 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:55.763608 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0816f267-5f68-47fa-9d79-1eb7240f4031 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1563 microversion: 2.1 time: 0.156306 Dec 18 21:45:55.764202 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3914/7880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:55 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:45:57.372374 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:45:57.372984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:45:57.376425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-35d5c4d3-dd1a-40e8-aae4-ad7ce9c6507f req-7e08f17e-1f7c-411a-ac6c-3a723aecc5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7ce6e1-319c-4ca0-9de9-7b4cfc928111", "tag": "40897270-a2ce-4795-8670-42c475863352"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:45:57.378022 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:45:57.378022 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:45:57.380150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:57.380607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:57.381648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:57.382088 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:57.389563 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-35d5c4d3-dd1a-40e8-aae4-ad7ce9c6507f req-7e08f17e-1f7c-411a-ac6c-3a723aecc5a6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:45:57.390028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-35d5c4d3-dd1a-40e8-aae4-ad7ce9c6507f req-7e08f17e-1f7c-411a-ac6c-3a723aecc5a6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:45:57.404567 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-35d5c4d3-dd1a-40e8-aae4-ad7ce9c6507f req-7e08f17e-1f7c-411a-ac6c-3a723aecc5a6 service nova] Creating event network-changed:40897270-a2ce-4795-8670-42c475863352 for instance 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 on nch1-master-1 Dec 18 21:45:57.410128 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-35d5c4d3-dd1a-40e8-aae4-ad7ce9c6507f req-7e08f17e-1f7c-411a-ac6c-3a723aecc5a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038931 Dec 18 21:45:57.411326 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3915/7881] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:45:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:45:57.607762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:45:57.615326 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-42b6bcb9-e2c8-44da-b132-881c2c14a95d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1563 microversion: 2.1 time: 0.246970 Dec 18 21:45:57.616088 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3967/7882] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:45:57 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:22.878505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0eed8c91-7315-464a-a343-d1b5d144f6ce tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:22.879511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0eed8c91-7315-464a-a343-d1b5d144f6ce tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:22.887794 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0eed8c91-7315-464a-a343-d1b5d144f6ce tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:22.888262 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0eed8c91-7315-464a-a343-d1b5d144f6ce tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:22.889094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0eed8c91-7315-464a-a343-d1b5d144f6ce tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:22.889548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0eed8c91-7315-464a-a343-d1b5d144f6ce tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:22.946963 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0eed8c91-7315-464a-a343-d1b5d144f6ce tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action" status: 200 len: 24572 microversion: 2.1 time: 0.073404 Dec 18 21:46:22.948621 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3916/7883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:46:22 2021] POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action => generated 24572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:46:33.966788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5ace245-caf4-45a4-a6b6-bd13792aac79 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:33.967365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5ace245-caf4-45a4-a6b6-bd13792aac79 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:33.975556 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5ace245-caf4-45a4-a6b6-bd13792aac79 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:33.976035 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5ace245-caf4-45a4-a6b6-bd13792aac79 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:33.976813 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5ace245-caf4-45a4-a6b6-bd13792aac79 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:33.977764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5ace245-caf4-45a4-a6b6-bd13792aac79 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:34.044830 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5ace245-caf4-45a4-a6b6-bd13792aac79 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action" status: 202 len: 0 microversion: 2.1 time: 0.081746 Dec 18 21:46:34.045645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3968/7884] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:46:33 2021] POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:46:34.054828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:34.055549 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:34.063247 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:34.063843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:34.064925 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:34.065462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:34.208460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:34.218062 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-527027c3-e849-4677-ad44-111438e53d78 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1686 microversion: 2.1 time: 0.167954 Dec 18 21:46:34.218624 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3917/7885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:34 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:35.236812 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:35.237441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:35.245173 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:35.245636 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:35.246455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:35.246903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:35.383180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:35.390545 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-662b9ba5-2abd-4b7c-98c3-43d4f17e8ea2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1666 microversion: 2.1 time: 0.158156 Dec 18 21:46:35.391116 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3969/7886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:35 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:36.482082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45b5039a-0583-4144-ab2c-e7e6142255c6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:36.483040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45b5039a-0583-4144-ab2c-e7e6142255c6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:36.490409 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b5039a-0583-4144-ab2c-e7e6142255c6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:36.490873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b5039a-0583-4144-ab2c-e7e6142255c6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:36.491662 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b5039a-0583-4144-ab2c-e7e6142255c6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:36.492111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45b5039a-0583-4144-ab2c-e7e6142255c6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:36.551123 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45b5039a-0583-4144-ab2c-e7e6142255c6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action" status: 200 len: 32649 microversion: 2.1 time: 0.073153 Dec 18 21:46:36.551999 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3918/7887] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:46:36 2021] POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action => generated 32649 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:46:36.562637 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7245d717-646e-40a0-87c2-4cb5da8d69fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:36.563183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7245d717-646e-40a0-87c2-4cb5da8d69fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:36.569883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7245d717-646e-40a0-87c2-4cb5da8d69fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:36.570392 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7245d717-646e-40a0-87c2-4cb5da8d69fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:36.571190 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7245d717-646e-40a0-87c2-4cb5da8d69fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:36.571641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7245d717-646e-40a0-87c2-4cb5da8d69fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:36.637291 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7245d717-646e-40a0-87c2-4cb5da8d69fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action" status: 202 len: 0 microversion: 2.1 time: 0.078223 Dec 18 21:46:36.638069 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3970/7888] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:46:36 2021] POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:46:36.646661 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:36.647462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:36.655208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:36.655779 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:36.656753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:36.657352 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:36.792737 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:36.802304 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4e4a1b0d-8c68-4df3-bbe9-f104817a8869 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1673 microversion: 2.1 time: 0.159720 Dec 18 21:46:36.802893 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3919/7889] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:36 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:46:36.924704 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:46:36.924974 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:46:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:46:37.824203 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:37.824897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:37.831137 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:37.831588 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:37.832366 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:37.832807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:37.973145 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:37.980542 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-534ab3fa-871d-4a78-8539-2b7fcf5a404f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1681 microversion: 2.1 time: 0.161944 Dec 18 21:46:37.981110 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3971/7890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:37 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:38.070122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58b93f83-b38e-4d04-9f72-2eac93711cb0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:38.071087 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58b93f83-b38e-4d04-9f72-2eac93711cb0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:38.079237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b93f83-b38e-4d04-9f72-2eac93711cb0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:38.079707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b93f83-b38e-4d04-9f72-2eac93711cb0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:38.080514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b93f83-b38e-4d04-9f72-2eac93711cb0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:38.080968 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b93f83-b38e-4d04-9f72-2eac93711cb0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:38.137172 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58b93f83-b38e-4d04-9f72-2eac93711cb0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action" status: 200 len: 38333 microversion: 2.1 time: 0.070613 Dec 18 21:46:38.138077 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3920/7891] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:46:38 2021] POST /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111/action => generated 38333 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:46:39.133603 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:39.134113 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:39.136168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3bff96ec-6e7d-4053-9e15-3be71742825e req-47abbe8a-8f43-45c3-8a52-070dac361eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7ce6e1-319c-4ca0-9de9-7b4cfc928111", "tag": "40897270-a2ce-4795-8670-42c475863352"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:39.137796 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:46:39.137796 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:46:39.141357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:39.142157 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:39.143164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:39.143791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:39.148060 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3bff96ec-6e7d-4053-9e15-3be71742825e req-47abbe8a-8f43-45c3-8a52-070dac361eb0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:39.148518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3bff96ec-6e7d-4053-9e15-3be71742825e req-47abbe8a-8f43-45c3-8a52-070dac361eb0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:39.159250 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3bff96ec-6e7d-4053-9e15-3be71742825e req-47abbe8a-8f43-45c3-8a52-070dac361eb0 service nova] Creating event network-changed:40897270-a2ce-4795-8670-42c475863352 for instance 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 on nch1-master-1 Dec 18 21:46:39.164396 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3bff96ec-6e7d-4053-9e15-3be71742825e req-47abbe8a-8f43-45c3-8a52-070dac361eb0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032297 Dec 18 21:46:39.165204 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3921/7892] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:46:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:46:39.170553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:46:39.273303 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2c311dbd-fece-42ba-bf63-41b83d33c2eb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 204 len: 0 microversion: 2.1 time: 0.143692 Dec 18 21:46:39.274399 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3972/7893] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:46:39 2021] DELETE /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:46:39.284058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:39.284781 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:39.291533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:39.292074 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:39.293207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:39.293718 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:39.519032 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:39.527023 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3cc0020b-b057-41af-966b-e32da8ce8865 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1687 microversion: 2.1 time: 0.247949 Dec 18 21:46:39.527686 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3922/7894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:39 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1687 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:40.545281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:40.545906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:40.553415 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:40.553883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:40.554711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:40.555166 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:40.688998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:40.697317 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b642ffa1-83bc-4d13-b249-a0af5f180dc6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1569 microversion: 2.1 time: 0.155728 Dec 18 21:46:40.698109 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3973/7895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:40 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:41.542959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4137cea6-12d5-4a2a-972f-87c3d05a03ae req-90514498-9b5f-44cb-a264-2b50ae6c99c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7ce6e1-319c-4ca0-9de9-7b4cfc928111", "name": "network-vif-deleted", "tag": "40897270-a2ce-4795-8670-42c475863352"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:41.544447 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:46:41.544447 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:46:41.552221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4137cea6-12d5-4a2a-972f-87c3d05a03ae req-90514498-9b5f-44cb-a264-2b50ae6c99c6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:41.552675 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4137cea6-12d5-4a2a-972f-87c3d05a03ae req-90514498-9b5f-44cb-a264-2b50ae6c99c6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:41.564570 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4137cea6-12d5-4a2a-972f-87c3d05a03ae req-90514498-9b5f-44cb-a264-2b50ae6c99c6 service nova] Creating event network-vif-deleted:40897270-a2ce-4795-8670-42c475863352 for instance 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 on nch1-master-1 Dec 18 21:46:41.569832 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4137cea6-12d5-4a2a-972f-87c3d05a03ae req-90514498-9b5f-44cb-a264-2b50ae6c99c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030445 Dec 18 21:46:41.570562 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3923/7896] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:46:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:46:41.715470 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:41.716649 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:41.722795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:41.723250 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:41.724038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:41.724479 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:41.755746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:41.756404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:41.756924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lazy-loading 'fault' on Instance uuid 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:46:41.796791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:41.804400 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1cf95ee-3dfd-4ef3-a367-ce29c123e57b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 200 len: 1355 microversion: 2.1 time: 0.092728 Dec 18 21:46:41.804984 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3974/7897] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:41 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 1355 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:42.823678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:42.824438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:42.830671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:42.831136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:42.831947 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:42.832395 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:42.848427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] HTTP exception thrown: Instance 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 could not be found. Dec 18 21:46:42.849029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Returning 404 to user: Instance 4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:46:42.849868 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ae4c0c8c-d24d-419d-b616-6423774056b2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111" status: 404 len: 111 microversion: 2.1 time: 0.031672 Dec 18 21:46:42.850445 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3924/7898] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:42 2021] GET /compute/v2.1/servers/4a7ce6e1-319c-4ca0-9de9-7b4cfc928111 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:46:45.826565 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e7b39417-cfaf-4a85-8536-27905c1bb051 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '.version_select at 0x7f714e28c9d0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:45.850055 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e7b39417-cfaf-4a85-8536-27905c1bb051 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-159841737" status: 202 len: 0 microversion: 2.1 time: 0.027332 Dec 18 21:46:45.850874 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3975/7899] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Dec 18 21:46:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-159841737 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:46:45.872920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0623ee17-f495-4e68-b990-178a1ce7c92d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: .version_select at 0x7f714ed1fa60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-102989376"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:45.890555 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-0623ee17-f495-4e68-b990-178a1ce7c92d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:46:45.895621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-0623ee17-f495-4e68-b990-178a1ce7c92d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:46:46.190358 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-0623ee17-f495-4e68-b990-178a1ce7c92d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:46:46.195024 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-0623ee17-f495-4e68-b990-178a1ce7c92d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:46:46.209490 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0623ee17-f495-4e68-b990-178a1ce7c92d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.340324 Dec 18 21:46:46.210093 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3925/7900] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:46:45 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:51.693127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-777168833", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "20048939-460f-4b5b-b048-37f3fb19f72d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-102989376", "security_groups": [{"name": "tempest-secgroup-smoke-842936759"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:52.144211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] validate_networks() for [('20048939-460f-4b5b-b048-37f3fb19f72d', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:46:52.600842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:46:52.601276 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:46:52.601757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:46:52.602167 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:46:52.603179 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:46:52.615122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:52.615584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:52.616416 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:52.617074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:52.648934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:46:52.654723 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:46:52.669493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:46:52.673006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:46:52.734378 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6fbd81bd-9178-4a8a-9135-1087bec0de07 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.045935 Dec 18 21:46:52.742243 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3976/7901] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:46:51 2021] POST /compute/v2.1/servers => generated 405 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:46:52.748176 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8143ea7a-3be8-4bb2-9acd-f5316ab77ffa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:52.748807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8143ea7a-3be8-4bb2-9acd-f5316ab77ffa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:52.819710 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8143ea7a-3be8-4bb2-9acd-f5316ab77ffa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:52.827530 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8143ea7a-3be8-4bb2-9acd-f5316ab77ffa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1265 microversion: 2.1 time: 0.084661 Dec 18 21:46:52.828910 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3926/7902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:52 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:46:53.846788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:53.851554 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:53.868422 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:53.872773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:53.873836 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:53.874488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:53.961927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:53.970677 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-35b32994-d705-461a-9122-a7663e449e9a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1335 microversion: 2.1 time: 0.128851 Dec 18 21:46:53.971936 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3977/7903] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:53 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1335 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:54.988318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:54.989154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:54.998376 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:54.998857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:54.999821 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:55.000499 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:55.172313 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:55.181951 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a4e08d8c-b08a-45ee-9ff2-6e22a5d9bb9b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1390 microversion: 2.1 time: 0.197663 Dec 18 21:46:55.182939 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3927/7904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:54 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1390 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:55.297025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-929a75d1-dad7-4e6c-8834-bde733eabe0b req-3c1e6b00-8009-49c7-8882-fa4faa57cc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a1605e-733a-4f68-bfa5-de5350eb63eb", "tag": "f3519765-4175-4184-9cac-d9b3c21d7fa8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:55.299037 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:46:55.299037 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:46:55.323592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-929a75d1-dad7-4e6c-8834-bde733eabe0b req-3c1e6b00-8009-49c7-8882-fa4faa57cc7c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:55.324138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-929a75d1-dad7-4e6c-8834-bde733eabe0b req-3c1e6b00-8009-49c7-8882-fa4faa57cc7c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:55.338171 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-929a75d1-dad7-4e6c-8834-bde733eabe0b req-3c1e6b00-8009-49c7-8882-fa4faa57cc7c service nova] Creating event network-changed:f3519765-4175-4184-9cac-d9b3c21d7fa8 for instance 95a1605e-733a-4f68-bfa5-de5350eb63eb on nch2-master-1 Dec 18 21:46:55.343563 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-929a75d1-dad7-4e6c-8834-bde733eabe0b req-3c1e6b00-8009-49c7-8882-fa4faa57cc7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050566 Dec 18 21:46:55.344818 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3978/7905] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:46:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:46:56.198949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:56.199510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:56.206128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:56.206632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:56.207430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:56.207880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:56.351591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:56.359461 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f7ed589-7714-43ef-8aa6-3d75e837b4b7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1390 microversion: 2.1 time: 0.164372 Dec 18 21:46:56.360021 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3928/7906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:56 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:57.377010 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:57.377646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:57.384546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:57.384999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:57.385786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:57.386221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:57.521026 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:57.529010 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dfa0bbaa-4efa-4191-a36b-307a22fb6480 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1390 microversion: 2.1 time: 0.156152 Dec 18 21:46:57.529587 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3979/7907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:57 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:58.545585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:58.546208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:58.552953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:58.553425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:58.554226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:58.554714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:58.699190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:46:58.706492 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f01f00e-8ad8-453f-a2bd-28423677c653 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1390 microversion: 2.1 time: 0.164576 Dec 18 21:46:58.707070 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3929/7908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:58 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:46:59.448436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-5b32b642-fb2e-4877-8c87-14bad7218abe req-c17443e0-5212-4ff1-8c7c-b906ef3f3598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a1605e-733a-4f68-bfa5-de5350eb63eb", "name": "network-vif-plugged", "status": "completed", "tag": "f3519765-4175-4184-9cac-d9b3c21d7fa8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:46:59.449997 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:46:59.449997 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:46:59.460015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5b32b642-fb2e-4877-8c87-14bad7218abe req-c17443e0-5212-4ff1-8c7c-b906ef3f3598 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:59.460482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-5b32b642-fb2e-4877-8c87-14bad7218abe req-c17443e0-5212-4ff1-8c7c-b906ef3f3598 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:59.472064 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-5b32b642-fb2e-4877-8c87-14bad7218abe req-c17443e0-5212-4ff1-8c7c-b906ef3f3598 service nova] Creating event network-vif-plugged:f3519765-4175-4184-9cac-d9b3c21d7fa8 for instance 95a1605e-733a-4f68-bfa5-de5350eb63eb on nch2-master-1 Dec 18 21:46:59.477633 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-5b32b642-fb2e-4877-8c87-14bad7218abe req-c17443e0-5212-4ff1-8c7c-b906ef3f3598 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 Dec 18 21:46:59.478417 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3980/7909] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:46:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:46:59.723473 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:46:59.724085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:46:59.730793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:59.731257 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:46:59.732048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:46:59.732501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:00.113017 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:00.120915 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74bcdff7-9ffc-4875-8fe5-4d827765015a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1390 microversion: 2.1 time: 0.401258 Dec 18 21:47:00.121472 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3930/7910] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:46:59 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1390 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:01.138913 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:01.139612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:01.146477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:01.146934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:01.147708 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:01.148149 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:01.283682 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:01.291239 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-49bd8688-15bb-45f6-b41b-85883f5b1a9c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1562 microversion: 2.1 time: 0.157386 Dec 18 21:47:01.291822 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3981/7911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:01 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:01.307284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:01.307905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:01.314519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:01.314984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:01.315773 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:01.316226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:01.446618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:01.453838 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f88e507-2476-46b2-b8eb-9332429e8427 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1562 microversion: 2.1 time: 0.150661 Dec 18 21:47:01.454512 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3931/7912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:01 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:03.048258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:03.048856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:03.058432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:03.058898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:03.059533 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-38c33e8b-9729-421a-b469-9cddccefc04c req-f5c98ed9-c892-4340-b52a-256e144bbfff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a1605e-733a-4f68-bfa5-de5350eb63eb", "tag": "f3519765-4175-4184-9cac-d9b3c21d7fa8"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:47:03.060000 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:03.060323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:03.061222 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:47:03.061222 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:47:03.069414 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-38c33e8b-9729-421a-b469-9cddccefc04c req-f5c98ed9-c892-4340-b52a-256e144bbfff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:03.070190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-38c33e8b-9729-421a-b469-9cddccefc04c req-f5c98ed9-c892-4340-b52a-256e144bbfff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:03.081983 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-38c33e8b-9729-421a-b469-9cddccefc04c req-f5c98ed9-c892-4340-b52a-256e144bbfff service nova] Creating event network-changed:f3519765-4175-4184-9cac-d9b3c21d7fa8 for instance 95a1605e-733a-4f68-bfa5-de5350eb63eb on nch2-master-1 Dec 18 21:47:03.087798 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-38c33e8b-9729-421a-b469-9cddccefc04c req-f5c98ed9-c892-4340-b52a-256e144bbfff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034143 Dec 18 21:47:03.088803 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3932/7913] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:47:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:47:03.211857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:03.219678 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d7802048-c5f0-4d23-a326-1a69931dbe3f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1562 microversion: 2.1 time: 0.175460 Dec 18 21:47:03.220590 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3982/7914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:03 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:47:26.464564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-51a8c275-2f1d-4dc7-900b-d30070259add tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:47:26.465608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-51a8c275-2f1d-4dc7-900b-d30070259add tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:26.472029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a8c275-2f1d-4dc7-900b-d30070259add tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:26.472500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a8c275-2f1d-4dc7-900b-d30070259add tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:26.473303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a8c275-2f1d-4dc7-900b-d30070259add tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:26.473761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-51a8c275-2f1d-4dc7-900b-d30070259add tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:26.524009 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-51a8c275-2f1d-4dc7-900b-d30070259add tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb/action" status: 200 len: 24567 microversion: 2.1 time: 0.063989 Dec 18 21:47:26.524649 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3933/7915] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:47:26 2021] POST /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb/action => generated 24567 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:47:32.913007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d721b815-d325-41f6-8365-a130669235f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:47:32.913950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d721b815-d325-41f6-8365-a130669235f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:32.919918 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d721b815-d325-41f6-8365-a130669235f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:32.920602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d721b815-d325-41f6-8365-a130669235f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:32.921283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d721b815-d325-41f6-8365-a130669235f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:32.921656 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d721b815-d325-41f6-8365-a130669235f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:32.992362 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d721b815-d325-41f6-8365-a130669235f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb/action" status: 202 len: 0 microversion: 2.1 time: 0.083189 Dec 18 21:47:32.992993 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3983/7916] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:47:32 2021] POST /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:47:33.001582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:33.002320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:33.010939 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:33.011481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:33.012615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:33.013097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:33.158208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:33.165657 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0c85be9b-fad2-4320-baf2-2a8d031863bd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1673 microversion: 2.1 time: 0.168159 Dec 18 21:47:33.166228 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3934/7917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:32 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:34.184749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:34.185452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:34.192341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:34.192798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:34.193589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:34.194049 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:34.325667 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:34.334138 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7abdb1a2-b0e7-4dbe-9c85-1d038cc9bc2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.153444 Dec 18 21:47:34.334753 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3984/7918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:34 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:35.351941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:35.353055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:35.360568 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:35.361040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:35.361843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:35.362329 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:35.494365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:35.503479 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b96caf6f-6892-41dc-93e5-a10e66e2bf04 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.155272 Dec 18 21:47:35.504057 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3935/7919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:35 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:36.520362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:36.520965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:36.528177 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:36.528624 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:36.529433 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:36.529868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:36.664821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:36.672036 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-954075a6-1b03-4452-80e3-b38bb9dfe292 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.155481 Dec 18 21:47:36.672598 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3985/7920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:36 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:37.688818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:37.689424 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:37.696427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:37.696899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:37.697702 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:37.698156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:37.829843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:37.837892 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b4c39007-bdc1-4d7c-8657-fc1687ca34c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.152810 Dec 18 21:47:37.838479 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3936/7921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:37 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:38.854950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:38.855555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:38.862510 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:38.862961 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:38.863745 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:38.864183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:39.001317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:39.009264 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ab202a9-fc42-43dd-9b28-7b0f0076fda0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.158674 Dec 18 21:47:39.009834 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3986/7922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:38 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:40.026609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:40.027236 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:40.033915 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:40.034418 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:40.035221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:40.035679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:40.163914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:40.171825 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fb0bce51-d353-47f2-b42e-5fb5750f51a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.149507 Dec 18 21:47:40.172393 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3937/7923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:40 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:41.188564 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:41.189183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:41.196029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:41.196487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:41.197278 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:41.197726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:41.336235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:41.343669 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-09c2dd9f-c690-4d98-9403-7741653bffbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.158820 Dec 18 21:47:41.344240 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3987/7924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:41 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:42.361071 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:42.361707 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:42.369439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:42.370341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:42.371596 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:42.372067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:42.503543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:42.512097 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ff36b5fb-7b50-4052-8d49-072426153b95 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.154656 Dec 18 21:47:42.512940 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3938/7925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:42 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:43.531706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:43.532294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:43.542067 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:43.542546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:43.543331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:43.543770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:43.672052 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:43.679350 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f6f94443-3a7d-4f7c-9376-14a55ddcdfcc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1678 microversion: 2.1 time: 0.153064 Dec 18 21:47:43.679928 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3988/7926] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:43 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:47:44.697334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:47:44.697946 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:47:44.704656 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:44.705128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:44.705934 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:47:44.706420 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:47:44.850694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:47:44.858635 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-36395939-6db2-4e25-81e9-1029dfb163f0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1681 microversion: 2.1 time: 0.165651 Dec 18 21:47:44.859204 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3939/7927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:47:44 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:09.036683 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8cc2ba81-0951-46d7-8932-616e8782b221 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:09.037519 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8cc2ba81-0951-46d7-8932-616e8782b221 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:09.043753 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc2ba81-0951-46d7-8932-616e8782b221 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:09.044212 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc2ba81-0951-46d7-8932-616e8782b221 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:09.044998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc2ba81-0951-46d7-8932-616e8782b221 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:09.045472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cc2ba81-0951-46d7-8932-616e8782b221 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:09.102864 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8cc2ba81-0951-46d7-8932-616e8782b221 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb/action" status: 200 len: 69141 microversion: 2.1 time: 0.069872 Dec 18 21:48:09.103517 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3989/7928] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:48:09 2021] POST /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb/action => generated 69141 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:48:16.136127 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:16.136871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:16.139484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-1206773c-e7eb-437c-9935-6a2e8e75fe10 req-e0cd1028-150d-4c7b-9c6b-0fe4ad14faa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a1605e-733a-4f68-bfa5-de5350eb63eb", "tag": "f3519765-4175-4184-9cac-d9b3c21d7fa8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:16.141823 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:48:16.141823 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:48:16.144023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:16.144844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:16.145991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:16.146646 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:16.151571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1206773c-e7eb-437c-9935-6a2e8e75fe10 req-e0cd1028-150d-4c7b-9c6b-0fe4ad14faa1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:16.152024 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-1206773c-e7eb-437c-9935-6a2e8e75fe10 req-e0cd1028-150d-4c7b-9c6b-0fe4ad14faa1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:16.163827 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-1206773c-e7eb-437c-9935-6a2e8e75fe10 req-e0cd1028-150d-4c7b-9c6b-0fe4ad14faa1 service nova] Creating event network-changed:f3519765-4175-4184-9cac-d9b3c21d7fa8 for instance 95a1605e-733a-4f68-bfa5-de5350eb63eb on nch2-master-1 Dec 18 21:48:16.169708 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-1206773c-e7eb-437c-9935-6a2e8e75fe10 req-e0cd1028-150d-4c7b-9c6b-0fe4ad14faa1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034732 Dec 18 21:48:16.170878 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3990/7929] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:48:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:48:16.175691 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:48:16.261496 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-13b37c5e-c71a-4b0a-86b4-910977b9d225 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 204 len: 0 microversion: 2.1 time: 0.128881 Dec 18 21:48:16.265937 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3940/7930] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:48:16 2021] DELETE /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:48:16.271946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:16.272902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:16.279604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:16.280069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:16.280868 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:16.281313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:16.431709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:16.439924 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-17318512-2f26-432e-a6e9-2efdfa54093f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1687 microversion: 2.1 time: 0.172471 Dec 18 21:48:16.440893 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3991/7931] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:16 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:48:17.458632 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:17.459609 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:17.467542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:17.468018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:17.468825 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:17.469285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:17.598161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:17.607158 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-53c74889-7b81-4fc2-9cfd-aa38e0b99339 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1568 microversion: 2.1 time: 0.152680 Dec 18 21:48:17.607727 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3941/7932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:17 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:18.227118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-40f01d75-c8bc-4e4e-83ad-fffd91815bc5 req-6207f3a2-c0a5-4919-bf7b-7e0dd7530cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a1605e-733a-4f68-bfa5-de5350eb63eb", "name": "network-vif-deleted", "tag": "f3519765-4175-4184-9cac-d9b3c21d7fa8"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:18.228782 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:48:18.228782 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:48:18.238482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-40f01d75-c8bc-4e4e-83ad-fffd91815bc5 req-6207f3a2-c0a5-4919-bf7b-7e0dd7530cce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:18.239081 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-40f01d75-c8bc-4e4e-83ad-fffd91815bc5 req-6207f3a2-c0a5-4919-bf7b-7e0dd7530cce service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:18.251185 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-40f01d75-c8bc-4e4e-83ad-fffd91815bc5 req-6207f3a2-c0a5-4919-bf7b-7e0dd7530cce service nova] Creating event network-vif-deleted:f3519765-4175-4184-9cac-d9b3c21d7fa8 for instance 95a1605e-733a-4f68-bfa5-de5350eb63eb on nch2-master-1 Dec 18 21:48:18.257183 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-40f01d75-c8bc-4e4e-83ad-fffd91815bc5 req-6207f3a2-c0a5-4919-bf7b-7e0dd7530cce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033711 Dec 18 21:48:18.257778 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3992/7933] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:48:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:48:18.625519 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:18.626865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:18.635265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:18.635872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:18.636844 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:18.637320 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:18.672284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:18.672750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:18.673211 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lazy-loading 'fault' on Instance uuid 95a1605e-733a-4f68-bfa5-de5350eb63eb {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:48:18.713975 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:18.722860 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8209983b-5ef6-4fa5-b1fb-6536101b63e2 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 200 len: 1355 microversion: 2.1 time: 0.101422 Dec 18 21:48:18.723527 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3942/7934] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:18 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:19.741172 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:19.741882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 95a1605e-733a-4f68-bfa5-de5350eb63eb] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:19.749397 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:19.749855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:19.750680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:19.751131 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:19.765923 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] HTTP exception thrown: Instance 95a1605e-733a-4f68-bfa5-de5350eb63eb could not be found. Dec 18 21:48:19.766672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Returning 404 to user: Instance 95a1605e-733a-4f68-bfa5-de5350eb63eb could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:48:19.767389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3238fb0-62dd-421d-80ef-91f5f8d7fffc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb" status: 404 len: 111 microversion: 2.1 time: 0.030403 Dec 18 21:48:19.767943 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3993/7935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:19 2021] GET /compute/v2.1/servers/95a1605e-733a-4f68-bfa5-de5350eb63eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:48:22.997319 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8cef20a8-b3f5-48ef-8b9b-c444e755e116 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '.version_select at 0x7f714ed39670>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:23.017685 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8cef20a8-b3f5-48ef-8b9b-c444e755e116 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-102989376" status: 202 len: 0 microversion: 2.1 time: 0.026173 Dec 18 21:48:23.018299 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3943/7936] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Dec 18 21:48:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-102989376 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:48:23.042698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5567e89b-d063-4f89-8b91-420f38c45deb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: .version_select at 0x7f714fb39940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-953522791"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:23.058754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5567e89b-d063-4f89-8b91-420f38c45deb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:48:23.064613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5567e89b-d063-4f89-8b91-420f38c45deb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:48:23.138855 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5567e89b-d063-4f89-8b91-420f38c45deb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:48:23.143777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-5567e89b-d063-4f89-8b91-420f38c45deb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:48:23.157699 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5567e89b-d063-4f89-8b91-420f38c45deb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.119316 Dec 18 21:48:23.158329 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3994/7937] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:48:23 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:28.566495 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1520798018", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "572641ed-7ea7-4ecc-9acc-3e35d41d6a7c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-953522791", "security_groups": [{"name": "tempest-secgroup-smoke-832935215"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:28.680569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] validate_networks() for [('572641ed-7ea7-4ecc-9acc-3e35d41d6a7c', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:48:29.163855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:48:29.164303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:48:29.164806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:48:29.165263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:48:29.167865 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:48:29.177037 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:29.177511 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:29.178396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:29.178856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:29.201498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:48:29.207396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:48:29.220334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:48:29.222966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:48:29.273563 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c878a781-94ad-405e-8516-07d0908d1e2c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712010 Dec 18 21:48:29.274751 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3944/7938] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:48:28 2021] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:48:29.285187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1a3bed31-0873-48af-86f2-c7c3e6170785 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:29.285787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1a3bed31-0873-48af-86f2-c7c3e6170785 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:29.358055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1a3bed31-0873-48af-86f2-c7c3e6170785 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:29.369443 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1a3bed31-0873-48af-86f2-c7c3e6170785 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1266 microversion: 2.1 time: 0.088456 Dec 18 21:48:29.376136 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3995/7939] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:29 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:30.387354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:30.388278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:30.395402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:30.395880 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:30.396705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:30.397170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:30.515732 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:30.528247 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d434ae01-3277-4060-8fe4-8450c9b6196e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1326 microversion: 2.1 time: 0.145536 Dec 18 21:48:30.530827 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3945/7940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:30 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:31.546584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:31.547150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:31.554845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:31.555377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:31.556370 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:31.556876 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:31.832920 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:31.860021 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7fcad12d-8f0d-4e9b-a867-fde9b9dbc3c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1391 microversion: 2.1 time: 0.316965 Dec 18 21:48:31.860743 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3996/7941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:31 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:48:32.059801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-2d88b086-e6c6-422d-995f-15c42517449c req-a4aa8a63-c432-4d86-a376-d2434c11ac62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:32.063068 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:48:32.063068 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:48:32.073082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2d88b086-e6c6-422d-995f-15c42517449c req-a4aa8a63-c432-4d86-a376-d2434c11ac62 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:32.073820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-2d88b086-e6c6-422d-995f-15c42517449c req-a4aa8a63-c432-4d86-a376-d2434c11ac62 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:32.090710 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-2d88b086-e6c6-422d-995f-15c42517449c req-a4aa8a63-c432-4d86-a376-d2434c11ac62 service nova] Creating event network-changed:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch1-master-1 Dec 18 21:48:32.099036 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-2d88b086-e6c6-422d-995f-15c42517449c req-a4aa8a63-c432-4d86-a376-d2434c11ac62 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047292 Dec 18 21:48:32.099643 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3946/7942] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:48:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:48:32.876915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:32.878133 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:32.885317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:32.885771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:32.886582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:32.887027 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:33.097286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:33.104933 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-01071e8b-2e7d-41e2-826a-e2ee155a7a7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1391 microversion: 2.1 time: 0.231906 Dec 18 21:48:33.105535 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3997/7943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:32 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:34.122165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:34.122941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:34.130357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:34.130830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:34.131647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:34.132108 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:34.264286 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:34.271655 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4a63c700-d6ae-46be-b097-acbddc4d7cae tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1391 microversion: 2.1 time: 0.154416 Dec 18 21:48:34.272236 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3947/7944] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:34 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:35.288679 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:35.289304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:35.296535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:35.296989 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:35.297788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:35.298227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:35.433501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:35.440814 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1e778938-d86c-4074-8bda-b122da5405c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1391 microversion: 2.1 time: 0.155869 Dec 18 21:48:35.441374 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3998/7945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:35 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:36.456799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:36.457428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:36.465271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:36.465913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:36.466760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:36.467220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:36.597036 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:36.604912 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-85b64238-13ef-4388-9b20-77ebe0d628b8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1391 microversion: 2.1 time: 0.151869 Dec 18 21:48:36.605584 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3948/7946] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:36 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:37.621350 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:37.622009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:37.628811 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:37.629264 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:37.630045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:37.630515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:37.762411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:37.770964 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8cf29f4f-d84a-4373-92e2-27d5c4c18f5c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1391 microversion: 2.1 time: 0.153939 Dec 18 21:48:37.771550 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 3999/7947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:37 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:38.057421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ef4d3987-0224-4188-a741-d318314f981c req-94debcb1-3d2f-46c2-9578-3c3918796c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "name": "network-vif-plugged", "status": "completed", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:38.059000 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:48:38.059000 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:48:38.067659 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ef4d3987-0224-4188-a741-d318314f981c req-94debcb1-3d2f-46c2-9578-3c3918796c57 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:38.068145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ef4d3987-0224-4188-a741-d318314f981c req-94debcb1-3d2f-46c2-9578-3c3918796c57 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:38.079450 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ef4d3987-0224-4188-a741-d318314f981c req-94debcb1-3d2f-46c2-9578-3c3918796c57 service nova] Creating event network-vif-plugged:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch1-master-1 Dec 18 21:48:38.084519 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ef4d3987-0224-4188-a741-d318314f981c req-94debcb1-3d2f-46c2-9578-3c3918796c57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030576 Dec 18 21:48:38.085274 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3949/7948] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:48:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:48:38.788181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:38.788819 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:38.796030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:38.796488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:38.797272 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:38.797712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:38.925714 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:38.933569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ecc0f1f3-a72c-409d-9934-98ea55357009 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1391 microversion: 2.1 time: 0.149197 Dec 18 21:48:38.934148 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4000/7949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:38 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:39.952102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:39.952812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:39.959272 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:39.959750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:39.960550 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:39.961011 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:40.095537 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:40.102941 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-74f902d7-299c-49ed-a60c-5f5a8715eab8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1562 microversion: 2.1 time: 0.156280 Dec 18 21:48:40.103730 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3950/7950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:39 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:40.119111 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:40.119721 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:40.126496 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:40.126949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:40.127733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:40.128168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:40.260098 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:40.267415 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a9d0ded-0d16-4801-b508-d1aa893a9b06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1562 microversion: 2.1 time: 0.152529 Dec 18 21:48:40.267982 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4001/7951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:40 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:48:42.125525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:48:42.126815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:48:42.128116 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-71ba57eb-dda5-43ff-89fc-4959dd52006e req-bfa8db7e-5d95-4a54-8a8e-84b715815f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:48:42.129643 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:48:42.129643 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:48:42.134374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:42.134854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:42.135727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:42.136469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:42.137407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-71ba57eb-dda5-43ff-89fc-4959dd52006e req-bfa8db7e-5d95-4a54-8a8e-84b715815f03 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:48:42.137856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-71ba57eb-dda5-43ff-89fc-4959dd52006e req-bfa8db7e-5d95-4a54-8a8e-84b715815f03 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:48:42.148936 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-71ba57eb-dda5-43ff-89fc-4959dd52006e req-bfa8db7e-5d95-4a54-8a8e-84b715815f03 service nova] Creating event network-changed:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch1-master-1 Dec 18 21:48:42.154930 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-71ba57eb-dda5-43ff-89fc-4959dd52006e req-bfa8db7e-5d95-4a54-8a8e-84b715815f03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030452 Dec 18 21:48:42.155771 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4002/7952] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:48:42.356663 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:48:42.364678 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8f4e8b76-684f-4cb9-a5bd-a6475827d22f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1562 microversion: 2.1 time: 0.243301 Dec 18 21:48:42.365727 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3951/7953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:48:42 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:05.625675 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1dc3577-0a84-4dc8-a8b1-6f8710189dbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:49:05.626698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1dc3577-0a84-4dc8-a8b1-6f8710189dbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:05.632846 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1dc3577-0a84-4dc8-a8b1-6f8710189dbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:05.633301 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1dc3577-0a84-4dc8-a8b1-6f8710189dbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:05.634089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1dc3577-0a84-4dc8-a8b1-6f8710189dbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:05.634568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1dc3577-0a84-4dc8-a8b1-6f8710189dbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:05.693286 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1dc3577-0a84-4dc8-a8b1-6f8710189dbb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action" status: 200 len: 24556 microversion: 2.1 time: 0.072531 Dec 18 21:49:05.693921 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4003/7954] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:49:05 2021] POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action => generated 24556 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:49:16.627936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:49:16.628941 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:16.635043 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:16.635516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:16.636460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:16.636949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:16.663828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:16.670039 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Old instance type m1.heat2, new instance type m1.heat {{(pid=140731) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 18 21:49:16.676422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:49:16.676860 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:49:16.677348 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:49:16.677772 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:49:16.678206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:49:16.742043 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e07b9c3-0d9a-4f87-8fe6-727517e226c1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action" status: 202 len: 0 microversion: 2.1 time: 0.117940 Dec 18 21:49:16.742707 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3952/7955] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:49:16 2021] POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:49:16.751286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:16.752029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:16.759457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:16.759916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:16.760746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:16.761178 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:16.906535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:16.914305 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-282570ea-83b3-4ef4-bd34-70d53cb96f5e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1689 microversion: 2.1 time: 0.167187 Dec 18 21:49:16.915058 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4004/7956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:16 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:17.934004 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:17.934876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:17.941266 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:17.941744 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:17.942614 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:17.943093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:18.153026 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:18.160408 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1a81647b-aca7-4158-b01f-84ee5141bc01 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1689 microversion: 2.1 time: 0.231704 Dec 18 21:49:18.161177 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3953/7957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:17 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:19.177893 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:19.178522 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:19.186138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:19.186617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:19.187398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:19.187837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:19.319787 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:19.327166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-59be0be0-4993-460e-a88c-2a3c5e6819c5 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.153183 Dec 18 21:49:19.327734 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4005/7958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:19 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:49:20.344977 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:20.345611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:20.352558 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:20.353040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:20.353841 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:20.354457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:20.489652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:20.497130 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c2fef9fa-0832-4b25-8b5f-be6b7f5bdc60 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.155926 Dec 18 21:49:20.497703 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3954/7959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:20 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:21.513905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:21.514553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:21.521242 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:21.521698 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:21.522529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:21.522978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:21.655602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:21.662978 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d3a06072-291d-4805-b24b-fad305ef40d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.152836 Dec 18 21:49:21.663552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4006/7960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:21 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:22.680497 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:22.681100 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:22.687999 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:22.688464 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:22.689288 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:22.689738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:22.824179 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:22.831616 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f56bda2-f415-4364-8dc9-e79571a1c5cb tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.154831 Dec 18 21:49:22.832183 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3955/7961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:22 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:23.848923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:23.849538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:23.856498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:23.856956 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:23.857768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:23.858206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:23.995443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:24.003399 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-62a39d17-9e8f-4770-b86f-0d8f548adb76 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.158308 Dec 18 21:49:24.003970 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4007/7962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:23 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:25.020339 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:25.020887 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:25.028186 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:25.028657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:25.029467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:25.029928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:25.159214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:25.166665 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-465f1b7d-668b-434b-baac-548bb317d795 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.150090 Dec 18 21:49:25.167212 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3956/7963] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:25 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:26.182801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:26.183528 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:26.190185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:26.190673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:26.191482 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:26.191926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:26.325471 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:26.332865 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-529264cc-8880-4e5f-9b78-9d9933df344a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.153826 Dec 18 21:49:26.333432 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4008/7964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:26 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:27.350530 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:27.351181 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:27.358453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:27.358926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:27.359997 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:27.360520 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:27.491802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:27.499103 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dccc5f73-a7de-415f-b794-bf1af0803f06 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.152488 Dec 18 21:49:27.499673 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3957/7965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:27 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:28.515928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:28.516520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:28.523232 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:28.523700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:28.524484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:28.524927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:28.661767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:28.669170 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5fa44df1-a413-4163-b247-a79854aba965 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.157034 Dec 18 21:49:28.669749 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4009/7966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:28 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:29.686797 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:29.687432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:29.694014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:29.694518 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:29.695309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:29.695761 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:29.829445 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:29.837344 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd14ee2b-8b4c-4055-8f0a-ba625fa4eac6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1694 microversion: 2.1 time: 0.155085 Dec 18 21:49:29.837956 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3958/7967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:29 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:30.854808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:30.855477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:30.862759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:30.863217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:30.864023 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:30.864478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:31.003875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:31.011321 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48f549bb-9008-442e-8f9a-954f36011737 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1693 microversion: 2.1 time: 0.160213 Dec 18 21:49:31.011887 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4010/7968] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:30 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:31.155183 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-ab3ecb3e-fea9-47a0-964d-72da6358e64c req-abd878ae-fb9c-4921-b09b-6bc9bc21935a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "name": "network-vif-unplugged", "status": "completed", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:49:31.156833 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:49:31.156833 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:49:31.164834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ab3ecb3e-fea9-47a0-964d-72da6358e64c req-abd878ae-fb9c-4921-b09b-6bc9bc21935a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:31.165360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-ab3ecb3e-fea9-47a0-964d-72da6358e64c req-abd878ae-fb9c-4921-b09b-6bc9bc21935a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:31.177847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-ab3ecb3e-fea9-47a0-964d-72da6358e64c req-abd878ae-fb9c-4921-b09b-6bc9bc21935a service nova] Creating event network-vif-unplugged:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch2-master-1 Dec 18 21:49:31.183906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [req-ab3ecb3e-fea9-47a0-964d-72da6358e64c req-abd878ae-fb9c-4921-b09b-6bc9bc21935a service nova] Instance e4375640-c87b-4969-970d-e1e4b73dca1a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140731) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:49:31.195655 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-ab3ecb3e-fea9-47a0-964d-72da6358e64c req-abd878ae-fb9c-4921-b09b-6bc9bc21935a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044096 Dec 18 21:49:31.196590 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3959/7969] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:49:32.028468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:32.029069 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:32.035754 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:32.036204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:32.036997 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:32.037434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:32.174056 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:32.182701 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c8224d0b-5a9d-464c-b549-783ffdc79d8e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1693 microversion: 2.1 time: 0.157858 Dec 18 21:49:32.183526 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4011/7970] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:32 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:33.205437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:33.206331 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:33.211223 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cb1dca40-472c-4154-9791-ddd8714cfa40 req-5e8f5a7c-1eeb-4077-a922-5b179fb0f6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:49:33.212739 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:33.213019 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:49:33.213019 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:49:33.213280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:33.213987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:33.214554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:33.221387 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cb1dca40-472c-4154-9791-ddd8714cfa40 req-5e8f5a7c-1eeb-4077-a922-5b179fb0f6b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:33.221954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cb1dca40-472c-4154-9791-ddd8714cfa40 req-5e8f5a7c-1eeb-4077-a922-5b179fb0f6b7 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:33.233511 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cb1dca40-472c-4154-9791-ddd8714cfa40 req-5e8f5a7c-1eeb-4077-a922-5b179fb0f6b7 service nova] Creating event network-changed:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch2-master-1 Dec 18 21:49:33.238954 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [req-cb1dca40-472c-4154-9791-ddd8714cfa40 req-5e8f5a7c-1eeb-4077-a922-5b179fb0f6b7 service nova] Instance e4375640-c87b-4969-970d-e1e4b73dca1a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140732) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 18 21:49:33.249999 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cb1dca40-472c-4154-9791-ddd8714cfa40 req-5e8f5a7c-1eeb-4077-a922-5b179fb0f6b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042592 Dec 18 21:49:33.250703 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4012/7971] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:49:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:49:33.424283 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:33.432440 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f49d90c7-c1fe-4605-baac-af6ac3e0bcbd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1691 microversion: 2.1 time: 0.232381 Dec 18 21:49:33.433346 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3960/7972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:33 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:34.451934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:34.452664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:34.458928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.459643 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:34.460432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.460877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:34.598960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:34.607013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9356a96f-6a42-454f-bc93-4b0bfb9283e6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1688 microversion: 2.1 time: 0.160021 Dec 18 21:49:34.607595 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4013/7973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:34 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:34.623655 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d9667d70-a085-4df7-9d04-8432caecdf37 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:49:34.624237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d9667d70-a085-4df7-9d04-8432caecdf37 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:34.630978 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9667d70-a085-4df7-9d04-8432caecdf37 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.631456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9667d70-a085-4df7-9d04-8432caecdf37 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:34.632275 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9667d70-a085-4df7-9d04-8432caecdf37 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.632738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d9667d70-a085-4df7-9d04-8432caecdf37 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:34.690648 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d9667d70-a085-4df7-9d04-8432caecdf37 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action" status: 204 len: 0 microversion: 2.1 time: 0.070951 Dec 18 21:49:34.691486 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3961/7974] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:49:34 2021] POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:49:34.699164 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:34.699798 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:34.705865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.706627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:34.707631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.708077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:34.924762 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:34.932177 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a6d60ecb-405b-42a2-b888-5c7bed7a808b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1688 microversion: 2.1 time: 0.236644 Dec 18 21:49:34.932756 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4014/7975] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:34 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:49:34.949725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:34.950393 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:34.956375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.956848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:34.957648 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:34.958105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:35.175421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:35.184980 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-00570efb-6f8f-4645-847c-f1ff48e43501 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1688 microversion: 2.1 time: 0.239248 Dec 18 21:49:35.185765 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3962/7976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:34 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:36.202371 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:49:36.202991 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:36.211213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:36.211672 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:36.212731 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:36.213184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:36.259680 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9ea0cf9e-01d7-472b-a3f1-e085d12fec4c req-e3a9a9a0-7145-4710-acc6-93552776e5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "name": "network-vif-plugged", "status": "completed", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:49:36.262777 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:49:36.262777 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:49:36.273917 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9ea0cf9e-01d7-472b-a3f1-e085d12fec4c req-e3a9a9a0-7145-4710-acc6-93552776e5a1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:36.274731 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9ea0cf9e-01d7-472b-a3f1-e085d12fec4c req-e3a9a9a0-7145-4710-acc6-93552776e5a1 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:36.288235 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9ea0cf9e-01d7-472b-a3f1-e085d12fec4c req-e3a9a9a0-7145-4710-acc6-93552776e5a1 service nova] Creating event network-vif-plugged:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch2-master-1 Dec 18 21:49:36.293807 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9ea0cf9e-01d7-472b-a3f1-e085d12fec4c req-e3a9a9a0-7145-4710-acc6-93552776e5a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037403 Dec 18 21:49:36.294757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3963/7977] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:49:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:49:36.376095 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:49:36.383733 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2a4cbb54-031d-4a30-aa5d-13374091177e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1680 microversion: 2.1 time: 0.185387 Dec 18 21:49:36.384312 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4015/7978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:49:36 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:49:58.556034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b44e593e-e59f-43d4-829b-6b40ea758526 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:49:58.557034 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b44e593e-e59f-43d4-829b-6b40ea758526 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:49:58.563876 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b44e593e-e59f-43d4-829b-6b40ea758526 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:58.564342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b44e593e-e59f-43d4-829b-6b40ea758526 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:58.565144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b44e593e-e59f-43d4-829b-6b40ea758526 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:49:58.565602 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b44e593e-e59f-43d4-829b-6b40ea758526 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:49:58.617782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b44e593e-e59f-43d4-829b-6b40ea758526 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action" status: 200 len: 24570 microversion: 2.1 time: 0.066699 Dec 18 21:49:58.618438 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3964/7979] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:49:58 2021] POST /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a/action => generated 24570 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:49:59.236122 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:49:59.236726 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:49:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:50:05.924923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:05.925576 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:05.928775 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-7711f2e9-40b1-4339-a26a-fda52eb2054e req-af24c9b7-c2a0-490c-a7e8-30dea192895a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:05.931057 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:50:05.931057 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:50:05.932028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:05.932733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:05.933609 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:05.934208 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:05.939672 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7711f2e9-40b1-4339-a26a-fda52eb2054e req-af24c9b7-c2a0-490c-a7e8-30dea192895a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:05.940131 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-7711f2e9-40b1-4339-a26a-fda52eb2054e req-af24c9b7-c2a0-490c-a7e8-30dea192895a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:05.952226 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-7711f2e9-40b1-4339-a26a-fda52eb2054e req-af24c9b7-c2a0-490c-a7e8-30dea192895a service nova] Creating event network-changed:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch2-master-1 Dec 18 21:50:05.957677 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-7711f2e9-40b1-4339-a26a-fda52eb2054e req-af24c9b7-c2a0-490c-a7e8-30dea192895a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033358 Dec 18 21:50:05.958611 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3965/7980] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:50:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:50:05.963883 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:50:06.052689 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-dc32333d-9ae7-4723-894d-2a5f425cc677 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 204 len: 0 microversion: 2.1 time: 0.131099 Dec 18 21:50:06.053380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4016/7981] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:50:05 2021] DELETE /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:50:06.063003 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:06.063980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:06.070150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:06.070881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:06.071867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:06.072513 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:06.327879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:06.335799 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4599f8ea-608d-45cf-b99f-5f0ef7ea898c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1686 microversion: 2.1 time: 0.277930 Dec 18 21:50:06.336705 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3966/7982] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:06 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1686 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:50:07.353384 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:07.354084 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:07.360746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:07.361204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:07.361995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:07.362468 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:07.562022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:07.569465 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-58e6d7be-a46d-4f34-b2d0-4b8d1bbd82c8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 200 len: 1568 microversion: 2.1 time: 0.220188 Dec 18 21:50:07.570040 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4017/7983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:07 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:07.789992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-def2bfc7-633f-4161-b9e5-bcc3dc2a4500 req-996ac72a-6620-418f-b8c9-056b64939bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4375640-c87b-4969-970d-e1e4b73dca1a", "name": "network-vif-deleted", "tag": "23b9728c-a2ce-479f-ba88-371b1cb0533c"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:07.791547 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:50:07.791547 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:50:07.799458 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-def2bfc7-633f-4161-b9e5-bcc3dc2a4500 req-996ac72a-6620-418f-b8c9-056b64939bf6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:07.799829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-def2bfc7-633f-4161-b9e5-bcc3dc2a4500 req-996ac72a-6620-418f-b8c9-056b64939bf6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:07.814387 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-def2bfc7-633f-4161-b9e5-bcc3dc2a4500 req-996ac72a-6620-418f-b8c9-056b64939bf6 service nova] Creating event network-vif-deleted:23b9728c-a2ce-479f-ba88-371b1cb0533c for instance e4375640-c87b-4969-970d-e1e4b73dca1a on nch2-master-1 Dec 18 21:50:07.819270 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-def2bfc7-633f-4161-b9e5-bcc3dc2a4500 req-996ac72a-6620-418f-b8c9-056b64939bf6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032936 Dec 18 21:50:07.819879 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3967/7984] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:50:08.587465 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:08.588007 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: e4375640-c87b-4969-970d-e1e4b73dca1a] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:08.595216 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:08.595681 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:08.596472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:08.596914 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:08.610673 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] HTTP exception thrown: Instance e4375640-c87b-4969-970d-e1e4b73dca1a could not be found. Dec 18 21:50:08.611253 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Returning 404 to user: Instance e4375640-c87b-4969-970d-e1e4b73dca1a could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:50:08.612069 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b5828977-57b5-42fe-aa12-8df4acebc0fc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a" status: 404 len: 111 microversion: 2.1 time: 0.028759 Dec 18 21:50:08.612599 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4018/7985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:08 2021] GET /compute/v2.1/servers/e4375640-c87b-4969-970d-e1e4b73dca1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:50:11.628426 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0e374038-fbc6-4a49-8b63-e16b5ca9265b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '.version_select at 0x7f714ee793a0>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:11.657014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0e374038-fbc6-4a49-8b63-e16b5ca9265b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-953522791" status: 202 len: 0 microversion: 2.1 time: 0.033311 Dec 18 21:50:11.657618 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3968/7986] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Dec 18 21:50:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-953522791 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:50:11.681319 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-696b698c-c068-429e-ad58-037c088ade83 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: .version_select at 0x7f714f8a9e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-467814206"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:11.695623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-696b698c-c068-429e-ad58-037c088ade83 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:50:11.701796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-696b698c-c068-429e-ad58-037c088ade83 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:50:12.118228 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-696b698c-c068-429e-ad58-037c088ade83 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:50:12.123622 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-696b698c-c068-429e-ad58-037c088ade83 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:50:12.137985 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-696b698c-c068-429e-ad58-037c088ade83 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.459816 Dec 18 21:50:12.138635 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4019/7987] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:50:11 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:50:18.045944 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-184520155", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "cfe8402e-d259-40be-9fbd-1c1f93d9bced"}], "key_name": "tempest-TestNetworkAdvancedServerOps-467814206", "security_groups": [{"name": "tempest-secgroup-smoke-1086163648"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:18.157038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] validate_networks() for [('cfe8402e-d259-40be-9fbd-1c1f93d9bced', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:50:18.597208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:50:18.597924 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:50:18.598469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:50:18.599156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:50:18.599621 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:50:18.610429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:18.610873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:18.612453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:18.613123 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:18.634734 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:50:18.642597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:50:18.657546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:50:18.660082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:50:18.714299 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-68bc3f90-47a6-46fc-9973-6ad14f879ec7 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.672534 Dec 18 21:50:18.720519 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3969/7988] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:50:18 2021] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:50:18.726865 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f3035c2-f8c5-41b6-858f-608bbcbd3cea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:18.727487 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f3035c2-f8c5-41b6-858f-608bbcbd3cea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:18.812785 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f3035c2-f8c5-41b6-858f-608bbcbd3cea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:18.828147 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f3035c2-f8c5-41b6-858f-608bbcbd3cea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1265 microversion: 2.1 time: 0.106125 Dec 18 21:50:18.828743 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4020/7989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:18 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:19.846345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:19.848056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:19.879639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:19.880119 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:19.886930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:19.887428 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:20.011309 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:20.025271 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d31cdf94-c17e-4665-b902-be4ff82034fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1325 microversion: 2.1 time: 0.183376 Dec 18 21:50:20.028637 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3970/7990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:19 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:21.045629 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:21.046458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:21.056170 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:21.056937 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:21.058356 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:21.065297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:21.221952 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:21.230407 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f084e9dd-a874-40d2-8209-8628674232d8 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1391 microversion: 2.1 time: 0.189156 Dec 18 21:50:21.231649 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4021/7991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:21 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:21.573795 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-239df75d-2e78-4cda-9a92-bb3087f8660f req-9df0988e-c513-4d19-bfb6-3e2f02ffcea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be677243-8a87-40f0-803c-82940b3a50a9", "tag": "b6af1d3f-a4b4-4823-8ba0-9de053c487f5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:21.576530 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:50:21.576530 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:50:21.585351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-239df75d-2e78-4cda-9a92-bb3087f8660f req-9df0988e-c513-4d19-bfb6-3e2f02ffcea8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:21.588301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-239df75d-2e78-4cda-9a92-bb3087f8660f req-9df0988e-c513-4d19-bfb6-3e2f02ffcea8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:21.603695 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-239df75d-2e78-4cda-9a92-bb3087f8660f req-9df0988e-c513-4d19-bfb6-3e2f02ffcea8 service nova] Creating event network-changed:b6af1d3f-a4b4-4823-8ba0-9de053c487f5 for instance be677243-8a87-40f0-803c-82940b3a50a9 on nch2-master-1 Dec 18 21:50:21.609820 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-239df75d-2e78-4cda-9a92-bb3087f8660f req-9df0988e-c513-4d19-bfb6-3e2f02ffcea8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042838 Dec 18 21:50:21.610807 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3971/7992] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:50:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:50:22.248619 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:22.249239 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:22.256126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:22.256586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:22.257383 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:22.257832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:22.390198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:22.398654 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8a1658fd-6fb5-4fd4-9d03-38c1162c3b3b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1391 microversion: 2.1 time: 0.154244 Dec 18 21:50:22.399236 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4022/7993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:22 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:23.416466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:23.416852 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:23.422961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:23.423437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:23.424241 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:23.424703 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:23.560937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:23.569526 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-24d455f5-3b73-4308-b91c-71e3b9a3352b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1391 microversion: 2.1 time: 0.158472 Dec 18 21:50:23.570103 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3972/7994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:23 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:24.587077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:24.587664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:24.594307 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:24.594766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:24.595544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:24.595981 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:24.726279 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:24.734131 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9b383605-5a47-4512-b7dd-7d04f7146423 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1391 microversion: 2.1 time: 0.151139 Dec 18 21:50:24.734974 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4023/7995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:24 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:25.751142 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:25.752306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:25.759482 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:25.759957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:25.760760 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:25.761239 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:25.897639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:25.906402 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-41a90608-f4f8-4535-acab-77e9b9909acc tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1391 microversion: 2.1 time: 0.159176 Dec 18 21:50:25.907241 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3973/7996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:25 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:26.441536 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-955069b3-3cfd-447c-b1d8-f368bce6ed0d req-24923431-569c-4177-b383-cf03de9cdbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be677243-8a87-40f0-803c-82940b3a50a9", "name": "network-vif-plugged", "status": "completed", "tag": "b6af1d3f-a4b4-4823-8ba0-9de053c487f5"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:26.443267 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:50:26.443267 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:50:26.452153 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-955069b3-3cfd-447c-b1d8-f368bce6ed0d req-24923431-569c-4177-b383-cf03de9cdbff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:26.452738 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-955069b3-3cfd-447c-b1d8-f368bce6ed0d req-24923431-569c-4177-b383-cf03de9cdbff service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:26.473812 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-955069b3-3cfd-447c-b1d8-f368bce6ed0d req-24923431-569c-4177-b383-cf03de9cdbff service nova] Creating event network-vif-plugged:b6af1d3f-a4b4-4823-8ba0-9de053c487f5 for instance be677243-8a87-40f0-803c-82940b3a50a9 on nch2-master-1 Dec 18 21:50:26.478960 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-955069b3-3cfd-447c-b1d8-f368bce6ed0d req-24923431-569c-4177-b383-cf03de9cdbff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041147 Dec 18 21:50:26.479648 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4024/7997] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:50:26.924194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:26.924815 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:26.931501 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:26.931970 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:26.932766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:26.933217 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:27.067049 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:27.074645 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3a136d4c-a7ea-47f6-93fb-a534af2a66ef tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1391 microversion: 2.1 time: 0.154089 Dec 18 21:50:27.075217 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3974/7998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:26 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:28.092797 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:28.093502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:28.099645 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:28.100106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:28.100895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:28.101341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:28.233563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:28.241045 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b9ee7133-fc81-4c85-837a-b5c463824c09 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1563 microversion: 2.1 time: 0.153141 Dec 18 21:50:28.241614 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4025/7999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:28 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:28.257541 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:28.258165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:28.264905 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:28.265369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:28.266165 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:28.266643 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:28.405776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:28.413143 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-befdd137-089d-48be-8342-ddd6e14bbc55 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1563 microversion: 2.1 time: 0.159436 Dec 18 21:50:28.413720 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3975/8000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:28 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:29.977984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:29.978641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:29.986632 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:29.987099 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:29.987927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:29.988662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:30.033674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e3b18e2b-f47c-4ef5-a40c-b7388963b6a9 req-fbab17d7-9c83-4001-a34d-18b697e486d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be677243-8a87-40f0-803c-82940b3a50a9", "tag": "b6af1d3f-a4b4-4823-8ba0-9de053c487f5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:30.035522 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:50:30.035522 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:50:30.043524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e3b18e2b-f47c-4ef5-a40c-b7388963b6a9 req-fbab17d7-9c83-4001-a34d-18b697e486d6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:30.044290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e3b18e2b-f47c-4ef5-a40c-b7388963b6a9 req-fbab17d7-9c83-4001-a34d-18b697e486d6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:30.056215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e3b18e2b-f47c-4ef5-a40c-b7388963b6a9 req-fbab17d7-9c83-4001-a34d-18b697e486d6 service nova] Creating event network-changed:b6af1d3f-a4b4-4823-8ba0-9de053c487f5 for instance be677243-8a87-40f0-803c-82940b3a50a9 on nch2-master-1 Dec 18 21:50:30.062229 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e3b18e2b-f47c-4ef5-a40c-b7388963b6a9 req-fbab17d7-9c83-4001-a34d-18b697e486d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093250 Dec 18 21:50:30.063322 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3976/8001] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:50:30.130830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:50:30.138497 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8242a3d0-c53e-4f4e-b0e1-458bb3548a53 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1563 microversion: 2.1 time: 0.171562 Dec 18 21:50:30.139183 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4026/8002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:29 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:50:53.430092 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-45f0f6bd-e31a-4056-aa71-340a8ff4d2b6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:53.431170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-45f0f6bd-e31a-4056-aa71-340a8ff4d2b6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:53.437742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45f0f6bd-e31a-4056-aa71-340a8ff4d2b6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:53.438215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45f0f6bd-e31a-4056-aa71-340a8ff4d2b6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:53.439048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45f0f6bd-e31a-4056-aa71-340a8ff4d2b6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:53.439506 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-45f0f6bd-e31a-4056-aa71-340a8ff4d2b6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:53.491744 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-45f0f6bd-e31a-4056-aa71-340a8ff4d2b6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action" status: 200 len: 24572 microversion: 2.1 time: 0.111067 Dec 18 21:50:53.492443 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3977/8003] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:50:53 2021] POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action => generated 24572 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:50:59.883853 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-929c7268-d1dc-4596-8159-aae92bc82bad tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:50:59.890668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-929c7268-d1dc-4596-8159-aae92bc82bad tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:59.891129 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-929c7268-d1dc-4596-8159-aae92bc82bad tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:59.914096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-929c7268-d1dc-4596-8159-aae92bc82bad tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Going to try to stop instance {{(pid=140732) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 21:50:59.954943 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-929c7268-d1dc-4596-8159-aae92bc82bad tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action" status: 202 len: 0 microversion: 2.1 time: 0.074605 Dec 18 21:50:59.955552 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4027/8004] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:50:59 2021] POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:50:59.966180 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:50:59.966986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:50:59.974345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:59.974819 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:50:59.975635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:50:59.976095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:00.108878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:00.116225 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a048c916-ced6-4490-9f4f-443ee39bb820 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.154853 Dec 18 21:51:00.116836 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3978/8005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:50:59 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:01.134676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:01.135373 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:01.142777 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:01.143578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:01.144618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:01.145060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:01.287002 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:01.294395 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-de5f3e72-20a9-45ea-a568-5b56d87dba9d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.164642 Dec 18 21:51:01.294973 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4028/8006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:01 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:02.311583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:02.312231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:02.319573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:02.320048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:02.320854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:02.321315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:02.449615 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:02.456996 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bd05b2a8-5e33-4c40-af3a-96212043323b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.149309 Dec 18 21:51:02.457566 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3979/8007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:02 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:03.474617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:03.475218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:03.482687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:03.483138 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:03.483934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:03.484380 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:03.624532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:03.631942 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-41b68312-7fea-40c4-bf22-b2fc533d7167 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.161133 Dec 18 21:51:03.632520 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4029/8008] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:03 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:04.648824 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:04.649481 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:04.656237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:04.656705 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:04.657498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:04.657957 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:04.789788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:04.797144 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4c1560ff-f9c3-4386-a44f-6f4eeb6aa488 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.152050 Dec 18 21:51:04.797734 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3980/8009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:04 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:05.814057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:05.814720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:05.821424 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:05.821886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:05.822707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:05.823151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:05.957567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:05.965080 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6df51433-1634-404e-a7c9-286928b8093a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.154873 Dec 18 21:51:05.965713 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4030/8010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:05 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:06.983284 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:06.983995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:06.990674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:06.991140 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:06.991935 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:06.992387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:07.121472 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:07.128949 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dc38b25d-a402-479c-88b7-989626035d58 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.149988 Dec 18 21:51:07.129524 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3981/8011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:06 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:08.145299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:08.145915 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:08.152697 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:08.153160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:08.153957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:08.154443 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:08.283567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:08.290970 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7f2492eb-7136-4628-bcbd-4d1adaa565b9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.149445 Dec 18 21:51:08.291553 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4031/8012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:08 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:09.308487 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:09.309116 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:09.316384 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:09.316858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:09.317673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:09.318134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:09.449582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:09.457102 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-dd7899c2-92e7-436f-87cb-5cdb86001b81 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1691 microversion: 2.1 time: 0.152380 Dec 18 21:51:09.457685 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3982/8013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:09 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:10.474297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:10.474916 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:10.481830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:10.482322 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:10.483122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:10.483572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:10.613491 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:10.620927 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-18a18976-605a-49cd-9b27-d4a84d07c3dd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1668 microversion: 2.1 time: 0.150463 Dec 18 21:51:10.621501 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4032/8014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:10 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:12.035505 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-28bee1a7-c6aa-486f-8cba-1cd875895e7a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:51:12.036374 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-28bee1a7-c6aa-486f-8cba-1cd875895e7a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:12.043220 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bee1a7-c6aa-486f-8cba-1cd875895e7a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:12.043692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bee1a7-c6aa-486f-8cba-1cd875895e7a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:12.044509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bee1a7-c6aa-486f-8cba-1cd875895e7a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:12.044952 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-28bee1a7-c6aa-486f-8cba-1cd875895e7a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:12.093427 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-28bee1a7-c6aa-486f-8cba-1cd875895e7a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action" status: 200 len: 35792 microversion: 2.1 time: 0.061632 Dec 18 21:51:12.094401 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3983/8015] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:51:12 2021] POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action => generated 35792 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:51:12.105175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3b143858-b218-4d59-9707-0618e540d6a3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:51:12.111988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b143858-b218-4d59-9707-0618e540d6a3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:12.112447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3b143858-b218-4d59-9707-0618e540d6a3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:12.134368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3b143858-b218-4d59-9707-0618e540d6a3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Going to try to start instance {{(pid=140732) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 21:51:12.175212 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3b143858-b218-4d59-9707-0618e540d6a3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action" status: 202 len: 0 microversion: 2.1 time: 0.073648 Dec 18 21:51:12.175843 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4033/8016] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:51:12 2021] POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:51:12.186971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:12.187684 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:12.194845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:12.195311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:12.196133 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:12.196589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:12.333387 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:12.341009 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2fe88237-c4fb-42b6-aa7f-4b9ea635096a tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1677 microversion: 2.1 time: 0.158628 Dec 18 21:51:12.341611 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3984/8017] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:12 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:13.359939 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:13.360758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:13.367331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:13.367779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:13.368558 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:13.368998 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:13.500302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:13.507666 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-deba778a-eaa8-44dd-8087-1b542d4006d3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1681 microversion: 2.1 time: 0.152744 Dec 18 21:51:13.508234 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4034/8018] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:13 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:37.688361 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-935af54e-036a-4d44-87c0-3d73ff4f3029 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:51:37.689351 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-935af54e-036a-4d44-87c0-3d73ff4f3029 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:37.696618 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-935af54e-036a-4d44-87c0-3d73ff4f3029 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:37.697095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-935af54e-036a-4d44-87c0-3d73ff4f3029 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:37.697898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-935af54e-036a-4d44-87c0-3d73ff4f3029 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:37.698404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-935af54e-036a-4d44-87c0-3d73ff4f3029 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:37.751313 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-935af54e-036a-4d44-87c0-3d73ff4f3029 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action" status: 200 len: 60350 microversion: 2.1 time: 0.067156 Dec 18 21:51:37.751979 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3985/8019] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:51:37 2021] POST /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9/action => generated 60350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:51:44.748459 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:44.748984 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:44.752673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3ed592d5-d1ce-4371-9c53-712a85c9f015 req-cf88b3d4-5920-40c6-8c38-b6f1b97d3029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be677243-8a87-40f0-803c-82940b3a50a9", "tag": "b6af1d3f-a4b4-4823-8ba0-9de053c487f5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:51:44.754461 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:51:44.754461 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:51:44.755393 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:44.755847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:44.756766 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:44.757070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:44.763696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3ed592d5-d1ce-4371-9c53-712a85c9f015 req-cf88b3d4-5920-40c6-8c38-b6f1b97d3029 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:44.764237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3ed592d5-d1ce-4371-9c53-712a85c9f015 req-cf88b3d4-5920-40c6-8c38-b6f1b97d3029 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:44.776074 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3ed592d5-d1ce-4371-9c53-712a85c9f015 req-cf88b3d4-5920-40c6-8c38-b6f1b97d3029 service nova] Creating event network-changed:b6af1d3f-a4b4-4823-8ba0-9de053c487f5 for instance be677243-8a87-40f0-803c-82940b3a50a9 on nch2-master-1 Dec 18 21:51:44.781227 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3ed592d5-d1ce-4371-9c53-712a85c9f015 req-cf88b3d4-5920-40c6-8c38-b6f1b97d3029 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032563 Dec 18 21:51:44.782206 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3986/8020] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:51:44.789546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:51:44.875202 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2f21ebf-aacf-47eb-a14c-c352dea16e2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 204 len: 0 microversion: 2.1 time: 0.129665 Dec 18 21:51:44.875978 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4035/8021] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:51:44 2021] DELETE /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:51:44.885396 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:44.886118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:44.893046 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:44.893666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:44.894629 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:44.895277 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:45.040015 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:45.048463 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-950ddda6-12c0-420a-88a2-11adc6995e5f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1687 microversion: 2.1 time: 0.167974 Dec 18 21:51:45.049053 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3987/8022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:44 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:46.065420 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:46.066057 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:46.072905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:46.073364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:46.074183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:46.074655 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:46.214809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:46.222737 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-48cee057-e236-4707-81e3-eadde0c5f6fd tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1569 microversion: 2.1 time: 0.161503 Dec 18 21:51:46.223311 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4036/8023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:46 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:46.909789 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-5dd04bf4-edb9-49aa-b2ee-80deb919bad9 req-d9a995e3-e45a-4c38-8397-dc75534f280a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be677243-8a87-40f0-803c-82940b3a50a9", "name": "network-vif-deleted", "tag": "b6af1d3f-a4b4-4823-8ba0-9de053c487f5"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:51:46.912025 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:51:46.912025 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:51:46.919738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5dd04bf4-edb9-49aa-b2ee-80deb919bad9 req-d9a995e3-e45a-4c38-8397-dc75534f280a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:46.920203 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-5dd04bf4-edb9-49aa-b2ee-80deb919bad9 req-d9a995e3-e45a-4c38-8397-dc75534f280a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:46.931311 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-5dd04bf4-edb9-49aa-b2ee-80deb919bad9 req-d9a995e3-e45a-4c38-8397-dc75534f280a service nova] Creating event network-vif-deleted:b6af1d3f-a4b4-4823-8ba0-9de053c487f5 for instance be677243-8a87-40f0-803c-82940b3a50a9 on nch2-master-1 Dec 18 21:51:46.936566 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-5dd04bf4-edb9-49aa-b2ee-80deb919bad9 req-d9a995e3-e45a-4c38-8397-dc75534f280a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094704 Dec 18 21:51:46.937158 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3988/8024] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:51:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:51:47.241410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:47.242689 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:47.250310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:47.251012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:47.251814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:47.252290 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:47.286861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:47.287315 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:47.287771 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lazy-loading 'fault' on Instance uuid be677243-8a87-40f0-803c-82940b3a50a9 {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:51:47.328658 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:47.336179 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-aa9b5eee-8491-4505-b19a-f766f4c0cc41 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 200 len: 1355 microversion: 2.1 time: 0.100020 Dec 18 21:51:47.336756 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4037/8025] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:47 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:48.357888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:48.358633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: be677243-8a87-40f0-803c-82940b3a50a9] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:48.364696 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:48.365170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:48.365972 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:48.366460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:48.380015 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] HTTP exception thrown: Instance be677243-8a87-40f0-803c-82940b3a50a9 could not be found. Dec 18 21:51:48.380625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Returning 404 to user: Instance be677243-8a87-40f0-803c-82940b3a50a9 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:51:48.381446 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6118758b-cb6b-4453-8383-0daf370c872e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9" status: 404 len: 111 microversion: 2.1 time: 0.029146 Dec 18 21:51:48.381973 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3989/8026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:48 2021] GET /compute/v2.1/servers/be677243-8a87-40f0-803c-82940b3a50a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:51:51.415464 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-880b3eb2-baf3-4167-a47c-a1dc0e716609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '.version_select at 0x7f714eb645e0>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:51.439924 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-880b3eb2-baf3-4167-a47c-a1dc0e716609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-467814206" status: 202 len: 0 microversion: 2.1 time: 0.028655 Dec 18 21:51:51.440861 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4038/8027] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Dec 18 21:51:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-467814206 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:51:51.470145 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2ba4f457-25ec-49ab-9ade-5489b770c720 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: .version_select at 0x7f716132adc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-57934208"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:51:51.491382 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2ba4f457-25ec-49ab-9ade-5489b770c720 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:51:51.498305 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2ba4f457-25ec-49ab-9ade-5489b770c720 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:51:51.673206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2ba4f457-25ec-49ab-9ade-5489b770c720 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:51:51.677967 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-2ba4f457-25ec-49ab-9ade-5489b770c720 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:51:51.692281 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2ba4f457-25ec-49ab-9ade-5489b770c720 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.226230 Dec 18 21:51:51.692878 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3990/8028] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:51:51 2021] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:51:57.101959 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-957372872", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "networks": [{"uuid": "5151f56a-2527-4839-9384-60be5aa279e3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-57934208", "security_groups": [{"name": "tempest-secgroup-smoke-1849189408"}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:51:57.233016 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] validate_networks() for [('5151f56a-2527-4839-9384-60be5aa279e3', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:51:57.689699 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:51:57.690458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:51:57.690943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:51:57.691546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:51:57.691965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:51:57.705005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:57.705486 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:57.706607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:57.707062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:57.726477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:51:57.732436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Getting quotas for user eccd820a1e45482abb10a2a787bf0341 and project 0ca451d1f26f48f583722f5ed440bf41. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:51:57.746613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:51:57.748988 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:51:57.796975 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f3c5c8b7-c466-4a96-ae00-784aa37a3fa6 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699377 Dec 18 21:51:57.802583 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4039/8029] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:51:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:51:57.807741 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0379a47e-6e11-45b6-9b73-d1c9ad99373d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:57.808463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0379a47e-6e11-45b6-9b73-d1c9ad99373d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:57.876252 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0379a47e-6e11-45b6-9b73-d1c9ad99373d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:57.885565 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0379a47e-6e11-45b6-9b73-d1c9ad99373d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1264 microversion: 2.1 time: 0.081547 Dec 18 21:51:57.886799 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3991/8030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:57 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1264 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:51:58.903711 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:51:58.904967 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:51:58.922742 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:58.928505 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:58.930287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:51:58.930757 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:51:59.061141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:51:59.068802 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6c900990-f919-4a77-93b8-cce89c301a13 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1334 microversion: 2.1 time: 0.169557 Dec 18 21:51:59.069936 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4040/8031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:51:58 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:00.088268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:00.088989 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:00.097597 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:00.098062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:00.098913 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:00.099371 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:00.392237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:00.399826 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7102dd7f-a7f1-4e7d-8338-b20e87ad9aa0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1390 microversion: 2.1 time: 0.317277 Dec 18 21:52:00.400387 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3992/8032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:00 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1390 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:00.822328 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8eb455f9-109e-4430-b204-b239ce633999 req-d26e7485-fb10-458b-8e4a-111bab41fc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ec0194-cac6-46f6-a18c-b9e363202fed", "tag": "e0094e8c-40b7-4d14-84b6-55e6b0defca6"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:00.824754 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:52:00.824754 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:52:00.845891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8eb455f9-109e-4430-b204-b239ce633999 req-d26e7485-fb10-458b-8e4a-111bab41fc3a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:00.846618 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8eb455f9-109e-4430-b204-b239ce633999 req-d26e7485-fb10-458b-8e4a-111bab41fc3a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:00.860874 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8eb455f9-109e-4430-b204-b239ce633999 req-d26e7485-fb10-458b-8e4a-111bab41fc3a service nova] Creating event network-changed:e0094e8c-40b7-4d14-84b6-55e6b0defca6 for instance 06ec0194-cac6-46f6-a18c-b9e363202fed on nch1-master-1 Dec 18 21:52:00.866609 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8eb455f9-109e-4430-b204-b239ce633999 req-d26e7485-fb10-458b-8e4a-111bab41fc3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048043 Dec 18 21:52:00.867930 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4041/8033] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:52:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:52:01.417574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:01.418303 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:01.425064 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:01.425591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:01.426500 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:01.427028 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:01.652172 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:01.659874 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4906b094-53f6-4eab-8803-1c54d9a40b64 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1390 microversion: 2.1 time: 0.246409 Dec 18 21:52:01.660536 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3993/8034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:01 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:02.677791 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:02.678530 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:02.684691 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:02.685148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:02.685934 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:02.686413 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:02.820199 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:02.828075 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6d04845a-eb07-447c-8fdd-5de512b5ade9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1390 microversion: 2.1 time: 0.155272 Dec 18 21:52:02.828645 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4042/8035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:02 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:03.845321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:03.845949 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:03.852759 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:03.853231 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:03.854044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:03.854527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:03.988468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:03.995726 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-00879005-2095-4a51-aa11-01521efd34e1 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1390 microversion: 2.1 time: 0.154146 Dec 18 21:52:03.996292 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3994/8036] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:03 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:05.012568 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:05.013181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:05.020254 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:05.020712 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:05.021504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:05.021943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:05.091047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-fa131201-309d-4e5e-985f-2c8bcefe9078 req-939b80eb-ef6c-4d8c-b9c3-9321a228bd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ec0194-cac6-46f6-a18c-b9e363202fed", "name": "network-vif-plugged", "status": "completed", "tag": "e0094e8c-40b7-4d14-84b6-55e6b0defca6"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:05.092685 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:52:05.092685 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:52:05.100062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fa131201-309d-4e5e-985f-2c8bcefe9078 req-939b80eb-ef6c-4d8c-b9c3-9321a228bd6f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:05.100359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-fa131201-309d-4e5e-985f-2c8bcefe9078 req-939b80eb-ef6c-4d8c-b9c3-9321a228bd6f service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:05.114243 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-fa131201-309d-4e5e-985f-2c8bcefe9078 req-939b80eb-ef6c-4d8c-b9c3-9321a228bd6f service nova] Creating event network-vif-plugged:e0094e8c-40b7-4d14-84b6-55e6b0defca6 for instance 06ec0194-cac6-46f6-a18c-b9e363202fed on nch1-master-1 Dec 18 21:52:05.119775 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-fa131201-309d-4e5e-985f-2c8bcefe9078 req-939b80eb-ef6c-4d8c-b9c3-9321a228bd6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088320 Dec 18 21:52:05.120371 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3995/8037] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:52:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:52:05.172441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:05.179784 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c898d81f-297d-4aeb-a3db-2032028bd4a9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1390 microversion: 2.1 time: 0.170990 Dec 18 21:52:05.180367 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4043/8038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:05 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:06.201202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:06.202053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:06.208534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:06.208998 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:06.210063 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:06.210543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:06.346872 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:06.354160 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-50617084-b350-4942-bcc0-4d92c816653d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1390 microversion: 2.1 time: 0.160546 Dec 18 21:52:06.354782 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3996/8039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:06 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:07.371222 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:07.371910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:07.378749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:07.379200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:07.380062 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:07.380503 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:07.516330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:07.523705 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5c017f8-cda9-47a3-9dc0-9cdcd58d8eea tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1563 microversion: 2.1 time: 0.156299 Dec 18 21:52:07.524298 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4044/8040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:07 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:07.539452 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:07.540085 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:07.546801 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:07.547278 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:07.548082 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:07.548546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:07.681984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:07.689889 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8847ae1b-5963-44cd-9c0e-03dc9ac3897d tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1563 microversion: 2.1 time: 0.154100 Dec 18 21:52:07.690490 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3997/8041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:07 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:09.251001 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:09.251617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:09.253326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-58c7f540-cdff-48cc-a6a3-d92b1bc171ee req-34b58b3d-f364-478b-ae9d-edc935ea1698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ec0194-cac6-46f6-a18c-b9e363202fed", "tag": "e0094e8c-40b7-4d14-84b6-55e6b0defca6"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:09.255176 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:52:09.255176 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:52:09.258483 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:09.258944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:09.259741 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:09.260185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:09.264881 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-58c7f540-cdff-48cc-a6a3-d92b1bc171ee req-34b58b3d-f364-478b-ae9d-edc935ea1698 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:09.265645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-58c7f540-cdff-48cc-a6a3-d92b1bc171ee req-34b58b3d-f364-478b-ae9d-edc935ea1698 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:09.278185 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-58c7f540-cdff-48cc-a6a3-d92b1bc171ee req-34b58b3d-f364-478b-ae9d-edc935ea1698 service nova] Creating event network-changed:e0094e8c-40b7-4d14-84b6-55e6b0defca6 for instance 06ec0194-cac6-46f6-a18c-b9e363202fed on nch1-master-1 Dec 18 21:52:09.295628 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-58c7f540-cdff-48cc-a6a3-d92b1bc171ee req-34b58b3d-f364-478b-ae9d-edc935ea1698 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046065 Dec 18 21:52:09.296665 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3998/8042] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:52:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 21:52:09.490437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:09.501382 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d909a967-8545-4a28-82c0-acf2c68e0609 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1563 microversion: 2.1 time: 0.254326 Dec 18 21:52:09.501989 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4045/8043] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:09 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:35.100377 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-653c9832-d94d-4f22-92dc-eefdc0a69ea0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:35.101386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-653c9832-d94d-4f22-92dc-eefdc0a69ea0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:35.108096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-653c9832-d94d-4f22-92dc-eefdc0a69ea0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:35.108570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-653c9832-d94d-4f22-92dc-eefdc0a69ea0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:35.109372 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-653c9832-d94d-4f22-92dc-eefdc0a69ea0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:35.109828 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-653c9832-d94d-4f22-92dc-eefdc0a69ea0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:35.161067 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-653c9832-d94d-4f22-92dc-eefdc0a69ea0 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action" status: 200 len: 24571 microversion: 2.1 time: 0.065531 Dec 18 21:52:35.161641 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 3999/8044] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:52:35 2021] POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:52:46.212898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:46.213472 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:46.220107 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:46.220563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:46.221349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:46.221792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:46.243808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lazy-loading 'flavor' on Instance uuid 06ec0194-cac6-46f6-a18c-b9e363202fed {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:52:46.306957 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8bfc2f50-f4d3-40a9-8aa9-c80b0381f414 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action" status: 202 len: 0 microversion: 2.1 time: 0.098087 Dec 18 21:52:46.307593 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4046/8045] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:52:46 2021] POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:52:46.316263 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:46.316986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:46.324583 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:46.325056 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:46.325867 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:46.326366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:46.460271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:46.468562 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d4898270-98da-46b3-bca7-fa16560e0dd9 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1690 microversion: 2.1 time: 0.156353 Dec 18 21:52:46.469059 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4000/8046] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:46 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:47.487364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:47.488066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:47.494146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:47.494635 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:47.495414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:47.495850 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:47.626660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:47.633959 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-34cec176-847f-492c-8524-e4a8a50e7cf4 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1673 microversion: 2.1 time: 0.152388 Dec 18 21:52:47.634566 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4047/8047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:47 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:48.726660 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52bd2b76-bce5-400b-bb5c-02576f286c50 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:48.727633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52bd2b76-bce5-400b-bb5c-02576f286c50 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:48.735848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52bd2b76-bce5-400b-bb5c-02576f286c50 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:48.736316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52bd2b76-bce5-400b-bb5c-02576f286c50 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:48.737122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52bd2b76-bce5-400b-bb5c-02576f286c50 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:48.737575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52bd2b76-bce5-400b-bb5c-02576f286c50 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:48.786986 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52bd2b76-bce5-400b-bb5c-02576f286c50 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action" status: 200 len: 38301 microversion: 2.1 time: 0.063831 Dec 18 21:52:48.787895 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4001/8048] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:52:48 2021] POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action => generated 38301 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:52:48.799573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-40f1c305-c788-4a30-8070-10e89af065c3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:48.800104 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-40f1c305-c788-4a30-8070-10e89af065c3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:48.807060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40f1c305-c788-4a30-8070-10e89af065c3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:48.807521 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40f1c305-c788-4a30-8070-10e89af065c3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:48.808316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40f1c305-c788-4a30-8070-10e89af065c3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:48.808760 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-40f1c305-c788-4a30-8070-10e89af065c3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:48.878377 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-40f1c305-c788-4a30-8070-10e89af065c3 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action" status: 202 len: 0 microversion: 2.1 time: 0.083076 Dec 18 21:52:48.879020 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4048/8049] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:52:48 2021] POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:52:48.887832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:48.888554 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:48.896126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:48.896638 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:48.897679 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:48.898182 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:49.065216 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:49.072784 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fd3e2d6a-bc7d-48ca-a0b1-371cc24f1211 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1679 microversion: 2.1 time: 0.189078 Dec 18 21:52:49.073583 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4002/8050] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:48 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:50.092484 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:50.093357 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:50.099516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:50.099972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:50.100749 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:50.101185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:50.241217 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:50.249348 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2ce88597-5273-4763-80c4-ae865a1c782b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1679 microversion: 2.1 time: 0.161731 Dec 18 21:52:50.249906 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4049/8051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:50 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:52:51.267194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:51.267810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:51.277899 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:51.278394 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:51.279197 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:51.279649 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:51.409807 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:51.417198 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-8b80bb81-a6d7-4d05-a79f-ca49f8458e12 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1682 microversion: 2.1 time: 0.153895 Dec 18 21:52:51.417784 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4003/8052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:51 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:51.507286 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-88227f29-daa6-45be-bd51-22bede6f168b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:51.508580 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-88227f29-daa6-45be-bd51-22bede6f168b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:51.515447 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88227f29-daa6-45be-bd51-22bede6f168b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:51.515904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88227f29-daa6-45be-bd51-22bede6f168b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:51.516949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88227f29-daa6-45be-bd51-22bede6f168b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:51.517848 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-88227f29-daa6-45be-bd51-22bede6f168b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:51.571866 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-88227f29-daa6-45be-bd51-22bede6f168b tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action" status: 200 len: 38301 microversion: 2.1 time: 0.069367 Dec 18 21:52:51.572534 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4050/8053] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:52:51 2021] POST /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed/action => generated 38301 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 21:52:52.577700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:52.578237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:52.581461 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cd534447-45d9-477a-882a-3548bad9890f req-bb5b1d65-aeb0-4092-8263-2174c771a580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ec0194-cac6-46f6-a18c-b9e363202fed", "tag": "e0094e8c-40b7-4d14-84b6-55e6b0defca6"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:52.583091 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:52:52.583091 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:52:52.585639 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:52.586118 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:52.587185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:52.587657 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:52.592455 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cd534447-45d9-477a-882a-3548bad9890f req-bb5b1d65-aeb0-4092-8263-2174c771a580 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:52.592906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cd534447-45d9-477a-882a-3548bad9890f req-bb5b1d65-aeb0-4092-8263-2174c771a580 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:52.604449 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cd534447-45d9-477a-882a-3548bad9890f req-bb5b1d65-aeb0-4092-8263-2174c771a580 service nova] Creating event network-changed:e0094e8c-40b7-4d14-84b6-55e6b0defca6 for instance 06ec0194-cac6-46f6-a18c-b9e363202fed on nch1-master-1 Dec 18 21:52:52.609332 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cd534447-45d9-477a-882a-3548bad9890f req-bb5b1d65-aeb0-4092-8263-2174c771a580 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033477 Dec 18 21:52:52.610598 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4051/8054] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:52:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:52:52.615042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:52:52.703477 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-58b33439-d6e2-4ad2-bf48-884b8c290c8f tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 204 len: 0 microversion: 2.1 time: 0.130125 Dec 18 21:52:52.704668 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4004/8055] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:52:52 2021] DELETE /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:52:52.714352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:52.715255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:52.723077 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:52.723561 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:52.724361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:52.724799 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:52.941086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:52.948687 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d7221f8a-2ceb-4e9d-85ba-16180c41ca7c tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1688 microversion: 2.1 time: 0.239558 Dec 18 21:52:52.949572 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4052/8056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:52 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:53.967102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:53.968349 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:53.975058 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:53.975523 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:53.976316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:53.976769 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:54.107829 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:54.115877 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fadc09fd-5b28-44e8-8003-7265c07f74fa tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1569 microversion: 2.1 time: 0.152868 Dec 18 21:52:54.116457 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4005/8057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:53 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:54.988358 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-0b81288e-b562-42af-86d0-363edb46227a req-362d7363-0026-4e64-b066-74eba8bc220a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ec0194-cac6-46f6-a18c-b9e363202fed", "name": "network-vif-deleted", "tag": "e0094e8c-40b7-4d14-84b6-55e6b0defca6"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:52:54.989907 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:52:54.989907 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:52:54.997538 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0b81288e-b562-42af-86d0-363edb46227a req-362d7363-0026-4e64-b066-74eba8bc220a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:54.997987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-0b81288e-b562-42af-86d0-363edb46227a req-362d7363-0026-4e64-b066-74eba8bc220a service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:55.010092 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-0b81288e-b562-42af-86d0-363edb46227a req-362d7363-0026-4e64-b066-74eba8bc220a service nova] Creating event network-vif-deleted:e0094e8c-40b7-4d14-84b6-55e6b0defca6 for instance 06ec0194-cac6-46f6-a18c-b9e363202fed on nch1-master-1 Dec 18 21:52:55.014958 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-0b81288e-b562-42af-86d0-363edb46227a req-362d7363-0026-4e64-b066-74eba8bc220a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030624 Dec 18 21:52:55.015567 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4053/8058] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:52:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:52:55.132830 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:55.133454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:55.140134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:55.140561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:55.141359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:55.141846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:55.172897 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:55.173369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:55.173834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lazy-loading 'fault' on Instance uuid 06ec0194-cac6-46f6-a18c-b9e363202fed {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:52:55.213510 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd820a1e45482abb10a2a787bf0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca451d1f26f48f583722f5ed440bf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:52:55.220819 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f166830d-6d60-4ffb-8a7a-89b6fd16d886 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 200 len: 1354 microversion: 2.1 time: 0.091707 Dec 18 21:52:55.221378 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4006/8059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:55 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 1354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:52:56.238677 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:56.239381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] [instance: 06ec0194-cac6-46f6-a18c-b9e363202fed] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:52:56.245492 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:56.245949 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:56.246790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:52:56.247231 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:52:56.260154 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] HTTP exception thrown: Instance 06ec0194-cac6-46f6-a18c-b9e363202fed could not be found. Dec 18 21:52:56.260733 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Returning 404 to user: Instance 06ec0194-cac6-46f6-a18c-b9e363202fed could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:52:56.261548 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b7b77fbf-b1c0-40da-9ff3-1617ea0a7c2e tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed" status: 404 len: 111 microversion: 2.1 time: 0.028406 Dec 18 21:52:56.262069 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4054/8060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:52:56 2021] GET /compute/v2.1/servers/06ec0194-cac6-46f6-a18c-b9e363202fed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:52:59.519207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e8803f6b-648f-4816-8bd4-60af2b8d7310 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] Calling method '.version_select at 0x7f714eec5e50>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:52:59.539356 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e8803f6b-648f-4816-8bd4-60af2b8d7310 tempest-TestNetworkAdvancedServerOps-1712526447 tempest-TestNetworkAdvancedServerOps-1712526447-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-57934208" status: 202 len: 0 microversion: 2.1 time: 0.023821 Dec 18 21:52:59.550882 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4007/8061] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Dec 18 21:52:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-57934208 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 21:53:10.740615 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-625331a2-bb7e-49ba-84f6-bbbb68f5b1b9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'create', calling method: .version_select at 0x7f714e5bc160>, body: {"keypair": {"name": "tempest-TestShelveInstance-128669919"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:53:10.761334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-625331a2-bb7e-49ba-84f6-bbbb68f5b1b9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:53:10.768825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-625331a2-bb7e-49ba-84f6-bbbb68f5b1b9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for user d138402b28b3454aaca10ca070a1f7e7 and project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:53:11.325926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-625331a2-bb7e-49ba-84f6-bbbb68f5b1b9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:53:11.331879 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-625331a2-bb7e-49ba-84f6-bbbb68f5b1b9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for user d138402b28b3454aaca10ca070a1f7e7 and project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:53:11.347952 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-625331a2-bb7e-49ba-84f6-bbbb68f5b1b9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.829034 Dec 18 21:53:11.348886 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4055/8062] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:53:10 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:12.360922 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-503757762", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-128669919", "security_groups": [{"name": "tempest-secgroup-smoke-560277771"}], "networks": [{"uuid": "7019d61b-e45f-4cbe-9b09-e3c79cd43041"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:53:12.471725 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] validate_networks() for [('7019d61b-e45f-4cbe-9b09-e3c79cd43041', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:53:12.861230 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:53:12.861670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:53:12.862159 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:53:12.862608 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:53:12.863199 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:53:12.872324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:12.872788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:12.873709 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:12.874160 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:12.891200 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for project c7e4c296f0144644b9107d08244cb934. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:53:12.896575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for user d138402b28b3454aaca10ca070a1f7e7 and project c7e4c296f0144644b9107d08244cb934. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:53:12.909752 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:53:12.912147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:53:12.957063 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [73c9d55f-f72f-441d-9f06-79bb767f0224] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:53:13.975422 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [73c9d55f-f72f-441d-9f06-79bb767f0224] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48386. Dec 18 21:53:13.980138 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d6685c9d-37b1-46d9-9a51-71a5dc19663e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.624596 Dec 18 21:53:13.980985 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4008/8063] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:53:12 2021] POST /compute/v2.1/servers => generated 405 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:53:13.992258 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d7a4086b-2fa4-4a07-9bc9-3729c1742e36 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:13.992875 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d7a4086b-2fa4-4a07-9bc9-3729c1742e36 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:14.045709 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d7a4086b-2fa4-4a07-9bc9-3729c1742e36 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:14.052496 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d7a4086b-2fa4-4a07-9bc9-3729c1742e36 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1245 microversion: 2.1 time: 0.064755 Dec 18 21:53:14.053020 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4056/8064] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:13 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:53:15.070926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3fa5c945-a13c-4933-867d-4800ef060616 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:15.071569 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3fa5c945-a13c-4933-867d-4800ef060616 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:15.123751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3fa5c945-a13c-4933-867d-4800ef060616 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:15.131254 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3fa5c945-a13c-4933-867d-4800ef060616 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1245 microversion: 2.1 time: 0.064181 Dec 18 21:53:15.131254 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4009/8065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:15 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1245 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:16.147602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fd0aa827-99ac-48dd-8f7c-4812dbe243d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:16.148437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fd0aa827-99ac-48dd-8f7c-4812dbe243d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:16.203660 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fd0aa827-99ac-48dd-8f7c-4812dbe243d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:16.210920 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fd0aa827-99ac-48dd-8f7c-4812dbe243d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1245 microversion: 2.1 time: 0.067786 Dec 18 21:53:16.211534 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4057/8066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:16 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:17.228185 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9fd70e65-8c19-4a2c-abbf-9f1b11d322ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:17.228816 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9fd70e65-8c19-4a2c-abbf-9f1b11d322ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:17.281450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9fd70e65-8c19-4a2c-abbf-9f1b11d322ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:17.288724 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9fd70e65-8c19-4a2c-abbf-9f1b11d322ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1245 microversion: 2.1 time: 0.064243 Dec 18 21:53:17.289298 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4010/8067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:17 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1245 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:18.306031 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:18.306720 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:18.314180 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:18.314668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:18.315466 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:18.316028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:18.376641 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:18.384186 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-697c9cd6-2887-4a97-b748-bb4fc4f34a23 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1249 microversion: 2.1 time: 0.081961 Dec 18 21:53:18.384768 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4058/8068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:18 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:19.400677 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:19.401302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:19.408055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:19.408521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:19.409546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:19.409995 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:19.476547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:19.483983 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f2a207b5-d80e-44a0-a9e2-18865f9919be tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1303 microversion: 2.1 time: 0.087019 Dec 18 21:53:19.493648 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4011/8069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:19 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:20.290774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-d67f7032-55c7-4b8c-be7b-e4861abbf66f req-8b005308-f9c9-4173-93e4-6a34749c2b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:53:20.293573 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:53:20.293573 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:53:20.312495 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d67f7032-55c7-4b8c-be7b-e4861abbf66f req-8b005308-f9c9-4173-93e4-6a34749c2b85 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:20.315055 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-d67f7032-55c7-4b8c-be7b-e4861abbf66f req-8b005308-f9c9-4173-93e4-6a34749c2b85 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:20.330666 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-d67f7032-55c7-4b8c-be7b-e4861abbf66f req-8b005308-f9c9-4173-93e4-6a34749c2b85 service nova] Creating event network-changed:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch2-master-1 Dec 18 21:53:20.337828 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-d67f7032-55c7-4b8c-be7b-e4861abbf66f req-8b005308-f9c9-4173-93e4-6a34749c2b85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050420 Dec 18 21:53:20.339665 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4059/8070] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:53:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:53:20.501312 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:20.501943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:20.508849 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:20.509315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:20.510150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:20.510658 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:20.645611 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:20.653282 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0028b825-a088-449b-8839-f338a6a451e5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1370 microversion: 2.1 time: 0.156289 Dec 18 21:53:20.653855 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4012/8071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:20 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:21.670805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:21.671520 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:21.678432 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:21.678894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:21.679687 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:21.680126 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:21.815408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:21.823087 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-1bbeaac4-68ce-45a9-889e-2944c5d2894c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1370 microversion: 2.1 time: 0.156589 Dec 18 21:53:21.823664 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4060/8072] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:21 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:22.840911 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:22.841535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:22.848391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:22.848858 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:22.849652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:22.850103 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:22.984379 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:22.991776 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-390ebb61-f14a-47a2-844d-cfc0da0964e8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1370 microversion: 2.1 time: 0.154861 Dec 18 21:53:22.992375 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4013/8073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:22 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:24.007525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:24.008070 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:24.014189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:24.014685 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:24.015458 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:24.015894 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:24.145191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:24.152484 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4fa18f5e-cb8d-45ae-9301-2190dc527c49 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1370 microversion: 2.1 time: 0.148835 Dec 18 21:53:24.153042 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4061/8074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:24 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:25.169334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:25.170120 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:25.177051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:25.177525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:25.178964 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:25.179439 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:25.319840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:25.327266 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c7e7d073-0f53-4801-8b16-b93fac56f537 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1370 microversion: 2.1 time: 0.161597 Dec 18 21:53:25.327835 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4014/8075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:25 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:26.344243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:26.344888 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:26.351654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:26.352114 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:26.352908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:26.353355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:26.481801 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:26.489673 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8b891f06-e3d5-47a9-b236-2566e77c887b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1370 microversion: 2.1 time: 0.149305 Dec 18 21:53:26.490274 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4062/8076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:26 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:27.165757 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6b55d2c9-2cc5-4683-9f50-2ee1a7278456 req-ae97bdda-1ee3-4030-910c-e0b5bae4cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "name": "network-vif-plugged", "status": "completed", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:53:27.167495 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:53:27.167495 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:53:27.177187 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6b55d2c9-2cc5-4683-9f50-2ee1a7278456 req-ae97bdda-1ee3-4030-910c-e0b5bae4cf11 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:27.177654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6b55d2c9-2cc5-4683-9f50-2ee1a7278456 req-ae97bdda-1ee3-4030-910c-e0b5bae4cf11 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:27.190102 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6b55d2c9-2cc5-4683-9f50-2ee1a7278456 req-ae97bdda-1ee3-4030-910c-e0b5bae4cf11 service nova] Creating event network-vif-plugged:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch2-master-1 Dec 18 21:53:27.195293 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6b55d2c9-2cc5-4683-9f50-2ee1a7278456 req-ae97bdda-1ee3-4030-910c-e0b5bae4cf11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033219 Dec 18 21:53:27.195877 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4015/8077] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:53:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:53:27.506542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:27.507191 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:27.513966 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:27.515011 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:27.515805 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:27.516251 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:27.659789 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:27.667842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e7dc7334-b737-40e2-ba5f-ba5a2b7b3182 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1370 microversion: 2.1 time: 0.165004 Dec 18 21:53:27.668415 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4063/8078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:27 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:28.684961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:28.685695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:28.692644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:28.693111 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:28.693908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:28.694386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:28.828576 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:28.836316 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b7729386-8e24-424b-9bd5-eb0b350e10c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1555 microversion: 2.1 time: 0.155455 Dec 18 21:53:28.836894 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4016/8079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:28 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:28.853168 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:53:28.853807 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:53:28.860434 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:28.860891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:28.861680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:28.862118 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:28.990148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:53:28.997594 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e1528d2b-2bfd-4b8b-a3b2-715c665d9322 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1555 microversion: 2.1 time: 0.148225 Dec 18 21:53:28.998168 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4064/8080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:53:28 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:53:30.954444 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-345facc5-0449-4da9-ad87-df08f8b0ca11 req-660ae370-8e42-4183-bfee-7ed44e129f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:53:30.956767 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:53:30.956767 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:53:30.965366 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-345facc5-0449-4da9-ad87-df08f8b0ca11 req-660ae370-8e42-4183-bfee-7ed44e129f93 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:53:30.965834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-345facc5-0449-4da9-ad87-df08f8b0ca11 req-660ae370-8e42-4183-bfee-7ed44e129f93 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:53:30.977978 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-345facc5-0449-4da9-ad87-df08f8b0ca11 req-660ae370-8e42-4183-bfee-7ed44e129f93 service nova] Creating event network-changed:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch2-master-1 Dec 18 21:53:30.983153 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-345facc5-0449-4da9-ad87-df08f8b0ca11 req-660ae370-8e42-4183-bfee-7ed44e129f93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032532 Dec 18 21:53:30.983810 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4017/8081] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:53:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:54:59.260458 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:54:59.261085 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:54:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:55:26.289262 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f82efa99-2048-43b1-87fb-668518ca915b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 18 21:55:26.290015 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d65e2c3a-bf34-479d-be5a-5182256b434e] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 18 21:55:26.293851 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:55:26.294431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:26.301038 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:26.301485 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:26.302283 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:26.302715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:26.324598 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lazy-loading 'flavor' on Instance uuid 2220e203-c690-4074-ace5-d0fcf7d86b9f {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:55:26.760381 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-65d62305-37bc-45a5-bc9f-bc7e1f158d60 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f/action" status: 202 len: 0 microversion: 2.1 time: 0.472695 Dec 18 21:55:26.761008 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4065/8082] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:55:26 2021] POST /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:55:26.768047 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:55:26.768896 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:55:26.772857 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:26.773573 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:26.779689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:26.780190 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:26.781000 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:26.781468 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:26.979774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:26.987254 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-ea17816c-3a13-4270-bddc-d3d5cd2b3595 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.221078 Dec 18 21:55:26.987844 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4018/8083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:26 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:28.024303 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:28.025009 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:28.034790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:28.035249 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:28.036037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:28.036477 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:28.037688 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] [d65e2c3a-bf34-479d-be5a-5182256b434e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48560. Dec 18 21:55:28.040624 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] [f82efa99-2048-43b1-87fb-668518ca915b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48558. Dec 18 21:55:28.175089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:28.182472 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-254ad764-530c-4a76-8c0b-8a5a602c42de tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.182364 Dec 18 21:55:28.183040 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4066/8084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:27 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:29.199652 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:29.200276 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:29.230095 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:29.230636 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:29.231450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:29.231940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:29.239312 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48566. Dec 18 21:55:29.240048 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48564. Dec 18 21:55:29.364787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:29.372180 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7a1a6ba1-419b-4c2a-97e5-5fd872d058d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.176560 Dec 18 21:55:29.372754 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4019/8085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:29 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:30.388814 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:30.389456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:30.396454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:30.396909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:30.397690 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:30.398124 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:30.533348 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:30.540650 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5290ed6b-abd1-412c-b898-743a131adede tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.155660 Dec 18 21:55:30.541208 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4067/8086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:30 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:31.557912 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:31.558504 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:31.565802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:31.566282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:31.567093 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:31.567548 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:31.697208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:31.704647 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-52e5729a-c6a4-403b-8079-b680cf7104a8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.150596 Dec 18 21:55:31.705219 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4020/8087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:31 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:32.720758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:32.721365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:32.727995 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:32.728449 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:32.729218 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:32.729654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:32.864246 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:32.871568 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccbfcf82-4dca-4ceb-83c2-ee1ca6c65b19 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.154598 Dec 18 21:55:32.872142 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4068/8088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:32 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:33.888914 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:33.889546 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:33.896987 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:33.897456 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:33.898280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:33.898742 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:34.027714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:34.035063 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-29135d6e-8137-4db4-9de2-3af9e82350fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.149951 Dec 18 21:55:34.035631 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4021/8089] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:33 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:35.052317 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:35.052960 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:35.059769 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:35.060225 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:35.061012 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:35.061454 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:35.191544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:35.198914 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-9f9be1e4-1657-433c-8c62-30ce8a6d1481 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.150867 Dec 18 21:55:35.199525 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4069/8090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:35 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:36.216090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:36.216713 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:36.223561 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:36.224021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:36.224818 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:36.225269 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:36.356714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:36.364049 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1056f364-8e9c-4b32-ae01-7d754ac87a69 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.151712 Dec 18 21:55:36.364616 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4022/8091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:36 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:37.380566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:37.381189 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:37.387891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:37.388346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:37.389130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:37.389573 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:37.519389 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:37.526755 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-51644b40-9728-4f43-a560-b7875d46a9c0 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1701 microversion: 2.1 time: 0.150001 Dec 18 21:55:37.527456 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4070/8092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:37 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1701 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:38.543990 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:38.544622 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:38.551463 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:38.551955 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:38.552753 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:38.553215 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:38.685893 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:38.694215 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5e87a243-3d9f-4dde-aad1-d80554b9062b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1701 microversion: 2.1 time: 0.153979 Dec 18 21:55:38.694821 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4023/8093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:38 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:39.712604 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:39.713607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:39.721965 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:39.722453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:39.723821 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:39.724577 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:39.899898 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:39.909732 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3376b0e-3861-4d7f-b245-08b6a912a041 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.201825 Dec 18 21:55:39.919846 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4071/8094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:39 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:40.928062 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:40.928701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:40.935940 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:40.936758 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:40.937630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:40.938090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:41.105630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:41.115916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11382987-9ed3-404a-8e87-dd56206c3987 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.191415 Dec 18 21:55:41.116762 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4024/8095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:40 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:41.737902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-fe7be5d5-6feb-4ab4-94e8-d98b3c686853 req-782a1120-6b8c-4196-98dc-427c515b69d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "name": "network-vif-plugged", "status": "completed", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:55:41.740548 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:55:41.740548 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:55:41.760990 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fe7be5d5-6feb-4ab4-94e8-d98b3c686853 req-782a1120-6b8c-4196-98dc-427c515b69d6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:41.761436 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-fe7be5d5-6feb-4ab4-94e8-d98b3c686853 req-782a1120-6b8c-4196-98dc-427c515b69d6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:41.783842 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-fe7be5d5-6feb-4ab4-94e8-d98b3c686853 req-782a1120-6b8c-4196-98dc-427c515b69d6 service nova] Creating event network-vif-plugged:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch2-master-1 Dec 18 21:55:41.789721 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-fe7be5d5-6feb-4ab4-94e8-d98b3c686853 req-782a1120-6b8c-4196-98dc-427c515b69d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056754 Dec 18 21:55:41.790695 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4072/8096] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:55:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:55:42.134315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:42.134937 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:42.142065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:42.142884 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:42.144280 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:42.144827 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:42.300727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:42.309483 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d2034ab-2fba-4195-a2db-fa4dca2cf73e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.178736 Dec 18 21:55:42.309989 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4025/8097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:42 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:43.327310 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:43.328648 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:43.341614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:43.344119 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:43.345751 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:43.346489 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:43.502334 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:43.510389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f5284f5b-8f6f-41cb-bc4a-07bafb978055 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.187093 Dec 18 21:55:43.520643 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4073/8098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:43 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:44.527149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:44.527948 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:44.535237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:44.535704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:44.536527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:44.536950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:44.720950 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:44.729782 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-82f193da-3f75-4b17-ba02-4a5db9331c96 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.206325 Dec 18 21:55:44.739529 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4026/8099] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:44 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:45.746957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:45.747822 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:45.756996 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:45.757662 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:45.758527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:45.759004 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:45.906657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:45.914311 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-481179b6-2bc2-4f51-92f8-e59f8566f731 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.170982 Dec 18 21:55:45.914898 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4074/8100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:45 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:46.931470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:46.932251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:46.940324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:46.940324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:46.940814 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:46.941357 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:47.094869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:47.103508 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b57ab0b3-a6e6-4ddb-b6ce-a38bd8b753c9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.175666 Dec 18 21:55:47.114273 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4027/8101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:46 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:48.121198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:48.121809 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:48.129085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:48.129542 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:48.130352 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:48.130792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:48.263417 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:48.271734 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cdb5f799-7fce-4493-a8e8-782558ed59d3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1696 microversion: 2.1 time: 0.154132 Dec 18 21:55:48.272275 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4075/8102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:48 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:49.289007 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:49.289556 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:49.296391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:49.296906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:49.297704 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:49.298154 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:49.426581 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:49.433878 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-874ea81a-290c-43cf-aa70-1ad659b048c8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1678 microversion: 2.1 time: 0.148880 Dec 18 21:55:49.434473 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4028/8103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:49 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:50.451148 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:50.451780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:50.458478 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:50.458927 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:50.459702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:50.460394 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:50.601646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:50.609616 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6791bb18-590d-4427-8045-ba12a536775c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1678 microversion: 2.1 time: 0.162232 Dec 18 21:55:50.610768 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4076/8104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:50 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:51.626425 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:51.627047 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:51.633750 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:51.634206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:51.635065 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:51.635517 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:51.689921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-f5b2b6c7-d696-430e-99a2-ade34d664b7f req-8d9a8778-dea8-4c12-a017-8aedf6702433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "name": "network-vif-unplugged", "status": "completed", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:55:51.691489 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:55:51.691489 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:55:51.699702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f5b2b6c7-d696-430e-99a2-ade34d664b7f req-8d9a8778-dea8-4c12-a017-8aedf6702433 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:51.700183 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-f5b2b6c7-d696-430e-99a2-ade34d664b7f req-8d9a8778-dea8-4c12-a017-8aedf6702433 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:51.712923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.server_external_events [req-f5b2b6c7-d696-430e-99a2-ade34d664b7f req-8d9a8778-dea8-4c12-a017-8aedf6702433 service nova] Unable to find a host for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f. Dropping event network-vif-unplugged {{(pid=140732) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 18 21:55:51.714175 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-f5b2b6c7-d696-430e-99a2-ade34d664b7f req-8d9a8778-dea8-4c12-a017-8aedf6702433 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028198 Dec 18 21:55:51.715380 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4077/8105] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:55:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 18 21:55:51.775812 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:51.784455 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3e3ce898-fcfc-40b8-a974-a659bbdfd594 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1621 microversion: 2.1 time: 0.161880 Dec 18 21:55:51.785035 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4029/8106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:51 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1621 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:51.801437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-57b0bd0c-599f-4106-9b18-ba939733e468 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:55:51.802014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-57b0bd0c-599f-4106-9b18-ba939733e468 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:51.808372 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57b0bd0c-599f-4106-9b18-ba939733e468 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:51.808863 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57b0bd0c-599f-4106-9b18-ba939733e468 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:51.809659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57b0bd0c-599f-4106-9b18-ba939733e468 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:51.810106 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-57b0bd0c-599f-4106-9b18-ba939733e468 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:51.899596 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-57b0bd0c-599f-4106-9b18-ba939733e468 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f/action" status: 202 len: 0 microversion: 2.1 time: 0.101950 Dec 18 21:55:51.900547 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4078/8107] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:55:51 2021] POST /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:55:51.908403 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:51.909041 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:51.915408 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:51.916485 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:51.916745 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:51.917105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:52.057264 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:52.065703 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2a81b462-a440-43f8-9a44-424c84ff2fc2 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1629 microversion: 2.1 time: 0.160980 Dec 18 21:55:52.066448 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4030/8108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:51 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1629 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:53.084188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:53.084795 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:53.090917 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:53.091365 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:53.092142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:53.092578 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:53.376695 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:53.384269 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-34c90e76-32eb-43e5-b4ba-ac3a1a4e06d4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.304601 Dec 18 21:55:53.384930 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4079/8109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:53 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:54.023259 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-26959fb6-d808-4308-854b-9a916e1ea84a req-2c6a9170-6408-4108-99f8-02cfa8b453f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:55:54.024823 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:55:54.024823 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:55:54.032738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-26959fb6-d808-4308-854b-9a916e1ea84a req-2c6a9170-6408-4108-99f8-02cfa8b453f2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:54.033206 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-26959fb6-d808-4308-854b-9a916e1ea84a req-2c6a9170-6408-4108-99f8-02cfa8b453f2 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:54.044853 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-26959fb6-d808-4308-854b-9a916e1ea84a req-2c6a9170-6408-4108-99f8-02cfa8b453f2 service nova] Creating event network-changed:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch1-master-1 Dec 18 21:55:54.050094 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-26959fb6-d808-4308-854b-9a916e1ea84a req-2c6a9170-6408-4108-99f8-02cfa8b453f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103475 Dec 18 21:55:54.050818 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4031/8110] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:55:54.411275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:54.412261 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:54.419075 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:54.419525 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:54.420346 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:54.420786 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:54.583076 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:54.590997 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6067e2e5-5e6d-402f-8690-1e609f7e0455 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.192065 Dec 18 21:55:54.591576 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4080/8111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:54 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:55.609345 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:55.610053 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:55.617051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:55.617525 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:55.618360 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:55.618820 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:55.764196 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:55.772628 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-98bd46e7-7c10-48b4-8471-d138a1e6d895 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.168188 Dec 18 21:55:55.773509 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4032/8112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:55 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:56.790504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:56.791188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:56.798439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:56.798904 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:56.799702 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:56.800143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:56.935457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:56.943233 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-fe79336e-07d6-487a-bee9-9aa30e0b063f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.156625 Dec 18 21:55:56.944037 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4081/8113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:56 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:57.961429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:57.962014 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:57.968738 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:57.969161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:57.970023 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:57.970498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:58.114174 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:58.122019 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-9ca1cbe4-035e-4e72-a3d7-8997d607766b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.164677 Dec 18 21:55:58.122944 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4033/8114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:57 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:55:59.139595 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:55:59.140311 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:55:59.146844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:59.147300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:59.148082 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:55:59.148518 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:55:59.288964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:55:59.296495 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d25bbaef-35f7-490a-aee7-89548108fd07 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.160825 Dec 18 21:55:59.297068 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4082/8115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:55:59 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:00.312790 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:00.313383 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:00.320018 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:00.320524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:00.321337 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:00.321793 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:00.462178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:00.469916 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1e6f71e1-5ef9-4a6d-aae1-fea13381a758 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.160906 Dec 18 21:56:00.471177 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4034/8116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:00 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:01.488219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:01.489281 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:01.496160 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:01.496617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:01.497408 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:01.497844 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:01.639308 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:01.647151 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6549590e-768f-4133-a245-9d2837058b4a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.163048 Dec 18 21:56:01.648024 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4083/8117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:01 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:02.664404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:02.665135 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:02.672091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:02.672564 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:02.674318 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:02.674785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:02.831013 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:02.838866 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-3d7906fc-ade3-40df-a987-91e39ca6474a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.178100 Dec 18 21:56:02.839459 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4035/8118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:02 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:03.856950 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:03.857616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:03.866976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:03.867431 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:03.868243 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:03.868688 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:04.010856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:04.019331 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7a54faab-b812-4eb7-b2d2-78824c917a5b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.166418 Dec 18 21:56:04.024445 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4084/8119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:03 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:05.035483 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:05.036068 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:05.042971 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:05.043536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:05.044347 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:05.044813 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:05.177245 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:05.184732 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1de4d8b7-c6eb-4e97-820c-590eb05f1f06 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.153097 Dec 18 21:56:05.185306 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4036/8120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:05 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:06.202096 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:06.202728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:06.210448 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:06.210908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:06.211909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:06.212200 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:06.342571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:06.349988 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3c9b56e6-c34d-4347-95d6-03491fbbb50c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.151658 Dec 18 21:56:06.350590 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4085/8121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:06 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:07.366692 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:07.367324 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:07.374069 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:07.374584 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:07.375390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:07.375851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:07.509443 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:07.517261 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-42b08c22-ee51-451c-a9bc-54a2021dea16 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.153887 Dec 18 21:56:07.517855 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4037/8122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:07 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:08.535102 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:08.539237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:08.546382 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:08.546845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:08.547646 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:08.548083 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:08.680804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:08.688274 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df5a8ac1-3029-4726-867b-f587d02c97b8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.157879 Dec 18 21:56:08.688850 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4086/8123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:08 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:09.705136 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:09.706353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:09.713449 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:09.713926 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:09.714755 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:09.715213 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:09.845962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:09.853302 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-36f41cea-cf68-4cea-ac2c-6a036bab97f7 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.151915 Dec 18 21:56:09.853871 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4038/8124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:09 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:10.101121 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-35c000db-352a-4e0b-85ef-647a3b656bc6 req-15039642-26de-422b-a515-95a96aae7bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "name": "network-vif-plugged", "status": "completed", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:56:10.102652 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:56:10.102652 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 21:56:10.111127 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-35c000db-352a-4e0b-85ef-647a3b656bc6 req-15039642-26de-422b-a515-95a96aae7bc3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:10.111555 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-35c000db-352a-4e0b-85ef-647a3b656bc6 req-15039642-26de-422b-a515-95a96aae7bc3 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:10.123521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-35c000db-352a-4e0b-85ef-647a3b656bc6 req-15039642-26de-422b-a515-95a96aae7bc3 service nova] Creating event network-vif-plugged:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch1-master-1 Dec 18 21:56:10.129052 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-35c000db-352a-4e0b-85ef-647a3b656bc6 req-15039642-26de-422b-a515-95a96aae7bc3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Dec 18 21:56:10.129651 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4087/8125] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:56:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:56:10.872285 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:10.873465 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:10.881020 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:10.881492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:10.882321 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:10.882787 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:11.012267 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:11.019682 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-1f302fc0-cf71-4765-ae17-486cb183d9a1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.152188 Dec 18 21:56:11.020253 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4039/8126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:10 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:12.037897 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:12.038628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:12.044847 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:12.045302 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:12.046085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:12.046550 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:12.188910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:12.196871 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cae1c0da-fab0-40fb-bbfb-db2be441740a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1687 microversion: 2.1 time: 0.163946 Dec 18 21:56:12.197443 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4088/8127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:12 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:56:13.214543 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:56:13.215168 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:56:13.221888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:13.222390 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:13.223193 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:56:13.223654 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:56:13.352617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:56:13.360007 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d48c41f3-3383-4192-b110-ef6528cf19ca tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1674 microversion: 2.1 time: 0.149493 Dec 18 21:56:13.360579 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4040/8128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:56:13 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:27.724151 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:27.724659 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:27.731086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:27.731616 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:27.736736 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:27.737331 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:27.763602 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 21:57:27.792294 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-85212dd4-b818-4739-b14c-b4859b9442be req-b3220cb4-58d9-4eca-a704-1bcd63eed46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:57:27.793879 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:57:27.793879 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:57:27.801700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-85212dd4-b818-4739-b14c-b4859b9442be req-b3220cb4-58d9-4eca-a704-1bcd63eed46c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:27.802244 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-85212dd4-b818-4739-b14c-b4859b9442be req-b3220cb4-58d9-4eca-a704-1bcd63eed46c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:27.815388 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-85212dd4-b818-4739-b14c-b4859b9442be req-b3220cb4-58d9-4eca-a704-1bcd63eed46c service nova] Creating event network-changed:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch1-master-1 Dec 18 21:57:27.821374 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-85212dd4-b818-4739-b14c-b4859b9442be req-b3220cb4-58d9-4eca-a704-1bcd63eed46c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101777 Dec 18 21:57:27.822327 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4041/8129] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:57:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:57:27.851390 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ccd2cc3c-9987-4f6e-9f1b-f5d7511ebff3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 204 len: 0 microversion: 2.1 time: 0.135084 Dec 18 21:57:27.851996 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4089/8130] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:57:27 2021] DELETE /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 21:57:27.861873 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:27.862938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:27.869840 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:27.870670 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:27.871521 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:27.872121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:28.129943 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:28.137645 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f38228ef-607f-4d9f-b4c4-facb90809564 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1680 microversion: 2.1 time: 0.280879 Dec 18 21:57:28.138365 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4042/8131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:27 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1680 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:29.155906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:29.156614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:29.163353 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:29.163804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:29.164587 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:29.165025 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:29.297032 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:29.304503 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-36913e3b-d6eb-4d2b-9873-60eaaa94a514 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1561 microversion: 2.1 time: 0.152743 Dec 18 21:57:29.305079 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4090/8132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:29 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:30.006509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-9db8a204-4b10-4df1-b224-3e00e34d53da req-da23aa6f-64c9-43a2-aac7-86400229add5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2220e203-c690-4074-ace5-d0fcf7d86b9f", "name": "network-vif-deleted", "tag": "c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:57:30.008624 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:57:30.008624 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:57:30.015854 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9db8a204-4b10-4df1-b224-3e00e34d53da req-da23aa6f-64c9-43a2-aac7-86400229add5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:30.016314 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-9db8a204-4b10-4df1-b224-3e00e34d53da req-da23aa6f-64c9-43a2-aac7-86400229add5 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:30.027211 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-9db8a204-4b10-4df1-b224-3e00e34d53da req-da23aa6f-64c9-43a2-aac7-86400229add5 service nova] Creating event network-vif-deleted:c29564e0-45c4-4dc7-94f6-c9ec6a4b3d83 for instance 2220e203-c690-4074-ace5-d0fcf7d86b9f on nch1-master-1 Dec 18 21:57:30.032334 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-9db8a204-4b10-4df1-b224-3e00e34d53da req-da23aa6f-64c9-43a2-aac7-86400229add5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030218 Dec 18 21:57:30.033032 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4043/8133] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:57:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:57:30.321628 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:30.322267 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:30.329534 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:30.329992 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:30.330825 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:30.331270 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:30.365586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:30.366037 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:30.366513 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lazy-loading 'fault' on Instance uuid 2220e203-c690-4074-ace5-d0fcf7d86b9f {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:57:30.407245 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:30.415590 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f313db8-1d48-43aa-954b-a76d63d1f014 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 200 len: 1335 microversion: 2.1 time: 0.097711 Dec 18 21:57:30.416177 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4091/8134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:30 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:31.434322 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:31.435033 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 2220e203-c690-4074-ace5-d0fcf7d86b9f] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:31.441221 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:31.442362 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:31.443161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:31.443612 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:31.456464 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] HTTP exception thrown: Instance 2220e203-c690-4074-ace5-d0fcf7d86b9f could not be found. Dec 18 21:57:31.457052 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Returning 404 to user: Instance 2220e203-c690-4074-ace5-d0fcf7d86b9f could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 21:57:31.457874 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-72be81d3-bdcf-48ab-910b-db1b5a68470b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f" status: 404 len: 111 microversion: 2.1 time: 0.028812 Dec 18 21:57:31.458418 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4044/8135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:31 2021] GET /compute/v2.1/servers/2220e203-c690-4074-ace5-d0fcf7d86b9f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 21:57:31.609790 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4f1f9a1e-2425-48d0-b7f7-2aa5abe2e81b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '.version_select at 0x7f714eb5ab80>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:31.613063 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f1f9a1e-2425-48d0-b7f7-2aa5abe2e81b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [5b6f3c36-0c9c-4fc0-ba3d-c0c9b564b8db] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:57:32.629748 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f1f9a1e-2425-48d0-b7f7-2aa5abe2e81b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [5b6f3c36-0c9c-4fc0-ba3d-c0c9b564b8db] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48866. Dec 18 21:57:32.648635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4f1f9a1e-2425-48d0-b7f7-2aa5abe2e81b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-128669919" status: 202 len: 0 microversion: 2.1 time: 1.042605 Dec 18 21:57:32.649212 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4092/8136] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:57:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-128669919 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:57:32.670826 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11198639-142a-4e25-9716-0cc3034093f8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'create', calling method: .version_select at 0x7f714ef7c940>, body: {"keypair": {"name": "tempest-TestShelveInstance-416481949"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:57:32.688316 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-11198639-142a-4e25-9716-0cc3034093f8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:57:32.693723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-11198639-142a-4e25-9716-0cc3034093f8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for user d138402b28b3454aaca10ca070a1f7e7 and project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:57:32.937205 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-11198639-142a-4e25-9716-0cc3034093f8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:57:32.942575 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-11198639-142a-4e25-9716-0cc3034093f8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for user d138402b28b3454aaca10ca070a1f7e7 and project c7e4c296f0144644b9107d08244cb934. Resources: {'key_pairs'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:57:32.956370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11198639-142a-4e25-9716-0cc3034093f8 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.289319 Dec 18 21:57:32.957006 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4045/8137] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 21:57:32 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:35.334557 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-943076303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-416481949", "security_groups": [{"name": "tempest-secgroup-smoke-854805613"}], "networks": [{"uuid": "7019d61b-e45f-4cbe-9b09-e3c79cd43041"}], "block_device_mapping_v2": [{"uuid": "1ed2a9ae-e3d5-4846-a4c8-250597c52197", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:57:35.740255 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.network.neutron [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] validate_networks() for [('7019d61b-e45f-4cbe-9b09-e3c79cd43041', None, None, None, None, None)] {{(pid=140732) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 21:57:36.155540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Flavor limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 21:57:36.155963 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Image limits 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 21:57:36.156437 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Flavor pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 21:57:36.156845 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Image pref 0:0:0 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 21:57:36.157256 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.virt.hardware [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 21:57:36.165823 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:36.166304 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:36.167163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:36.167605 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:36.184022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for project c7e4c296f0144644b9107d08244cb934. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 21:57:36.188947 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Getting quotas for user d138402b28b3454aaca10ca070a1f7e7 and project c7e4c296f0144644b9107d08244cb934. Resources: {'instances', 'cores', 'ram'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 21:57:36.244142 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Going to run 1 instances... {{(pid=140732) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 21:57:36.246347 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ed2a9ae-e3d5-4846-a4c8-250597c52197',volume_size=None,volume_type=None)] {{(pid=140732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 21:57:36.368884 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bd369e1a-a7f1-4ce9-a862-b927fdc98f1f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.039460 Dec 18 21:57:36.369804 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4093/8138] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:57:35 2021] POST /compute/v2.1/servers => generated 405 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 21:57:36.380282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fca9b274-d8af-4afe-aaa2-0e8c166db268 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:36.380920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fca9b274-d8af-4afe-aaa2-0e8c166db268 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:36.432651 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fca9b274-d8af-4afe-aaa2-0e8c166db268 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:36.439234 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fca9b274-d8af-4afe-aaa2-0e8c166db268 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1087 microversion: 2.1 time: 0.063703 Dec 18 21:57:36.439801 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4046/8139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:36 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:37.456590 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eea690a6-86ae-4bd6-8a9f-20aa10053dc6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:37.457197 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eea690a6-86ae-4bd6-8a9f-20aa10053dc6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:37.508974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eea690a6-86ae-4bd6-8a9f-20aa10053dc6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:37.515638 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eea690a6-86ae-4bd6-8a9f-20aa10053dc6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1087 microversion: 2.1 time: 0.063634 Dec 18 21:57:37.516218 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4094/8140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:37 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:38.531864 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-14cb2b9f-8476-4e9d-9384-f28afff2bdb4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:38.532488 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-14cb2b9f-8476-4e9d-9384-f28afff2bdb4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:38.585961 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-14cb2b9f-8476-4e9d-9384-f28afff2bdb4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:38.593014 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-14cb2b9f-8476-4e9d-9384-f28afff2bdb4 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1087 microversion: 2.1 time: 0.064964 Dec 18 21:57:38.593582 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4047/8141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:38 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:39.609676 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-bc29d39c-cfb0-4137-9ef4-6fac2585bf7e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:39.610292 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-bc29d39c-cfb0-4137-9ef4-6fac2585bf7e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:39.661623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-bc29d39c-cfb0-4137-9ef4-6fac2585bf7e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:39.668127 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-bc29d39c-cfb0-4137-9ef4-6fac2585bf7e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1087 microversion: 2.1 time: 0.062219 Dec 18 21:57:39.668693 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4095/8142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:39 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1087 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:40.684644 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:40.685270 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:40.692701 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:40.693177 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:40.693976 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:40.694474 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:40.757454 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:40.764768 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-4ab509af-e304-4c43-a60b-ff846c5f0ba5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1137 microversion: 2.1 time: 0.083915 Dec 18 21:57:40.765335 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4048/8143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:40 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:41.781861 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:41.782488 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:41.790309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:41.790778 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:41.791572 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:41.792014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:41.853508 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:41.861166 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cd81a7da-4a9f-4664-a4c1-089cd40dc85c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1203 microversion: 2.1 time: 0.084047 Dec 18 21:57:41.861753 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4096/8144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:41 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1203 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:42.724429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-f3f1fc06-bcb4-4c2f-8fd5-7d64cd95a6fd req-27ef24d9-b944-4405-b324-3420099f9032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:57:42.726011 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:57:42.726011 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:57:42.736084 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f3f1fc06-bcb4-4c2f-8fd5-7d64cd95a6fd req-27ef24d9-b944-4405-b324-3420099f9032 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:42.736582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-f3f1fc06-bcb4-4c2f-8fd5-7d64cd95a6fd req-27ef24d9-b944-4405-b324-3420099f9032 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:42.760125 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-f3f1fc06-bcb4-4c2f-8fd5-7d64cd95a6fd req-27ef24d9-b944-4405-b324-3420099f9032 service nova] Creating event network-changed:dbf46913-d2a9-4d87-a2a9-c259e2feeb2a for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b on nch2-master-1 Dec 18 21:57:42.770227 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-f3f1fc06-bcb4-4c2f-8fd5-7d64cd95a6fd req-27ef24d9-b944-4405-b324-3420099f9032 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047163 Dec 18 21:57:42.771560 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4049/8145] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:57:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:57:42.878176 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:42.878905 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:42.886768 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:42.887309 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:42.888192 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:42.888726 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:43.034238 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:43.042778 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31724ea3-c025-488d-b045-56560c48254b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1258 microversion: 2.1 time: 0.168412 Dec 18 21:57:43.043453 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4097/8146] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:42 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:44.062022 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:44.063498 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:44.070460 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:44.070933 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:44.071747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:44.072208 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:44.207953 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:44.215641 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a769492b-db26-4fb8-93d7-69b6d0acd114 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1258 microversion: 2.1 time: 0.158828 Dec 18 21:57:44.216222 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4050/8147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:44 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:45.232452 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:45.233064 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:45.240323 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:45.240783 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:45.241566 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:45.242005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:45.372414 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:45.379740 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a2fd1bbd-dc3a-4a2c-bd9a-102de0692b80 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1258 microversion: 2.1 time: 0.151086 Dec 18 21:57:45.380303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4098/8148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:45 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:57:46.396722 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:46.397359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:46.404161 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:46.404633 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:46.405430 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:46.405888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:46.536265 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:46.544052 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-2afed264-60e1-48db-8c25-679a3f5bf17c tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1258 microversion: 2.1 time: 0.151652 Dec 18 21:57:46.544651 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4051/8149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:46 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:47.561368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:47.561975 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:47.569313 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:47.569764 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:47.570582 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:47.571022 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:47.703502 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:47.712013 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-70da007e-2dd1-44b9-89f7-ee52f56f21ec tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1258 microversion: 2.1 time: 0.154370 Dec 18 21:57:47.712585 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4099/8150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:47 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 21:57:48.233471 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-b36ed862-b112-4981-b24d-46727d2d3442 req-03a663a8-e1ff-4784-a696-de19a9d00d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "name": "network-vif-plugged", "status": "completed", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:57:48.235285 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:57:48.235285 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:57:48.243682 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b36ed862-b112-4981-b24d-46727d2d3442 req-03a663a8-e1ff-4784-a696-de19a9d00d5b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:48.244261 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-b36ed862-b112-4981-b24d-46727d2d3442 req-03a663a8-e1ff-4784-a696-de19a9d00d5b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:48.256018 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-b36ed862-b112-4981-b24d-46727d2d3442 req-03a663a8-e1ff-4784-a696-de19a9d00d5b service nova] Creating event network-vif-plugged:dbf46913-d2a9-4d87-a2a9-c259e2feeb2a for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b on nch2-master-1 Dec 18 21:57:48.260954 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-b36ed862-b112-4981-b24d-46727d2d3442 req-03a663a8-e1ff-4784-a696-de19a9d00d5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087652 Dec 18 21:57:48.261545 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4052/8151] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:57:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:57:48.731207 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:48.731810 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:48.738594 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:48.739074 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:48.739857 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:48.740291 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:48.869928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:48.877238 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3338ad55-9411-46c3-bb57-12e98b2f306a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1258 microversion: 2.1 time: 0.149822 Dec 18 21:57:48.877808 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4100/8152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:48 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:49.895155 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:49.895870 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:49.901984 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:49.902515 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:49.903342 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:49.903799 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:50.038125 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:50.045624 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-650bcc60-4b3c-47ea-a6e9-c5fda44cae64 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1442 microversion: 2.1 time: 0.155436 Dec 18 21:57:50.046196 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4053/8153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:49 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:50.062613 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:57:50.063015 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:57:50.069425 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:50.069884 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:50.070706 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:50.071146 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:50.206156 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:57:50.214325 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-da6cff8b-8f70-4330-b30d-77f18a0231d9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1442 microversion: 2.1 time: 0.156063 Dec 18 21:57:50.214970 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4101/8154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:57:50 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:57:51.782839 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-c6dbefd1-21db-453a-8e9f-1e48501c491a req-1c9ffefd-5246-46e5-8946-310aeb431925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:57:51.783999 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:57:51.783999 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 21:57:51.792427 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c6dbefd1-21db-453a-8e9f-1e48501c491a req-1c9ffefd-5246-46e5-8946-310aeb431925 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:57:51.792901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-c6dbefd1-21db-453a-8e9f-1e48501c491a req-1c9ffefd-5246-46e5-8946-310aeb431925 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:57:51.806389 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-c6dbefd1-21db-453a-8e9f-1e48501c491a req-1c9ffefd-5246-46e5-8946-310aeb431925 service nova] Creating event network-changed:dbf46913-d2a9-4d87-a2a9-c259e2feeb2a for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b on nch2-master-1 Dec 18 21:57:51.811326 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-c6dbefd1-21db-453a-8e9f-1e48501c491a req-1c9ffefd-5246-46e5-8946-310aeb431925 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032510 Dec 18 21:57:51.811946 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4054/8155] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 21:57:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 21:58:16.950373 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:58:16.951072 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:58:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:59:56.899442 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:59:56.900173 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 21:59:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:59:57.069758 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 21:59:57.070341 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:59:57.076196 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:59:57.076653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:59:57.077441 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:59:57.077887 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:59:57.105141 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.objects.instance [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lazy-loading 'flavor' on Instance uuid 5a971e49-ee8a-4fb9-be79-d4385adc122b {{(pid=140732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 21:59:57.176544 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [8794ef8f-769f-4ebf-b406-f268af7629fe] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 21:59:58.192788 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [8794ef8f-769f-4ebf-b406-f268af7629fe] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49142. Dec 18 21:59:58.196238 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-505bfd6c-66da-4886-9027-7351350af5d6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b/action" status: 202 len: 0 microversion: 2.1 time: 1.175516 Dec 18 21:59:58.196841 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4102/8156] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 21:59:57 2021] POST /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b/action => generated 0 bytes in 1177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 21:59:58.205271 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 18 21:59:58.207371 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 18 21:59:58.211589 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:59:58.212299 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:59:58.221248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:59:58.221715 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:59:58.222547 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:59:58.223695 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:59:58.363991 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:59:58.371435 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a246ec1-b35a-487a-be93-76fb63169899 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.169335 Dec 18 21:59:58.372000 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4055/8157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:59:58 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 21:59:59.279686 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 21:59:59.280312 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 21:59:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 21:59:59.390839 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 21:59:59.391552 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 21:59:59.398837 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:59:59.399294 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:59:59.400079 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 21:59:59.400553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 21:59:59.536654 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 21:59:59.544095 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-85f60b97-e18e-4571-a4c8-0d0cd86fed0b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.158179 Dec 18 21:59:59.544658 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4103/8158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:59:59 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:00.561810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:00.562389 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:00.592723 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:00.593227 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:00.594044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:00.595035 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:00.600747 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49158. Dec 18 22:00:00.603020 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49156. Dec 18 22:00:00.735411 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:00.743110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-83904445-10c1-41c1-ad6a-d935bf2844b1 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.185017 Dec 18 22:00:00.743673 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4056/8159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:00 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:01.759903 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:01.760516 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:01.767834 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:01.768287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:01.769073 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:01.769515 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:01.911361 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:01.918878 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-22b31576-c708-4e35-ad3e-bfe019e2747e tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.162729 Dec 18 22:00:01.919437 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4104/8160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:01 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:02.936149 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:02.936834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:02.943711 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:02.944237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:02.945042 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:02.945527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:03.077536 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:03.085798 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7c4f4738-44d2-43d9-85a4-7eb8a5fc9164 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.153271 Dec 18 22:00:03.086396 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4057/8161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:02 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:04.103617 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:04.104230 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:04.111779 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:04.112235 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:04.113028 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:04.113474 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:04.250005 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:04.258450 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ffd220ee-c8b4-4ee8-874b-38ca12d9ba5a tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.158505 Dec 18 22:00:04.259119 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4105/8162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:04 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:05.276466 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:05.277097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:05.283885 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:05.284359 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:05.285163 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:05.285628 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:05.420834 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:05.428699 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-e1b39caa-e5b9-4a34-a54d-63a93ac2fabc tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.156012 Dec 18 22:00:05.429270 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4058/8163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:05 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:06.445724 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:06.446297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:06.453046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:06.453504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:06.454978 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:06.455428 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:06.583388 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:06.591403 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a130c4f0-be08-490e-9a5a-e2f0517dd16f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.149541 Dec 18 22:00:06.591980 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4106/8164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:06 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:07.608514 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:07.609138 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:07.615988 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:07.616451 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:07.617271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:07.617720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:07.752128 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:07.759573 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-cfeebb65-27af-49e2-92b5-980d31ea6729 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.154797 Dec 18 22:00:07.760138 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4059/8165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:07 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:08.776833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:08.777642 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:08.784862 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:08.785327 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:08.786122 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:08.786612 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:08.921899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:08.929378 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-7ce1e125-f146-4512-adff-32207b0bf790 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.156363 Dec 18 22:00:08.929957 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4107/8166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:08 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:00:09.946090 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:09.946763 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:09.953627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:09.954096 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:09.954930 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:09.955388 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:10.094078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:10.101968 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11f5ce54-9e66-4cc2-9eb4-e7cf4b371cc9 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.159619 Dec 18 22:00:10.102572 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4060/8167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:09 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:11.118945 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:11.119589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:11.126206 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:11.127275 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:11.128060 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:11.128563 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:11.258364 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:11.266816 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b18407bc-0dd2-4a52-99a3-ca31746d7b39 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1508 microversion: 2.1 time: 0.151601 Dec 18 22:00:11.267374 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4108/8168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:11 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:11.282717 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:00:11.283302 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:11.289993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:11.290509 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:11.291306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:11.291756 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:11.449216 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5bd2d312-5b9f-4d4f-8408-12990eb79e45 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "POST /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b/action" status: 202 len: 0 microversion: 2.1 time: 0.170128 Dec 18 22:00:11.449828 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4061/8169] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 22:00:11 2021] POST /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 22:00:11.457747 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:11.458410 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:11.464490 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:11.464941 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:11.465767 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:11.466213 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:11.599403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:11.607023 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d2bb24a5-d6ec-4bc7-b5bd-17c67d8ec9f3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1516 microversion: 2.1 time: 0.153061 Dec 18 22:00:11.607604 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4109/8170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:11 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:00:12.625720 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:12.627170 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:12.633311 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:12.633788 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:12.634625 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:12.635091 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:12.778994 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:12.787443 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d0274c6c-35b2-45f9-bba8-ab58561d3ec5 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1518 microversion: 2.1 time: 0.166416 Dec 18 22:00:12.788029 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4062/8171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:12 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:12.962856 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-7e76835a-3ab6-46c8-b045-b7a220c59ab9 req-3a548145-d2ac-4f1d-8550-2c1321d50ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "name": "network-vif-unplugged", "status": "completed", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:00:12.965116 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:00:12.965116 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:00:12.974299 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7e76835a-3ab6-46c8-b045-b7a220c59ab9 req-3a548145-d2ac-4f1d-8550-2c1321d50ba8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:12.974962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-7e76835a-3ab6-46c8-b045-b7a220c59ab9 req-3a548145-d2ac-4f1d-8550-2c1321d50ba8 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:12.987976 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.compute.server_external_events [req-7e76835a-3ab6-46c8-b045-b7a220c59ab9 req-3a548145-d2ac-4f1d-8550-2c1321d50ba8 service nova] Unable to find a host for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b. Dropping event network-vif-unplugged {{(pid=140732) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 18 22:00:12.989059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-7e76835a-3ab6-46c8-b045-b7a220c59ab9 req-3a548145-d2ac-4f1d-8550-2c1321d50ba8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030551 Dec 18 22:00:12.989844 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4110/8172] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:00:12 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 18 22:00:13.805700 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:13.806353 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:13.815479 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:13.815966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:13.816754 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:13.817207 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:14.072237 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:14.079800 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-c05e99a6-9563-4040-899a-2a835f8f62bb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.277853 Dec 18 22:00:14.080383 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4063/8173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:13 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:14.199592 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-63d4f428-d876-44e6-a99c-507a561ca290 req-643a56e0-bc29-4aa1-bd79-07b5aaf1a301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:00:14.201124 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:00:14.201124 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:00:14.209407 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-63d4f428-d876-44e6-a99c-507a561ca290 req-643a56e0-bc29-4aa1-bd79-07b5aaf1a301 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:14.209962 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-63d4f428-d876-44e6-a99c-507a561ca290 req-643a56e0-bc29-4aa1-bd79-07b5aaf1a301 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:14.228105 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-63d4f428-d876-44e6-a99c-507a561ca290 req-643a56e0-bc29-4aa1-bd79-07b5aaf1a301 service nova] Creating event network-changed:dbf46913-d2a9-4d87-a2a9-c259e2feeb2a for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b on nch1-master-1 Dec 18 22:00:14.233704 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-63d4f428-d876-44e6-a99c-507a561ca290 req-643a56e0-bc29-4aa1-bd79-07b5aaf1a301 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037812 Dec 18 22:00:14.234342 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4111/8174] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:00:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:00:15.097437 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:15.098178 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:15.105086 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:15.105553 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:15.106386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:15.106878 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:15.350580 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:15.358574 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-531b95d1-1e8d-463d-a456-5f76bb108eb3 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.265281 Dec 18 22:00:15.359364 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4064/8175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:15 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:16.376774 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:16.377480 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:16.383843 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:16.384297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:16.385085 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:16.385529 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:16.517547 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:16.524929 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-baaa2cef-3da7-4c5c-8b7d-e51c4c31477b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.153132 Dec 18 22:00:16.525503 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4112/8176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:16 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:17.542477 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:17.543122 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:17.549838 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:17.550346 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:17.551151 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:17.551610 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:17.685467 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:17.693445 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-94853cf1-9020-41d0-b245-83893f7386ee tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.154864 Dec 18 22:00:17.694018 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4065/8177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:17 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:18.711438 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:18.712045 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:18.718832 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:18.719287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:18.720725 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:18.721175 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:18.851938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:18.859375 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-ac351da3-e12b-4c85-8ff7-c589d216509d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.151930 Dec 18 22:00:18.859952 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4113/8178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:18 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:00:19.876226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:19.876843 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:19.883527 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:19.883993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:19.884796 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:19.885251 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:20.019048 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:20.026378 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7c0a50c-fef5-4522-8ae2-eb2c142ad821 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.153945 Dec 18 22:00:20.026983 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4066/8179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:19 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:21.043964 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:21.044523 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:21.051696 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:21.052150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:21.052938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:21.053377 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:21.188247 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:21.196308 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-a8d8c42e-4424-480e-9f48-3378b45b935b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.156184 Dec 18 22:00:21.196895 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4114/8180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:21 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:00:21.411806 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-bf34aabf-82d6-4f26-8a65-69b06bf5bf1b req-3b2e5e4c-591e-4503-9cd9-2af798df1f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "name": "network-vif-plugged", "status": "completed", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:00:21.413419 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:00:21.413419 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:00:21.421315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bf34aabf-82d6-4f26-8a65-69b06bf5bf1b req-3b2e5e4c-591e-4503-9cd9-2af798df1f9e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:21.421784 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-bf34aabf-82d6-4f26-8a65-69b06bf5bf1b req-3b2e5e4c-591e-4503-9cd9-2af798df1f9e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:21.433473 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-bf34aabf-82d6-4f26-8a65-69b06bf5bf1b req-3b2e5e4c-591e-4503-9cd9-2af798df1f9e service nova] Creating event network-vif-plugged:dbf46913-d2a9-4d87-a2a9-c259e2feeb2a for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b on nch1-master-1 Dec 18 22:00:21.437013 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [req-bf34aabf-82d6-4f26-8a65-69b06bf5bf1b req-3b2e5e4c-591e-4503-9cd9-2af798df1f9e service nova] [be0ce26c-9f69-47f6-91e5-be6e1955b69a] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 22:00:22.213403 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:22.214003 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:22.220715 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:22.221158 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:22.221932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:22.222395 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:22.351329 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:22.358635 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d038c003-a9bc-4469-a9ff-5d687d558dfe tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.149195 Dec 18 22:00:22.359201 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4115/8181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:22 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:00:22.452847 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [req-bf34aabf-82d6-4f26-8a65-69b06bf5bf1b req-3b2e5e4c-591e-4503-9cd9-2af798df1f9e service nova] [be0ce26c-9f69-47f6-91e5-be6e1955b69a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49226. Dec 18 22:00:22.456272 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-bf34aabf-82d6-4f26-8a65-69b06bf5bf1b req-3b2e5e4c-591e-4503-9cd9-2af798df1f9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.048802 Dec 18 22:00:22.456888 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4067/8182] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:00:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:00:23.375891 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:23.377143 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:23.383729 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:23.384171 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:23.384946 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:23.385381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:23.513673 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:23.521152 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e3cdaf90-35e3-4572-8cec-a29c20aaefff tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1574 microversion: 2.1 time: 0.148981 Dec 18 22:00:23.521840 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4116/8183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:23 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:00:24.539341 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:00:24.539958 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:00:24.546774 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:24.547248 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:24.548102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:00:24.548687 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:00:24.681868 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:00:24.690006 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-d7518b7e-9893-42df-a5ec-e91c4c9fb126 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1561 microversion: 2.1 time: 0.155684 Dec 18 22:00:24.690610 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4068/8184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:00:24 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:01:48.973185 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:01:48.973737 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:01:48.980944 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:48.981404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:48.982453 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:48.982909 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:49.016631 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 22:01:49.080416 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-1c1cb16b-1ace-4a3c-a54b-e0486c7a60af req-e519feda-6ec4-4bb1-9054-4144c5eebdee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:01:49.082137 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:01:49.082137 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:01:49.089776 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1c1cb16b-1ace-4a3c-a54b-e0486c7a60af req-e519feda-6ec4-4bb1-9054-4144c5eebdee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:49.090457 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-1c1cb16b-1ace-4a3c-a54b-e0486c7a60af req-e519feda-6ec4-4bb1-9054-4144c5eebdee service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:49.102454 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-1c1cb16b-1ace-4a3c-a54b-e0486c7a60af req-e519feda-6ec4-4bb1-9054-4144c5eebdee service nova] Creating event network-changed:dbf46913-d2a9-4d87-a2a9-c259e2feeb2a for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b on nch1-master-1 Dec 18 22:01:49.108285 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-1c1cb16b-1ace-4a3c-a54b-e0486c7a60af req-e519feda-6ec4-4bb1-9054-4144c5eebdee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137302 Dec 18 22:01:49.109263 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-b1691b5b-3227-4775-a707-7cbd0df8331b tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 204 len: 0 microversion: 2.1 time: 0.140671 Dec 18 22:01:49.109757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4069/8185] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:01:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 22:01:49.109907 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4117/8186] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 22:01:48 2021] DELETE /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 22:01:49.120287 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:01:49.121046 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:01:49.127244 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:49.127746 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:49.128543 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:49.128983 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:49.420707 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:01:49.429495 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-df5640a5-67cc-4f13-8d0b-d5138f0002eb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1567 microversion: 2.1 time: 0.313849 Dec 18 22:01:49.430292 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4118/8187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:01:49 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:01:50.448268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:01:50.448908 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:01:50.455102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:50.455574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:50.456397 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:50.456853 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:50.633590 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:01:50.641645 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-b2cbcda1-818a-4438-8311-256bf4449a3f tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1448 microversion: 2.1 time: 0.198563 Dec 18 22:01:50.642462 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4070/8188] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:01:50 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:01:51.658895 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:01:51.659630 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:01:51.667816 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:51.667943 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:51.668728 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:51.669248 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:51.728674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-4b52fe31-5631-41b0-b178-5d2ab6959436 req-caeaba3f-0a9a-48b3-91f9-f25becd1fce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a971e49-ee8a-4fb9-be79-d4385adc122b", "name": "network-vif-deleted", "tag": "dbf46913-d2a9-4d87-a2a9-c259e2feeb2a"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:01:51.730487 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:01:51.730487 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:01:51.744534 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4b52fe31-5631-41b0-b178-5d2ab6959436 req-caeaba3f-0a9a-48b3-91f9-f25becd1fce4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:51.745423 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-4b52fe31-5631-41b0-b178-5d2ab6959436 req-caeaba3f-0a9a-48b3-91f9-f25becd1fce4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:51.748100 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd138402b28b3454aaca10ca070a1f7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e4c296f0144644b9107d08244cb934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:01:51.756606 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-2d3690ea-114c-40ba-a445-a275294141f6 tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 200 len: 1381 microversion: 2.1 time: 0.101247 Dec 18 22:01:51.757196 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4119/8189] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:01:51 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 1381 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:01:51.761076 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-4b52fe31-5631-41b0-b178-5d2ab6959436 req-caeaba3f-0a9a-48b3-91f9-f25becd1fce4 service nova] Creating event network-vif-deleted:dbf46913-d2a9-4d87-a2a9-c259e2feeb2a for instance 5a971e49-ee8a-4fb9-be79-d4385adc122b on nch1-master-1 Dec 18 22:01:51.766124 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-4b52fe31-5631-41b0-b178-5d2ab6959436 req-caeaba3f-0a9a-48b3-91f9-f25becd1fce4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041654 Dec 18 22:01:51.766806 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4071/8190] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:01:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:01:52.774429 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:01:52.775078 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] [instance: 5a971e49-ee8a-4fb9-be79-d4385adc122b] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:01:52.781804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:52.782280 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:52.783089 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:01:52.783535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:01:52.796597 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] HTTP exception thrown: Instance 5a971e49-ee8a-4fb9-be79-d4385adc122b could not be found. Dec 18 22:01:52.797187 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Returning 404 to user: Instance 5a971e49-ee8a-4fb9-be79-d4385adc122b could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 22:01:52.798059 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e5aec7e5-d3e9-476c-848d-77dd958715fb tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b" status: 404 len: 111 microversion: 2.1 time: 0.027493 Dec 18 22:01:52.798571 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4120/8191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:01:52 2021] GET /compute/v2.1/servers/5a971e49-ee8a-4fb9-be79-d4385adc122b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 22:01:52.955079 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-0a1b8b93-9d4b-41fd-969c-5681daac650d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] Calling method '.version_select at 0x7f714fb19a60>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:01:52.987847 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-0a1b8b93-9d4b-41fd-969c-5681daac650d tempest-TestShelveInstance-495639169 tempest-TestShelveInstance-495639169-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-416481949" status: 202 len: 0 microversion: 2.1 time: 0.036822 Dec 18 22:01:52.988829 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4072/8192] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 22:01:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-416481949 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 22:02:09.775330 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-cae22111-4111-4cfb-8697-7460c274840b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Action: 'create', calling method: .version_select at 0x7f714ee95430>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-285701377"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:02:09.789411 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cae22111-4111-4cfb-8697-7460c274840b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for project bb152351dd1a4914b8b0a47536625080. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 22:02:09.794219 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cae22111-4111-4cfb-8697-7460c274840b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for user 3ad9bb5f9c834d75bb3833e4a9df0159 and project bb152351dd1a4914b8b0a47536625080. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 22:02:09.918029 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cae22111-4111-4cfb-8697-7460c274840b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for project bb152351dd1a4914b8b0a47536625080. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 22:02:09.923262 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.quota [None req-cae22111-4111-4cfb-8697-7460c274840b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for user 3ad9bb5f9c834d75bb3833e4a9df0159 and project bb152351dd1a4914b8b0a47536625080. Resources: {'key_pairs'} {{(pid=140732) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 22:02:09.938108 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-cae22111-4111-4cfb-8697-7460c274840b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.325079 Dec 18 22:02:09.938746 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4121/8193] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Dec 18 22:02:09 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:11.010582 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1967152738", "imageRef": "394b3891-80f2-44c9-a9aa-56fe23a5acb3", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-285701377", "security_groups": [{"name": "tempest-secgroup-smoke-1114189222"}], "networks": [{"uuid": "b24ccf3a-47d3-47b5-9c65-d881553b675f"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:02:11.113714 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] validate_networks() for [('b24ccf3a-47d3-47b5-9c65-d881553b675f', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 22:02:11.503055 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 22:02:11.503571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 22:02:11.504148 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 22:02:11.504647 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 22:02:11.505150 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 22:02:11.514747 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:11.515226 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:11.516109 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:11.516664 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:11.534888 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for project bb152351dd1a4914b8b0a47536625080. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 22:02:11.540121 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for user 3ad9bb5f9c834d75bb3833e4a9df0159 and project bb152351dd1a4914b8b0a47536625080. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 22:02:11.552566 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 22:02:11.555101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='394b3891-80f2-44c9-a9aa-56fe23a5acb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 22:02:11.608495 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-5a7497b1-6a26-4b6b-9af9-27d1460db4e6 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.603028 Dec 18 22:02:11.609362 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4073/8194] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 22:02:11 2021] POST /compute/v2.1/servers => generated 406 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 22:02:11.620103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-709d539a-a382-44df-b5be-637fa95147b9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:11.620994 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-709d539a-a382-44df-b5be-637fa95147b9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:11.677338 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-709d539a-a382-44df-b5be-637fa95147b9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:11.684521 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-709d539a-a382-44df-b5be-637fa95147b9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1248 microversion: 2.1 time: 0.069306 Dec 18 22:02:11.685171 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4122/8195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:11 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1248 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:12.702993 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:12.703620 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:12.716585 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:12.717061 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:12.717879 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:12.718368 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:12.784147 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:12.791722 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a601786b-8b51-4372-9ce7-512a70e9e0f5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1306 microversion: 2.1 time: 0.093498 Dec 18 22:02:12.792291 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4074/8196] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:12 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:13.808938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:13.810501 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:13.818584 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:13.819368 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:13.820224 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:13.820670 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:14.079349 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:14.102443 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-6f670e2c-61a4-49f7-afa5-c23f094c6c56 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1374 microversion: 2.1 time: 0.296806 Dec 18 22:02:14.103355 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4123/8197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:13 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1374 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:14.154845 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-e855b513-2a1c-480f-a9a7-e7b79e995807 req-8878eb2b-8a19-4a89-bc4a-f6440f83b503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bed4681-8d93-422a-946d-9f7a19302d39", "tag": "7e2c06c7-a5ef-419a-89d2-ef1a774f7df7"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:02:14.157847 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:02:14.157847 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:02:14.181271 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e855b513-2a1c-480f-a9a7-e7b79e995807 req-8878eb2b-8a19-4a89-bc4a-f6440f83b503 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:14.186115 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-e855b513-2a1c-480f-a9a7-e7b79e995807 req-8878eb2b-8a19-4a89-bc4a-f6440f83b503 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:14.211925 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-e855b513-2a1c-480f-a9a7-e7b79e995807 req-8878eb2b-8a19-4a89-bc4a-f6440f83b503 service nova] Creating event network-changed:7e2c06c7-a5ef-419a-89d2-ef1a774f7df7 for instance 0bed4681-8d93-422a-946d-9f7a19302d39 on nch2-master-1 Dec 18 22:02:14.219360 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-e855b513-2a1c-480f-a9a7-e7b79e995807 req-8878eb2b-8a19-4a89-bc4a-f6440f83b503 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068283 Dec 18 22:02:14.220691 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4075/8198] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:02:15.119972 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:15.120614 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:15.127653 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:15.128134 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:15.128938 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:15.129381 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:15.262705 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:15.270724 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-31a4f01f-6df0-47a0-a65d-2cb5feb3d5a5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1374 microversion: 2.1 time: 0.154489 Dec 18 22:02:15.271384 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4124/8199] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:15 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:16.289134 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:16.289850 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:16.295980 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:16.296450 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:16.297344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:16.297996 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:16.437668 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:16.445176 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6e702493-cf3f-4209-acc7-99b774377cc9 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1374 microversion: 2.1 time: 0.161460 Dec 18 22:02:16.445668 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4076/8200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:16 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:17.465391 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:17.465987 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:17.472877 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:17.473339 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:17.474130 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:17.474606 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:17.606923 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:17.614354 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-5f1f85c3-4a12-473f-b882-6e682c497ecb tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1374 microversion: 2.1 time: 0.155365 Dec 18 22:02:17.615013 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4125/8201] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:17 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:18.631066 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:18.631689 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:18.638375 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:18.638851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:18.639650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:18.640104 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:18.769733 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:18.777094 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-02cfc4c0-168c-4b78-b43c-5037dfa2ffb7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1374 microversion: 2.1 time: 0.149884 Dec 18 22:02:18.777661 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4077/8202] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:18 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1374 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:19.653932 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-ad4cc16f-0780-4367-8b17-26e821ed03db req-489b622c-e956-433f-b43c-a435b4496c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bed4681-8d93-422a-946d-9f7a19302d39", "name": "network-vif-plugged", "status": "completed", "tag": "7e2c06c7-a5ef-419a-89d2-ef1a774f7df7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:02:19.655651 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:02:19.655651 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:02:19.665204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ad4cc16f-0780-4367-8b17-26e821ed03db req-489b622c-e956-433f-b43c-a435b4496c94 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:19.665833 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-ad4cc16f-0780-4367-8b17-26e821ed03db req-489b622c-e956-433f-b43c-a435b4496c94 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:19.678045 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-ad4cc16f-0780-4367-8b17-26e821ed03db req-489b622c-e956-433f-b43c-a435b4496c94 service nova] Creating event network-vif-plugged:7e2c06c7-a5ef-419a-89d2-ef1a774f7df7 for instance 0bed4681-8d93-422a-946d-9f7a19302d39 on nch2-master-1 Dec 18 22:02:19.683692 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-ad4cc16f-0780-4367-8b17-26e821ed03db req-489b622c-e956-433f-b43c-a435b4496c94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033527 Dec 18 22:02:19.684385 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4126/8203] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:02:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:02:19.795871 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:19.796421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:19.803340 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:19.803810 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:19.804617 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:19.805078 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:19.941800 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:19.949188 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6cec6c40-b2f4-46ac-a37f-0bc181c46031 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1374 microversion: 2.1 time: 0.158055 Dec 18 22:02:19.949757 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4078/8204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:19 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:20.968150 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:20.968804 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:20.975657 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:20.976115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:20.976910 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:20.977355 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:21.116404 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:21.124758 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-4edceac3-0ebd-4369-956c-bdb14b844e1c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1558 microversion: 2.1 time: 0.161840 Dec 18 22:02:21.125339 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4127/8205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:20 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:21.145044 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:02:21.145771 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:02:21.154906 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:21.155422 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:21.156344 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:21.156856 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:21.294156 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:02:21.301736 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fcbf816e-402e-4040-8fe6-570e9536f855 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1558 microversion: 2.1 time: 0.160995 Dec 18 22:02:21.302328 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4079/8206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:02:21 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:02:23.088128 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-45a0e324-a57e-479b-9723-a6e33a944eb6 req-404f940e-2e43-4a3b-9840-d17efe5b154c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bed4681-8d93-422a-946d-9f7a19302d39", "tag": "7e2c06c7-a5ef-419a-89d2-ef1a774f7df7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:02:23.089696 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:02:23.089696 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:02:23.099401 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-45a0e324-a57e-479b-9723-a6e33a944eb6 req-404f940e-2e43-4a3b-9840-d17efe5b154c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:02:23.099908 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-45a0e324-a57e-479b-9723-a6e33a944eb6 req-404f940e-2e43-4a3b-9840-d17efe5b154c service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:02:23.111939 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-45a0e324-a57e-479b-9723-a6e33a944eb6 req-404f940e-2e43-4a3b-9840-d17efe5b154c service nova] Creating event network-changed:7e2c06c7-a5ef-419a-89d2-ef1a774f7df7 for instance 0bed4681-8d93-422a-946d-9f7a19302d39 on nch2-master-1 Dec 18 22:02:23.117004 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-45a0e324-a57e-479b-9723-a6e33a944eb6 req-404f940e-2e43-4a3b-9840-d17efe5b154c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032884 Dec 18 22:02:23.117849 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4128/8207] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:02:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 22:03:19.297050 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:03:19.297803 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:03:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:04:15.717678 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 18 22:04:15.718781 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 18 22:04:15.722281 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-6f01a635-cc4f-4770-b85a-34a0d9e85d7a tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1685878965"}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:04:15.723306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-6f01a635-cc4f-4770-b85a-34a0d9e85d7a tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:15.729279 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f01a635-cc4f-4770-b85a-34a0d9e85d7a tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:15.729751 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f01a635-cc4f-4770-b85a-34a0d9e85d7a tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:15.730578 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f01a635-cc4f-4770-b85a-34a0d9e85d7a tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:15.731029 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-6f01a635-cc4f-4770-b85a-34a0d9e85d7a tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:16.001258 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-6f01a635-cc4f-4770-b85a-34a0d9e85d7a tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "POST /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39/action" status: 202 len: 0 microversion: 2.1 time: 0.285747 Dec 18 22:04:16.001904 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4080/8208] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 22:04:15 2021] POST /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 22:04:22.563844 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f82efa99-2048-43b1-87fb-668518ca915b] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 18 22:04:22.565481 ncdv-master-1 devstack@n-api.service[140732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d65e2c3a-bf34-479d-be5a-5182256b434e] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 18 22:04:22.663527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-e81076a9-5439-43a6-bed8-c8d6a600011d req-8265e565-ada8-481b-b795-3f14988b3889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bed4681-8d93-422a-946d-9f7a19302d39", "name": "network-vif-plugged", "status": "completed", "tag": "7e2c06c7-a5ef-419a-89d2-ef1a774f7df7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:04:22.666050 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:04:22.666050 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:04:22.674362 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e81076a9-5439-43a6-bed8-c8d6a600011d req-8265e565-ada8-481b-b795-3f14988b3889 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:22.674886 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-e81076a9-5439-43a6-bed8-c8d6a600011d req-8265e565-ada8-481b-b795-3f14988b3889 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:22.688113 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-e81076a9-5439-43a6-bed8-c8d6a600011d req-8265e565-ada8-481b-b795-3f14988b3889 service nova] Creating event network-vif-plugged:7e2c06c7-a5ef-419a-89d2-ef1a774f7df7 for instance 0bed4681-8d93-422a-946d-9f7a19302d39 on nch2-master-1 Dec 18 22:04:22.693218 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-e81076a9-5439-43a6-bed8-c8d6a600011d req-8265e565-ada8-481b-b795-3f14988b3889 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132631 Dec 18 22:04:22.693823 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4129/8209] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:04:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:04:29.520570 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-357932522", "imageRef": "f572f8e1-1946-4751-bd20-eb07747e8799", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-285701377", "security_groups": [{"name": "tempest-secgroup-smoke-1114189222"}], "networks": [{"uuid": "b24ccf3a-47d3-47b5-9c65-d881553b675f"}]}} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:04:29.547974 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49716. Dec 18 22:04:29.548699 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49714. Dec 18 22:04:29.634557 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.network.neutron [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] validate_networks() for [('b24ccf3a-47d3-47b5-9c65-d881553b675f', None, None, None, None, None)] {{(pid=140731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 22:04:29.997966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Flavor limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 22:04:29.998438 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Image limits 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 22:04:29.998928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Flavor pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 22:04:29.999354 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Image pref 0:0:0 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 22:04:29.999780 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.virt.hardware [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 22:04:30.008301 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:30.008766 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:30.009599 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:30.010051 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:30.025973 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for project bb152351dd1a4914b8b0a47536625080. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 22:04:30.030959 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.quota [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Getting quotas for user 3ad9bb5f9c834d75bb3833e4a9df0159 and project bb152351dd1a4914b8b0a47536625080. Resources: {'instances', 'cores', 'ram'} {{(pid=140731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 22:04:30.043645 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Going to run 1 instances... {{(pid=140731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 22:04:30.046365 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f572f8e1-1946-4751-bd20-eb07747e8799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 22:04:30.089511 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [73c9d55f-f72f-441d-9f06-79bb767f0224] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 22:04:31.105690 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [73c9d55f-f72f-441d-9f06-79bb767f0224] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49728. Dec 18 22:04:31.110112 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a3739955-5186-4fc1-8c63-e297e41126d8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.613640 Dec 18 22:04:31.110816 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4081/8210] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 22:04:29 2021] POST /compute/v2.1/servers => generated 406 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 22:04:31.144112 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-04390a9c-c574-45e7-a056-e1e8f46d034b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:31.145014 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-04390a9c-c574-45e7-a056-e1e8f46d034b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:31.160159 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] [f82efa99-2048-43b1-87fb-668518ca915b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49732. Dec 18 22:04:31.161097 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] [d65e2c3a-bf34-479d-be5a-5182256b434e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49736. Dec 18 22:04:31.208300 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-04390a9c-c574-45e7-a056-e1e8f46d034b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:31.215671 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-04390a9c-c574-45e7-a056-e1e8f46d034b tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1247 microversion: 2.1 time: 0.098764 Dec 18 22:04:31.216239 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4130/8211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:31 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1247 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:32.232901 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:32.233678 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:32.243323 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:32.243855 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:32.244674 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:32.245126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:32.323832 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:32.332196 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f3b96ec5-d603-4b8b-9cb4-a7920d3a8c9d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1317 microversion: 2.1 time: 0.103809 Dec 18 22:04:32.332840 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4082/8212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:32 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1317 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:32.359539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-8dbfe6d1-59b5-41d7-bb2e-950358404ae4 req-243c91c6-1418-4c63-bd86-e6486982979b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bed4681-8d93-422a-946d-9f7a19302d39", "name": "network-vif-unplugged", "status": "completed", "tag": "7e2c06c7-a5ef-419a-89d2-ef1a774f7df7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:04:32.361653 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:04:32.361653 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:04:32.375475 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8dbfe6d1-59b5-41d7-bb2e-950358404ae4 req-243c91c6-1418-4c63-bd86-e6486982979b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:32.375924 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-8dbfe6d1-59b5-41d7-bb2e-950358404ae4 req-243c91c6-1418-4c63-bd86-e6486982979b service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:32.388030 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-8dbfe6d1-59b5-41d7-bb2e-950358404ae4 req-243c91c6-1418-4c63-bd86-e6486982979b service nova] Creating event network-vif-unplugged:7e2c06c7-a5ef-419a-89d2-ef1a774f7df7 for instance 0bed4681-8d93-422a-946d-9f7a19302d39 on nch2-master-1 Dec 18 22:04:32.393729 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-8dbfe6d1-59b5-41d7-bb2e-950358404ae4 req-243c91c6-1418-4c63-bd86-e6486982979b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038502 Dec 18 22:04:32.395425 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4131/8213] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:04:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:04:33.350492 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:33.352462 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:33.367635 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:33.369526 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:33.371202 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:33.371697 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:33.551097 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:33.558604 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-34912134-2772-4eaa-a487-e6aba8a91d18 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.211773 Dec 18 22:04:33.559457 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4083/8214] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:33 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:34.577201 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:34.577896 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:34.584080 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:34.584532 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:34.585316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:34.585759 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:34.735086 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:34.743735 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-8ae566ba-b346-4cc2-aa96-9ccc3ca2154e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.171392 Dec 18 22:04:34.744334 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4132/8215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:34 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:35.761057 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:35.761671 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:35.768398 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:35.768862 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:35.769650 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:35.770102 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:35.910334 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:35.919110 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-11ec6787-d033-4768-87de-d119503da5e8 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.162268 Dec 18 22:04:35.920045 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4084/8216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:35 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:36.937874 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:36.939539 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:36.948700 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:36.949680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:36.950842 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:36.951540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:37.091456 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:37.098703 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-e16dcdaa-0805-4054-ab63-424eba507bb3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.165528 Dec 18 22:04:37.099303 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4133/8217] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:36 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:38.115630 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:38.116243 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:38.123470 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:38.123936 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:38.124727 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:38.125175 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:38.276105 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:38.284295 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-131295c7-9a70-45ae-b6e8-97391e7788d7 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.171951 Dec 18 22:04:38.294323 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4085/8218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:38 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:39.301092 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:39.301703 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:39.309204 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:39.309664 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:39.310498 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:39.310942 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:39.462136 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:39.469837 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3bec1f4b-b0d2-4da9-b8b9-51ab28c0240d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.172467 Dec 18 22:04:39.470443 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4134/8219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:39 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:40.486833 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:40.487476 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:40.494038 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:40.494528 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:40.495343 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:40.495802 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:40.648402 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:40.656244 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f7c93bf7-e65c-47c3-aa59-fa9dfd97f4d4 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.173356 Dec 18 22:04:40.656810 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4086/8220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:40 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:41.677184 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:41.677902 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:41.684553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:41.685006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:41.685792 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:41.686237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:41.825030 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:41.838418 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-309c5156-886c-4d99-a283-831ead772263 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.169176 Dec 18 22:04:41.839576 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4135/8221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:41 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:42.856326 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:42.856966 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:42.863785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:42.864268 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:42.865073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:42.865538 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:42.995592 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:43.002896 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-7fda0ea6-c98c-46c5-bd33-44232a4e2f49 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.150849 Dec 18 22:04:43.003475 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4087/8222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:42 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:43.948544 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-032e4e1a-e8cc-4778-b7c0-01547805085b req-8b06ccbe-15f9-4964-9707-7d7d5dfa25fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66db8b5c-063f-430c-a588-70d71bb2fb51", "tag": "b2b66278-f4a7-4aae-be60-1a175098d318"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:04:43.950210 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:04:43.950210 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:04:43.958973 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-032e4e1a-e8cc-4778-b7c0-01547805085b req-8b06ccbe-15f9-4964-9707-7d7d5dfa25fb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:43.959567 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-032e4e1a-e8cc-4778-b7c0-01547805085b req-8b06ccbe-15f9-4964-9707-7d7d5dfa25fb service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:43.980553 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-032e4e1a-e8cc-4778-b7c0-01547805085b req-8b06ccbe-15f9-4964-9707-7d7d5dfa25fb service nova] Creating event network-changed:b2b66278-f4a7-4aae-be60-1a175098d318 for instance 66db8b5c-063f-430c-a588-70d71bb2fb51 on nch1-master-1 Dec 18 22:04:43.985776 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-032e4e1a-e8cc-4778-b7c0-01547805085b req-8b06ccbe-15f9-4964-9707-7d7d5dfa25fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042272 Dec 18 22:04:43.986568 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4136/8223] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:04:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 22:04:44.019574 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:44.020874 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:44.028461 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:44.028928 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:44.029965 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:44.030459 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:44.262516 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:44.270000 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-f8a2f0af-a429-4336-a024-da167586cb5d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.254196 Dec 18 22:04:44.270609 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4088/8224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:44 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:45.288627 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:45.289803 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:45.295926 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:45.296379 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:45.297154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:45.297589 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:45.429188 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:45.436451 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-37884d6d-cce5-4e2c-8303-cb39f334b5b5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.152825 Dec 18 22:04:45.437027 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4137/8225] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:45 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:04:46.453315 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:46.453938 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:46.460694 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:46.461214 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:46.462021 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:46.462503 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:46.596304 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:46.604031 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-75c30656-ed4b-403f-8981-e37261c8bbc1 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.154498 Dec 18 22:04:46.604626 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4089/8226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:46 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:47.621234 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:47.621841 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:47.628586 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:47.629041 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:47.629824 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:47.630282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:47.764680 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:47.772007 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-3676b459-0843-4aa8-b534-543e6810b884 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.155056 Dec 18 22:04:47.772582 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4138/8227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:47 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:48.788729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:48.789381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:48.796126 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:48.796591 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:48.797386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:48.797846 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:48.930986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:48.938318 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a08310d3-6910-4888-9331-4994ecfab1dd tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.153298 Dec 18 22:04:48.938889 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4090/8228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:48 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:49.954935 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:49.955540 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:49.962773 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:49.963227 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:49.964006 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:49.964444 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:50.096316 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:50.104206 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-39f8c246-9c52-4acd-aeea-62e8adb1dea5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.153037 Dec 18 22:04:50.104776 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4139/8229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:49 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:50.638898 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-759e8846-a0a5-4664-9ad1-431cf586098f req-7b1aad89-dddc-4ade-a0e2-0fe8fe222195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66db8b5c-063f-430c-a588-70d71bb2fb51", "name": "network-vif-plugged", "status": "completed", "tag": "b2b66278-f4a7-4aae-be60-1a175098d318"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:04:50.640560 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:04:50.640560 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:04:50.649073 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-759e8846-a0a5-4664-9ad1-431cf586098f req-7b1aad89-dddc-4ade-a0e2-0fe8fe222195 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:50.649542 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-759e8846-a0a5-4664-9ad1-431cf586098f req-7b1aad89-dddc-4ade-a0e2-0fe8fe222195 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:50.660708 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-759e8846-a0a5-4664-9ad1-431cf586098f req-7b1aad89-dddc-4ade-a0e2-0fe8fe222195 service nova] Creating event network-vif-plugged:b2b66278-f4a7-4aae-be60-1a175098d318 for instance 66db8b5c-063f-430c-a588-70d71bb2fb51 on nch1-master-1 Dec 18 22:04:50.665611 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-759e8846-a0a5-4664-9ad1-431cf586098f req-7b1aad89-dddc-4ade-a0e2-0fe8fe222195 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030463 Dec 18 22:04:50.666200 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4091/8230] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:04:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:04:51.121163 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:51.121770 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:51.128457 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:51.128911 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:51.129692 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:51.130132 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:51.259211 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:51.266569 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-15812cba-8cfd-4d5b-ae3b-be8dcc0edf7e tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1373 microversion: 2.1 time: 0.149694 Dec 18 22:04:51.267144 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4140/8231] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:51 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1373 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:52.284524 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:52.285229 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:52.291404 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:52.291869 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:52.292712 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:52.293101 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:52.423986 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:52.431932 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-08fd8fe4-060e-4fb0-9d47-57d51dc81044 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1558 microversion: 2.1 time: 0.152321 Dec 18 22:04:52.432503 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4092/8232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:52 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:52.448159 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:04:52.448788 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:04:52.455439 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:52.455890 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:52.456668 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:52.457103 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:52.590906 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:04:52.598140 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-eebe0287-0692-44ba-a8e3-b5bafaea4a31 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1558 microversion: 2.1 time: 0.154280 Dec 18 22:04:52.598740 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4141/8233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:04:52 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:04:54.275916 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-6e687da3-b893-4cfe-a17c-f7ec469039f7 req-9d6099cf-31d3-4d7a-9869-aea8e33f41e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66db8b5c-063f-430c-a588-70d71bb2fb51", "tag": "b2b66278-f4a7-4aae-be60-1a175098d318"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:04:54.277472 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:04:54.277472 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:04:54.284962 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6e687da3-b893-4cfe-a17c-f7ec469039f7 req-9d6099cf-31d3-4d7a-9869-aea8e33f41e6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:04:54.285571 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-6e687da3-b893-4cfe-a17c-f7ec469039f7 req-9d6099cf-31d3-4d7a-9869-aea8e33f41e6 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:04:54.300453 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-6e687da3-b893-4cfe-a17c-f7ec469039f7 req-9d6099cf-31d3-4d7a-9869-aea8e33f41e6 service nova] Creating event network-changed:b2b66278-f4a7-4aae-be60-1a175098d318 for instance 66db8b5c-063f-430c-a588-70d71bb2fb51 on nch1-master-1 Dec 18 22:04:54.306239 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-6e687da3-b893-4cfe-a17c-f7ec469039f7 req-9d6099cf-31d3-4d7a-9869-aea8e33f41e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096100 Dec 18 22:04:54.306980 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4093/8234] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:04:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:04:56.918218 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:04:56.918940 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 22:04:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:04:58.571594 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:04:58.572134 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:04:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:06:32.846535 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-f2f455b3-9a82-44be-aa86-54006035f971 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-770249140"}} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:06:32.847743 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-f2f455b3-9a82-44be-aa86-54006035f971 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:32.853815 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f455b3-9a82-44be-aa86-54006035f971 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:32.854293 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f455b3-9a82-44be-aa86-54006035f971 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:32.855087 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f455b3-9a82-44be-aa86-54006035f971 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:32.855527 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-f2f455b3-9a82-44be-aa86-54006035f971 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:33.127671 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-f2f455b3-9a82-44be-aa86-54006035f971 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "POST /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51/action" status: 202 len: 0 microversion: 2.1 time: 0.286365 Dec 18 22:06:33.128491 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4142/8235] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Dec 18 22:06:32 2021] POST /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 18 22:06:39.190727 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 18 22:06:39.192920 ncdv-master-1 devstack@n-api.service[140731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 18 22:06:39.197164 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-3b2573b0-5dfa-4fdf-a202-ed105b535de7 req-04bafdaf-13b0-4bf9-aa3e-a86cf10a8af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66db8b5c-063f-430c-a588-70d71bb2fb51", "name": "network-vif-plugged", "status": "completed", "tag": "b2b66278-f4a7-4aae-be60-1a175098d318"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:06:39.198736 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:06:39.198736 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:06:39.208851 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3b2573b0-5dfa-4fdf-a202-ed105b535de7 req-04bafdaf-13b0-4bf9-aa3e-a86cf10a8af9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:39.209681 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-3b2573b0-5dfa-4fdf-a202-ed105b535de7 req-04bafdaf-13b0-4bf9-aa3e-a86cf10a8af9 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:39.221706 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-3b2573b0-5dfa-4fdf-a202-ed105b535de7 req-04bafdaf-13b0-4bf9-aa3e-a86cf10a8af9 service nova] Creating event network-vif-plugged:b2b66278-f4a7-4aae-be60-1a175098d318 for instance 66db8b5c-063f-430c-a588-70d71bb2fb51 on nch1-master-1 Dec 18 22:06:39.227687 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-3b2573b0-5dfa-4fdf-a202-ed105b535de7 req-04bafdaf-13b0-4bf9-aa3e-a86cf10a8af9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Dec 18 22:06:39.229032 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4094/8236] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:06:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:06:39.315441 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:06:39.315978 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:06:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:06:47.032957 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:47.033623 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:47.041398 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:47.041999 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:47.043921 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:47.044440 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:47.057282 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-88fad589-212c-444e-9756-20c27f93f8d9 req-65c2ee0a-b133-4075-b9ba-6664d33250d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66db8b5c-063f-430c-a588-70d71bb2fb51", "tag": "b2b66278-f4a7-4aae-be60-1a175098d318"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:06:47.058813 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:06:47.058813 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:06:47.068370 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-88fad589-212c-444e-9756-20c27f93f8d9 req-65c2ee0a-b133-4075-b9ba-6664d33250d4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:47.068842 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-88fad589-212c-444e-9756-20c27f93f8d9 req-65c2ee0a-b133-4075-b9ba-6664d33250d4 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:47.079553 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [c7790313-2262-4e79-a0d8-98238f22764b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50082. Dec 18 22:06:47.079796 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Going to try to terminate instance {{(pid=140732) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 22:06:47.081493 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] [d551fa59-d51d-40a1-bcd3-4825fae7c5bb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50084. Dec 18 22:06:47.083451 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-88fad589-212c-444e-9756-20c27f93f8d9 req-65c2ee0a-b133-4075-b9ba-6664d33250d4 service nova] Creating event network-changed:b2b66278-f4a7-4aae-be60-1a175098d318 for instance 66db8b5c-063f-430c-a588-70d71bb2fb51 on nch1-master-1 Dec 18 22:06:47.088375 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-88fad589-212c-444e-9756-20c27f93f8d9 req-65c2ee0a-b133-4075-b9ba-6664d33250d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056943 Dec 18 22:06:47.089611 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4095/8237] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:06:47.168524 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-d88ac43e-62e2-476c-8748-0aa9545b4b1d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 204 len: 0 microversion: 2.1 time: 0.139181 Dec 18 22:06:47.172793 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4143/8238] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 22:06:47 2021] DELETE /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 22:06:47.178667 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:47.179453 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:47.186167 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:47.186676 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:47.187535 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:47.188194 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:47.422381 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:06:47.430370 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-bea62122-48bc-4fa4-8433-df90b2b55a6d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1683 microversion: 2.1 time: 0.255890 Dec 18 22:06:47.431061 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4096/8239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:06:47 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1683 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:06:48.448899 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:48.449607 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:48.456740 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:48.457571 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:48.458493 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:48.459221 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:48.593928 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:06:48.601389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-effc440a-9ed5-4853-8c86-1dff586f9a96 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1564 microversion: 2.1 time: 0.157054 Dec 18 22:06:48.602178 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4144/8240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:06:48 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:06:49.155421 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [req-a6195b53-2d9d-4afd-820f-4cc07ca774b3 req-416d652d-71f7-48a5-8713-93558da85b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66db8b5c-063f-430c-a588-70d71bb2fb51", "name": "network-vif-unplugged", "status": "completed", "tag": "b2b66278-f4a7-4aae-be60-1a175098d318"}]} {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:06:49.157084 ncdv-master-1 devstack@n-api.service[140731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:06:49.157084 ncdv-master-1 devstack@n-api.service[140731]: warnings.warn(msg) Dec 18 22:06:49.165666 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a6195b53-2d9d-4afd-820f-4cc07ca774b3 req-416d652d-71f7-48a5-8713-93558da85b45 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:49.165896 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [req-a6195b53-2d9d-4afd-820f-4cc07ca774b3 req-416d652d-71f7-48a5-8713-93558da85b45 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:49.179211 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.compute.server_external_events [req-a6195b53-2d9d-4afd-820f-4cc07ca774b3 req-416d652d-71f7-48a5-8713-93558da85b45 service nova] Creating event network-vif-unplugged:b2b66278-f4a7-4aae-be60-1a175098d318 for instance 66db8b5c-063f-430c-a588-70d71bb2fb51 on nch1-master-1 Dec 18 22:06:49.184827 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [req-a6195b53-2d9d-4afd-820f-4cc07ca774b3 req-416d652d-71f7-48a5-8713-93558da85b45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033312 Dec 18 22:06:49.185429 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4097/8241] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:06:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:06:49.573625 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-13f42944-5dea-4c86-9d00-27b70fe77888 req-496c0f4c-fd5b-4139-991d-a07a58062c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66db8b5c-063f-430c-a588-70d71bb2fb51", "name": "network-vif-deleted", "tag": "b2b66278-f4a7-4aae-be60-1a175098d318"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:06:49.575268 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:06:49.575268 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:06:49.582115 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-13f42944-5dea-4c86-9d00-27b70fe77888 req-496c0f4c-fd5b-4139-991d-a07a58062c12 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:49.582608 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-13f42944-5dea-4c86-9d00-27b70fe77888 req-496c0f4c-fd5b-4139-991d-a07a58062c12 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:49.593627 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-13f42944-5dea-4c86-9d00-27b70fe77888 req-496c0f4c-fd5b-4139-991d-a07a58062c12 service nova] Creating event network-vif-deleted:b2b66278-f4a7-4aae-be60-1a175098d318 for instance 66db8b5c-063f-430c-a588-70d71bb2fb51 on nch1-master-1 Dec 18 22:06:49.598419 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-13f42944-5dea-4c86-9d00-27b70fe77888 req-496c0f4c-fd5b-4139-991d-a07a58062c12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099894 Dec 18 22:06:49.599298 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4145/8242] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:06:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:06:49.619627 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:49.621040 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:49.627577 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:49.628253 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:49.629306 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:49.629847 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:49.662992 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:49.663391 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:49.663859 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.objects.instance [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lazy-loading 'fault' on Instance uuid 66db8b5c-063f-430c-a588-70d71bb2fb51 {{(pid=140731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 22:06:49.703785 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:06:49.711279 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a66d0514-13d4-411b-b4b6-fdab17611b8d tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 200 len: 1337 microversion: 2.1 time: 0.095753 Dec 18 22:06:49.711809 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4098/8243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:06:49 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 1337 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:06:50.729808 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:50.730546 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 66db8b5c-063f-430c-a588-70d71bb2fb51] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:50.736830 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:50.737282 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:50.738066 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:50.738553 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:50.752844 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.wsgi [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] HTTP exception thrown: Instance 66db8b5c-063f-430c-a588-70d71bb2fb51 could not be found. Dec 18 22:06:50.753445 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Returning 404 to user: Instance 66db8b5c-063f-430c-a588-70d71bb2fb51 could not be found. {{(pid=140732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 22:06:50.754349 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-0f29e8ab-82ff-48f1-96b3-90f9a294ae85 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51" status: 404 len: 111 microversion: 2.1 time: 0.029505 Dec 18 22:06:50.754928 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4146/8244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:06:50 2021] GET /compute/v2.1/servers/66db8b5c-063f-430c-a588-70d71bb2fb51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 22:06:52.371273 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:52.372429 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:52.373504 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-063b2c08-271f-4f9a-a4b7-7e84012cb882 req-179593e9-87a6-452c-a99a-529dc69cf43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bed4681-8d93-422a-946d-9f7a19302d39", "tag": "7e2c06c7-a5ef-419a-89d2-ef1a774f7df7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:06:52.375544 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:06:52.375544 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:06:52.380067 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:52.380540 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:52.381364 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:52.381823 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:52.383780 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-063b2c08-271f-4f9a-a4b7-7e84012cb882 req-179593e9-87a6-452c-a99a-529dc69cf43e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:52.384318 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-063b2c08-271f-4f9a-a4b7-7e84012cb882 req-179593e9-87a6-452c-a99a-529dc69cf43e service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:52.394885 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-063b2c08-271f-4f9a-a4b7-7e84012cb882 req-179593e9-87a6-452c-a99a-529dc69cf43e service nova] Creating event network-changed:7e2c06c7-a5ef-419a-89d2-ef1a774f7df7 for instance 0bed4681-8d93-422a-946d-9f7a19302d39 on nch2-master-1 Dec 18 22:06:52.399883 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-063b2c08-271f-4f9a-a4b7-7e84012cb882 req-179593e9-87a6-452c-a99a-529dc69cf43e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030527 Dec 18 22:06:52.400690 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4147/8245] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 22:06:52.407369 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Going to try to terminate instance {{(pid=140731) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 22:06:52.503863 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-a7193297-40b1-40b1-a773-c92137e3ba57 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 204 len: 0 microversion: 2.1 time: 0.136492 Dec 18 22:06:52.504550 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4099/8246] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 22:06:52 2021] DELETE /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 22:06:52.513181 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:52.513974 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.compute.api [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140732) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:52.520359 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:52.520901 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:52.521828 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:52.522882 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:52.745154 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.policy [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140732) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:06:52.753389 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-c5075dba-e3ba-4cdf-8a19-c29728c7642c tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1683 microversion: 2.1 time: 0.244252 Dec 18 22:06:52.754013 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4148/8247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:06:52 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 22:06:53.771432 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:53.772144 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:53.779386 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:53.779848 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:53.780642 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:53.781094 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:53.970565 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.policy [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9bb5f9c834d75bb3833e4a9df0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb152351dd1a4914b8b0a47536625080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140731) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 22:06:53.978050 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-565088b9-b1c6-4ca7-9523-74e936c6c5aa tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 200 len: 1564 microversion: 2.1 time: 0.210697 Dec 18 22:06:53.978652 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4100/8248] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:06:53 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 1564 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 22:06:54.528297 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [req-cc0418b9-c1a1-4123-940b-327e5e984921 req-fa45fba8-962f-4710-8203-62969c354ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bed4681-8d93-422a-946d-9f7a19302d39", "name": "network-vif-deleted", "tag": "7e2c06c7-a5ef-419a-89d2-ef1a774f7df7"}]} {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 22:06:54.530290 ncdv-master-1 devstack@n-api.service[140732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 22:06:54.530290 ncdv-master-1 devstack@n-api.service[140732]: warnings.warn(msg) Dec 18 22:06:54.540694 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cc0418b9-c1a1-4123-940b-327e5e984921 req-fa45fba8-962f-4710-8203-62969c354ff0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:54.541198 ncdv-master-1 devstack@n-api.service[140732]: DEBUG oslo_concurrency.lockutils [req-cc0418b9-c1a1-4123-940b-327e5e984921 req-fa45fba8-962f-4710-8203-62969c354ff0 service nova] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:54.553320 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.compute.server_external_events [req-cc0418b9-c1a1-4123-940b-327e5e984921 req-fa45fba8-962f-4710-8203-62969c354ff0 service nova] Creating event network-vif-deleted:7e2c06c7-a5ef-419a-89d2-ef1a774f7df7 for instance 0bed4681-8d93-422a-946d-9f7a19302d39 on nch2-master-1 Dec 18 22:06:54.558201 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [req-cc0418b9-c1a1-4123-940b-327e5e984921 req-fa45fba8-962f-4710-8203-62969c354ff0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033722 Dec 18 22:06:54.559704 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4149/8249] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Dec 18 22:06:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 22:06:54.995507 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '>' {{(pid=140731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:54.996290 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.compute.api [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] [instance: 0bed4681-8d93-422a-946d-9f7a19302d39] Fetching instance by UUID {{(pid=140731) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 22:06:55.003204 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:55.003673 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:55.004469 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 22:06:55.004920 ncdv-master-1 devstack@n-api.service[140731]: DEBUG oslo_concurrency.lockutils [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Lock "cebfe89f-5b97-4ab9-9d9f-7dac71d0b692" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 22:06:55.019870 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.wsgi [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] HTTP exception thrown: Instance 0bed4681-8d93-422a-946d-9f7a19302d39 could not be found. Dec 18 22:06:55.020729 ncdv-master-1 devstack@n-api.service[140731]: DEBUG nova.api.openstack.wsgi [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Returning 404 to user: Instance 0bed4681-8d93-422a-946d-9f7a19302d39 could not be found. {{(pid=140731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 22:06:55.021589 ncdv-master-1 devstack@n-api.service[140731]: INFO nova.api.openstack.requestlog [None req-fe81c42f-89bb-45a0-bf18-cab7e26204d5 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39" status: 404 len: 111 microversion: 2.1 time: 0.030101 Dec 18 22:06:55.022491 ncdv-master-1 devstack@n-api.service[140731]: [pid: 140731|app: 0|req: 4101/8250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 22:06:54 2021] GET /compute/v2.1/servers/0bed4681-8d93-422a-946d-9f7a19302d39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 22:06:55.178237 ncdv-master-1 devstack@n-api.service[140732]: DEBUG nova.api.openstack.wsgi [None req-846cc6f3-413a-4ea4-95a0-9ca2752009e3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] Calling method '.version_select at 0x7f71614a4f70>' {{(pid=140732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 22:06:55.200414 ncdv-master-1 devstack@n-api.service[140732]: INFO nova.api.openstack.requestlog [None req-846cc6f3-413a-4ea4-95a0-9ca2752009e3 tempest-TestSnapshotPattern-2010718401 tempest-TestSnapshotPattern-2010718401-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-285701377" status: 202 len: 0 microversion: 2.1 time: 0.026051 Dec 18 22:06:55.201131 ncdv-master-1 devstack@n-api.service[140732]: [pid: 140732|app: 0|req: 4150/8251] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 22:06:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-285701377 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 22:08:16.939989 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:08:16.940589 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 22:08:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:09:56.976040 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:09:56.976690 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 22:09:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:09:58.590503 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:09:58.591044 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:09:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:09:59.334641 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:09:59.334818 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:09:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:10:08.461044 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:10:08.461541 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:10:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:11:36.956562 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:11:36.957568 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 22:11:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:12:05.133273 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:12:05.133937 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 22:12:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:13:16.993329 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:13:16.993946 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 22:13:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:13:18.608892 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:13:18.609311 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:13:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:13:19.352136 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:13:19.352328 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:13:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:13:28.479054 ncdv-master-1 devstack@n-api.service[140732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:13:28.479681 ncdv-master-1 devstack@n-api.service[140732]: Sat Dec 18 22:13:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 22:14:56.974350 ncdv-master-1 devstack@n-api.service[140731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 22:14:56.975008 ncdv-master-1 devstack@n-api.service[140731]: Sat Dec 18 22:14:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!